Effect of paper quality on the response rate to a postal survey: A randomised controlled trial. [ISRCTN32032031

PubMed Central

Clark, T Justin; Khan, Khalid S; Gupta, Janesh K

2001-01-01

Background Response rates to surveys are declining and this threatens the validity and generalisability of their findings. We wanted to determine whether paper quality influences the response rate to postal surveys Methods A postal questionnaire was sent to all members of the British Society of Gynaecological Endoscopy (BSGE). Recipients were randomised to receiving the questionnaire printed on standard quality paper or high quality paper. Results The response rate for the recipients of high quality paper was 43/195 (22%) and 57/194 (29%) for standard quality paper (relative rate of response 0.75, 95% CI 0.33–1.05, p = 0.1 Conclusion The use of high quality paper did not increase response rates to a questionnaire survey of gynaecologists affiliated to an endoscopic society. PMID:11782286

How should the psychological well-being of zoo elephants be objectively investigated?

PubMed

Mason, Georgia J; Veasey, Jake S

2010-01-01

Animal welfare (sometimes termed "well-being") is about feelings - states such as "suffering" or "contentment" that we can infer but cannot measure directly. Welfare indices have been developed from two main sources: studies of suffering humans, and of research animals deliberately subjected to challenges known to affect emotional state. We briefly review the resulting indices here, and discuss how well they are understood for elephants, since objective welfare assessment should play a central role in evidence-based elephant management. We cover behavioral and cognitive responses (approach/avoidance; intention, redirected and displacement activities; vigilance/startle; warning signals; cognitive biases, apathy and depression-like changes; stereotypic behavior); physiological responses (sympathetic responses; corticosteroid output - often assayed non-invasively via urine, feces or even hair; other aspects of HPA function, e.g. adrenal hypertrophy); and the potential negative effects of prolonged stress on reproduction (e.g. reduced gametogenesis; low libido; elevated still-birth rates; poor maternal care) and health (e.g. poor wound-healing; enhanced disease rates; shortened lifespans). The best validated, most used welfare indices for elephants are corticosteroid outputs and stereotypic behavior. Indices suggested as valid, partially validated, and/or validated but not yet applied within zoos include: measures of preference/avoidance; displacement movements; vocal/postural signals of affective (emotional) state; startle/vigilance; apathy; salivary and urinary epinephrine; female acyclity; infant mortality rates; skin/foot infections; cardio-vascular disease; and premature adult death. Potentially useful indices that have not yet attracted any validation work in elephants include: operant responding and place preference tests; intention and vacuum movements; fear/stress pheromone release; cognitive biases; heart rate, pupil dilation and blood pressure; corticosteroid assay from hair, especially tail-hairs (to access endocrine events up to a year ago); adrenal hypertrophy; male infertility; prolactinemia; and immunological changes.

Validation Study of a Gatekeeping Attitude Index for Social Work Education

ERIC Educational Resources Information Center

Tam, Dora M. Y.; Coleman, Heather

2011-01-01

This article reports on a study designed to validate the Gatekeeping Attitude Index, a 14-item Likert scaling index. The authors collected data from a convenience sample of social work field instructors (N = 188) with a response rate of 74.0%. Construct validation by exploratory factor analysis identified a 2-factor solution on the index after…

HPA and SAM axis responses as correlates of self- vs parental ratings of anxiety in boys with an Autistic Disorder.

PubMed

Bitsika, Vicki; Sharpley, Christopher F; Sweeney, John A; McFarlane, James R

2014-03-29

Anxiety and Autistic Disorder (AD) are both neurological conditions and both disorders share some features that make it difficult to precisely allocate specific symptoms to each disorder. HPA and SAM axis activities have been conclusively associated with anxiety, and may provide a method of validating anxiety rating scale assessments given by parents and their children with AD about those children. Data from HPA axis (salivary cortisol) and SAM axis (salivary alpha amylase) responses were collected from a sample of 32 high-functioning boys (M age=11yr) with an Autistic Disorder (AD) and were compared with the boys' and their mothers' ratings of the boys' anxiety. There was a significant difference between the self-ratings given by the boys and ratings given about them by their mothers. Further, only the boys' self-ratings of their anxiety significantly predicted the HPA axis responses and neither were significantly related to SAM axis responses. Some boys showed cortisol responses which were similar to that previously reported in children who had suffered chronic and severe anxiety arising from stressful social interactions. As well as suggesting that some boys with an AD can provide valid self-assessments of their anxiety, these data also point to the presence of very high levels of chronic HPA-axis arousal and consequent chronic anxiety in these boys. Copyright © 2014 Elsevier Inc. All rights reserved.

The Validity and Responsiveness of Isometric Lower Body Multi-Joint Tests of Muscular Strength: a Systematic Review.

PubMed

Drake, David; Kennedy, Rodney; Wallace, Eric

2017-12-01

Researchers and practitioners working in sports medicine and science require valid tests to determine the effectiveness of interventions and enhance understanding of mechanisms underpinning adaptation. Such decision making is influenced by the supportive evidence describing the validity of tests within current research. The objective of this study is to review the validity of lower body isometric multi-joint tests ability to assess muscular strength and determine the current level of supporting evidence. Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines were followed in a systematic fashion to search, assess and synthesize existing literature on this topic. Electronic databases such as Web of Science, CINAHL and PubMed were searched up to 18 March 2015. Potential inclusions were screened against eligibility criteria relating to types of test, measurement instrument, properties of validity assessed and population group and were required to be published in English. The Consensus-based Standards for the Selection of health Measurement Instruments (COSMIN) checklist was used to assess methodological quality and measurement property rating of included studies. Studies rated as fair or better in methodological quality were included in the best evidence synthesis. Fifty-nine studies met the eligibility criteria for quality appraisal. The ten studies that rated fair or better in methodological quality were included in the best evidence synthesis. The most frequently investigated lower body isometric multi-joint tests for validity were the isometric mid-thigh pull and isometric squat. The validity of each of these tests was strong in terms of reliability and construct validity. The evidence for responsiveness of tests was found to be moderate for the isometric squat test and unknown for the isometric mid-thigh pull. No tests using the isometric leg press met the criteria for inclusion in the best evidence synthesis. Researchers and practitioners can use the isometric squat and isometric mid-thigh pull with confidence in terms of reliability and construct validity. Further work to investigate other validity components such as criterion validity, smallest detectable change and responsiveness to resistance exercise interventions may be beneficial to the current level of evidence.

Validation of the Omni Scale of Perceived Exertion in a sample of Spanish-speaking youth from the USA.

PubMed

Suminski, Richard R; Robertson, Robert J; Goss, Fredric L; Olvera, Norma

2008-08-01

Whether the translation of verbal descriptors from English to Spanish affects the validity of the Children's OMNI Scale of Perceived Exertion is not known, so the validity of a Spanish version of the OMNI was examined with 32 boys and 36 girls (9 to 12 years old) for whom Spanish was the primary language. Oxygen consumption, ventilation, respiratory rate, respiratory exchange ratio, heart rate, and ratings of perceived exertion for the overall body (RPE-O) were measured during an incremental treadmill test. All response values displayed significant linear increases across test stages. The linear regression analyses indicated RPE-O values were distributed as positive linear functions of oxygen consumption, ventilation, respiratory rate, respiratory exchange ratio, heart rate, and percent of maximal oxygen consumption. All regression models were statistically significant. The Spanish OMNI Scale is valid for estimating exercise effort during walking and running amongst Hispanic youth whose primary language is Spanish.

Face value: amygdala response reflects the validity of first impressions.

PubMed

Rule, Nicholas O; Moran, Joseph M; Freeman, Jonathan B; Whitfield-Gabrieli, Susan; Gabrieli, John D E; Ambady, Nalini

2011-01-01

The human amygdala responds to first impressions of people as judged from their faces, such as normative judgments about the trustworthiness of strangers. It is unknown, however, whether amygdala responses to first impressions can be validated by objective criteria. Here, we examined amygdala responses to faces of Chief Executive Officers (CEOs) where real-world outcomes could be measured objectively by the amounts of profits made by each CEO's company. During fMRI scanning, participants made incidental judgments about the symmetry of each CEO's face. After scanning, participants rated each CEO's face on leadership ability. Parametric analyses showed that greater left amygdala response to the CEOs' faces was associated with higher post-scan ratings of the CEOs' leadership ability. In addition, greater left amygdala response was also associated with greater profits made by the CEOs' companies and this relationship was statistically mediated by external raters' perceptions of arousal. Thus, amygdala response reflected both subjective judgments and objective measures of leadership ability based on first impressions. Copyright © 2010 Elsevier Inc. All rights reserved.

Preliminary Validation of a New Measure of Negative Response Bias: The Temporal Memory Sequence Test.

PubMed

Hegedish, Omer; Kivilis, Naama; Hoofien, Dan

2015-01-01

The Temporal Memory Sequence Test (TMST) is a new measure of negative response bias (NRB) that was developed to enrich the forced-choice paradigm. The TMST does not resemble the common structure of forced-choice tests and is presented as a temporal recall memory test. The validation sample consisted of 81 participants: 21 healthy control participants, 20 coached simulators, and 40 patients with acquired brain injury (ABI). The TMST had high reliability and significantly high positive correlations with the Test of Memory Malingering and Word Memory Test effort scales. Moreover, the TMST effort scales exhibited high negative correlations with the Glasgow Coma Scale, thus validating the previously reported association between probable malingering and mild traumatic brain injury. A suggested cutoff score yielded acceptable classification rates in the ABI group as well as in the simulator and control groups. The TMST appears to be a promising measure of NRB detection, with respectable rates of reliability and construct and criterion validity.

External Validity of Contingent Valuation: Comparing Hypothetical and Actual Payments.

PubMed

Ryan, Mandy; Mentzakis, Emmanouil; Jareinpituk, Suthi; Cairns, John

2017-11-01

Whilst contingent valuation is increasingly used in economics to value benefits, questions remain concerning its external validity that is do hypothetical responses match actual responses? We present results from the first within sample field test. Whilst Hypothetical No is always an Actual No, Hypothetical Yes exceed Actual Yes responses. A constant rate of response reversals across bids/prices could suggest theoretically consistent option value responses. Certainty calibrations (verbal and numerical response scales) minimise hypothetical-actual discrepancies offering a useful solution. Helping respondents resolve uncertainty may reduce the discrepancy between hypothetical and actual payments and thus lead to more accurate policy recommendations. Copyright © 2016 John Wiley & Sons, Ltd. Copyright © 2016 John Wiley & Sons, Ltd.

Heart Rate and VO[subscript 2] Responses to Cycle Ergometry in White and African American Men

ERIC Educational Resources Information Center

Vehrs, Pat R.; Fellingham, Gilbert W.

2006-01-01

The validity of estimates of peak oxygen consumption (VO[subscript 2]peak) using submaximal exercise tests may be compromised when the participants being tested are not similar to the participants used to develop the test. This study compared ethnic differences in the heart rate (HR) and oxygen consumption (VO[subscript 2]) responses to submaximal…

Validating a two-high-threshold measurement model for confidence rating data in recognition.

PubMed

Bröder, Arndt; Kellen, David; Schütz, Julia; Rohrmeier, Constanze

2013-01-01

Signal Detection models as well as the Two-High-Threshold model (2HTM) have been used successfully as measurement models in recognition tasks to disentangle memory performance and response biases. A popular method in recognition memory is to elicit confidence judgements about the presumed old/new status of an item, allowing for the easy construction of ROCs. Since the 2HTM assumes fewer latent memory states than response options are available in confidence ratings, the 2HTM has to be extended by a mapping function which models individual rating scale usage. Unpublished data from 2 experiments in Bröder and Schütz (2009) validate the core memory parameters of the model, and 3 new experiments show that the response mapping parameters are selectively affected by manipulations intended to affect rating scale use, and this is independent of overall old/new bias. Comparisons with SDT show that both models behave similarly, a case that highlights the notion that both modelling approaches can be valuable (and complementary) elements in a researcher's toolbox.

Development of Chemistry Triangle Oriented Module on Topic of Reaction Rate for Senior High School Level Grade XI Chemistry Learning.

NASA Astrophysics Data System (ADS)

Sari, D. R.; Hardeli; Bayharti

2018-04-01

This study aims to produce chemistry triangle oriented module on topic of reaction rate, and to reveal the validity and practicality level of the generated module. The type of research used is EducationalDesign Research (EDR) with development model is Plompmodel. This model consists of three phases, which are preliminary research, prototyping phase, and assessment phase. The instrument used in this research is questionnaire validity and practicality. The data of the research were analyzed by using Kappa Cohen formula. The chemistry triangle oriented module validation sheet was given to 5 validators consisting of 3 chemistry lecturers and 2 high school chemistry teachers, while the practicality sheet was given to 2 chemistry teachers, 6 students of SMAN 10 Padang grade XII MIA 5 on the small groupevaluation and 25 students of SMAN 10 Padang grade XII MIA 6 on the field test. Based on the questionnaire validity analysis, the validity level of the module is very high with the value of kappa moment 0.87. The level of practicality based on teacher questionnaire response is very high category with a kappa moment value 0.96. Based on the questionnaire of student responses on small group evaluation, the level of practicality is very high category with a kappa moment 0.81, and the practicality is very high category with kappa moment value 0.83 based on questionnaire of student response on field test.

Prospective validation of immunological infiltrate for prediction of response to neoadjuvant chemotherapy in HER2-negative breast cancer--a substudy of the neoadjuvant GeparQuinto trial.

PubMed

Issa-Nummer, Yasmin; Darb-Esfahani, Silvia; Loibl, Sibylle; Kunz, Georg; Nekljudova, Valentina; Schrader, Iris; Sinn, Bruno Valentin; Ulmer, Hans-Ullrich; Kronenwett, Ralf; Just, Marianne; Kühn, Thorsten; Diebold, Kurt; Untch, Michael; Holms, Frank; Blohmer, Jens-Uwe; Habeck, Jörg-Olaf; Dietel, Manfred; Overkamp, Friedrich; Krabisch, Petra; von Minckwitz, Gunter; Denkert, Carsten

2013-01-01

We have recently described an increased lymphocytic infiltration rate in breast carcinoma tissue is a significant response predictor for anthracycline/taxane-based neoadjuvant chemotherapy (NACT). The aim of this study was to prospectively validate the tumor-associated lymphocyte infiltrate as predictive marker for response to anthracycline/taxane-based NACT. The immunological infiltrate was prospectively evaluated in a total of 313 core biopsies from HER2 negative patients of the multicenter PREDICT study, a substudy of the neoadjuvant GeparQuinto study. Intratumoral lymphocytes (iTuLy), stromal lymphocytes (strLy) as well as lymphocyte-predominant breast cancer (LPBC) were evaluated by histopathological assessment. Pathological complete response (pCR) rates were analyzed and compared between the defined subgroups using the exact test of Fisher. Patients with lymphocyte-predominant breast cancer (LPBC) had a significantly increased pCR rate of 36.6%, compared to non-LPBC patients (14.3%, p<0.001). LPBC and stromal lymphocytes were significantly independent predictors for pCR in multivariate analysis (LPBC: OR 2.7, p = 0.003, strLy: OR 1.2, p = 0.01). The amount of intratumoral lymphocytes was significantly predictive for pCR in univariate (OR 1.2, p = 0.01) but not in multivariate logistic regression analysis (OR 1.2, p = 0.11). Confirming previous investigations of our group, we have prospectively validated in an independent cohort that an increased immunological infiltrate in breast tumor tissue is predictive for response to anthracycline/taxane-based NACT. Patients with LPBC and increased stromal lymphocyte infiltration have significantly increased pCR rates. The lymphocytic infiltrate is a promising additional parameter for histopathological evaluation of breast cancer core biopsies.

Validity aspects of the patient feedback questionnaire on consultation skills (PFC), a promising learning instrument in medical education.

PubMed

Reinders, Marcel E; Blankenstein, Annette H; Knol, Dirk L; de Vet, Henrica C W; van Marwijk, Harm W J

2009-08-01

A focus on the communicator competency is considered to be an important requirement to help physicians to acquire consultation skills. A feedback questionnaire, in which patients assess consultation skills might be a useful learning tool. An existing questionnaire on patient perception of patient-centeredness (PPPC) was adapted to cover the 'communicator' items in the competency profile. We assessed the face and content validity, the construct validity and the internal consistency of this new patient feedback on consultation skills (PFC) questionnaire. We assessed the face validity of the PFC by interviewing patients and general practice trainees (GPTs) during the developmental process. The content validity was determined by experts (n=10). First-year GPTs (23) collected 222 PFCs, from which the data were used to assess the construct validity (factor analysis), internal consistency, response rates and ceiling effects. The PFC adequately covers the corresponding 'communicator' competency (face and content validity). Factor analysis showed a one-dimensional construct. The internal consistency was high (Cronbach's alpha 0.89). For the single items, the response rate varied from 89.2% to 100%; the maximum score (ceiling effect) varied from 45.5% to 89.2%. The PFC appears to be a valid, internally consistent instrument. The PFC may be a valuable learning tool with which GPTs, other physicians and medical students can acquire feedback from patients regarding their consultation skills.

Identification of reduced-order thermal therapy models using thermal MR images: theory and validation.

PubMed

Niu, Ran; Skliar, Mikhail

2012-07-01

In this paper, we develop and validate a method to identify computationally efficient site- and patient-specific models of ultrasound thermal therapies from MR thermal images. The models of the specific absorption rate of the transduced energy and the temperature response of the therapy target are identified in the reduced basis of proper orthogonal decomposition of thermal images, acquired in response to a mild thermal test excitation. The method permits dynamic reidentification of the treatment models during the therapy by recursively utilizing newly acquired images. Such adaptation is particularly important during high-temperature therapies, which are known to substantially and rapidly change tissue properties and blood perfusion. The developed theory was validated for the case of focused ultrasound heating of a tissue phantom. The experimental and computational results indicate that the developed approach produces accurate low-dimensional treatment models despite temporal and spatial noises in MR images and slow image acquisition rate.

A Demonstration of Validity for Certification by the American Board of Anesthesiology.

ERIC Educational Resources Information Center

Slogoff, Stephen; And Others

1994-01-01

To investigate the validity of anesthesiologist certification, 146 anesthesiology program directors were asked whether they would permit each of their graduating residents to complete 3 increasingly complex anesthetic regimens to the directors themselves and rate residents on specific skills. Director responses generally correspond to…

The development and psychometric testing of a Disaster Response Self-Efficacy Scale among undergraduate nursing students.

PubMed

Li, Hong-Yan; Bi, Rui-Xue; Zhong, Qing-Ling

2017-12-01

Disaster nurse education has received increasing importance in China. Knowing the abilities of disaster response in undergraduate nursing students is beneficial to promote teaching and learning. However, there are few valid and reliable tools that measure the abilities of disaster response in undergraduate nursing students. To develop a self-report scale of self-efficacy in disaster response for Chinese undergraduate nursing students and test its psychometric properties. Nursing students (N=318) from two medical colleges were chosen by purposive sampling. The Disaster Response Self-Efficacy Scale (DRSES) was developed and psychometrically tested. Reliability and content validity were studied. Construct validity was tested by exploratory and confirmatory factor analysis. Reliability was tested by internal consistency and test-retest reliability. The DRSES consisted of 3 factors and 19 items with a 5-point rating. The content validity was 0.91, Cronbach's alpha coefficient was 0.912, and the intraclass correlation coefficient for test-retest reliability was 0.953. The construct validity was good (χ 2 /df=2.440, RMSEA=0.068, NFI=0.907, CFI=0.942, IFI=0.430, p<0.001). The newly developed DRSES has proven good reliability and validity. It could therefore be used as an assessment tool to evaluate self-efficacy in disaster response for Chinese undergraduate nursing students. Copyright © 2017. Published by Elsevier Ltd.

Reliability and validity of expert assessment based on airborne and urinary measures of nickel and chromium exposure in the electroplating industry.

PubMed

Chen, Yu-Cheng; Coble, Joseph B; Deziel, Nicole C; Ji, Bu-Tian; Xue, Shouzheng; Lu, Wei; Stewart, Patricia A; Friesen, Melissa C

2014-11-01

The reliability and validity of six experts' exposure ratings were evaluated for 64 nickel-exposed and 72 chromium-exposed workers from six Shanghai electroplating plants based on airborne and urinary nickel and chromium measurements. Three industrial hygienists and three occupational physicians independently ranked the exposure intensity of each metal on an ordinal scale (1-4) for each worker's job in two rounds: the first round was based on responses to an occupational history questionnaire and the second round also included responses to an electroplating industry-specific questionnaire. The Spearman correlation (r(s)) was used to compare each rating's validity to its corresponding subject-specific arithmetic mean of four airborne or four urinary measurements. Reliability was moderately high (weighted kappa range=0.60-0.64). Validity was poor to moderate (r(s)=-0.37-0.46) for both airborne and urinary concentrations of both metals. For airborne nickel concentrations, validity differed by plant. For dichotomized metrics, sensitivity and specificity were higher based on urinary measurements (47-78%) than airborne measurements (16-50%). Few patterns were observed by metal, assessment round, or expert type. These results suggest that, for electroplating exposures, experts can achieve moderately high agreement and (reasonably) distinguish between low and high exposures when reviewing responses to in-depth questionnaires used in population-based case-control studies.

Reliability and validity of expert assessment based on airborne and urinary measures of nickel and chromium exposure in the electroplating industry

PubMed Central

Chen, Yu-Cheng; Coble, Joseph B; Deziel, Nicole C.; Ji, Bu-Tian; Xue, Shouzheng; Lu, Wei; Stewart, Patricia A; Friesen, Melissa C

2014-01-01

The reliability and validity of six experts’ exposure ratings were evaluated for 64 nickel-exposed and 72 chromium-exposed workers from six Shanghai electroplating plants based on airborne and urinary nickel and chromium measurements. Three industrial hygienists and three occupational physicians independently ranked the exposure intensity of each metal on an ordinal scale (1–4) for each worker's job in two rounds: the first round was based on responses to an occupational history questionnaire and the second round also included responses to an electroplating industry-specific questionnaire. Spearman correlation (rs) was used to compare each rating's validity to its corresponding subject-specific arithmetic mean of four airborne or four urinary measurements. Reliability was moderately-high (weighted kappa range=0.60–0.64). Validity was poor to moderate (rs= -0.37–0.46) for both airborne and urinary concentrations of both metals. For airborne nickel concentrations, validity differed by plant. For dichotomized metrics, sensitivity and specificity were higher based on urinary measurements (47–78%) than airborne measurements (16–50%). Few patterns were observed by metal, assessment round, or expert type. These results suggest that, for electroplating exposures, experts can achieve moderately-high agreement and (reasonably) distinguish between low and high exposures when reviewing responses to in-depth questionnaires used in population-based case-control studies. PMID:24736099

Detecting symptom exaggeration in combat veterans using the MMPI-2 symptom validity scales: a mixed group validation.

PubMed

Tolin, David F; Steenkamp, Maria M; Marx, Brian P; Litz, Brett T

2010-12-01

Although validity scales of the Minnesota Multiphasic Personality Inventory-2 (MMPI-2; J. N. Butcher, W. G. Dahlstrom, J. R. Graham, A. Tellegen, & B. Kaemmer, 1989) have proven useful in the detection of symptom exaggeration in criterion-group validation (CGV) studies, usually comparing instructed feigners with known patient groups, the application of these scales has been problematic when assessing combat veterans undergoing posttraumatic stress disorder (PTSD) examinations. Mixed group validation (MGV) was employed to determine the efficacy of MMPI-2 exaggeration scales in compensation-seeking (CS) and noncompensation-seeking (NCS) veterans. Unlike CGV, MGV allows for a mix of exaggerating and nonexaggerating individuals in each group, does not require that the exaggeration versus nonexaggerating status of any individual be known, and can be adjusted for different base-rate estimates. MMPI-2 responses of 377 male veterans were examined according to CS versus NCS status. MGV was calculated using 4 sets of base-rate estimates drawn from the literature. The validity scales generally performed well (adequate sensitivity, specificity, and efficiency) under most base-rate estimations, and most produced cutoff scores that showed adequate detection of symptom exaggeration, regardless of base-rate assumptions. These results support the use of MMPI-2 validity scales for PTSD evaluations in veteran populations, even under varying base rates of symptom exaggeration.

Stimulus-driven and knowledge-driven processes in attention to warbles

NASA Astrophysics Data System (ADS)

Dowling, W. Jay; Tillmann, Barbara

2003-10-01

Listeners identified warbles differing in amplitude-modulation rate (3-10 Hz). And measured RT while listeners maintained above 90% correct responses. After a practice session listeners identified target warbles following stimulus-driven or knowledge-driven cues. The stimulus-driven cue was a 250-ms ``beep'' at the target pitch (valid) or another pitch (invalid); the knowledge-driven cue was a midrange ``melody'' pointing to the target pitch (always valid). A 500-ms target warble followed the cue after delays of 0-500 ms (250-750 ms SOA). The listener pressed a key to indicate ``slow'' or ``fast.'' RTs were shortest at the briefest delay. In contrast to results from a memory task, RTs here were much shorter, and we found no evidence for IOR or attentional blink. Listeners began generating responses while the target was still sounding. Invalid ``beeps'' slowed responses at the briefest (but not the longer) delays; adding a valid ``beep'' to the valid ``melody'' did not speed responses.

Individualism: a valid and important dimension of cultural differences between nations.

PubMed

Schimmack, Ulrich; Oishi, Shigehiro; Diener, Ed

2005-01-01

Oyserman, Coon, and Kemmelmeier's (2002) meta-analysis suggested problems in the measurement of individualism and collectivism. Studies using Hofstede's individualism scores show little convergent validity with more recent measures of individualism and collectivism. We propose that the lack of convergent validity is due to national differences in response styles. Whereas Hofstede statistically controlled for response styles, Oyserman et al.'s meta-analysis relied on uncorrected ratings. Data from an international student survey demonstrated convergent validity between Hofstede's individualism dimension and horizontal individualism when response styles were statistically controlled, whereas uncorrected scores correlated highly with the individualism scores in Oyserman et al.'s meta-analysis. Uncorrected horizontal individualism scores and meta-analytic individualism scores did not correlate significantly with nations' development, whereas corrected horizontal individualism scores and Hofstede's individualism dimension were significantly correlated with development. This pattern of results suggests that individualism is a valid construct for cross-cultural comparisons, but that the measurement of this construct needs improvement.

Response rates in case-control studies of cancer by era of fieldwork and by characteristics of study design.

PubMed

Xu, Mengting; Richardson, Lesley; Campbell, Sally; Pintos, Javier; Siemiatycki, Jack

2018-04-09

The purpose of this study was to describe time trends in response rates in case-control studies of cancer and identify study design factors that influence response rate. We reviewed 370 case-control studies of cancer published in 12 journals during indicator years in each of the last four decades. We estimated time trends of response rates and reasons for nonresponse in each of the following types of study subjects: cases, medical source controls, and population controls. We also estimated response rates according to characteristics of study context. Median response rates among cases and population controls were between 75% and 80% in the 1970s. Between 1971 and 2010, study response rates declined by 0.31% per year for cases and 0.78% for population controls. Only a minority of studies reported reasons for nonparticipation; subject refusal was the most common reported reason. Studies conducted in North America had lower median response rates than studies conducted in Europe. In-person and telephone interviews elicited higher response rates than mail questionnaires. Response rates from case-control studies of cancer have declined, and this could threaten the validity of results derived from these studies. Copyright © 2018 Elsevier Inc. All rights reserved.

Measuring Client Experiences in Maternity Care under Change: Development of a Questionnaire Based on the WHO Responsiveness Model

PubMed Central

Scheerhagen, Marisja; van Stel, Henk F.; Birnie, Erwin; Franx, Arie; Bonsel, Gouke J.

2015-01-01

Background Maternity care is an integrated care process, which consists of different services, involves different professionals and covers different time windows. To measure performance of maternity care based on clients' experiences, we developed and validated a questionnaire. Methods and Findings We used the 8-domain WHO Responsiveness model, and previous materials to develop a self-report questionnaire. A dual study design was used for development and validation. Content validity of the ReproQ-version-0 was determined through structured interviews with 11 pregnant women (≥28 weeks), 10 women who recently had given birth (≤12 weeks), and 19 maternity care professionals. Structured interviews established the domain relevance to the women; all items were separately commented on. All Responsiveness domains were judged relevant, with Dignity and Communication ranking highest. Main missing topic was the assigned expertise of the health professional. After first adaptation, construct validity of the ReproQ-version-1 was determined through a web-based survey. Respondents were approached by maternity care organizations with different levels of integration of services of midwives and obstetricians. We sent questionnaires to 605 third trimester pregnant women (response 65%), and 810 women 6 weeks after delivery (response 55%). Construct validity was based on: response patterns; exploratory factor analysis; association of the overall score with a Visual Analogue Scale (VAS), known group comparisons. Median overall ReproQ score was 3.70 (range 1–4) showing good responsiveness. The exploratory factor analysis supported the assumed domain structure and suggested several adaptations. Correlation of the VAS rating and overall ReproQ score (antepartum, postpartum) supported validity (r = 0.56; 0.59, p<0.001 Spearman's correlation coefficient). Pre-stated group comparisons confirmed the expected difference following a good vs. adverse birth outcome. Fully integrated organizations performed slightly better (median = 3.78) than less integrated organizations (median = 3.63; p<0.001). Participation rate of women with a low educational level and/or a non-western origin was low. Conclusions The ReproQ appears suitable for assessing quality of maternity care from the clients' perspective. Recruitment of disadvantaged groups requires additional non-digital approaches. PMID:25671310

Evaluative measurement properties of the patient-specific functional scale for primary shoulder complaints in physical therapy practice.

PubMed

Koehorst, Marije L S; van Trijffel, Emiel; Lindeboom, Robert

2014-08-01

Clinical measurement, longitudinal. To assess the test-retest reliability, construct validity, and responsiveness of the Patient-Specific Functional Scale (PSFS) in patients with a primary shoulder complaint. Health measurement outcomes have become increasingly important for evaluating treatment. Patient-specific questionnaires are useful tools for determining treatment goals and evaluating treatment in individual patients. These questionnaires have not yet been validated in patients with nonspecific shoulder pain. Patients completed the PSFS, the numeric pain rating scale, and the Shoulder Pain and Disability Index at baseline, and after 1 week and 4 to 6 weeks. Test-retest reliability was determined using intraclass correlation coefficients. To assess convergent validity, change scores of the PSFS were correlated with the numeric pain rating scale and Shoulder Pain and Disability Index change scores. Responsiveness was assessed by calculating the area under the curve, the minimal clinically important change, and minimal detectable change, using the global rating of change as an external criterion. Fifty patients (37 men; mean age, 47.7 years) participated in the study. Reliability was high (intraclass correlation coefficient = 0.87; 95% confidence interval [CI]: 0.72, 0.94). The correlations between the change scores of the PSFS and those of the Shoulder Pain and Disability Index and numeric pain rating scale were 0.45 (95% CI: 0.17, 0.80) and 0.55 (95% CI: 0.29, 0.73), respectively. The area under the curve for the PSFS was 0.67 (95% CI: 0.51, 0.83). The minimal detectable change and minimal clinically important change were 0.97 and 1.29 points, respectively. These results suggest that the PSFS is a reliable, valid, and responsive instrument that can be used as an evaluative instrument in patients with a primary shoulder complaint.

Psychometric properties of the Itch Numeric Rating Scale in patients with moderate-to-severe plaque psoriasis.

PubMed

Kimball, A B; Naegeli, A N; Edson-Heredia, E; Lin, C-Y; Gaich, C; Nikaï, E; Wyrwich, K; Yosipovitch, G

2016-07-01

Itching is a profoundly distressing symptom for many patients with psoriasis, but it has not been rigorously studied using validated tools for this condition. This study investigated the psychometric properties of the Itch Numeric Rating Scale (Itch NRS), a single-item patient-reported outcome (PRO) measuring the worst itching severity due to psoriasis in the past 24 h. Using disease-specific clinician-rated and PRO data from one phase II and three phase III randomized clinical studies of subjects with moderate-to-severe plaque psoriasis, the Itch NRS was evaluated for test-retest reliability, construct validity and responsiveness. A responder definition was explored using anchor- and distribution-based methods. Test-retest reliability analyses supported the reproducibility of the measure (intraclass correlation coefficient range 0·71-0·74). To support the construct validity of the Itch NRS, large cross-sectional correlations with the Dermatology Life Quality Index (DLQI) Symptoms and Feelings domain (r ≥ 0·60 at baseline and r ≥ 0·80 at week 12) supported a priori hypotheses, while large correlations (r ≥ 0·71) between changes in Itch NRS scores and changes in DLQI Symptoms and Feelings domain scores from baseline to week 12 established responsiveness. A 4-point change was optimal for demonstrating a level of clinically meaningful improvement in itch severity after 12 weeks of treatment, which corresponds with marked clinical improvements in plaque psoriasis. The Itch NRS demonstrated sufficient reliability, validity and responsiveness, and appropriate interpretation standards for evaluating change over time in itch severity among patients with moderate-to-severe plaque psoriasis when validated using clinical trial data for this condition. © 2016 The Authors. British Journal of Dermatology published by John Wiley & Sons Ltd on behalf of British Association of Dermatologists.

Validity analysis on merged and averaged data using within and between analysis: focus on effect of qualitative social capital on self-rated health.

PubMed

Shin, Sang Soo; Shin, Young-Jeon

2016-01-01

With an increasing number of studies highlighting regional social capital (SC) as a determinant of health, many studies are using multi-level analysis with merged and averaged scores of community residents' survey responses calculated from community SC data. Sufficient examination is required to validate if the merged and averaged data can represent the community. Therefore, this study analyzes the validity of the selected indicators and their applicability in multi-level analysis. Within and between analysis (WABA) was performed after creating community variables using merged and averaged data of community residents' responses from the 2013 Community Health Survey in Korea, using subjective self-rated health assessment as a dependent variable. Further analysis was performed following the model suggested by WABA result. Both E-test results (1) and WABA results (2) revealed that single-level analysis needs to be performed using qualitative SC variable with cluster mean centering. Through single-level multivariate regression analysis, qualitative SC with cluster mean centering showed positive effect on self-rated health (0.054, p<0.001), although there was no substantial difference in comparison to analysis using SC variables without cluster mean centering or multi-level analysis. As modification in qualitative SC was larger within the community than between communities, we validate that relational analysis of individual self-rated health can be performed within the group, using cluster mean centering. Other tests besides the WABA can be performed in the future to confirm the validity of using community variables and their applicability in multi-level analysis.

Validation and Use of a Predictive Modeling Tool: Employing Scientific Findings to Improve Responsible Conduct of Research Education.

PubMed

Mulhearn, Tyler J; Watts, Logan L; Todd, E Michelle; Medeiros, Kelsey E; Connelly, Shane; Mumford, Michael D

2017-01-01

Although recent evidence suggests ethics education can be effective, the nature of specific training programs, and their effectiveness, varies considerably. Building on a recent path modeling effort, the present study developed and validated a predictive modeling tool for responsible conduct of research education. The predictive modeling tool allows users to enter ratings in relation to a given ethics training program and receive instantaneous evaluative information for course refinement. Validation work suggests the tool's predicted outcomes correlate strongly (r = 0.46) with objective course outcomes. Implications for training program development and refinement are discussed.

Validation of the short forms of the Pelvic Floor Distress Inventory (PFDI-20), Pelvic Floor Impact Questionnaire (PFIQ-7), and Pelvic Organ Prolapse/Urinary Incontinence Sexual Questionnaire (PISQ-12) in Finnish.

PubMed

Mattsson, Nina Kristiina; Nieminen, Kari; Heikkinen, Anna-Mari; Jalkanen, Jyrki; Koivurova, Sari; Eloranta, Marja-Liisa; Suvitie, Pia; Tolppanen, Anna-Maija

2017-05-02

Although several validated generic health-related quality of life instruments exist, disease-specific instruments are important as they are often more sensitive to changes in symptom severity. It is essential to validate the instruments in a new population and language before their use. The objective of the study was to translate into Finnish the short forms of three condition-specific questionnaires (PFDI-20, PFIQ-7 and PISQ-12) and to evaluate their psychometric properties in Finnish women with symptomatic pelvic organ prolapse. A multistep translation method was used followed by an evaluation of validity and reliability in prolapse patients. Convergent and discriminant validity, internal consistency and reliability via test-retest were calculated. Sixty-three patients waiting for prolapse surgery filled the three questionnaires within two weeks. Response rate for each item was high in PFDI-20 and PISQ-12 (99.8 and 98.9% respectively). For PFIQ-7 response rate was only 60%. In PFIQ-7, six respondents (9.5%) reached the minimum value of zero showing floor effect. None of the instruments had ceiling effect. Based on the item-total correlations both PFIQ-7 and PFDI-20 had acceptable convergent validity, while the convergent validity of PISQ-12 was lower, r = 0.138-0.711. However, in this instrument only three questions (questions 6, 10 and 11) had r < 0.3 while others had r ≥ 0.380. In the test-retest analysis all the three instruments showed good reliability (ICC 0.75-0.92). Similarly, the internal consistency of the instruments, measured by Cronbach's α, was good (range 0.69-0.96) indicating high homogeneity. Finnish validated translation of the PFDI-20 and PISQ-12 have acceptable psychometric properties and can be used for both research purposes and clinical evaluation of pelvic organ prolapse symptoms. The Finnish version of PFIQ-7 displayed low response rate and some evidence of a floor effect, and thus its use is not recommended in its current form.

A structured interview for the DSM-III personality disorders. A preliminary report.

PubMed

Stangl, D; Pfohl, B; Zimmerman, M; Bowers, W; Corenthal, C

1985-06-01

With few exceptions, published studies fail to indicate that the DSM-III personality disorders can be distinguished from each other with respect to etiology, prognosis, treatment response, or family history. The Structured Interview for the DSM-III Personality Disorders (SIDP) was developed to improve axis II diagnostic reliability, and hence allow validity testing of axis II. Sixty-three subjects were independently rated by two interviewers using the SIDP. The kappa coefficients for interrater agreement reached .70 or higher for histrionic, borderline, and dependent personalities. While it is impossible to separate the validity testing of the SIDP from validity testing of the DSM-III personality criteria themselves, preliminary results from 102 inpatient SIDP interviews suggest some criterion-based validity with respect to standard personality rating scales and some construct validity with respect to the dexamethasone suppression test.

Development, Evaluation, and Validation of Environmental Assessment Tools to Evaluate the College Nutrition Environment

ERIC Educational Resources Information Center

Freedman, Marjorie R.

2010-01-01

Objective: To develop, evaluate, and validate 2 nutrition environment assessment tools (surveys), for specific use in combating overweight on college/university campuses. Participants and Methods: Invitations to complete surveys were e-mailed to food service and health center directors at 47 universities, Winter 2008. Overall response rate was…

Methods and Practices of Investigators for Determining Participants’ Decisional Capacity and Comprehension of Protocols

PubMed Central

Kon, Alexander A.; Klug, Michael

2010-01-01

Ethicists recommend that investigators assess subjects’ comprehension prior to accepting their consent as valid. Because children represent an at-risk population, ensuring adequate comprehension in pediatric research is vital. We surveyed all corresponding authors of research articles published over a six-month period in five leading adult and pediatric journals. Our goal was to assess how often subject’s comprehension or decisional capacity was assessed in the consent process, whether there was any difference between adult and pediatric research projects, and the rate at which investigators use formal or validated tools to assess capacity. Responses from 102 authors were analyzed (response rate 56%). Approximately two-thirds of respondents stated that they assessed comprehension or decisional capacity prior to accepting consent, and we found no difference between adult and pediatric researchers. Nine investigators used a formal questionnaire, and three used a validated tool. These findings suggest that fewer than expected investigators assess comprehension and decisional capacity, and that the use of standardized and validated tools is the exception rather than the rule. PMID:19385838

Validity testing and neuropsychology practice in the VA healthcare system: results from recent practitioner survey (.).

PubMed

Young, J Christopher; Roper, Brad L; Arentsen, Timothy J

2016-05-01

A survey of neuropsychologists in the Veterans Health Administration examined symptom/performance validity test (SPVT) practices and estimated base rates for patient response bias. Invitations were emailed to 387 psychologists employed within the Veterans Affairs (VA), identified as likely practicing neuropsychologists, resulting in 172 respondents (44.4% response rate). Practice areas varied, with 72% at least partially practicing in general neuropsychology clinics and 43% conducting VA disability exams. Mean estimated failure rates were 23.0% for clinical outpatient, 12.9% for inpatient, and 39.4% for disability exams. Failure rates were the highest for mTBI and PTSD referrals. Failure rates were positively correlated with the number of cases seen and frequency and number of SPVT use. Respondents disagreed regarding whether one (45%) or two (47%) failures are required to establish patient response bias, with those administering more measures employing the more stringent criterion. Frequency of the use of specific SPVTs is reported. Base rate estimates for SPVT failure in VA disability exams are comparable to those in other medicolegal settings. However, failure in routine clinical exams is much higher in the VA than in other settings, possibly reflecting the hybrid nature of the VA's role in both healthcare and disability determination. Generally speaking, VA neuropsychologists use SPVTs frequently and eschew pejorative terms to describe their failure. Practitioners who require only one SPVT failure to establish response bias may overclassify patients. Those who use few or no SPVTs may fail to identify response bias. Additional clinical and theoretical implications are discussed.

Validation of the Amsterdam Dynamic Facial Expression Set – Bath Intensity Variations (ADFES-BIV): A Set of Videos Expressing Low, Intermediate, and High Intensity Emotions

PubMed Central

Wingenbach, Tanja S. H.

2016-01-01

Most of the existing sets of facial expressions of emotion contain static photographs. While increasing demand for stimuli with enhanced ecological validity in facial emotion recognition research has led to the development of video stimuli, these typically involve full-blown (apex) expressions. However, variations of intensity in emotional facial expressions occur in real life social interactions, with low intensity expressions of emotions frequently occurring. The current study therefore developed and validated a set of video stimuli portraying three levels of intensity of emotional expressions, from low to high intensity. The videos were adapted from the Amsterdam Dynamic Facial Expression Set (ADFES) and termed the Bath Intensity Variations (ADFES-BIV). A healthy sample of 92 people recruited from the University of Bath community (41 male, 51 female) completed a facial emotion recognition task including expressions of 6 basic emotions (anger, happiness, disgust, fear, surprise, sadness) and 3 complex emotions (contempt, embarrassment, pride) that were expressed at three different intensities of expression and neutral. Accuracy scores (raw and unbiased (Hu) hit rates) were calculated, as well as response times. Accuracy rates above chance level of responding were found for all emotion categories, producing an overall raw hit rate of 69% for the ADFES-BIV. The three intensity levels were validated as distinct categories, with higher accuracies and faster responses to high intensity expressions than intermediate intensity expressions, which had higher accuracies and faster responses than low intensity expressions. To further validate the intensities, a second study with standardised display times was conducted replicating this pattern. The ADFES-BIV has greater ecological validity than many other emotion stimulus sets and allows for versatile applications in emotion research. It can be retrieved free of charge for research purposes from the corresponding author. PMID:26784347

Validation of the Amsterdam Dynamic Facial Expression Set--Bath Intensity Variations (ADFES-BIV): A Set of Videos Expressing Low, Intermediate, and High Intensity Emotions.

PubMed

Wingenbach, Tanja S H; Ashwin, Chris; Brosnan, Mark

2016-01-01

Most of the existing sets of facial expressions of emotion contain static photographs. While increasing demand for stimuli with enhanced ecological validity in facial emotion recognition research has led to the development of video stimuli, these typically involve full-blown (apex) expressions. However, variations of intensity in emotional facial expressions occur in real life social interactions, with low intensity expressions of emotions frequently occurring. The current study therefore developed and validated a set of video stimuli portraying three levels of intensity of emotional expressions, from low to high intensity. The videos were adapted from the Amsterdam Dynamic Facial Expression Set (ADFES) and termed the Bath Intensity Variations (ADFES-BIV). A healthy sample of 92 people recruited from the University of Bath community (41 male, 51 female) completed a facial emotion recognition task including expressions of 6 basic emotions (anger, happiness, disgust, fear, surprise, sadness) and 3 complex emotions (contempt, embarrassment, pride) that were expressed at three different intensities of expression and neutral. Accuracy scores (raw and unbiased (Hu) hit rates) were calculated, as well as response times. Accuracy rates above chance level of responding were found for all emotion categories, producing an overall raw hit rate of 69% for the ADFES-BIV. The three intensity levels were validated as distinct categories, with higher accuracies and faster responses to high intensity expressions than intermediate intensity expressions, which had higher accuracies and faster responses than low intensity expressions. To further validate the intensities, a second study with standardised display times was conducted replicating this pattern. The ADFES-BIV has greater ecological validity than many other emotion stimulus sets and allows for versatile applications in emotion research. It can be retrieved free of charge for research purposes from the corresponding author.

Validity and Responsiveness of the Two-Minute Walk Test for Measuring Functional Recovery After Total Knee Arthroplasty.

PubMed

Unnanuntana, Aasis; Ruangsomboon, Pakpoom; Keesukpunt, Worawut

2018-06-01

The 2-minute walk test (2mwt) is a performance-based test that evaluates functional recovery after total knee arthroplasty (TKA). This study evaluated its validity compared with the modified Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC), Oxford Knee Score (OKS), modified Knee Score, Numerical Pain Rating Scale, and Timed Up and Go test, and its responsiveness in assessing functional recovery in TKA patients. This prospective cohort study included 162 patients undergoing primary TKA between 2013 and 2015. We used patient-reported outcome measures (modified WOMAC, OKS, modified Knee Score, Numerical Pain Rating Scale) and performance-based tests (2mwt and Timed Up and Go test) at baseline and 3, 6, and 12 months postoperatively. The construct validity of 2mwt was determined between the 2mwt distances walked and other outcome measurements. To assess responsiveness, effect size and standardized response mean were analyzed. Minimal clinically important difference of 2mwt at 12 months after TKA was also calculated. All outcome measurements improved significantly from baseline to 3, 6, and 12 months postoperatively. Bivariate analysis revealed mild to moderate associations between the 2mwt and modified WOMAC function subscales, and moderate to strong associations with OKS. Mild to moderate correlations were found for pain and stiffness between 2mwt and other outcome measurements. The effect size and standardized response mean at 12 months were large, with a minimal clinically important difference of 12.7 m. 2mwt is a validated performance-based test with responsiveness properties. Being simple and easy to perform, it can be used routinely in clinical practice to evaluate functional recovery after TKA. Copyright © 2018 The Authors. Published by Elsevier Inc. All rights reserved.

The work role functioning questionnaire 2.0 (Dutch version): examination of its reliability, validity and responsiveness in the general working population.

PubMed

Abma, Femke I; van der Klink, Jac J L; Bültmann, Ute

2013-03-01

The promotion of a sustainable, healthy and productive working life attracts more and more attention. Recently the Work Role Functioning Questionnaire (WRFQ) has been cross-culturally translated and adapted to Dutch. This questionnaire aims to measure the health-related work functioning of workers with health problems. The aim of this study is to evaluate the reliability, validity (including five new items) and responsiveness of the WRFQ 2.0 in the working population. A longitudinal study was conducted among workers. The reliability (internal consistency, test-retest reliability, measurement error), validity (structural validity-factor analysis, construct validity by means of hypotheses testing) and responsiveness of the WRFQ 2.0 were evaluated. A total of N = 553 workers completed the survey. The final WRFQ 2.0 has four subscales and showed very good internal consistency, moderate test-retest reliability, good construct validity and moderate responsiveness in the working population. The WRFQ was able to distinguish between groups with different levels of mental health, physical health, fatigue and need for recovery. A moderate correlation was found between WRFQ and related constructs respectively work ability and work productivity. A weak relationship was found with general self-rated health, work engagement and work involvement. The WRFQ 2.0 is a reliable and valid instrument to measure health-related work functioning in the working population. Further validation in larger samples is recommended, especially for test-retest reliability, responsiveness and the questionnaire's ability to predict the future course of health-related work functioning.

Construct validation of an interactive digital algorithm for ostomy care.

PubMed

Beitz, Janice M; Gerlach, Mary A; Schafer, Vickie

2014-01-01

The purpose of this study was to evaluate construct validity for a previously face and content validated Ostomy Algorithm using digital real-life clinical scenarios. A cross-sectional, mixed-methods Web-based survey design study was conducted. Two hundred ninety-seven English-speaking RNs completed the study; participants practiced in both acute care and postacute settings, with 1 expert ostomy nurse (WOC nurse) and 2 nonexpert nurses. Following written consent, respondents answered demographic questions and completed a brief algorithm tutorial. Participants were then presented with 7 ostomy-related digital scenarios consisting of real-life photos and pertinent clinical information. Respondents used the 11 assessment components of the digital algorithm to choose management options. Participant written comments about the scenarios and the research process were collected. The mean overall percentage of correct responses was 84.23%. Mean percentage of correct responses for respondents with a self-reported basic ostomy knowledge was 87.7%; for those with a self-reported intermediate ostomy knowledge was 85.88% and those who were self-reported experts in ostomy care achieved 82.77% correct response rate. Five respondents reported having no prior ostomy care knowledge at screening and achieved an overall 45.71% correct response rate. No negative comments regarding the algorithm were recorded by participants. The new standardized Ostomy Algorithm remains the only face, content, and construct validated digital clinical decision instrument currently available. Further research on application at the bedside while tracking patient outcomes is warranted.

Representativeness and response rates from the Domestic/International Gastroenterology Surveillance Study (DIGEST).

PubMed

Tijssen, J G

1999-01-01

The Domestic/international Gastroenterology Surveillance Study (DIGEST) examined the prevalence of upper gastrointestinal symptoms among the general population in 10 countries, and the impact of these symptoms on healthcare usage and quality of life. This report discusses the validation of the DIGEST sample and reviews the response rates from the survey. External validation of the DIGEST sample was conducted by comparing the age, age by gender and annual household incomes of the sample with census-derived data. A comparison was also made between Psychological General Well-Being Index (PGWBI) scores from study subjects in the Scandinavian countries and the USA and the total sample population norms. Under- and oversampling, defined as > or =5% difference from the population norms, was evident in eight out of 10 countries, but no systematic bias was evident. The final distribution of the sample by gender was 51% female and 49% male. Although differences in PGWBI scores were noted between DIGEST subjects and population norms, these differences were <0.30 standard deviations--markedly below the difference considered as relevant for the PGWBI. Response for the survey in individual countries ranged from 17% in the USA to 61% in Norway, with a survey-wide rate of 27%. The overall response rate, including primary non-respondents, was 13.4%. The majority of nonresponse (51.4%) was attributed to failure to establish contact with the subjects, with 41.7% of subjects declining to be interviewed and the remaining 6.9% of subjects not meeting the age and sex criteria used for the survey. The DIGEST sample exhibited good external validity, providing a foundation for comparison between data derived from individual countries in the survey.

A systematic review of publications assessing reliability and validity of the Behavioral Risk Factor Surveillance System (BRFSS), 2004–2011

PubMed Central

2013-01-01

Background In recent years response rates on telephone surveys have been declining. Rates for the behavioral risk factor surveillance system (BRFSS) have also declined, prompting the use of new methods of weighting and the inclusion of cell phone sampling frames. A number of scholars and researchers have conducted studies of the reliability and validity of the BRFSS estimates in the context of these changes. As the BRFSS makes changes in its methods of sampling and weighting, a review of reliability and validity studies of the BRFSS is needed. Methods In order to assess the reliability and validity of prevalence estimates taken from the BRFSS, scholarship published from 2004–2011 dealing with tests of reliability and validity of BRFSS measures was compiled and presented by topics of health risk behavior. Assessments of the quality of each publication were undertaken using a categorical rubric. Higher rankings were achieved by authors who conducted reliability tests using repeated test/retest measures, or who conducted tests using multiple samples. A similar rubric was used to rank validity assessments. Validity tests which compared the BRFSS to physical measures were ranked higher than those comparing the BRFSS to other self-reported data. Literature which undertook more sophisticated statistical comparisons was also ranked higher. Results Overall findings indicated that BRFSS prevalence rates were comparable to other national surveys which rely on self-reports, although specific differences are noted for some categories of response. BRFSS prevalence rates were less similar to surveys which utilize physical measures in addition to self-reported data. There is very little research on reliability and validity for some health topics, but a great deal of information supporting the validity of the BRFSS data for others. Conclusions Limitations of the examination of the BRFSS were due to question differences among surveys used as comparisons, as well as mode of data collection differences. As the BRFSS moves to incorporating cell phone data and changing weighting methods, a review of reliability and validity research indicated that past BRFSS landline only data were reliable and valid as measured against other surveys. New analyses and comparisons of BRFSS data which include the new methodologies and cell phone data will be needed to ascertain the impact of these changes on estimates in the future. PMID:23522349

Using Rasch rating scale model to reassess the psychometric properties of the Persian version of the PedsQL™ 4.0 Generic Core Scales in school children.

PubMed

Jafari, Peyman; Bagheri, Zahra; Ayatollahi, Seyyed Mohamad Taghi; Soltani, Zahra

2012-03-13

Item response theory (IRT) is extensively used to develop adaptive instruments of health-related quality of life (HRQoL). However, each IRT model has its own function to estimate item and category parameters, and hence different results may be found using the same response categories with different IRT models. The present study used the Rasch rating scale model (RSM) to examine and reassess the psychometric properties of the Persian version of the PedsQL™ 4.0 Generic Core Scales. The PedsQL™ 4.0 Generic Core Scales was completed by 938 Iranian school children and their parents. Convergent, discriminant and construct validity of the instrument were assessed by classical test theory (CTT). The RSM was applied to investigate person and item reliability, item statistics and ordering of response categories. The CTT method showed that the scaling success rate for convergent and discriminant validity were 100% in all domains with the exception of physical health in the child self-report. Moreover, confirmatory factor analysis supported a four-factor model similar to its original version. The RSM showed that 22 out of 23 items had acceptable infit and outfit statistics (<1.4, >0.6), person reliabilities were low, item reliabilities were high, and item difficulty ranged from -1.01 to 0.71 and -0.68 to 0.43 for child self-report and parent proxy-report, respectively. Also the RSM showed that successive response categories for all items were not located in the expected order. This study revealed that, in all domains, the five response categories did not perform adequately. It is not known whether this problem is a function of the meaning of the response choices in the Persian language or an artifact of a mostly healthy population that did not use the full range of the response categories. The response categories should be evaluated in further validation studies, especially in large samples of chronically ill patients.

Validation of standard ASTM F2732 and comparison with ISO 11079 with respect to comfort temperature ratings for cold protective clothing.

PubMed

Gao, Chuansi; Lin, Li-Yen; Halder, Amitava; Kuklane, Kalev; Holmér, Ingvar

2015-01-01

American standard ASTM F2732 estimates the lowest environmental temperature for thermal comfort for cold weather protective clothing. International standard ISO 11079 serves the same purpose but expresses cold stress in terms of required clothing insulation for a given cold climate. The objective of this study was to validate and compare the temperature ratings using human subject tests at two levels of metabolic rates (2 and 4 MET corresponding to 116.4 and 232.8 W/m(2)). Nine young and healthy male subjects participated in the cold exposure at 3.4 and -30.6 °C. The results showed that both standards predict similar temperature ratings for an intrinsic clothing insulation of 1.89 clo and for 2 MET activity. The predicted temperature rating for 2 MET activity is consistent with test subjects' thermophysiological responses, perceived thermal sensation and thermal comfort. For 4 MET activity, however, the whole body responses were on the cold side, particularly the responses of the extremities. ASTM F2732 is also limited due to its omission and simplification of three climatic variables (air velocity, radiant temperature and relative humidity) and exposure time in the cold which are of practical importance. Copyright © 2014 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Teachers' Perceptions and Undergraduate Students' Experience in E-Exam in Higher Institution in Nigeria

ERIC Educational Resources Information Center

Hamsatu, Pur; Yusufu, Gambo; Mohammed, Habib A.

2016-01-01

This study was conducted to explore teachers' perceptions, and students' experiences in e-Examination in University of Maiduguri. Questionnaires were distributed to 30 teachers and 50 students, and the 80 collated instruments were valid for data analysis, representing a response rate of 100%. The validity of the questionnaire was approved by some…

Using the Theory of Planned Behavior to Explain and Predict Behavior Intentions in Taiwan

ERIC Educational Resources Information Center

Wu, Cheng-Lung

2015-01-01

This study aims to use the theory of planned behavior to verify undergraduates' behavioral intentions regarding their participation in aquatic sports. Undergraduates in Taiwan serve as the research subjects and a survey method employs questionnaires. A total of 200 valid questionnaires were received out of 230, thus giving a valid response rate of…

Developing and Verifying a Business-Creativity Assessment Tool: A Nationwide Study in Taiwan

ERIC Educational Resources Information Center

Cheng, Kai-Wen; Chen, Yu-Fen

2010-01-01

This study was designed to assess business creativity of students in Taiwan. A questionnaire was developed and administered to students in business-related departments of 16 vocational schools during November 2006. Of the 1,420 administered questionnaires, 1,052 were valid, resulting in a valid response rate of 70.48%. Exploratory factor analysis…

Tensile Deformation and Adiabatic Heating in Post-Yield Response of Polycarbonate

DTIC Science & Technology

2015-11-01

display a currently valid OMB control number. PLEASE DO NOT RETURN YOUR FORM TO THE ABOVE ADDRESS. 1. REPORT DATE (DD-MM-YYYY) November 2015 2...to investigate the rate-dependent mechanical response from quasi-static to intermediate (~5/s) strain rates using a traditional servo -hydraulic load...less than 7-mm thickness) These specimens were loaded in tension using an Instron servo -hydraulic test frame. Far-field load and stress measurements

Microcounseling Skill Discrimination Scale: A Methodological Note

ERIC Educational Resources Information Center

Stokes, Joseph; Romer, Daniel

1977-01-01

Absolute ratings on the Microcounseling Skill Discrimination Scale (MSDS) confound the individual's use of the rating scale and actual ability to discriminate effective and ineffective counselor behaviors. This note suggests methods of scoring the MSDS that will eliminate variability attributable to response language and improve the validity of…

Identification of Reduced-Order Thermal Therapy Models Using Thermal MR Images: Theory and Validation

PubMed Central

2013-01-01

In this paper, we develop and validate a method to identify computationally efficient site- and patient-specific models of ultrasound thermal therapies from MR thermal images. The models of the specific absorption rate of the transduced energy and the temperature response of the therapy target are identified in the reduced basis of proper orthogonal decomposition of thermal images, acquired in response to a mild thermal test excitation. The method permits dynamic reidentification of the treatment models during the therapy by recursively utilizing newly acquired images. Such adaptation is particularly important during high-temperature therapies, which are known to substantially and rapidly change tissue properties and blood perfusion. The developed theory was validated for the case of focused ultrasound heating of a tissue phantom. The experimental and computational results indicate that the developed approach produces accurate low-dimensional treatment models despite temporal and spatial noises in MR images and slow image acquisition rate. PMID:22531754

Concurrent validity and sensitivity to change of Direct Behavior Rating Single-Item Scales (DBR-SIS) within an elementary sample.

PubMed

Smith, Rhonda L; Eklund, Katie; Kilgus, Stephen P

2018-03-01

The purpose of this study was to evaluate the concurrent validity, sensitivity to change, and teacher acceptability of Direct Behavior Rating single-item scales (DBR-SIS), a brief progress monitoring measure designed to assess student behavioral change in response to intervention. Twenty-four elementary teacher-student dyads implemented a daily report card intervention to promote positive student behavior during prespecified classroom activities. During both baseline and intervention, teachers completed DBR-SIS ratings of 2 target behaviors (i.e., Academic Engagement, Disruptive Behavior) whereas research assistants collected systematic direct observation (SDO) data in relation to the same behaviors. Five change metrics (i.e., absolute change, percent of change from baseline, improvement rate difference, Tau-U, and standardized mean difference; Gresham, 2005) were calculated for both DBR-SIS and SDO data, yielding estimates of the change in student behavior in response to intervention. Mean DBR-SIS scores were predominantly moderately to highly correlated with SDO data within both baseline and intervention, demonstrating evidence of the former's concurrent validity. DBR-SIS change metrics were also significantly correlated with SDO change metrics for both Disruptive Behavior and Academic Engagement, yielding evidence of the former's sensitivity to change. In addition, teacher Usage Rating Profile-Assessment (URP-A) ratings indicated they found DBR-SIS to be acceptable and usable. Implications for practice, study limitations, and areas of future research are discussed. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Patterns of Cognitive Strengths and Weaknesses: Identification Rates, Agreement, and Validity for Learning Disabilities Identification

PubMed Central

Miciak, Jeremy; Fletcher, Jack M.; Stuebing, Karla; Vaughn, Sharon; Tolar, Tammy D.

2014-01-01

Purpose Few empirical investigations have evaluated LD identification methods based on a pattern of cognitive strengths and weaknesses (PSW). This study investigated the reliability and validity of two proposed PSW methods: the concordance/discordance method (C/DM) and cross battery assessment (XBA) method. Methods Cognitive assessment data for 139 adolescents demonstrating inadequate response to intervention was utilized to empirically classify participants as meeting or not meeting PSW LD identification criteria using the two approaches, permitting an analysis of: (1) LD identification rates; (2) agreement between methods; and (3) external validity. Results LD identification rates varied between the two methods depending upon the cut point for low achievement, with low agreement for LD identification decisions. Comparisons of groups that met and did not meet LD identification criteria on external academic variables were largely null, raising questions of external validity. Conclusions This study found low agreement and little evidence of validity for LD identification decisions based on PSW methods. An alternative may be to use multiple measures of academic achievement to guide intervention. PMID:24274155

Validation Relaxation: A Quality Assurance Strategy for Electronic Data Collection

PubMed Central

Gordon, Nicholas; Griffiths, Thomas; Kraemer, John D; Siedner, Mark J

2017-01-01

Background The use of mobile devices for data collection in developing world settings is becoming increasingly common and may offer advantages in data collection quality and efficiency relative to paper-based methods. However, mobile data collection systems can hamper many standard quality assurance techniques due to the lack of a hardcopy backup of data. Consequently, mobile health data collection platforms have the potential to generate datasets that appear valid, but are susceptible to unidentified database design flaws, areas of miscomprehension by enumerators, and data recording errors. Objective We describe the design and evaluation of a strategy for estimating data error rates and assessing enumerator performance during electronic data collection, which we term “validation relaxation.” Validation relaxation involves the intentional omission of data validation features for select questions to allow for data recording errors to be committed, detected, and monitored. Methods We analyzed data collected during a cluster sample population survey in rural Liberia using an electronic data collection system (Open Data Kit). We first developed a classification scheme for types of detectable errors and validation alterations required to detect them. We then implemented the following validation relaxation techniques to enable data error conduct and detection: intentional redundancy, removal of “required” constraint, and illogical response combinations. This allowed for up to 11 identifiable errors to be made per survey. The error rate was defined as the total number of errors committed divided by the number of potential errors. We summarized crude error rates and estimated changes in error rates over time for both individuals and the entire program using logistic regression. Results The aggregate error rate was 1.60% (125/7817). Error rates did not differ significantly between enumerators (P=.51), but decreased for the cohort with increasing days of application use, from 2.3% at survey start (95% CI 1.8%-2.8%) to 0.6% at day 45 (95% CI 0.3%-0.9%; OR=0.969; P<.001). The highest error rate (84/618, 13.6%) occurred for an intentional redundancy question for a birthdate field, which was repeated in separate sections of the survey. We found low error rates (0.0% to 3.1%) for all other possible errors. Conclusions A strategy of removing validation rules on electronic data capture platforms can be used to create a set of detectable data errors, which can subsequently be used to assess group and individual enumerator error rates, their trends over time, and categories of data collection that require further training or additional quality control measures. This strategy may be particularly useful for identifying individual enumerators or systematic data errors that are responsive to enumerator training and is best applied to questions for which errors cannot be prevented through training or software design alone. Validation relaxation should be considered as a component of a holistic data quality assurance strategy. PMID:28821474

Validation Relaxation: A Quality Assurance Strategy for Electronic Data Collection.

PubMed

Kenny, Avi; Gordon, Nicholas; Griffiths, Thomas; Kraemer, John D; Siedner, Mark J

2017-08-18

The use of mobile devices for data collection in developing world settings is becoming increasingly common and may offer advantages in data collection quality and efficiency relative to paper-based methods. However, mobile data collection systems can hamper many standard quality assurance techniques due to the lack of a hardcopy backup of data. Consequently, mobile health data collection platforms have the potential to generate datasets that appear valid, but are susceptible to unidentified database design flaws, areas of miscomprehension by enumerators, and data recording errors. We describe the design and evaluation of a strategy for estimating data error rates and assessing enumerator performance during electronic data collection, which we term "validation relaxation." Validation relaxation involves the intentional omission of data validation features for select questions to allow for data recording errors to be committed, detected, and monitored. We analyzed data collected during a cluster sample population survey in rural Liberia using an electronic data collection system (Open Data Kit). We first developed a classification scheme for types of detectable errors and validation alterations required to detect them. We then implemented the following validation relaxation techniques to enable data error conduct and detection: intentional redundancy, removal of "required" constraint, and illogical response combinations. This allowed for up to 11 identifiable errors to be made per survey. The error rate was defined as the total number of errors committed divided by the number of potential errors. We summarized crude error rates and estimated changes in error rates over time for both individuals and the entire program using logistic regression. The aggregate error rate was 1.60% (125/7817). Error rates did not differ significantly between enumerators (P=.51), but decreased for the cohort with increasing days of application use, from 2.3% at survey start (95% CI 1.8%-2.8%) to 0.6% at day 45 (95% CI 0.3%-0.9%; OR=0.969; P<.001). The highest error rate (84/618, 13.6%) occurred for an intentional redundancy question for a birthdate field, which was repeated in separate sections of the survey. We found low error rates (0.0% to 3.1%) for all other possible errors. A strategy of removing validation rules on electronic data capture platforms can be used to create a set of detectable data errors, which can subsequently be used to assess group and individual enumerator error rates, their trends over time, and categories of data collection that require further training or additional quality control measures. This strategy may be particularly useful for identifying individual enumerators or systematic data errors that are responsive to enumerator training and is best applied to questions for which errors cannot be prevented through training or software design alone. Validation relaxation should be considered as a component of a holistic data quality assurance strategy. ©Avi Kenny, Nicholas Gordon, Thomas Griffiths, John D Kraemer, Mark J Siedner. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 18.08.2017.

Validation of the XDP-MDSP rating scale for the evaluation of patients with X-linked dystonia-parkinsonism.

PubMed

Pasco, Paul Matthew D; Jamora, Roland Dominic G; Rosales, Raymond L; Diesta, Cid Czarina E; Ng, Arlene R; Teleg, Rosalia A; Go, Criscely L; Lee, Lillian; Fernandez, Hubert H

2017-01-01

X-linked dystonia-parkinsonism(XDP) is a neurodegenerative disorder endemic to the Philippines. A rating scale was developed by the authors under the guidance of the Movement Disorder Society of the Philippines (MDSP) to assess XDP severity and progression, functional impact, and response to treatment in future clinical trials. Our main objective was to validate our new scale, the XDP-MDSP scale. The initial validation process included pragmatic testing to XDP patients followed by a modified Delphi procedure with an international advisory panel of dystonia, parkinsonism and scale development experts. Pearson correlation was used to assess construct validity of our new scale versus the assess construct validity of our new scale versus standard dystonia, parkinsonism, non-motor and functional scales; and also to assess divergent validity against behavioral and cognitive scales. The 37-item XDP-MDSP scale has five parts: I-dystonia, II-parkinsonism, III-non-motor features, IV-ADL, and V-global impression. After initial validation, the scale was administered to 204 XDP patients. Inter-domain correlation for the first four parts was acceptable. The correlation between these domains and the global rating was slightly lower. Correlations between Parts I, II, III, and IV versus standard dystonia, parkinsonism, non-motor and functional scales were acceptable with values ranging from 0.323 to 0.428. For divergent validity, a significant correlation was seen with behavioral scales. No significant correlation was noted with the cognitive scale. The proposed XDP-MDSP scale is internally valid but the global rating subscale may need to be modified or eliminated. While there is convergent validity, divergent validation was successful only on cognitive and not behavioral scales. The frequent co-occurrence of anxiety and depression, and its effect on the motor and functional state, may explain this finding.

Clinimetrics and clinical psychometrics: macro- and micro-analysis.

PubMed

Tomba, Elena; Bech, Per

2012-01-01

Clinimetrics was introduced three decades ago to specify the domain of clinical markers in clinical medicine (indexes or rating scales). In this perspective, clinical validity is the platform for selecting the various indexes or rating scales (macro-analysis). Psychometric validation of these indexes or rating scales is the measuring aspect (micro-analysis). Clinical judgment analysis by experienced psychiatrists is included in the macro-analysis and the item response theory models are especially preferred in the micro-analysis when using the total score as a sufficient statistic. Clinical assessment tools covering severity of illness scales, prognostic measures, issues of co-morbidity, longitudinal assessments, recovery, stressors, lifestyle, psychological well-being, and illness behavior have been identified. The constructive dialogue in clinimetrics between clinical judgment and psychometric validation procedures is outlined for generating developments of clinical practice in psychiatry. Copyright © 2012 S. Karger AG, Basel.

Analysis of Individual "Test Of Astronomy STandards" (TOAST) Item Responses

ERIC Educational Resources Information Center

Slater, Stephanie J.; Schleigh, Sharon Price; Stork, Debra J.

2015-01-01

The development of valid and reliable strategies to efficiently determine the knowledge landscape of introductory astronomy college students is an effort of great interest to the astronomy education community. This study examines individual item response rates from a widely used conceptual understanding survey, the Test Of Astronomy Standards…

A Comparison of Conjoint Analysis Response Formats

Treesearch

Kevin J. Boyle; Thomas P. Holmes; Mario F. Teisl; Brian Roe

2001-01-01

A split-sample design is used to evaluate the convergent validity of three response formats used in conjoint analysis experiments. WC investigate whether recoding rating data to rankings and choose-one formats, and recoding ranking data to choose one. result in structural models and welfare estimates that are statistically indistinguishable from...

Techniques for obtaining subjective response to vertical vibration

NASA Technical Reports Server (NTRS)

Clarke, M. J.; Oborne, D. J.

1975-01-01

Laboratory experiments were performed to validate the techniques used for obtaining ratings in the field surveys carried out by the University College of Swansea. In addition, attempts were made to evaluate the basic form of the human response to vibration. Some of the results obtained by different methods are described.

Using Rasch Analysis to Inform Rating Scale Development

ERIC Educational Resources Information Center

Van Zile-Tamsen, Carol

2017-01-01

The use of surveys, questionnaires, and rating scales to measure important outcomes in higher education is pervasive, but reliability and validity information is often based on problematic Classical Test Theory approaches. Rasch Analysis, based on Item Response Theory, provides a better alternative for examining the psychometric quality of rating…

Brief Report: Concurrent Validity of Autism Symptom Severity Measures

ERIC Educational Resources Information Center

Reszka, Stephanie S.; Boyd, Brian A.; McBee, Matthew; Hume, Kara A.; Odom, Samuel L.

2014-01-01

The autism spectrum disorder (ASD) diagnostic classifications, according to the DSM-5, include a severity rating. Several screening and/or diagnostic measures, such as the autism diagnostic and observation schedule (ADOS), Childhood Autism Rating Scale (CARS) and social responsiveness scale (SRS) (teacher and parent versions), include an…

Psychometric Properties of the Revised Mathematics Anxiety Rating Scale

ERIC Educational Resources Information Center

Baloglu, Mustafa; Zelhart, Paul F.

2007-01-01

An exploratory factor analysis and several confirmatory analyses were performed to evaluate the factorial structure of the Revised Mathematics Anxiety Rating Scale (RMARS) through the responses of 805 college students. On 559 students' scores, the instrument's construct validity was tested through a confirmatory factor analysis (CFA) and was found…

Can training in empathetic validation improve medical students' communication with patients suffering pain? A test of concept.

PubMed

Linton, Steven J; Flink, Ida K; Nilsson, Emma; Edlund, Sara

2017-05-01

Patient-centered, empathetic communication has been recommended as a means for improving the health care of patients suffering pain. However, a problem has been training health care providers since programs may be time-consuming and difficult to learn. Validation, a form of empathetic response that communicates that what a patient experiences is accepted as true, has been suggested as an appropriate method for improving communication with patients suffering pain. We study the immediate effects of providing medical students with a 2-session (45-minute duration each) program in validation skills on communication. A one group, pretest vs posttest design was employed with 22 volunteer medical students. To control patient variables, actors simulated 1 of 2 patient scenarios (randomly provided at pretest and posttest). Video recordings were blindly evaluated. Self-ratings of validation and satisfaction were also employed. Observed validation responses increased significantly after training and corresponded to significant reductions in invalidating responses. Both the patient simulators and the medical students were significantly more satisfied after the training. We demonstrated that training empathetic validation results in improved communication thus extending previous findings to a medical setting with patients suffering pain. Our results suggest that it would be feasible to provide validation training for health care providers and this warrants further investigation in controlled studies.

Patient-Reported Outcome Measures for Hand and Wrist Trauma: Is There Sufficient Evidence of Reliability, Validity, and Responsiveness?

PubMed

Dacombe, Peter Jonathan; Amirfeyz, Rouin; Davis, Tim

2016-03-01

Patient-reported outcome measures (PROMs) are important tools for assessing outcomes following injuries to the hand and wrist. Many commonly used PROMs have no evidence of reliability, validity, and responsiveness in a hand and wrist trauma population. This systematic review examines the PROMs used in the assessment of hand and wrist trauma patients, and the evidence for reliability, validity, and responsiveness of each measure in this population. A systematic review of Pubmed, Medline, and CINAHL searching for randomized controlled trials of patients with traumatic injuries to the hand and wrist was carried out to identify the PROMs. For each identified PROM, evidence of reliability, validity, and responsiveness was identified using a further systematic review of the Pubmed, Medline, CINAHL, and reverse citation trail audit procedure. The PROM used most often was the Disabilities of the Arm, Shoulder and Hand (DASH) questionnaire; the Patient-Rated Wrist Evaluation (PRWE), Gartland and Werley score, Michigan Hand Outcomes score, Mayo Wrist Score, and Short Form 36 were also commonly used. Only the DASH and PRWE have evidence of reliability, validity, and responsiveness in patients with traumatic injuries to the hand and wrist; other measures either have incomplete evidence or evidence gathered in a nontraumatic population. The DASH and PRWE both have evidence of reliability, validity, and responsiveness in a hand and wrist trauma population. Other PROMs used to assess hand and wrist trauma patients do not. This should be considered when selecting a PROM for patients with traumatic hand and wrist pathology.

Creating Abbreviated Rating Scales to Monitor Classroom Inattention-Overactivity, Aggression, and Peer Conflict: Reliability, Validity, and Treatment Sensitivity

ERIC Educational Resources Information Center

Volpe, Robert J.; Gadow, Kenneth D.

2010-01-01

Rating scales developed to measure child emotional and behavioral problems typically are so long as to make their use in progress monitoring impractical in typical school settings. This study examined two methods of selecting items from existing rating scales to create shorter instruments for use in assessing response to intervention. The…

The Achilles tendon total rupture score: a study of responsiveness, internal consistency and convergent validity on patients with acute Achilles tendon ruptures

PubMed Central

2012-01-01

Background The Achilles tendon Total Rupture Score was developed by a research group in 2007 in response to the need for a patient reported outcome measure for this patient population. Beyond this original development paper, no further validation studies have been published. Consequently the purpose of this study was to evaluate internal consistency, convergent validity and responsiveness of this newly developed patient reported outcome measure within patients who have sustained an isolated acute Achilles tendon rupture. Methods Sixty-four eligible patients with an acute rupture of their Achilles tendon completed the Achilles tendon Total Rupture Score alongside two further patient reported outcome measures (Disability Rating Index and EQ 5D). These were completed at baseline, six weeks, three months, six months and nine months post injury. The Achilles tendon Total Rupture Score was evaluated for internal consistency, using Cronbach's alpha, convergent validity, through correlation analysis and responsiveness, by analysing floor and ceiling effects and calculating its relative efficiency in comparison to the Disability Rating Index and EQ 5D scores. Results The Achilles tendon Total Rupture Score demonstrated high internal consistency (Cronbachs alpha > 0.8) and correlated significantly (p < 0.001) with the Disability Rating Index at five time points (pre-injury, six weeks, three, six and nine months) with correlation coefficients between -0.5 and -0.9. However, the confidence intervals were wide. Furthermore, the ability of the new score to detect clinically important changes over time (responsiveness) was shown to be greater than the Disability Rating Index and EQ 5D. Conclusions A universally accepted outcome measure is imperative to allow comparisons to be made across practice. This is the first study to evaluate aspects of validity of this newly developed outcome measure, outside of the developing centre. The ATRS demonstrated high internal consistency and responsiveness, with limited convergent validity. This research provides further support for the use of this outcome measure, however further research is required to advocate its universal use in patients with acute Achilles tendon ruptures. Such areas include inter-rater reliability and research to determine the minimally clinically important difference between scores. All authors have read and concur with the content of this manuscript. The material presented has not been and will not be submitted for publication elsewhere, except as an abstract. All authors have made substantial contributions to all of the following: (1) the conception and design of the study, or acquisition of data, or analysis and interpretation of data, (2) drafting the article or revising it critically for important intellectual content and (3) final approval of the submitted version. This research has been funded by Arthritis Research UK, no conflicts of interests have been declared by the authors. Kind Regards Rebecca Kearney (corresponding author) Research Physiotherapist PMID:22376047

Cross-validation of clinical characteristics and treatment patterns associated with phenotypes for lithium response defined by the Alda scale.

PubMed

Scott, Jan; Geoffroy, Pierre Alexis; Sportiche, Sarah; Brichant-Petit-Jean, Clara; Gard, Sebastien; Kahn, Jean-Pierre; Azorin, Jean-Michel; Henry, Chantal; Etain, Bruno; Bellivier, Frank

2017-01-15

It is increasingly recognised that reliable and valid assessments of lithium response are needed in order to target more efficiently the use of this medication in bipolar disorders (BD) and to identify genotypes, endophenotypes and biomarkers of response. In a large, multi-centre, clinically representative sample of 300 cases of BD, we assess external clinical validators of lithium response phenotypes as defined using three different recommended approaches to scoring the Alda lithium response scale. The scale comprises an A scale (rating lithium response) and a B scale (assessing confounders). Analysis of the two continuous scoring methods (A scale score minus the B scale score, or A scale score in those with a low B scale score) demonstrated that 21-23% of the explained variance in lithium response was accounted for by a positive family history of BD I and the early introduction of lithium. Categorical definitions of response suggest poor response is also associated with a positive history of alcohol and/or substance use comorbidities. High B scale scores were significantly associated with longer duration of illness prior to receiving lithium and the presence of psychotic symptoms. The original sample was not recruited specifically to study lithium response. The Alda scale is designed to assess response retrospectively. This cross-validation study identifies different clinical phenotypes of lithium response when defined by continuous or categorical measures. Future clinical, genetic and biomarker studies should report both the findings and the method employed to assess lithium response according to the Alda scale. Copyright © 2016 Elsevier B.V. All rights reserved.

The dual impact of "appeal" and "researcher credibility" on mail survey response rate in the context of preventive health care.

PubMed

Angur, M G; Nataraajan, R; Chawla, S K

1994-01-01

Health and fitness centers are becoming increasingly aware of their importance in the realm of preventive health care. Many hospitals have begun to open and run fitness centers, a trend that seems very likely to continue. In a competitive environment, every center would desire to obtain maximum valid customer information at minimum cost, and this paper addresses this issue. The authors investigate the confluence of both appeal and researcher credibility on mail questionnaire response rates from a metropolitan membership of a large fitness center. Personal appeal with high researcher credibility was found to generate significantly higher response rate followed by the hybrid appeal with low researcher credibility.

Validation of Patient-Reported Outcomes Measurement Information System Short Forms for Use in Childhood-Onset Systemic Lupus Erythematosus.

PubMed

Jones, Jordan T; Carle, Adam C; Wootton, Janet; Liberio, Brianna; Lee, Jiha; Schanberg, Laura E; Ying, Jun; Morgan DeWitt, Esi; Brunner, Hermine I

2017-01-01

To validate the pediatric Patient-Reported Outcomes Measurement Information System short forms (PROMIS-SFs) in childhood-onset systemic lupus erythematosus (SLE) in a clinical setting. At 3 study visits, childhood-onset SLE patients completed the PROMIS-SFs (anger, anxiety, depressive symptoms, fatigue, physical function-mobility, physical function-upper extremity, pain interference, and peer relationships) using the PROMIS assessment center, and health-related quality of life (HRQoL) legacy measures (Pediatric Quality of Life Inventory, Childhood Health Assessment Questionnaire, Simple Measure of Impact of Lupus Erythematosus in Youngsters [SMILEY], and visual analog scales [VAS] of pain and well-being). Physicians rated childhood-onset SLE activity on a VAS and completed the Systemic Lupus Erythematosus Disease Activity Index 2000. Using a global rating scale of change (GRC) between study visits, physicians rated change of childhood-onset SLE activity (GRC-MD1: better/same/worse) and change of patient overall health (GRC-MD2: better/same/worse). Questionnaire scores were compared in support of validity and responsiveness to change (external standards: GRC-MD1, GRC-MD2). In this population-based cohort (n = 100) with a mean age of 15.8 years (range 10-20 years), the PROMIS-SFs were completed in less than 5 minutes in a clinical setting. The PROMIS-SF scores correlated at least moderately (Pearson's r ≥ 0.5) with those of legacy HRQoL measures, except for the SMILEY. Measures of childhood-onset SLE activity did not correlate with the PROMIS-SFs. Responsiveness to change of the PROMIS-SFs was supported by path, mixed-model, and correlation analyses. To assess HRQoL in childhood-onset SLE, the PROMIS-SFs demonstrated feasibility, internal consistency, construct validity, and responsiveness to change in a clinical setting. © 2016, American College of Rheumatology.

Quality of survey reporting in nephrology journals: a methodologic review.

PubMed

Li, Alvin Ho-Ting; Thomas, Sonia M; Farag, Alexandra; Duffett, Mark; Garg, Amit X; Naylor, Kyla L

2014-12-05

Survey research is an important research method used to determine individuals' attitudes, knowledge, and behaviors; however, as with other research methods, inadequate reporting threatens the validity of results. This study aimed to describe the quality of reporting of surveys published between 2001 and 2011 in the field of nephrology. The top nephrology journals were systematically reviewed (2001-2011: American Journal of Kidney Diseases, Nephrology Dialysis Transplantation, and Kidney International; 2006-2011: Clinical Journal of the American Society of Nephrology) for studies whose primary objective was to collect and report survey results. Included were nephrology journals with a heavy focus on clinical research and high impact factors. All titles and abstracts were screened in duplicate. Surveys were excluded if they were part of a multimethod study, evaluated only psychometric characteristics, or used semi-structured interviews. Information was collected on survey and respondent characteristics, questionnaire development (e.g., pilot testing), psychometric characteristics (e.g., validity and reliability), survey methods used to optimize response rate (e.g., system of multiple contacts), and response rate. After a screening of 19,970 citations, 216 full-text articles were reviewed and 102 surveys were included. Approximately 85% of studies reported a response rate. Almost half of studies (46%) discussed how they developed their questionnaire and only a quarter of studies (28%) mentioned the validity or reliability of the questionnaire. The only characteristic that improved over the years was the proportion of articles reporting missing data (2001-2004: 46.4%; 2005-2008: 61.9%; and 2009-2011: 84.8%; respectively) (P<0.01). The quality of survey reporting in nephrology journals remains suboptimal. In particular, reporting of the validity and reliability of the questionnaire must be improved. Guidelines to improve survey reporting and increase transparency are clearly needed. Copyright © 2014 by the American Society of Nephrology.

Quality appraisal of generic self-reported instruments measuring health-related productivity changes: a systematic review

PubMed Central

2014-01-01

Background Health impairments can result in disability and changed work productivity imposing considerable costs for the employee, employer and society as a whole. A large number of instruments exist to measure health-related productivity changes; however their methodological quality remains unclear. This systematic review critically appraised the measurement properties in generic self-reported instruments that measure health-related productivity changes to recommend appropriate instruments for use in occupational and economic health practice. Methods PubMed, PsycINFO, Econlit and Embase were systematically searched for studies whereof: (i) instruments measured health-related productivity changes; (ii) the aim was to evaluate instrument measurement properties; (iii) instruments were generic; (iv) ratings were self-reported; (v) full-texts were available. Next, methodological quality appraisal was based on COSMIN elements: (i) internal consistency; (ii) reliability; (iii) measurement error; (iv) content validity; (v) structural validity; (vi) hypotheses testing; (vii) cross-cultural validity; (viii) criterion validity; and (ix) responsiveness. Recommendations are based on evidence syntheses. Results This review included 25 articles assessing the reliability, validity and responsiveness of 15 different generic self-reported instruments measuring health-related productivity changes. Most studies evaluated criterion validity, none evaluated cross-cultural validity and information on measurement error is lacking. The Work Limitation Questionnaire (WLQ) was most frequently evaluated with moderate respectively strong positive evidence for content and structural validity and negative evidence for reliability, hypothesis testing and responsiveness. Less frequently evaluated, the Stanford Presenteeism Scale (SPS) showed strong positive evidence for internal consistency and structural validity, and moderate positive evidence for hypotheses testing and criterion validity. The Productivity and Disease Questionnaire (PRODISQ) yielded strong positive evidence for content validity, evidence for other properties is lacking. The other instruments resulted in mostly fair-to-poor quality ratings with limited evidence. Conclusions Decisions based on the content of the instrument, usage purpose, target country and population, and available evidence are recommended. Until high-quality studies are in place to accurately assess the measurement properties of the currently available instruments, the WLQ and, in a Dutch context, the PRODISQ are cautiously preferred based on its strong positive evidence for content validity. Based on its strong positive evidence for internal consistency and structural validity, the SPS is cautiously recommended. PMID:24495301

Validity of response assessment criteria in neoadjuvant chemotherapy for gastric cancer (JCOG0507-A).

PubMed

Kurokawa, Yukinori; Shibata, Taro; Sasako, Mitsuru; Sano, Takeshi; Tsuburaya, Akira; Iwasaki, Yoshiaki; Fukuda, Haruhiko

2014-01-01

Neoadjuvant chemotherapy may improve outcomes in gastric cancer. Tumor responses can be evaluated with RECIST, Japanese Classification of Gastric Carcinoma (JCGC), and histological criteria. These approaches have not yet been compared. We analyzed two phase II trials of neoadjuvant chemotherapy using S-1 plus cisplatin. JCOG0210 included patients with linitis plastica and large ulcero-invasive tumors, whereas JCOG0405 comprised those with para-aortic or bulky lymph node metastases. Radiologic evaluations were conducted using RECIST in JCOG0405 and JCGC criteria in JCOG0210, because the latter included many patients without measurable lesions. A histological responder was defined as a patient in whom one third or more of the tumor was affected. The hazard ratios (HR) for death between responders and non-responders and response rate differences between short- and long-term survivors were estimated. In JCOG0210 (n = 49), HR was 0.54 in JCGC responders (P = 0.059) and 0.40 in histological responders (P = 0.005). The difference in response rates between short- and long-term survivors using histological criteria (34 %, P = 0.023) was greater than that using JCGC criteria (24 %, P = 0.15). In JCOG0405 (n = 51), HR was 0.67 in RECIST responders (P = 0.35) and 0.39 in histological responders (P = 0.030). In short- and long-term survivors, respectively, RECIST response rates were 62  and 67 % (P = 0.77), whereas histological response rates were 33  and 63 % (P = 0.048). Histological criteria showed higher response assessment validity than RECIST or JCGC criteria and yielded the best surrogate endpoint for overall survival.

Validation study of a web-based assessment of functional recovery after radical prostatectomy.

PubMed

Vickers, Andrew J; Savage, Caroline J; Shouery, Marwan; Eastham, James A; Scardino, Peter T; Basch, Ethan M

2010-08-05

Good clinical care of prostate cancer patients after radical prostatectomy depends on careful assessment of post-operative morbidities, yet physicians do not always judge patient symptoms accurately. Logistical problems associated with using paper questionnaire limit their use in the clinic. We have implemented a web-interface ("STAR") for patient-reported outcomes after radical prostatectomy. We analyzed data on the first 9 months of clinical implementation to evaluate the validity of the STAR questionnaire to assess functional outcomes following radical prostatectomy. We assessed response rate, internal consistency within domains, and the association between survey responses and known predictors of sexual and urinary function, including age, time from surgery, nerve sparing status and co-morbidities. Of 1581 men sent an invitation to complete the instrument online, 1235 responded for a response rate of 78%. Cronbach's alpha was 0.84, 0.86 and 0.97 for bowel, urinary and sexual function respectively. All known predictors of sexual and urinary function were significantly associated with survey responses in the hypothesized direction. We have found that web-based assessment of functional recovery after radical prostatectomy is practical and feasible. The instrument demonstrated excellent psychometric properties, suggested that validity is maintained when questions are transferred from paper to electronic format and when patients give responses that they know will be seen by their doctor and added to their clinic record. As such, our system allows ready implementation of patient-reported outcomes into routine clinical practice.

Validation study of a web-based assessment of functional recovery after radical prostatectomy

PubMed Central

2010-01-01

Background Good clinical care of prostate cancer patients after radical prostatectomy depends on careful assessment of post-operative morbidities, yet physicians do not always judge patient symptoms accurately. Logistical problems associated with using paper questionnaire limit their use in the clinic. We have implemented a web-interface ("STAR") for patient-reported outcomes after radical prostatectomy. Methods We analyzed data on the first 9 months of clinical implementation to evaluate the validity of the STAR questionnaire to assess functional outcomes following radical prostatectomy. We assessed response rate, internal consistency within domains, and the association between survey responses and known predictors of sexual and urinary function, including age, time from surgery, nerve sparing status and co-morbidities. Results Of 1581 men sent an invitation to complete the instrument online, 1235 responded for a response rate of 78%. Cronbach's alpha was 0.84, 0.86 and 0.97 for bowel, urinary and sexual function respectively. All known predictors of sexual and urinary function were significantly associated with survey responses in the hypothesized direction. Conclusions We have found that web-based assessment of functional recovery after radical prostatectomy is practical and feasible. The instrument demonstrated excellent psychometric properties, suggested that validity is maintained when questions are transferred from paper to electronic format and when patients give responses that they know will be seen by their doctor and added to their clinic record. As such, our system allows ready implementation of patient-reported outcomes into routine clinical practice. PMID:20687938

Feasibility of using a tablet computer survey for parental assessment of resident communication skills.

PubMed

Co, John Patrick T; Mohamed, Hodon; Kelleher, Mary Louise; Edgman-Levitan, Susan; Perrin, James M

2008-01-01

The Accreditation Council for Graduate Medical Education recommends using patient surveys for assessing resident competency in interpersonal and communication skills. Despite the existence of several validated patient surveys for communication assessment, no system has been developed for their sustained use in resident assessment. We developed and pilot tested a system to collect surveys from parents of hospitalized children on the day of discharge. We used a 28-item, tablet computer-based survey that measures individual provider and team communication. The computer displays resident photographs to ensure accurate identification and offers the survey in multiple languages. We assessed parental acceptance of the system by analyzing response rate, as well as reasons for response and nonresponse. Of the 98 eligible parents that were approached, 62 (63%) completed the survey. Only 2 (2%) of the eligible families refused to participate, and only 5 (5%) refused participation because of the survey not being available in a language they were familiar with. Use of a tablet computer parent survey for resident assessment is feasible, with response rates comparable to those of mailed surveys. The low rate of parental refusal indicates our system could be used to attain sufficient numbers of survey responses to help validly measure resident communication skills.

Evaluating the Effectiveness of Rating Instruments for a Communication Skills Assessment of Medical Residents

ERIC Educational Resources Information Center

Iramaneerat, Cherdsak; Myford, Carol M.; Yudkowsky, Rachel; Lowenstein, Tali

2009-01-01

The investigators used evidence based on response processes to evaluate and improve the validity of scores on the Patient-Centered Communication and Interpersonal Skills (CIS) Scale for the assessment of residents' communication competence. The investigators retrospectively analyzed the communication skills ratings of 68 residents at the…

Adjustment and Validation of the Mathematical Prediction Model for Sweat Rate, Heart Rate and Body Temperature under Outdoor Conditions

DTIC Science & Technology

1986-11-01

Predicting rectal temperature response to work environment and clothing. J. Pppl . PhysioL. 32: 812-822, 1972. 3. Givoni B., Goldman RF: Predicting...heart rote response to work, environment and clothing. J. PppL . PhysioL. 34: 201-204, 1973. 4. Givoni B., Goldman RF: Predicting effects of heat...expenditure with loads while standing or walking very slowly. J. Pppl . Physlol. 43: 477-581, 1877. G. Shapiro Y., Pandolf KB., Breckenridge JR., Goldman RF

Circulatory and Metabolic Responses of Young Women at HR=180 and HR=MAX

ERIC Educational Resources Information Center

Humphrey, Dennis L.; Falls, Harold B.

1975-01-01

This study investigated whether the commonly used 180 heart rate termination criterion during progressive treadmill testing is valid for estimating absolute aerobic power in young healthy females. (RC)

Validating independent ratings of executive functioning following acquired brain injury using Rasch analysis.

PubMed

Simblett, Sara K; Badham, Rachel; Greening, Kate; Adlam, Anna; Ring, Howard; Bateman, Andrew

2012-01-01

Assessment of everyday problems with executive functioning following acquired brain injury (ABI) is greatly valued by neurorehabilitation services. Reliance on self-report measures alone is problematic within this client group who may experience difficulties with awareness and memory. The construct validity and reliability of independent ratings (i.e., ratings provided by a carer/relative) on the Dysexecutive Questionnaire (DEX-I) was explored in this study. Consistent with the results recently reported on the self-rated version of the DEX (DEX-S; Simblett & Bateman, 2011 ), Rasch analysis completed on 271 responses to the DEX-I revealed that the scale did not fit the Rasch model and did not meet the assumption of unidimensionality, that is, a single underlying construct could not be found for the DEX-I that would allow development of an interval-level measure as a whole. Subscales, based on theoretical conceptualisations of executive functioning (Stuss, 2007 ) previously suggested for the DEX-S, were able to demonstrate fit to the Rasch model and unidimensionality. Reliability of independent responses to these subscales in comparison to self-reported ratings is discussed. These results contribute to a greater understanding of how assessment of executive functioning can be improved.

Derivation of the MMPI-2-RF Henry-Heilbronner Index-r (HHI-r) scale.

PubMed

Henry, George K; Heilbronner, Robert L; Algina, James; Kaya, Yasemin

2013-01-01

The 15-item Henry-Heilbronner Index (HHI) was published in 2006 as an MMPI-2 embedded measure of psychological response validity. When the MMPI-2 was revised in 2008 only 11 of the 15 original HHI items were retained on the MMPI-2-RF, prohibiting use of the HHI as an embedded validity indicator on the MMPI-2-RF. Using the original HHI sample an 11-item version of the HHI, the HHI-r, was evaluated for use as an embedded measure of psychological response validity for the MMPI-2-RF. The 11-item HHI-r was very similar to the HHI in classification accuracy. An HHI-r cutoff score of ≥7 was associated with a classification accuracy rate of 84.0%, good sensitivity (68.9%), and high specificity (93.2%) in identifying symptom exaggeration in personal injury and disability litigants versus non-litigating head-injured patients. These preliminary results suggest the HHI-r functions in a manner similar to the original HHI as a measure of psychological response validity, and may be used by psychologists and neuropsychologists as an MMPI-2-RF embedded validity indicator.

[Nursing outcomes for ineffective breathing patterns and impaired spontaneous ventilation in intensive care].

PubMed

do Canto, Débora Francisco; Almeida, Miriam de Abreu

2013-12-01

This study aimed to validate the results of Nursing selected from the link NANDA-I-NOC (Nursing Outcomes Classification--NANDA--International) for diagnosis Ineffective Breathing Pattern and Impaired Spontaneous Ventilation in adult intensive care unit. This is a content validation study conducted in a university hospital in southern Brazil with 15 expert nurses with clinical experience and knowledge of the ratings. The instruments contained five-point Likert scales to rate the importance of each outcome (1st step) and indicator (Step 2) for the diagnoses studied. We calculated weighted averages for each outcome/indicator, considering) 1 = 0. 2 = 0.25, 3 = 0.50 4 = 0.75 and 5 = 1. The outcomes suggested by the NOC with averages above 0.8 were considered validated as well as the indicators. The results Respiratory State--airway permeability (Ineffective Breathing Patterns) and 11 indicators, and Response to mechanical ventilation: adult (Impaired Spontaneous Ventilation) with 26 indicators were validated.

Response rate, response time, and economic costs of survey research: A randomized trial of practicing pharmacists.

PubMed

Hardigan, Patrick C; Popovici, Ioana; Carvajal, Manuel J

2016-01-01

There is a gap between increasing demands from pharmacy journals, publishers, and reviewers for high survey response rates and the actual responses often obtained in the field by survey researchers. Presumably demands have been set high because response rates, times, and costs affect the validity and reliability of survey results. Explore the extent to which survey response rates, average response times, and economic costs are affected by conditions under which pharmacist workforce surveys are administered. A random sample of 7200 U.S. practicing pharmacists was selected. The sample was stratified by delivery method, questionnaire length, item placement, and gender of respondent for a total of 300 observations within each subgroup. A job satisfaction survey was administered during March-April 2012. Delivery method was the only classification showing significant differences in response rates and average response times. The postal mail procedure accounted for the highest response rates of completed surveys, but the email method exhibited the quickest turnaround. A hybrid approach, consisting of a combination of postal and electronic means, showed the least favorable results. Postal mail was 2.9 times more cost effective than the email approach and 4.6 times more cost effective than the hybrid approach. Researchers seeking to increase practicing pharmacists' survey participation and reduce response time and related costs can benefit from the analytical procedures tested here. Copyright © 2016 Elsevier Inc. All rights reserved.

A systematic review of the measurement properties of the European Organisation for Research and Treatment of Cancer In-patient Satisfaction with Care Questionnaire, the EORTC IN-PATSAT32.

PubMed

Neijenhuijs, Koen I; Jansen, Femke; Aaronson, Neil K; Brédart, Anne; Groenvold, Mogens; Holzner, Bernhard; Terwee, Caroline B; Cuijpers, Pim; Verdonck-de Leeuw, Irma M

2018-05-07

The EORTC IN-PATSAT32 is a patient-reported outcome measure (PROM) to assess cancer patients' satisfaction with in-patient health care. The aim of this study was to investigate whether the initial good measurement properties of the IN-PATSAT32 are confirmed in new studies. Within the scope of a larger systematic review study (Prospero ID 42017057237), a systematic search was performed of Embase, Medline, PsycINFO, and Web of Science for studies that investigated measurement properties of the IN-PATSAT32 up to July 2017. Study quality was assessed, data were extracted, and synthesized according to the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) methodology. Nine studies were included in this review. The evidence on reliability and construct validity were rated as sufficient and of the quality of the evidence as moderate. The evidence on structural validity was rated as insufficient and of low quality. The evidence on internal consistency was indeterminate. Measurement error, responsiveness, criterion validity, and cross-cultural validity were not reported in the included studies. Measurement error could be calculated for two studies and was judged indeterminate. In summary, the IN-PATSAT32 performs as expected with respect to reliability and construct validity. No firm conclusions can be made yet whether the IN-PATSAT32 also performs as well with respect to structural validity and internal consistency. Further research on these measurement properties of the PROM is therefore needed as well as on measurement error, responsiveness, criterion validity, and cross-cultural validity. For future studies, it is recommended to take the COSMIN methodology into account.

Perceptions of medical school graduates and students regarding their academic preparation to teach.

PubMed

Henry, B W; Haworth, J G; Hering, P

2006-09-01

How medical students learn and develop the characteristics associated with good teaching in medicine is not well known. Information about this process can improve the academic preparation of medical students for teaching responsibilities. The purpose of this study was to determine how different experiences contributed to the knowledge, skills, and attitudes of medical school graduates and students regarding medical teaching. A questionnaire was developed, addressing reliability and validity considerations, and given to first year residents and third year medical students (taught by those residents). Completed questionnaires were collected from 76 residents and 110 students (81% of the sample group). Item responses were analysed using descriptive and inferential statistics. Most residents (n = 54; 71%) positively viewed opportunities they had to practice teaching when they were seniors. Residents rated three activities for learning to teach highest: (1) observing teachers as they teach; (2) reviewing the material to be taught; and (3) directly teaching students; representing both individual and participatory ways of learning. Residents' self ratings of teaching behaviours improved over time and this self assessment by the residents was validated by the students' responses. Comparison between residents' self ratings and students' views of typical resident teaching behaviours showed agreement on levels of competence, confidence, and motivation. The students rated characteristics of enthusiasm, organisation, and fulfilment lower (p<0.002) than residents rated themselves. The residents and students in this study viewed academic preparation for teaching responsibilities positively and showed agreement on characteristics of good teaching that may be helpful indicators in the process of developing medical teachers.

Assistive technology to help persons in a minimally conscious state develop responding and stimulation control: Performance assessment and social rating.

PubMed

Lancioni, Giulio E; Singh, Nirbhay N; O'Reilly, Mark F; Sigafoos, Jeff; D'Amico, Fiora; Buonocunto, Francesca; Navarro, Jorge; Lanzilotti, Crocifissa; Fiore, Piero; Megna, Marisa; Damiani, Sabino

2015-01-01

Post-coma persons in a minimally conscious state (MCS) and with extensive motor impairment and lack of speech tend to be passive and isolated. This study aimed to (a) further assess a technology-aided approach for fostering MCS participants' responding and stimulation control and (b) carry out a social validation check about the approach. Eight MCS participants were exposed to the aforementioned approach according to an ABAB design. The technology included optic, pressure or touch microswitches to monitor eyelid, hand or finger responses and a computer system that allowed those responses to produce brief periods of positive stimulation during the B (intervention) phases of the study. Eighty-four university psychology students and 42 care and health professionals were involved in the social validation check. The MCS participants showed clear increases in their response frequencies, thus producing increases in their levels of environmental stimulation input, during the B phases of the study. The students and care and health professionals involved in the social validation check rated the technology-aided approach more positively than a control condition in which stimulation was automatically presented to the participants. A technology-aided approach to foster responding and stimulation control in MCS persons may be effective and socially desirable.

Using Rasch rating scale model to reassess the psychometric properties of the Persian version of the PedsQLTM 4.0 Generic Core Scales in school children

PubMed Central

2012-01-01

Background Item response theory (IRT) is extensively used to develop adaptive instruments of health-related quality of life (HRQoL). However, each IRT model has its own function to estimate item and category parameters, and hence different results may be found using the same response categories with different IRT models. The present study used the Rasch rating scale model (RSM) to examine and reassess the psychometric properties of the Persian version of the PedsQLTM 4.0 Generic Core Scales. Methods The PedsQLTM 4.0 Generic Core Scales was completed by 938 Iranian school children and their parents. Convergent, discriminant and construct validity of the instrument were assessed by classical test theory (CTT). The RSM was applied to investigate person and item reliability, item statistics and ordering of response categories. Results The CTT method showed that the scaling success rate for convergent and discriminant validity were 100% in all domains with the exception of physical health in the child self-report. Moreover, confirmatory factor analysis supported a four-factor model similar to its original version. The RSM showed that 22 out of 23 items had acceptable infit and outfit statistics (<1.4, >0.6), person reliabilities were low, item reliabilities were high, and item difficulty ranged from -1.01 to 0.71 and -0.68 to 0.43 for child self-report and parent proxy-report, respectively. Also the RSM showed that successive response categories for all items were not located in the expected order. Conclusions This study revealed that, in all domains, the five response categories did not perform adequately. It is not known whether this problem is a function of the meaning of the response choices in the Persian language or an artifact of a mostly healthy population that did not use the full range of the response categories. The response categories should be evaluated in further validation studies, especially in large samples of chronically ill patients. PMID:22414135

Listening to urban soundscapes: Physiological validity of perceptual dimensions.

PubMed

Irwin, Amy; Hall, Deborah A; Peters, Andrew; Plack, Christopher J

2011-02-01

Predominantly, the impact of environmental noise is measured using sound level, ignoring the influence of other factors on subjective experience. The present study tested physiological responses to natural urban soundscapes, using functional magnetic resonance imaging and vector cardiogram. City-based recordings were matched in overall sound level (71 decibel A-weighted scale), but differed on ratings of pleasantness and vibrancy. Listening to soundscapes evoked significant activity in a number of auditory brain regions. Compared with soundscapes that evoked no (neutral) emotional response, those evoking a pleasant or unpleasant emotional response engaged an additional neural circuit including the right amygdala. Ratings of vibrancy had little effect overall, and brain responses were more sensitive to pleasantness than was heart rate. A novel finding is that urban soundscapes with similar loudness can have dramatically different effects on the brain's response to the environment. Copyright © 2010 Society for Psychophysiological Research.

Nomogram predicting response after chemoradiotherapy in rectal cancer using sequential PETCT imaging: a multicentric prospective study with external validation.

PubMed

van Stiphout, Ruud G P M; Valentini, Vincenzo; Buijsen, Jeroen; Lammering, Guido; Meldolesi, Elisa; van Soest, Johan; Leccisotti, Lucia; Giordano, Alessandro; Gambacorta, Maria A; Dekker, Andre; Lambin, Philippe

2014-11-01

To develop and externally validate a predictive model for pathologic complete response (pCR) for locally advanced rectal cancer (LARC) based on clinical features and early sequential (18)F-FDG PETCT imaging. Prospective data (i.a. THUNDER trial) were used to train (N=112, MAASTRO Clinic) and validate (N=78, Università Cattolica del S. Cuore) the model for pCR (ypT0N0). All patients received long-course chemoradiotherapy (CRT) and surgery. Clinical parameters were age, gender, clinical tumour (cT) stage and clinical nodal (cN) stage. PET parameters were SUVmax, SUVmean, metabolic tumour volume (MTV) and maximal tumour diameter, for which response indices between pre-treatment and intermediate scan were calculated. Using multivariate logistic regression, three probability groups for pCR were defined. The pCR rates were 21.4% (training) and 23.1% (validation). The selected predictive features for pCR were cT-stage, cN-stage, response index of SUVmean and maximal tumour diameter during treatment. The models' performances (AUC) were 0.78 (training) and 0.70 (validation). The high probability group for pCR resulted in 100% correct predictions for training and 67% for validation. The model is available on the website www.predictcancer.org. The developed predictive model for pCR is accurate and externally validated. This model may assist in treatment decisions during CRT to select complete responders for a wait-and-see policy, good responders for extra RT boost and bad responders for additional chemotherapy. Copyright © 2014 The Authors. Published by Elsevier Ireland Ltd.. All rights reserved.

Treatment Acceptability of Behavioral Interventions for Children: An Assessment by Mothers of Children with Disruptive Behavior Disorders.

ERIC Educational Resources Information Center

Jones, Melanie L.; Eyberg, Sheila M.; Adams, Christina D.; Boggs, Stephen R.

1998-01-01

Study assesses the acceptability of six child-management interventions as rated by mothers (N=20) of children referred for treatment for a disruptive-behavior disorder. Positive reinforcement was rated as a more acceptable treatment than response time, time-out, differential attention, overcorrection, and spanking. Results validate findings of…

Sensory Over-Responsivity, Psychopathology, and Family Impairment in School-Aged Children

ERIC Educational Resources Information Center

Carter, Alice S.; Ben-Sasson, Ayelet; Briggs-Gowan, Margaret J.

2011-01-01

Objective: To establish the diagnostic validity of sensory overresponsivity (SOR), there is a need to document rates of SOR and the co-occurrence of SOR with other psychiatric disorders. Although this was not a diagnostic study of SOR, this study was designed to investigate rates of elevated SOR symptoms and associations between elevated SOR…

Automated Pilot Performance Assessment in the T-37: A Feasibility Study. Final Report (May 1968-April 1971).

ERIC Educational Resources Information Center

Knoop, Patricia A.; Welde, William L.

Air Force investigators conducted a three year program to develop a capability for automated quantification and assessment of in-flight pilot performance. Such a capability enhances pilot training by making ratings more objective, valid, reliable and sensitive, and by freeing instructors from rating responsibilities, allowing them to concentrate…

Moving beyond Means: Revealing Features of the Learning Environment by Investigating the Consensus among Student Ratings

ERIC Educational Resources Information Center

Schweig, Jonathan David

2016-01-01

Student ratings, a critical component in policy efforts to assess and improve teaching, are often collected using questionnaires, and inferences about teachers are then based on aggregated student survey responses. While considerable attention has been paid to the reliability and validity of these aggregates, much less attention has been paid to…

Patient-Reported Outcome Measures for Hand and Wrist Trauma

PubMed Central

Dacombe, Peter Jonathan; Amirfeyz, Rouin; Davis, Tim

2016-01-01

Background: Patient-reported outcome measures (PROMs) are important tools for assessing outcomes following injuries to the hand and wrist. Many commonly used PROMs have no evidence of reliability, validity, and responsiveness in a hand and wrist trauma population. This systematic review examines the PROMs used in the assessment of hand and wrist trauma patients, and the evidence for reliability, validity, and responsiveness of each measure in this population. Methods: A systematic review of Pubmed, Medline, and CINAHL searching for randomized controlled trials of patients with traumatic injuries to the hand and wrist was carried out to identify the PROMs. For each identified PROM, evidence of reliability, validity, and responsiveness was identified using a further systematic review of the Pubmed, Medline, CINAHL, and reverse citation trail audit procedure. Results: The PROM used most often was the Disabilities of the Arm, Shoulder and Hand (DASH) questionnaire; the Patient-Rated Wrist Evaluation (PRWE), Gartland and Werley score, Michigan Hand Outcomes score, Mayo Wrist Score, and Short Form 36 were also commonly used. Only the DASH and PRWE have evidence of reliability, validity, and responsiveness in patients with traumatic injuries to the hand and wrist; other measures either have incomplete evidence or evidence gathered in a nontraumatic population. Conclusions: The DASH and PRWE both have evidence of reliability, validity, and responsiveness in a hand and wrist trauma population. Other PROMs used to assess hand and wrist trauma patients do not. This should be considered when selecting a PROM for patients with traumatic hand and wrist pathology. PMID:27418884

Complexity of GPs' explanations about mental health problems: development, reliability, and validity of a measure

PubMed Central

Cape, John; Morris, Elena; Burd, Mary; Buszewicz, Marta

2008-01-01

Background How GPs understand mental health problems determines their treatment choices; however, measures describing GPs' thinking about such problems are not currently available. Aim To develop a measure of the complexity of GP explanations of common mental health problems and to pilot its reliability and validity. Design of study A qualitative development of the measure, followed by inter-rater reliability and validation pilot studies. Setting General practices in North London. Method Vignettes of simulated consultations with patients with mental health problems were videotaped, and an anchored measure of complexity of psychosocial explanation in response to these vignettes was developed. Six GPs, four psychologists, and two lay people viewed the vignettes. Their responses were rated for complexity, both using the anchored measure and independently by two experts in primary care mental health. In a second reliability and revalidation study, responses of 50 GPs to two vignettes were rated for complexity. The GPs also completed a questionnaire to determine their interest and training in mental health, and they completed the Depression Attitudes Questionnaire. Results Inter-rater reliability of the measure of complexity of explanation in both pilot studies was satisfactory (intraclass correlation coefficient = 0.78 and 0.72). The measure correlated with expert opinion as to what constitutes a complex explanation, and the responses of psychologists, GPs, and lay people differed in measured complexity. GPs with higher complexity scores had greater interest, more training in mental health, and more positive attitudes to depression. Conclusion Results suggest that the complexity of GPs' psychosocial explanations about common mental health problems can be reliably and validly assessed by this new standardised measure. PMID:18505616

The modified gait abnormality rating scale in patients with a conversion disorder: a reliability and responsiveness study.

PubMed

Vandenberg, Justin M; George, Deanna R; O'Leary, Andrea J; Olson, Lindsay C; Strassburg, Kaitlyn R; Hollman, John H

2015-01-01

Individuals with conversion disorder have neurologic symptoms that are not identified by an underlying organic cause. Often the symptoms manifest as gait disturbances. The modified gait abnormality rating scale (GARS-M) may be useful for quantifying gait abnormalities in these individuals. The purpose of this study was to examine the reliability, responsiveness and concurrent validity of GARS-M scores in individuals with conversion disorder. Data from 27 individuals who completed a rehabilitation program were included in this study. Pre- and post-intervention videos were obtained and walking speed was measured. Five examiners independently evaluated gait performance according to the GARS-M criteria. Inter- and intrarater reliability of GARS-M scores were estimated with intraclass correlation coefficients (ICCs). Responsiveness was estimated with the minimum detectable change (MDC). Pre- to post-treatment changes in GARS-M scores were analyzed with a dependent t-test. The correlation between GARS-M scores and walking speed was analyzed to assess concurrent validity. GARS-M scores were quantified with good-to-excellent inter- (ICC = 0.878) and intrarater reliability (ICC = 0.989). The MDC was 2 points. Mean GARS-M scores decreased from 7 ± 5 at baseline to 1 ± 2 at discharge (t26 = 7.411, p < 0.001) and 85% of patients improved beyond the MDC. Furthermore, GARS-M scores and walking speed measurements were moderately correlated (r = -0.582, p = 0.004), indicating that the GARS-M has acceptable concurrent validity. Our findings provide evidence that the GARS-M scores are reliable, valid and responsive for quantifying gait abnormalities in patients with conversion disorder. GARS-M scores provide objective measures upon which treatment effects can be assessed. Copyright © 2014 Elsevier B.V. All rights reserved.

Validation of a short form of the Western Ontario and McMaster Universities Osteoarthritis Index function subscale in hip and knee osteoarthritis.

PubMed

Baron, Gabriel; Tubach, Florence; Ravaud, Philippe; Logeart, Isabelle; Dougados, Maxime

2007-05-15

A short version of the Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC) function scale has recently been developed to enhance the applicability of the scale in routine practice and clinical research for patients with hip and knee osteoarthritis. The goal of the present study was to validate this short form. We conducted a prospective 4-week cohort study of 1,036 outpatients. Performance on the WOMAC function long form (LF) and short form (SF) was compared. Agreement between responses on the 2 forms was examined according to a Bland-Altman plot. Responsiveness to change (by standardized response mean [SRM]), reproducibility (intraclass correlation coefficient [ICC]), and internal consistency (Cronbach's alpha) were computed for both forms. Construct validity was assessed based on functional impairment as measured on a numerical rating scale. At baseline, 24% of patients who completed the WOMAC LF had missing data for at least 1 item as compared with only 6% of patients who completed the WOMAC SF. The mean WOMAC SF score was greater than the mean WOMAC LF score (mean +/- SD difference -4.3 +/- 4.8 on a 0-100 scale). SRMs were 0.61 and 0.73, ICCs were 0.76 and 0.68, and Cronbach's alphas were 0.93 and 0.85 for the WOMAC LF and SF, respectively. The 2 forms had comparable correlation with functional impairment. The WOMAC function short form has a low rate of missing data and is a responsive, reproducible, and valid measure. The mean SF score was 4 points higher than the mean LF score.

Translation, Cross-Cultural Adaptation, and Validation of the Activity Rating Scale for Disorders of the Knee.

PubMed

Flosadottir, Vala; Roos, Ewa M; Ageberg, Eva

2017-09-01

The Activity Rating Scale (ARS) for disorders of the knee evaluates the level of activity by the frequency of participation in 4 separate activities with high demands on knee function, with a score ranging from 0 (none) to 16 (pivoting activities 4 times/wk). To translate and cross-culturally adapt the ARS into Swedish and to assess measurement properties of the Swedish version of the ARS. Cohort study (diagnosis); Level of evidence, 2. The COSMIN guidelines were followed. Participants (N = 100 [55 women]; mean age, 27 years) who were undergoing rehabilitation for a knee injury completed the ARS twice for test-retest reliability. The Knee injury and Osteoarthritis Outcome Score (KOOS), Tegner Activity Scale (TAS), and modernized Saltin-Grimby Physical Activity Level Scale (SGPALS) were administered at baseline to validate the ARS. Construct validity and responsiveness of the ARS were evaluated by testing predefined hypotheses regarding correlations between the ARS, KOOS, TAS, and SGPALS. The Cronbach alpha, intraclass correlation coefficients, absolute reliability, standard error of measurement, smallest detectable change, and Spearman rank-order correlation coefficients were calculated. The ARS showed good internal consistency (α ≈ 0.96), good test-retest reliability (intraclass correlation coefficient >0.9), and no systematic bias between measurements. The standard error of measurement was less than 2 points, and the smallest detectable change was less than 1 point at the group level and less than 5 points at the individual level. More than 75% of the hypotheses were confirmed, indicating good construct validity and good responsiveness of the ARS. The Swedish version of the ARS is valid, reliable, and responsive for evaluating the level of activity based on the frequency of participation in high-demand knee sports activities in young adults with a knee injury.

Reinstatement of contextual conditioned anxiety in virtual reality and the effects of transcutaneous vagus nerve stimulation in humans.

PubMed

Genheimer, Hannah; Andreatta, Marta; Asan, Esther; Pauli, Paul

2017-12-20

Since exposure therapy for anxiety disorders incorporates extinction of contextual anxiety, relapses may be due to reinstatement processes. Animal research demonstrated more stable extinction memory and less anxiety relapse due to vagus nerve stimulation (VNS). We report a valid human three-day context conditioning, extinction and return of anxiety protocol, which we used to examine effects of transcutaneous VNS (tVNS). Seventy-five healthy participants received electric stimuli (unconditioned stimuli, US) during acquisition (Day1) when guided through one virtual office (anxiety context, CTX+) but never in another (safety context, CTX-). During extinction (Day2), participants received tVNS, sham, or no stimulation and revisited both contexts without US delivery. On Day3, participants received three USs for reinstatement followed by a test phase. Successful acquisition, i.e. startle potentiation, lower valence, higher arousal, anxiety and contingency ratings in CTX+ versus CTX-, the disappearance of these effects during extinction, and successful reinstatement indicate validity of this paradigm. Interestingly, we found generalized reinstatement in startle responses and differential reinstatement in valence ratings. Altogether, our protocol serves as valid conditioning paradigm. Reinstatement effects indicate different anxiety networks underlying physiological versus verbal responses. However, tVNS did neither affect extinction nor reinstatement, which asks for validation and improvement of the stimulation protocol.

Recruiting general practitioners for surveys: reflections on the difficulties and some lessons learned.

PubMed

Parkinson, Anne; Jorm, Louisa; Douglas, Kirsty A; Gee, Alison; Sargent, Ginny M; Lujic, Sanja; McRae, Ian S

2015-01-01

Surveys of GPs are essential to facilitate future planning and delivery of health services. However, recruitment of GPs into research has been disappointing with response rates declining over recent years. This study identified factors that facilitated or hampered GP recruitment in a recent survey of Australian GPs where a range of strategies were used to improve recruitment following poor initial responses. GP response rates for different stages of the survey were examined and compared with reasons GPs and leaders of university research networks cited for non-participation. Poor initial response rates were improved by including a questionnaire in the mail-out, changing the mail-out source from an unknown research team to locally known network leaders, approaching a group of GPs known to have research and training interests, and offering financial compensation. Response rates increased from below 1% for the first wave to 14.5% in the final wave. Using a known and trusted network of professionals to endorse the survey combined with an explicit compensation payment significantly enhanced GP response rates. To obtain response rates for surveys of GPs that are high enough to sustain external validity requires an approach that persuades GPs and their gatekeepers that it is worth their time to participate.

Experimental Validation of ARFI Surveillance of Subcutaneous Hemorrhage (ASSH) Using Calibrated Infusions in a Tissue-Mimicking Model and Dogs.

PubMed

Geist, Rebecca E; DuBois, Chase H; Nichols, Timothy C; Caughey, Melissa C; Merricks, Elizabeth P; Raymer, Robin; Gallippi, Caterina M

2016-09-01

Acoustic radiation force impulse (ARFI) Surveillance of Subcutaneous Hemorrhage (ASSH) has been previously demonstrated to differentiate bleeding phenotype and responses to therapy in dogs and humans, but to date, the method has lacked experimental validation. This work explores experimental validation of ASSH in a poroelastic tissue-mimic and in vivo in dogs. The experimental design exploits calibrated flow rates and infusion durations of evaporated milk in tofu or heparinized autologous blood in dogs. The validation approach enables controlled comparisons of ASSH-derived bleeding rate (BR) and time to hemostasis (TTH) metrics. In tissue-mimicking experiments, halving the calibrated flow rate yielded ASSH-derived BRs that decreased by 44% to 48%. Furthermore, for calibrated flow durations of 5.0 minutes and 7.0 minutes, average ASSH-derived TTH was 5.2 minutes and 7.0 minutes, respectively, with ASSH predicting the correct TTH in 78% of trials. In dogs undergoing calibrated autologous blood infusion, ASSH measured a 3-minute increase in TTH, corresponding to the same increase in the calibrated flow duration. For a measured 5% decrease in autologous infusion flow rate, ASSH detected a 7% decrease in BR. These tissue-mimicking and in vivo preclinical experimental validation studies suggest the ASSH BR and TTH measures reflect bleeding dynamics. © The Author(s) 2015.

[Measurement properties of self-report questionnaires published in Korean nursing journals].

PubMed

Lee, Eun-Hyun; Kim, Chun-Ja; Kim, Eun Jung; Chae, Hyun-Ju; Cho, Soo-Yeon

2013-02-01

The purpose of this study was to evaluate measurement properties of self-report questionnaires for studies published in Korean nursing journals. Of 424 Korean nursing articles initially identified, 168 articles met the inclusion criteria. The methodological quality of the measurements used in the studies and interpretability were assessed using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. It consists of items on internal consistency, reliability, measurement error, content validity, construct validity including structural validity, hypothesis testing, cross-cultural validity, and criterion validity, and responsiveness. For each item of the COSMIN checklist, measurement properties are rated on a four-point scale: excellent, good, fair, and poor. Each measurement property is scored with worst score counts. All articles used the classical test theory for measurement properties. Internal consistency (72.6%), construct validity (56.5%), and content validity (38.2%) were most frequently reported properties being rated as 'excellent' by COSMIN checklist, whereas other measurement properties were rarely reported. A systematic review of measurement properties including interpretability of most instruments warrants further research and nursing-focused checklists assessing measurement properties should be developed to facilitate intervention outcomes across Korean studies.

Getting a Valid Survey Response From 662 Plastic Surgeons in the 21st Century.

PubMed

Reinisch, John F; Yu, Daniel C; Li, Wai-Yee

2016-01-01

Web-based surveys save time and money. As electronic questionnaires have increased in popularity, telephone and mailed surveys have declined. With any survey, a response rate of 75% or greater is critical for the validity of any study. We wanted to determine which survey method achieved the highest response among academic plastic surgeons. All American Association of Plastic Surgeons members were surveyed regarding authorship issues. They were randomly assigned to receive the questionnaire through 1 of 4 methods: (A) emailed with a link to an online survey; (B) regular mail; (C) regular mail + $1 bill, and (D) regular mail + $5 bill. Two weeks after the initial mailing, the number of responses was collected, and nonresponders were contacted to remind them to participate. The study was closed after 10 weeks. Survey costs were calculated based on the actual cost of sending the initial survey, including stationary, printing, postage (groups B-D), labor, and cost of any financial incentives. Cost of reminders to nonresponders was calculated at $5 per reminder, giving a total survey cost. Of 662 surveys sent, 54 were returned because of incorrect address/email, retirement, or death. Four hundred seventeen of the remaining 608 surveys were returned and analyzed. The response rate was lowest in the online group and highest in those mailed with a monetary incentive. Despite the convenience and low initial cost of web-based surveys, this generated the lowest response. We obtained statistically significant response rates (79% and 84%) only by using postal mail with monetary incentives and reminders. The inclusion of a $1 bill represented the greatest value and cost-effective survey method, based on cost per response.

Reliability, Validity, and Responsiveness of InFLUenza Patient-Reported Outcome (FLU-PRO©) Scores in Influenza-Positive Patients.

PubMed

Powers, John H; Bacci, Elizabeth D; Guerrero, M Lourdes; Leidy, Nancy Kline; Stringer, Sonja; Kim, Katherine; Memoli, Matthew J; Han, Alison; Fairchok, Mary P; Chen, Wei-Ju; Arnold, John C; Danaher, Patrick J; Lalani, Tahaniyat; Ridoré, Michelande; Burgess, Timothy H; Millar, Eugene V; Hernández, Andrés; Rodríguez-Zulueta, Patricia; Smolskis, Mary C; Ortega-Gallegos, Hilda; Pett, Sarah; Fischer, William; Gillor, Daniel; Macias, Laura Moreno; DuVal, Anna; Rothman, Richard; Dugas, Andrea; Ruiz-Palacios, Guillermo M

2018-02-01

To assess the reliability, validity, and responsiveness of InFLUenza Patient-Reported Outcome (FLU-PRO©) scores for quantifying the presence and severity of influenza symptoms. An observational prospective cohort study of adults (≥18 years) with influenza-like illness in the United States, the United Kingdom, Mexico, and South America was conducted. Participants completed the 37-item draft FLU-PRO daily for up to 14 days. Item-level and factor analyses were used to remove items and determine factor structure. Reliability of the final tool was estimated using Cronbach α and intraclass correlation coefficients (2-day reliability). Convergent and known-groups validity and responsiveness were assessed using global assessments of influenza severity and return to usual health. Of the 536 patients enrolled, 221 influenza-positive subjects comprised the analytical sample. The mean age of the patients was 40.7 years, 60.2% were women, and 59.7% were white. The final 32-item measure has six factors/domains (nose, throat, eyes, chest/respiratory, gastrointestinal, and body/systemic), with a higher order factor representing symptom severity overall (comparative fit index = 0.92; root mean square error of approximation = 0.06). Cronbach α was high (total = 0.92; domain range = 0.71-0.87); test-retest reliability (intraclass correlation coefficient, day 1-day 2) was 0.83 for total scores and 0.57 to 0.79 for domains. Day 1 FLU-PRO domain and total scores were moderately to highly correlated (≥0.30) with Patient Global Rating of Flu Severity (except nose and throat). Consistent with known-groups validity, scores differentiated severity groups on the basis of global rating (total: F = 57.2, P < 0.001; domains: F = 8.9-67.5, P < 0.001). Subjects reporting return to usual health showed significantly greater (P < 0.05) FLU-PRO score improvement by day 7 than did those who did not, suggesting score responsiveness. Results suggest that FLU-PRO scores are reliable, valid, and responsive to change in influenza-positive adults. Copyright © 2018 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Synaptic dynamics contribute to long-term single neuron response fluctuations.

PubMed

Reinartz, Sebastian; Biro, Istvan; Gal, Asaf; Giugliano, Michele; Marom, Shimon

2014-01-01

Firing rate variability at the single neuron level is characterized by long-memory processes and complex statistics over a wide range of time scales (from milliseconds up to several hours). Here, we focus on the contribution of non-stationary efficacy of the ensemble of synapses-activated in response to a given stimulus-on single neuron response variability. We present and validate a method tailored for controlled and specific long-term activation of a single cortical neuron in vitro via synaptic or antidromic stimulation, enabling a clear separation between two determinants of neuronal response variability: membrane excitability dynamics vs. synaptic dynamics. Applying this method we show that, within the range of physiological activation frequencies, the synaptic ensemble of a given neuron is a key contributor to the neuronal response variability, long-memory processes and complex statistics observed over extended time scales. Synaptic transmission dynamics impact on response variability in stimulation rates that are substantially lower compared to stimulation rates that drive excitability resources to fluctuate. Implications to network embedded neurons are discussed.

[Response rate, missing values, validity and reproducibility of responses in mark-sheet and conventional questionnaires].

PubMed

Tsubono, Y; Fukao, A; Hisamichi, S

1994-06-01

A self-administered questionnaire using the mark-sheet method (MSM), in which responses of subjects are computer processed directly through an optical scanning device, has recently been utilized in epidemiologic surveys. Compared to the data coding process for a conventional questionnaire, in which a keypuncher enters the responses manually into a computer (manual method; MM), optical scanning requires less time and cost. Accuracy of the MSM for use in the general population in Japan, however, remains uncertain. Therefore the response rates, frequencies of missing values, validity and reproducibility of the answers in self-administered questionnaires were compared between the MSM and MM. Subjects were 463 residents aged 40-69 years living in 6 local districts of a rural town in northeastern Japan. They were randomly allocated, by district basis, to the MSM group (n = 242) or the MM group (n = 221). The questionnaire was delivered and collected at the subject's home by volunteers. Two weeks after collecting the original questionnaire, the same type of questionnaire was again distributed to half of the responders randomly chosen to investigate reproducibility. The overall response rate did not differ in MSM and MM (96.7% vs 98.2%, p = 0.312). Among questions with a multiple-choice type of answer, proportions of missing values were not different for most of the items, but it was lower in MSM for all of the 33 food frequency items. Reproducibilities of food frequency items measured by Spearman's rank correlation did not differ substantially in two groups.(ABSTRACT TRUNCATED AT 250 WORDS)

Measuring End-of-Life Care Processes in Nursing Homes

ERIC Educational Resources Information Center

Temkin-Greener, Helena; Zheng, Nan; Norton, Sally A.; Quill, Timothy; Ladwig, Susan; Veazie, Peter

2009-01-01

Purpose: The objectives of this study were to develop measures of end-of-life (EOL) care processes in nursing homes and to validate the instrument for measuring them. Design and Methods: A survey of directors of nursing was conducted in 608 eligible nursing homes in New York State. Responses were obtained from 313 (51.5% response rate) facilities.…

Reliability and Validity of the Zephyr[TM] BioHarness[TM] to Measure Respiratory Responses to Exercise

ERIC Educational Resources Information Center

Hailstone, Jono; Kilding, Andrew E.

2011-01-01

The Zephyr[TM] BioHarness[TM] (Zephyr Technology, Auckland, New Zealand) is a wireless physiological monitoring system that has the ability to measure respiratory rate unobtrusively. However, the ability of the BioHarness[TM] to accurately and reproducibly determine respiratory rate across a range of intensities is currently unknown. The aim of…

Metacognition and abstract reasoning.

PubMed

Markovits, Henry; Thompson, Valerie A; Brisson, Janie

2015-05-01

The nature of people's meta-representations of deductive reasoning is critical to understanding how people control their own reasoning processes. We conducted two studies to examine whether people have a metacognitive representation of abstract validity and whether familiarity alone acts as a separate metacognitive cue. In Study 1, participants were asked to make a series of (1) abstract conditional inferences, (2) concrete conditional inferences with premises having many potential alternative antecedents and thus specifically conducive to the production of responses consistent with conditional logic, or (3) concrete problems with premises having relatively few potential alternative antecedents. Participants gave confidence ratings after each inference. Results show that confidence ratings were positively correlated with logical performance on abstract problems and concrete problems with many potential alternatives, but not with concrete problems with content less conducive to normative responses. Confidence ratings were higher with few alternatives than for abstract content. Study 2 used a generation of contrary-to-fact alternatives task to improve levels of abstract logical performance. The resulting increase in logical performance was mirrored by increases in mean confidence ratings. Results provide evidence for a metacognitive representation based on logical validity, and show that familiarity acts as a separate metacognitive cue.

Validation of catchment models for predicting land-use and climate change impacts. 2. Case study for a Mediterranean catchment

NASA Astrophysics Data System (ADS)

Parkin, G.; O'Donnell, G.; Ewen, J.; Bathurst, J. C.; O'Connell, P. E.; Lavabre, J.

1996-02-01

Validation methods commonly used to test catchment models are not capable of demonstrating a model's fitness for making predictions for catchments where the catchment response is not known (including hypothetical catchments, and future conditions of existing catchments which are subject to land-use or climate change). This paper describes the first use of a new method of validation (Ewen and Parkin, 1996. J. Hydrol., 175: 583-594) designed to address these types of application; the method involves making 'blind' predictions of selected hydrological responses which are considered important for a particular application. SHETRAN (a physically based, distributed catchment modelling system) is tested on a small Mediterranean catchment. The test involves quantification of the uncertainty in four predicted features of the catchment response (continuous hydrograph, peak discharge rates, monthly runoff, and total runoff), and comparison of observations with the predicted ranges for these features. The results of this test are considered encouraging.

Validation of new psychosocial factors questionnaires: a Colombian national study.

PubMed

Villalobos, Gloria H; Vargas, Angélica M; Rondón, Martin A; Felknor, Sarah A

2013-01-01

The study of workers' health problems possibly associated with stressful conditions requires valid and reliable tools for monitoring risk factors. The present study validates two questionnaires to assess psychosocial risk factors for stress-related illnesses within a sample of Colombian workers. The validation process was based on a representative sample survey of 2,360 Colombian employees, aged 18-70 years. Worker response rate was 90%; 46% of the responders were women. Internal consistency was calculated, construct validity was tested with factor analysis and concurrent validity was tested with Spearman correlations. The questionnaires demonstrated adequate reliability (0.88-0.95). Factor analysis confirmed the dimensions proposed in the measurement model. Concurrent validity resulted in significant correlations with stress and health symptoms. "Work and Non-work Psychosocial Factors Questionnaires" were found to be valid and reliable for the assessment of workers' psychosocial factors, and they provide information for research and intervention. Copyright © 2012 Wiley Periodicals, Inc.

Linguistic validation of the US Spanish work productivity and activity impairment questionnaire, general health version.

PubMed

Gawlicki, Mary C; Reilly, Margaret C; Popielnicki, Ana; Reilly, Kate

2006-01-01

There are no measures of health-related absenteeism and presenteeism validated for use in the large and increasing US Spanish-speaking population. Before using a Spanish translation of an available English-language questionnaire, the linguistic validity of the Spanish version must be established to ensure its conceptual equivalence to the original and its cultural appropriateness. The objective of this study was to evaluate the linguistic validity of the US Spanish version of the Work Productivity and Activity Impairment questionnaire, General Health Version (WPAI:GH). A US Spanish translation of the US English WPAI:GH was created through a reiterative process of creating harmonized forward and back translations by independent translators. Spanish-speaking and English-speaking subjects residing in the US self-administered the WPAI:GH in their primary language and were subsequently debriefed by a bilingual (Spanish-English) interviewer. US Spanish subjects (N = 31) and English subjects (N = 35), stratified equally by educational level, with and without a high school degree participated in the study. The WPAI-GH item comprehension rate was 98.6% for Spanish and 99.6% for English. Response revision rates during debriefing were 1.6% for Spanish and 0.5% for English. Responses to hypothetical scenarios indicated that both language versions adequately differentiate sick time taken for health and non-health reasons and between absenteeism and presenteeism. Linguistic validity of the US Spanish translation of the WPAI:GH was established among a diverse US Spanish-speaking population, including those with minimal education.

Validity of the Child Facial Coding System for the Assessment of Acute Pain in Children With Cerebral Palsy.

PubMed

Hadden, Kellie L; LeFort, Sandra; O'Brien, Michelle; Coyte, Peter C; Guerriere, Denise N

2016-04-01

The purpose of the current study was to examine the concurrent and discriminant validity of the Child Facial Coding System for children with cerebral palsy. Eighty-five children (mean = 8.35 years, SD = 4.72 years) were videotaped during a passive joint stretch with their physiotherapist and during 3 time segments: baseline, passive joint stretch, and recovery. Children's pain responses were rated from videotape using the Numerical Rating Scale and Child Facial Coding System. Results indicated that Child Facial Coding System scores during the passive joint stretch significantly correlated with Numerical Rating Scale scores (r = .72, P < .01). Child Facial Coding System scores were also significantly higher during the passive joint stretch than the baseline and recovery segments (P < .001). Facial activity was not significantly correlated with the developmental measures. These findings suggest that the Child Facial Coding System is a valid method of identifying pain in children with cerebral palsy. © The Author(s) 2015.

Enhanced Oceanic Operations Human-In-The-Loop In-Trail Procedure Validation Simulation Study

NASA Technical Reports Server (NTRS)

Murdoch, Jennifer L.; Bussink, Frank J. L.; Chamberlain, James P.; Chartrand, Ryan C.; Palmer, Michael T.; Palmer, Susan O.

2008-01-01

The Enhanced Oceanic Operations Human-In-The-Loop In-Trail Procedure (ITP) Validation Simulation Study investigated the viability of an ITP designed to enable oceanic flight level changes that would not otherwise be possible. Twelve commercial airline pilots with current oceanic experience flew a series of simulated scenarios involving either standard or ITP flight level change maneuvers and provided subjective workload ratings, assessments of ITP validity and acceptability, and objective performance measures associated with the appropriate selection, request, and execution of ITP flight level change maneuvers. In the majority of scenarios, subject pilots correctly assessed the traffic situation, selected an appropriate response (i.e., either a standard flight level change request, an ITP request, or no request), and executed their selected flight level change procedure, if any, without error. Workload ratings for ITP maneuvers were acceptable and not substantially higher than for standard flight level change maneuvers, and, for the majority of scenarios and subject pilots, subjective acceptability ratings and comments for ITP were generally high and positive. Qualitatively, the ITP was found to be valid and acceptable. However, the error rates for ITP maneuvers were higher than for standard flight level changes, and these errors may have design implications for both the ITP and the study's prototype traffic display. These errors and their implications are discussed.

Instruments to assess self-care among healthy children: A systematic review of measurement properties.

PubMed

Urpí-Fernández, Ana-María; Zabaleta-Del-Olmo, Edurne; Montes-Hidalgo, Javier; Tomás-Sábado, Joaquín; Roldán-Merino, Juan-Francisco; Lluch-Canut, María-Teresa

2017-12-01

To identify, critically appraise and summarize the measurement properties of instruments to assess self-care in healthy children. Assessing self-care is a proper consideration for nursing practice and nursing research. No systematic review summarizes instruments of measurement validated in healthy children. Psychometric review in accordance with the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) panel. MEDLINE, CINAHL, PsycINFO, Web of Science and Open Grey were searched from their inception to December 2016. Validation studies with a healthy child population were included. Search was not restricted by language. Two reviewers independently assessed the methodological quality of included studies using the COSMIN checklist. Eleven studies were included in the review assessing the measurement properties of ten instruments. There was a maximum of two studies per instrument. None of the studies evaluated the properties of test-retest reliability, measurement error, criterion validity and responsiveness. Internal consistency and structural validity were rated as "excellent" or "good" in four studies. Four studies were rated as "excellent" in content validity. Cross-cultural validity was rated as "poor" in the two studies (three instruments) which cultural adaptation was carried out. The evidence available does not allow firm conclusions about the instruments identified in terms of reliability and validity. Future research should focus on generate evidence about a wider range of measurement properties of these instruments using a rigorous methodology, as well as instrument testing on different countries and child population. © 2017 John Wiley & Sons Ltd.

Assessment of two different types of bias affecting the results of outcome-based evaluation in undergraduate medical education.

PubMed

Schiekirka, Sarah; Anders, Sven; Raupach, Tobias

2014-07-21

Estimating learning outcome from comparative student self-ratings is a reliable and valid method to identify specific strengths and shortcomings in undergraduate medical curricula. However, requiring students to complete two evaluation forms (i.e. one before and one after teaching) might adversely affect response rates. Alternatively, students could be asked to rate their initial performance level retrospectively. This approach might threaten the validity of results due to response shift or effort justification bias. Two consecutive cohorts of medical students enrolled in a six-week cardio-respiratory module were enrolled in this study. In both cohorts, performance gain was estimated for 33 specific learning objectives. In the first cohort, outcomes calculated from ratings provided before (pretest) and after (posttest) teaching were compared to outcomes derived from comparative self-ratings collected after teaching only (thentest and posttest). In the second cohort, only thentests and posttests were used to calculate outcomes, but data collection tools differed with regard to item presentation. In one group, thentest and posttest ratings were obtained sequentially on separate forms while in the other, both ratings were obtained simultaneously for each learning objective. Using thentest ratings to calculate performance gain produced slightly higher values than using true pretest ratings. Direct comparison of then- and posttest ratings also yielded slightly higher performance gain than sequential ratings, but this effect was negligibly small. Given the small effect sizes, using thentests appears to be equivalent to using true pretest ratings. Item presentation in the posttest does not significantly impact on results.

Assessment of two different types of bias affecting the results of outcome-based evaluation in undergraduate medical education

PubMed Central

2014-01-01

Background Estimating learning outcome from comparative student self-ratings is a reliable and valid method to identify specific strengths and shortcomings in undergraduate medical curricula. However, requiring students to complete two evaluation forms (i.e. one before and one after teaching) might adversely affect response rates. Alternatively, students could be asked to rate their initial performance level retrospectively. This approach might threaten the validity of results due to response shift or effort justification bias. Methods Two consecutive cohorts of medical students enrolled in a six-week cardio-respiratory module were enrolled in this study. In both cohorts, performance gain was estimated for 33 specific learning objectives. In the first cohort, outcomes calculated from ratings provided before (pretest) and after (posttest) teaching were compared to outcomes derived from comparative self-ratings collected after teaching only (thentest and posttest). In the second cohort, only thentests and posttests were used to calculate outcomes, but data collection tools differed with regard to item presentation. In one group, thentest and posttest ratings were obtained sequentially on separate forms while in the other, both ratings were obtained simultaneously for each learning objective. Results Using thentest ratings to calculate performance gain produced slightly higher values than using true pretest ratings. Direct comparison of then- and posttest ratings also yielded slightly higher performance gain than sequential ratings, but this effect was negligibly small. Conclusions Given the small effect sizes, using thentests appears to be equivalent to using true pretest ratings. Item presentation in the posttest does not significantly impact on results. PMID:25043503

Health risk behaviors in adolescents and emerging adults with congenital heart disease: psychometric properties of the Health Behavior Scale-Congenital Heart Disease.

PubMed

Goossens, Eva; Luyckx, Koen; Mommen, Nele; Gewillig, Marc; Budts, Werner; Zupancic, Nele; Moons, Philip

2013-12-01

To optimize long-term outcomes, patients with congenital heart disease (CHD) should adopt health-promoting behaviors. Studies on health behavior in afflicted patients are scarce and comparability of study results is limited. To enlarge the body of evidence, we have developed the Health Behavior Scale-Congenital Heart Disease (HBS-CHD). We examined the psychometric properties of the HBS-CHD by providing evidence for (a) the content validity; (b) validity based on the relationships with other variables; (c) reliability in terms of stability; and (d) responsiveness. Ten experts rated the relevance of the HBS-CHD items. The item content validity index (I-CVI) and the averaged scale content validity index (S-CVI/Ave); the modified multi-rater Kappa and proportion of missing values for each question were calculated. Relationships with other variables were evaluated using six hypotheses that were tested in 429 adolescents with CHD. Stability of the instrument was assessed using Heise's method; and responsiveness was tested by calculating the Guyatt's Responsiveness Index (GRI). Overall, 86.3% of the items had a good to excellent content validity; the S-CVI/Ave (0.81) and multi-rater Kappa (0.78) were adequate. The average proportion of missing values was low (1.2%). Because five out of six hypotheses were confirmed, evidence for the validity of the HBS-CHD based on relationships with other variables was provided. The stability of the instrument could not be confirmed based on our data. The GRI showed good to excellent capacity of the HBS-CHD to detect clinical changes in the health behavior over time. We found that the HBS-CHD is a valid and responsive questionnaire to assess health behaviors in patients with CHD.

Validation of social skills of adolescent males in an interview conversation with a previously unknown adult.

PubMed

Spence, S H

1981-01-01

Seventy convicted young male offenders were videotaped during a 5-min standardized interview with a previously unknown adult. In order to determine the social validity of the behavioral components of social interaction for this population, measures of 13 behaviors were obtained from the tapes. These measures were then correlated with ratings of friendliness, social anxiety, social skills performance, and employability made by four independent adult judges from the same tapes. It was found that measures of eye contact and verbal initiations were correlated significantly with all four criterion rating scales. The frequencies of smiling and speech dysfluencies were both significantly correlated with ratings of friendliness and employability. The amount spoken was found to be a significant predictor of social skills performance whereas the frequency of head movements influenced judgments of social anxiety. The latency of response was negatively correlated with social skills and employability ratings and the frequency of question-asking and interruptions correlated significantly with friendliness, social skills, and employability ratings. Finally, the levels of gestures, gross body movements, and attention feedback responses were not found to influence judgments on any of the criterion scales. The implications of the study for selection of targets for social skills training for adolescent male offenders are discussed.

Validation of social skills of adolescent males in an interview conversation with a previously unknown adult.

PubMed Central

Spence, S H

1981-01-01

Seventy convicted young male offenders were videotaped during a 5-min standardized interview with a previously unknown adult. In order to determine the social validity of the behavioral components of social interaction for this population, measures of 13 behaviors were obtained from the tapes. These measures were then correlated with ratings of friendliness, social anxiety, social skills performance, and employability made by four independent adult judges from the same tapes. It was found that measures of eye contact and verbal initiations were correlated significantly with all four criterion rating scales. The frequencies of smiling and speech dysfluencies were both significantly correlated with ratings of friendliness and employability. The amount spoken was found to be a significant predictor of social skills performance whereas the frequency of head movements influenced judgments of social anxiety. The latency of response was negatively correlated with social skills and employability ratings and the frequency of question-asking and interruptions correlated significantly with friendliness, social skills, and employability ratings. Finally, the levels of gestures, gross body movements, and attention feedback responses were not found to influence judgments on any of the criterion scales. The implications of the study for selection of targets for social skills training for adolescent male offenders are discussed. PMID:7287599

Do Differential Response Rates to Patient Surveys Between Organizations Lead to Unfair Performance Comparisons?: Evidence From the English Cancer Patient Experience Survey.

PubMed

Saunders, Catherine L; Elliott, Marc N; Lyratzopoulos, Georgios; Abel, Gary A

2016-01-01

Patient surveys typically have variable response rates between organizations, leading to concerns that such differences may affect the validity of performance comparisons. To explore the size and likely sources of associations between hospital-level survey response rates and patient experience. Cross-sectional mail survey including 60 patient experience items sent to 101,771 cancer survivors recently treated by 158 English NHS hospitals. Age, sex, race/ethnicity, socioeconomic status, clinical diagnosis, hospital type, and region were available for respondents and nonrespondents. The overall response rate was 67% (range, 39% to 77% between hospitals). Hospitals with higher response rates had higher scores for all items (Spearman correlation range, 0.03-0.44), particularly questions regarding hospital-level administrative processes, for example, procedure cancellations or medical note availability.From multivariable analysis, associations between individual patient experience and hospital-level response rates were statistically significant (P<0.05) for 53/59 analyzed questions, decreasing to 37/59 after adjusting for case-mix, and 25/59 after further adjusting for hospital-level characteristics.Predicting responses of nonrespondents, and re-estimating hypothetical hospital scores assuming a 100% response rate, we found that currently low performing hospitals would have attained even lower scores. Overall nationwide attainment would have decreased slightly to that currently observed. Higher response rate hospitals have more positive experience scores, and this is only partly explained by patient case-mix. High response rates may be a marker of efficient hospital administration, and higher quality that should not, therefore, be adjusted away in public reporting. Although nonresponse may result in slightly overestimating overall national levels of performance, it does not appear to meaningfully bias comparisons of case-mix-adjusted hospital results.

Development and psychometric characteristics of a new domain of the stanford faculty development program instrument.

PubMed

Owolabi, Mayowa O

2014-01-01

Teacher's attitude domain, a pivotal aspect of clinical teaching, is missing in the Stanford Faculty Development Program Questionnaire (SFDPQ), the most widely used student-based assessment method of clinical teaching skills. This study was conducted to develop and validate the teacher's attitude domain and evaluate the validity and internal consistency reliability of the augmented SFDPQ. Items generated for the new domain included teacher's enthusiasm, sobriety, humility, thoroughness, empathy, and accessibility. The study involved 20 resident doctors assessed once by 64 medical students using the augmented SFDPQ. Construct validity was explored using correlation among the different domains and a global rating scale. Factor analysis was performed. The response rate was 94%. The new domain had a Cronbach's alpha of 0.89, with 1-factor solution explaining 57.1% of its variance. It showed the strongest correlation to the global rating scale (rho = 0.71). The augmented SFDPQ, which had a Cronbach's alpha of 0.93, correlated better (rho = 0.72, p < 0.00001) to the global rating scale than the original SFDPQ (rho = 0.67, p < 0.00001). The new teacher's attitude domain exhibited good internal consistency and construct and factorial validity. It enhanced the content and construct validity of the SFDPQ. The validated construct of the augmented SFDPQ is recommended for design and evaluation of basic and continuing clinical teaching programs. © 2014 The Alliance for Continuing Education in the Health Professions, the Society for Academic Continuing Medical Education, and the Council on Continuing Medical Education, Association for Hospital Medical Education.

Development and Validation of a Practical Instrument for Injury Prevention: The Occupational Safety and Health Monitoring and Assessment Tool (OSH-MAT).

PubMed

Sun, Yi; Arning, Martin; Bochmann, Frank; Börger, Jutta; Heitmann, Thomas

2018-06-01

The Occupational Safety and Health Monitoring and Assessment Tool (OSH-MAT) is a practical instrument that is currently used in the German woodworking and metalworking industries to monitor safety conditions at workplaces. The 12-item scoring system has three subscales rating technical, organizational, and personnel-related conditions in a company. Each item has a rating value ranging from 1 to 9, with higher values indicating higher standard of safety conditions. The reliability of this instrument was evaluated in a cross-sectional survey among 128 companies and its validity among 30,514 companies. The inter-rater reliability of the instrument was examined independently and simultaneously by two well-trained safety engineers. Agreement between the double ratings was quantified by the intraclass correlation coefficient and absolute agreement of the rating values. The content validity of the OSH-MAT was evaluated by quantifying the association between OSH-MAT values and 5-year average injury rates by Poisson regression analysis adjusted for the size of the companies and industrial sectors. The construct validity of OSH-MAT was examined by principle component factor analysis. Our analysis indicated good to very good inter-rater reliability (intraclass correlation coefficient = 0.64-0.74) of OSH-MAT values with an absolute agreement of between 72% and 81%. Factor analysis identified three component subscales that met exactly the structure theory of this instrument. The Poisson regression analysis demonstrated a statistically significant exposure-response relationship between OSH-MAT values and the 5-year average injury rates. These analyses indicate that OSH-MAT is a valid and reliable instrument that can be used effectively to monitor safety conditions at workplaces.

Incremental Validity of Biographical Data in the Prediction of En Route Air Traffic Control Specialist Technical Skills

DOT National Transportation Integrated Search

2012-07-01

Previous research demonstrated that an empirically-keyed, response-option scored biographical data (biodata) : scale predicted supervisory ratings of air traffic control specialist (ATCS) job performance (Dean & Broach, : 2011). This research f...

Studies of wheel-running reinforcement: parameters of Herrnstein's (1970) response-strength equation vary with schedule order.

PubMed

Belke, T W

2000-05-01

Six male Wistar rats were exposed to different orders of reinforcement schedules to investigate if estimates from Herrnstein's (1970) single-operant matching law equation would vary systematically with schedule order. Reinforcement schedules were arranged in orders of increasing and decreasing reinforcement rate. Subsequently, all rats were exposed to a single reinforcement schedule within a session to determine within-session changes in responding. For each condition, the operant was lever pressing and the reinforcing consequence was the opportunity to run for 15 s. Estimates of k and R(O) were higher when reinforcement schedules were arranged in order of increasing reinforcement rate. Within a session on a single reinforcement schedule, response rates increased between the beginning and the end of a session. A positive correlation between the difference in parameters between schedule orders and the difference in response rates within a session suggests that the within-session change in response rates may be related to the difference in the asymptotes. These results call into question the validity of parameter estimates from Herrnstein's (1970) equation when reinforcer efficacy changes within a session.

Validation of an auditory startle response system using chemicals or parametric modulation as positive controls.

PubMed

Marable, Brian R; Maurissen, Jacques P J

2004-01-01

Neurotoxicity regulatory guidelines mandate that automated test systems be validated using chemicals. However, in some cases, chemicals may not necessarily be needed to prove test system validity. To examine this issue, two independent experiments were conducted to validate an automated auditory startle response (ASR) system. In Experiment 1, we used adult (PND 63) and weanling (PND 22) Sprague-Dawley rats (10/sex/dose) to determine the effect of either d-amphetamine (4.0 or 8.0 mg/kg) or clonidine (0.4 or 0.8 mg/kg) on the ASR peak amplitude (ASR PA). The startle response of each rat to a short burst of white noise (120 dB SPL) was recorded over 50 consecutive trials. The ASR PA was significantly decreased (by clonidine) and increased (by d-amphetamine) compared to controls in PND 63 rats. In PND 22 rats, the response to clonidine was similar to adults, but d-amphetamine effects were not significant. Neither drug affected the rate of the decrease in ASR PA over time (habituation). In Experiment 2, PND 31 Sprague-Dawley rats (8/sex) were presented with 150 trials consisting of either white noise bursts of variable intensity (70-120 dB SPL in 10 dB increments, presented in random order) or null (0 dB SPL) trials. Statistically significant sex- and intensity-dependent differences were detected in the ASR PA. These results suggest that in some cases, parametric modulation may be an alternative to using chemicals for test system validation.

Dyadic confirmatory factor analysis of the inflammatory bowel disease family responsibility questionnaire.

PubMed

Greenley, Rachel Neff; Reed-Knight, Bonney; Blount, Ronald L; Wilson, Helen W

2013-09-01

Evaluate the factor structure of youth and maternal involvement ratings on the Inflammatory Bowel Disease Family Responsibility Questionnaire, a measure of family allocation of condition management responsibilities in pediatric inflammatory bowel disease. Participants included 251 youth aged 11-18 years with inflammatory bowel disease and their mothers. Item-level descriptive analyses, subscale internal consistency estimates, and confirmatory factor analyses of youth and maternal involvement were conducted using a dyadic data-analytic approach. Results supported the validity of 4 conceptually derived subscales including general health maintenance, social aspects, condition management tasks, and nutrition domains. Additionally, results indicated adequate support for the factor structure of a 21-item youth involvement measure and strong support for a 16-item maternal involvement measure. Additional empirical support for the validity of the Inflammatory Bowel Disease Family Responsibility Questionnaire was provided. Future research to replicate current findings and to examine the measure's clinical utility is warranted.

Development of a Research Participants’ Perception Survey to Improve Clinical Research

PubMed Central

Yessis, Jennifer L.; Kost, Rhonda G.; Lee, Laura M.; Coller, Barry S.; Henderson, David K.

2012-01-01

Abstract Introduction: Clinical research participants’ perceptions regarding their experiences during research protocols provide outcome‐based insights into the effectiveness of efforts to protect rights and safety, and opportunities to enhance participants’ clinical research experiences. Use of validated surveys measuring patient‐centered outcomes is standard in hospitals, yet no instruments exist to assess outcomes of clinical research processes. Methods: We derived survey questions from data obtained from focus groups comprised of research participants and professionals. We assessed the survey for face/content validity, and privacy/confidentiality protections and fielded it to research participants at 15 centers. We conducted analyses of response rates, sample characteristics, and psychometrics, including survey and item completion and analysis, internal consistency, item internal consistency, criterion‐related validity, and item usefulness. Responses were tested for fit into existing patient‐centered dimensions of care and new clinical research dimensions using Cronbach's alpha coefficient. Results: Surveys were mailed to 18,890 individuals; 4,961 were returned (29%). Survey completion was 89% overall; completion rates exceeded 90% for 88 of 93 evaluable items. Questions fit into three dimensions of patient‐centered care and two novel clinical research dimensions (Cronbach's alpha for dimensions: 0.69–0.85). Conclusions: The validated survey offers a new method for assessing and improving outcomes of clinical research processes. Clin Trans Sci 2012; Volume 5: 452–460 PMID:23253666

The Role of Inhibition in a Computational Model of an Auditory Cortical Neuron during the Encoding of Temporal Information

PubMed Central

Bendor, Daniel

2015-01-01

In auditory cortex, temporal information within a sound is represented by two complementary neural codes: a temporal representation based on stimulus-locked firing and a rate representation, where discharge rate co-varies with the timing between acoustic events but lacks a stimulus-synchronized response. Using a computational neuronal model, we find that stimulus-locked responses are generated when sound-evoked excitation is combined with strong, delayed inhibition. In contrast to this, a non-synchronized rate representation is generated when the net excitation evoked by the sound is weak, which occurs when excitation is coincident and balanced with inhibition. Using single-unit recordings from awake marmosets (Callithrix jacchus), we validate several model predictions, including differences in the temporal fidelity, discharge rates and temporal dynamics of stimulus-evoked responses between neurons with rate and temporal representations. Together these data suggest that feedforward inhibition provides a parsimonious explanation of the neural coding dichotomy observed in auditory cortex. PMID:25879843

Development and Validation of Quality Criteria for Providing Patient- and Family-centered Injury Care.

PubMed

Boyd, Jamie M; Burton, Rachael; Butler, Barb L; Dyer, Dianne; Evans, David C; Felteau, Melissa; Gruen, Russell L; Jaffe, Kenneth M; Kortbeek, John; Lang, Eddy; Lougheed, Val; Moore, Lynne; Narciso, Michelle; Oxland, Peter; Rivara, Frederick P; Roberts, Derek; Sarakbi, Diana; Vine, Karen; Stelfox, Henry T

2017-08-01

The aim of this study was to develop and evaluate the content validity of quality criteria for providing patient- and family-centered injury care. Quality criteria have been developed for clinical injury care, but not patient- and family-centered injury care. Using a modified Research AND Development Corporation (RAND)/University of California, Los Angeles (UCLA) Appropriateness Methodology, a panel of 16 patients, family members, injury and quality of care experts serially rated and revised criteria for patient- and family-centered injury care identified from patient and family focus groups. The criteria were then sent to 384 verified trauma centers in the United States, Canada, Australia, and New Zealand for evaluation. A total of 46 criteria were rated and revised by the panel over 4 rounds of review producing 14 criteria related to clinical care (n = 4; transitions of care, pain management, patient safety, provider competence), communication (n = 3; information for patients/families; communication of discharge plans to patients/families, communication between hospital and community providers), holistic care (n = 4; patient hygiene, kindness and respect, family access to patient, social and spiritual support) and end-of-life care (n = 3; decision making, end-of-life care, family follow-up). Medical directors, managers, or coordinators representing 254 trauma centers (66% response rate) rated 12 criteria to be important (95% of responses) for patient- and family-centered injury care. Fewer centers rated family access to the patient (80%) and family follow-up after patient death (65%) to be important criteria. Fourteen-candidate quality criteria for patient- and family-centered injury care were developed and shown to have content validity. These may be used to guide quality improvement practices.

The use of incentives in vulnerable populations for a telephone survey: a randomized controlled trial.

PubMed

Knoll, Megan; Soller, Lianne; Ben-Shoshan, Moshe; Harrington, Daniel; Fragapane, Joey; Joseph, Lawrence; La Vieille, Sebastien; St-Pierre, Yvan; Wilson, Kathi; Elliott, Susan; Clarke, Ann

2012-10-19

Poor response rates in prevalence surveys can lead to nonresponse bias thereby compromising the validity of prevalence estimates. We conducted a telephone survey of randomly selected households to estimate the prevalence of food allergy in the 10 Canadian provinces between May 2008 and March 2009 (the SCAAALAR study: Surveying Canadians to Assess the Prevalence of Common Food Allergies and Attitudes towards Food LAbeling and Risk). A household response rate of only 34.6% was attained, and those of lower socioeconomic status, lower education and new Canadians were underrepresented. We are now attempting to target these vulnerable populations in the SPAACE study (Surveying the Prevalence of Food Allergy in All Canadian Environments) and are evaluating strategies to increase the response rate. Although the success of incentives to increase response rates has been demonstrated previously, no studies have specifically examined the use of unconditional incentives in these vulnerable populations in a telephone survey. The pilot study will compare response rates between vulnerable Canadian populations receiving and not receiving an incentive. Randomly selected households were randomly assigned to receive either a $5 incentive or no incentive. The between group differences in response rates and 95% confidence intervals (CIs) were calculated. The response rates for the incentive and non-incentive groups were 36.1% and 28.7% respectively, yielding a between group difference of 7.4% (-0.7%, 15.6%). Although the wide CI precludes definitive conclusions, our results suggest that unconditional incentives are effective in vulnerable populations for telephone surveys.

Work Performance Ratings: Measurement Test Bed for Validity and Accuracy Research

DTIC Science & Technology

1989-02-01

Department: To maximize the financial status of the organization. This department is responsible for maintaining a balance between accounts receivable and...Commission guidelines. This department attempts to increase employee productivity and improve the quality of worklife thereby increasing satisfaction and

Kerlinger's Criterial Referents Theory Revisited.

ERIC Educational Resources Information Center

Zak, Itai; Birenbaum, Menucha

1980-01-01

Kerlinger's criterial referents theory of attitudes was tested cross-culturally by administering an education attitude referents summated-rating scale to 713 individuals in Israel. The response pattern to criterial and noncriterial referents was examined. Results indicated empirical cross-cultural validity of theory, but questioned measuring…

The use of Subject Matter Experts in Validating an Oral Health-Related Quality of Life measure in Korean.

PubMed

Seo, Jaesung; MacEntee, Michael; Brondani, Mario

2015-09-04

This paper aimed to employ subject matter experts (SMEs) to assess the extent to which the Korean version of the short-form of the OHIP (OHIP-14 K) is culturally valid and equivalent in Korean. We approached 17 bilingual Korean SMEs from which 10 independently rated the clarity, relevance, and cultural equivalence of the OHIP-14 K. SME's varied between 10 and 41 years of clinical experience and were mostly males (# 7). We used Item-level Content Validity Index (I-CVI) to gauge the proportion of SMEs who considered the content of OHIP items (e.g., instruction, response format, etc.) to be culturally valid. We also performed additional analysis to determine the level of agreement between the SMEs. The experts rated most of the items to be clear (S-CVI = 0.93) while having difficulties in assigning relevance of the questions to the expected domains (S-CVI = 0.42). Moreover, considerable disagreement existed among the experts in regard to the relevance (Kfree = 0.19 to 1.00) and the cultural equivalence indexes (ADM = 0.36 to 0.96). The content of the OHIP-14 K for the most part clearly reproduced the language of the original OHIP-14. However, experts disagreed on the relevance and conceptual equivalence of the OHIP-14 K for a Korean population. Patient-oriented outcome measures such as the OHIP can be used across cultures once there are indeed assessing the same domains and constructs of interest. The CVI technique seems to be an alternative tool for evaluating content validity and equivalency of an OHQoL measure. A more refined, culturally relevant version of OHIP-14 K was proposed although there is no available data yet to support a better score validity, reliability and responsiveness of this proposed version.

Psychometric properties of the Numeric Pain Rating Scale and Neck Disability Index in patients with cervicogenic headache.

PubMed

Young, Ian A; Dunning, James; Butts, Raymond; Cleland, Joshua A; Fernández-de-Las-Peñas, César

2018-01-01

Background Self-reported disability and pain intensity are commonly used outcomes in patients with cervicogenic headaches. However, there is a paucity of psychometric evidence to support the use of these self-report outcomes for individuals treated with cervicogenic headaches. Therefore, it is unknown if these measures are reliable, responsive, or result in meaningful clinically important changes in this patient population. Methods A secondary analysis of a randomized clinical trial (n = 110) examining the effects of spinal manipulative therapy with and without exercise in patients with cervicogenic headaches. Reliability, construct validity, responsiveness and thresholds for minimal detectable change and clinically important difference values were calculated for the Neck Disability Index and Numeric Pain Rating Scale. Results The Neck Disability Index exhibited excellent reliability (ICC = 0.92; [95 % CI: 0.46-0.97]), while the Numeric Pain Rating Scale exhibited moderate reliability (ICC = 0.72; [95 % CI: 0.08-0.90]) in the short term. Both instruments also exhibited adequate responsiveness (area under the curve; range = 0.78-0.93) and construct validity ( p < 0.001) in this headache population. Conclusions Both instruments seem well suited as short-term self-report measures for patients with cervicogenic headaches. Clinicians and researchers should expect at least a 2.5-point reduction on the numeric pain rating scale and a 5.5-point reduction on the neck disability index after 4 weeks of intervention to be considered clinically meaningful.

Is email a reliable means of contacting authors of previously published papers? A study of the Emergency Medicine Journal for 2001.

PubMed

O'Leary, F

2003-07-01

To determine whether it is possible to contact authors of previously published papers via email. A cross sectional study of the Emergency Medicine Journal for 2001. 118 articles were included in the study. The response rate from those with valid email addresses was 73%. There was no statistical difference between the type of email address used and the address being invalid (p=0.392) or between the type of article and the likelihood of a reply (p=0.197). More responses were obtained from work addresses when compared with Hotmail addresses (86% v 57%, p=0.02). Email is a valid means of contacting authors of previously published articles, particularly within the emergency medicine specialty. A work based email address may be a more valid means of contact than a Hotmail address.

Contact irritant responses of Aedes aegypti Using sublethal concentration and focal application of pyrethroid chemicals.

PubMed

Manda, Hortance; Shah, Pankhil; Polsomboon, Suppaluck; Chareonviriyaphap, Theeraphap; Castro-Llanos, Fanny; Morrison, Amy; Burrus, Roxanne G; Grieco, John P; Achee, Nicole L

2013-01-01

Previous studies have demonstrated contact irritant and spatial repellent behaviors in Aedes aegypti following exposure to sublethal concentrations of chemicals. These sublethal actions are currently being evaluated in the development of a push-pull strategy for Ae. aegypti control. This study reports on mosquito escape responses after exposure to candidate chemicals for a contact irritant focused push-pull strategy using varying concentrations and focal application. Contact irritancy (escape) behavior, knockdown and 24 hour mortality rates were quantified in populations of female Ae. aegypti under laboratory conditions and validated in the field (Thailand and Peru) using experimental huts. Evaluations were conducted using varying concentrations and treatment surface area coverage (SAC) of three pyrethroid insecticides: alphacypermethrin, lambacyhalothrin and deltamethrin. Under laboratory conditions, exposure of Ae. aegypti to alphacypermethrin using the standard field application rate (FAR) resulted in escape responses at 25% and 50% SAC that were comparable with escape responses at 100% SAC. Significant escape responses were also observed at <100% SAC using ½FAR of all test compounds. In most trials, KD and 24 hour mortality rates were higher in mosquitoes that did not escape than in those that escaped. In Thailand, field validation studies indicated an early time of exit (by four hours) and 40% increase in escape using ½FAR of alphacypermethrin at 75% SAC compared to a matched chemical-free control. In Peru, however, the maximum increase in Ae. aegypti escape from alphacypermethrin-treated huts was 11%. Results presented here suggest a potential role for sublethal and focal application of contact irritant chemicals in an Ae. aegypti push-pull strategy to reduce human-vector contact inside treated homes. However, the impact of an increase in escape response on dengue virus transmission is currently unknown and will depend on rate of biting on human hosts prior to house exiting.

Validity of instruments to assess students' travel and pedestrian safety.

PubMed

Mendoza, Jason A; Watson, Kathy; Baranowski, Tom; Nicklas, Theresa A; Uscanga, Doris K; Hanfling, Marcus J

2010-05-18

Safe Routes to School (SRTS) programs are designed to make walking and bicycling to school safe and accessible for children. Despite their growing popularity, few validated measures exist for assessing important outcomes such as type of student transport or pedestrian safety behaviors. This research validated the SRTS school travel survey and a pedestrian safety behavior checklist. Fourth grade students completed a brief written survey on how they got to school that day with set responses. Test-retest reliability was obtained 3-4 hours apart. Convergent validity of the SRTS travel survey was assessed by comparison to parents' report. For the measure of pedestrian safety behavior, 10 research assistants observed 29 students at a school intersection for completion of 8 selected pedestrian safety behaviors. Reliability was determined in two ways: correlations between the research assistants' ratings to that of the Principal Investigator (PI) and intraclass correlations (ICC) across research assistant ratings. The SRTS travel survey had high test-retest reliability (kappa = 0.97, n = 96, p < 0.001) and convergent validity (kappa = 0.87, n = 81, p < 0.001). The pedestrian safety behavior checklist had moderate reliability across research assistants' ratings (ICC = 0.48) and moderate correlation with the PI (r = 0.55, p = < 0.01). When two raters simultaneously used the instrument, the ICC increased to 0.65. Overall percent agreement (91%), sensitivity (85%) and specificity (83%) were acceptable. These validated instruments can be used to assess SRTS programs. The pedestrian safety behavior checklist may benefit from further formative work.

Development of the Parent Responses to School Functioning Questionnaire.

PubMed

Barber Garcia, Brittany N; Gray, Laura S; Simons, Laura E; Logan, Deirdre E

2017-10-01

Parents play an important role in supporting school functioning in youth with chronic pain, but no validated tools exists to assess parental responses to child and adolescent pain behaviors in the school context. Such a tool would be useful in identifying targets of change to reduce pain-related school impairment. The goal of this study was to develop and preliminarily validate the Parent Responses to School Functioning Questionnaire (PRSF), a parent self-report measure of this construct. After initial expert review and pilot testing, the measure was administered to 418 parents of children (ages 6-17 years) seen for initial multidisciplinary chronic pain clinic evaluation. The final 16-item PRSF showed evidence of good internal consistency (α = .82) and 2-week test-retest reliability (intraclass correlation coefficient = .87). Criterion validity was demonstrated by significant correlations with school absence rates and overall school functioning, and construct validity was demonstrated by correlations with general parental responses to pain. Three subscales emerged capturing parents' personal distress, parents' level of distrust of the school, and parents' expectations and behaviors related to their child's management of challenging school situations. These results provide preliminary support for the PRSF as a psychometrically sound tool to assess parents' responses to child pain in the school setting. The 16-item PRSF measures parental responses to their child's chronic pain in the school context. The clinically useful measure can inform interventions aimed reducing functional disability in children with chronic pain by enhancing parents' ability to respond adaptively to child pain behaviors. Copyright © 2017 American Pain Society. Published by Elsevier Inc. All rights reserved.

Event related potentials during covert orientation of visual attention: effects of cue validity and directionality.

PubMed

Wright, M J; Geffen, G M; Geffen, L B

1995-10-01

Covert orientation of attention was studied in 30 adults who fixated warning cues and pressed a button at target onset. Directional cues (arrows) indicated the most probable (p = 0.8) side of target occurrence. Subjects responded fastest when validly cued, slowest to invalidly cued targets, and at an intermediate rate when the cue (a cross) was not directional. Directional cues took longer to evaluate (increased N1 and P2 latencies) and produced more focussed attention and greater response preparation (enhanced CNV and P3 amplitude) than non-directional cues. These findings indicate that the expectancy of a target can be manipulated by a spatial cue at three levels, sensory, attention, and response preparation, and lead to changes in the sensory perceptual processing of the target. Validly cued targets produced an increase in P1 amplitude reflecting attention enhanced sensory processing whereas invalidly cued targets increased N1 and P3 amplitudes reflecting the re-orientation of attention, and further processing and updating of information required of low probability stimuli respectively. P3 latency to invalidly cued targets was also delayed reflecting the additional processes required to shift attention to a new location. The P3 latency validity effect was smaller than that found for response time suggesting response execution may also be affected by spatial attention.

Translation, adaptation and validation of the American short form Patient Activation Measure (PAM13) in a Danish version.

PubMed

Maindal, Helle Terkildsen; Sokolowski, Ineta; Vedsted, Peter

2009-06-29

The Patient Activation Measure (PAM) is a measure that assesses patient knowledge, skill, and confidence for self-management. This study validates the Danish translation of the 13-item Patient Activation Measure (PAM13) in a Danish population with dysglycaemia. 358 people with screen-detected dysglycaemia participating in a primary care health education study responded to PAM13. The PAM13 was translated into Danish by a standardised forward-backward translation. Data quality was assessed by mean, median, item response, missing values, floor and ceiling effects, internal consistency (Cronbach's alpha and average inter-item correlation) and item-rest correlations. Scale properties were assessed by Rasch Rating Scale models. The item response was high with a small number of missing values (0.8-4.2%). Floor effect was small (range 0.6-3.6%), but the ceiling effect was above 15% for all items (range 18.6-62.7%). The alpha-coefficient was 0.89 and the average inter-item correlation 0.38. The Danish version formed a unidimensional, probabilistic Guttman-like scale explaining 43.2% of the variance. We did however, find a different item sequence compared to the original scale. A Danish version of PAM13 with acceptable validity and reliability is now available. Further development should focus on single items, response categories in relation to ceiling effects and further validation of reproducibility and responsiveness.

Reliability, validity, and significance of assessment of sense of contribution in the workplace.

PubMed

Takaki, Jiro; Taniguchi, Toshiyo; Fujii, Yasuhito

2014-01-29

The purpose of this study was to assess the validity and reliability of the Sense of Contribution Scale (SCS), a newly developed, 7-item questionnaire used to measure sense of contribution in the workplace. Workers at 272 organizations answered questionnaires that included the SCS. Because of non-participation or missing data, the number of subjects included in the analyses for internal consistency and validity varied from 1,675 to 2,462 (response rates 54.6%-80.2%). Fifty-four workers were included in the analysis of test-retest reliability (response rate, 77.1%). The SCS showed high internal consistency (Cronbach's α coefficients in men and women were 0.85 and 0.86, respectively) and test-retest reliability (intraclass correlation coefficient = 0.91). Significant (p < 0.001), positive, moderate correlations were found between the SCS score and scores for organization-based self-esteem and work engagement in both genders, which support the SCS's convergent and discriminant validity. The criterion validity of the SCS was supported by the finding that in both genders, the SCS scores were significantly (p < 0.05) and inversely associated with psychological distress and sleep disturbance in crude and in multivariable analyses that adjusted for demographics, organization-based self-esteem, work engagement, effort-reward ratio, workplace bullying, and procedural and interactional justice. The SCS is a psychometrically satisfactory measure of sense of contribution in the workplace. The SCS provides a new and useful instrument to measure sense of contribution, which is independently associated with mental health in workers, for studies in organizational science, occupational health psychology and occupational medicine.

Reliability, Validity, and Significance of Assessment of Sense of Contribution in the Workplace

PubMed Central

Takaki, Jiro; Taniguchi, Toshiyo; Fujii, Yasuhito

2014-01-01

The purpose of this study was to assess the validity and reliability of the Sense of Contribution Scale (SCS), a newly developed, 7-item questionnaire used to measure sense of contribution in the workplace. Workers at 272 organizations answered questionnaires that included the SCS. Because of non-participation or missing data, the number of subjects included in the analyses for internal consistency and validity varied from 1,675 to 2,462 (response rates 54.6%–80.2%). Fifty-four workers were included in the analysis of test–retest reliability (response rate, 77.1%). The SCS showed high internal consistency (Cronbach’s α coefficients in men and women were 0.85 and 0.86, respectively) and test–retest reliability (intraclass correlation coefficient = 0.91). Significant (p < 0.001), positive, moderate correlations were found between the SCS score and scores for organization-based self-esteem and work engagement in both genders, which support the SCS’s convergent and discriminant validity. The criterion validity of the SCS was supported by the finding that in both genders, the SCS scores were significantly (p < 0.05) and inversely associated with psychological distress and sleep disturbance in crude and in multivariable analyses that adjusted for demographics, organization-based self-esteem, work engagement, effort–reward ratio, workplace bullying, and procedural and interactional justice. The SCS is a psychometrically satisfactory measure of sense of contribution in the workplace. The SCS provides a new and useful instrument to measure sense of contribution, which is independently associated with mental health in workers, for studies in organizational science, occupational health psychology and occupational medicine. PMID:24481035

Psychometric validation of the Psoriasis Symptom Diary using Phase III study data from patients with chronic plaque psoriasis.

PubMed

Strober, Bruce; Zhao, Yang; Tran, Mary Helen; Gnanasakthy, Ari; Nyirady, Judit; Papavassilis, Charis; Nelson, Lauren M; McLeod, Lori D; Mordin, Margaret; Gottlieb, Alice B; Elewski, Boni E; Lebwohl, Mark

2016-03-01

This analysis aimed to confirm the reliability, validity, and responsiveness of the Psoriasis Symptom Diary (PSD) using data from two Phase III studies in patients with moderate to severe chronic plaque psoriasis. Data from two randomized, double-blind, double-dummy, placebo-controlled, multicenter Phase III studies (n = 820) assessing the efficacy and safety of secukinumab were used. The PSD (24-h recall; 0-10 numeric rating scale) was electronically administered each evening. Test-retest reliability was determined using intraclass correlations. Construct validity hypotheses were evaluated via correlations with the Psoriasis Area and Severity Index (PASI), Investigator's Global Assessment (IGA), Dermatology Life Quality Index (DLQI), EuroQoL 5-Dimension Health Status Questionnaire, and Patient Global Impression of Change (PGIC). Discriminating ability and responsiveness were evaluated by estimating mean differences and effect sizes between known groups (using the PASI and IGA). Phase II-derived, anchor-based PGIC thresholds and cumulative distribution function (CDF) plots described meaningful change. Items on the PSD yielded high intraclass coefficients (>0.90). Correlations were in the anticipated direction and by week 12 were moderate to strong (0.41-0.73) in magnitude, demonstrating construct validity. Average PSD item scores differed predictably and significantly between known groups. Responsiveness effect size estimates were moderate to large (0.6-1.5), and CDF plots showed the percentage of responders to be consistently higher in treatment than in placebo arms across the range of change in PSD scores. The PSD is reliable, valid, and responsive, and represents a valid tool to enhance treatment decisions in patients with moderate to severe plaque psoriasis. © 2015 The International Society of Dermatology.

Development and validation of a trustworthy multisource feedback instrument to support nurse appraisals.

PubMed

Crossley, James G M

2015-01-01

Nurse appraisal is well established in the Western world because of its obvious educational advantages. Appraisal works best with many sources of information on performance. Multisource feedback (MSF) is widely used in business and in other clinical disciplines to provide such information. It has also been incorporated into nursing appraisals, but, so far, none of the instruments in use for nurses has been validated. We set out to develop an instrument aligned with the UK Knowledge and Skills Framework (KSF) and to evaluate its reliability and feasibility across a wide hospital-based nursing population. The KSF framework provided a content template. Focus groups developed an instrument based on consensus. The instrument was administered to all the nursing staff in 2 large NHS hospitals forming a single trust in London, England. We used generalizability analysis to estimate reliability, response rates and unstructured interviews to evaluate feasibility, and factor structure and correlation studies to evaluate validity. On a voluntary basis the response rate was moderate (60%). A failure to engage with information technology and employment-related concerns were commonly cited as reasons for not responding. In this population, 11 responses provided a profile with sufficient reliability to inform appraisal (G = 0.7). Performance on the instrument was closely and significantly correlated with performance on a KSF questionnaire. This is the first contemporary psychometric evaluation of an MSF instrument for nurses. MSF appears to be as valid and reliable as an assessment method to inform appraisal in nurses as it is in other health professional groups. © 2015 The Alliance for Continuing Education in the Health Professions, the Society for Academic Continuing Medical Education, and the Council on Continuing Medical Education, Association for Hospital Medical Education.

Utilizing the Total Design Method in medicine: maximizing response rates in long, non-incentivized, personal questionnaire postal surveys.

PubMed

Kazzazi, Fawz; Haggie, Rebecca; Forouhi, Parto; Kazzazi, Nazar; Malata, Charles M

2018-01-01

Maximizing response rates in questionnaires can improve their validity and quality by reducing non-response bias. A comprehensive analysis is essential for producing reasonable conclusions in patient-reported outcome research particularly for topics of a sensitive nature. This often makes long (≥7 pages) questionnaires necessary but these have been shown to reduce response rates in mail surveys. Our work adapted the "Total Design Method," initially produced for commercial markets, to raise response rates in a long (total: 11 pages, 116 questions), non-incentivized, very personal postal survey sent to almost 350 women. A total of 346 women who had undergone mastectomy and immediate breast reconstruction from 2008-2014 (inclusive) at Addenbrooke's University Hospital were sent our study pack (Breast-Q satisfaction questionnaire and support documents) using our modified "Total Design Method." Participants were sent packs and reminders according to our designed schedule. Of the 346 participants, we received 258 responses, an overall response rate of 74.5% with a useable response rate of 72.3%. One hundred and six responses were received before the week 1 reminder (30.6%), 120 before week 3 (34.6%), 225 before the week 7 reminder (64.6%) and the remainder within 3 weeks of the final pack being sent. The median age of patients that the survey was sent to, and the median age of the respondents, was 54 years. In this study, we have demonstrated the successful implementation of a novel approach to postal surveys. Despite the length of the questionnaire (nine pages, 116 questions) and limitations of expenses to mail a survey to ~350 women, we were able to attain a response rate of 74.6%.

A clinician-administered severity rating scale for illness anxiety: development, reliability, and validity of the H-YBOCS-M.

PubMed

Skritskaya, Natalia A; Carson-Wong, Amanda R; Moeller, James R; Shen, Sa; Barsky, Arthur J; Fallon, Brian A

2012-07-01

Clinician-administered measures to assess severity of illness anxiety and response to treatment are few. The authors evaluated a modified version of the hypochondriasis-Y-BOCS (H-YBOCS-M), a 19-item, semistructured, clinician-administered instrument designed to rate severity of illness-related thoughts, behaviors, and avoidance. The scale was administered to 195 treatment-seeking adults with DSM-IV hypochondriasis. Test-retest reliability was assessed in a subsample of 20 patients. Interrater reliability was assessed by 27 interviews independently rated by four raters. Sensitivity to change was evaluated in a subsample of 149 patients. Convergent and discriminant validity was examined by comparing H-YBOCS-M scores to other measures administered. Item clustering was examined with confirmatory and exploratory factor analyses. The H-YBOCS-M demonstrated good internal consistency, interrater and test-retest reliability, and sensitivity to symptom change with treatment. Construct validity was supported by significant higher correlations with scores on other measures of hypochondriasis than with nonhypochondriacal measures. Improvement over time in response to treatment correlated with improvement both on measures of hypochondriasis and on measures of somatization, depression, anxiety, and functional status. Confirmatory factor analysis did not show adequate fit for a three-factor model. Exploratory factor analysis revealed a five-factor solution with the first two factors consistent with the separation of the H-YBOCS-M items into the subscales of illness-related avoidance and compulsions. H-YBOCS-M appears to be valid, reliable, and appropriate as an outcome measure for treatment studies of illness anxiety. Study results highlight "avoidance" as a key feature of illness anxiety-with potentially important nosologic and treatment implications. © 2012 Wiley Periodicals, Inc.

A CLINICIAN-ADMINISTERED SEVERITY RATING SCALE FOR ILLNESS ANXIETY: DEVELOPMENT, RELIABILITY, AND VALIDITY OF THE H-YBOCS-M

PubMed Central

Skritskaya, Natalia A.; Carson-Wong, Amanda R.; Moeller, James R.; Shen, Sa; Barsky, Arthur J.; Fallon, Brian A.

2012-01-01

Background Clinician-administered measures to assess severity of illness anxiety and response to treatment are few. The authors evaluated a modified version of the hypochondriasis-Y-BOCS (H-YBOCS-M), a 19-item, semistructured, clinician-administered instrument designed to rate severity of illness-related thoughts, behaviors, and avoidance. Methods The scale was administered to 195 treatment-seeking adults with DSM-IV hypochondriasis. Test–retest reliability was assessed in a subsample of 20 patients. Interrater reliability was assessed by 27 interviews independently rated by four raters. Sensitivity to change was evaluated in a subsample of 149 patients. Convergent and discriminant validity was examined by comparing H-YBOCS-M scores to other measures administered. Item clustering was examined with confirmatory and exploratory factor analyses. Results The H-YBOCS-M demonstrated good internal consistency, interrater and test–retest reliability, and sensitivity to symptom change with treatment. Construct validity was supported by significant higher correlations with scores on other measures of hypochondriasis than with nonhypochondriacal measures. Improvement over time in response to treatment correlated with improvement both on measures of hypochondriasis and on measures of somatization, depression, anxiety, and functional status. Confirmatory factor analysis did not show adequate fit for a three-factor model. Exploratory factor analysis revealed a five-factor solution with the first two factors consistent with the separation of the H-YBOCS-M items into the subscales of illness-related avoidance and compulsions. Conclusions H-YBOCS-M appears to be valid, reliable, and appropriate as an outcome measure for treatment studies of illness anxiety. Study results highlight “avoidance” as a key feature of illness anxiety—with potentially important nosologic and treatment implications. PMID:22504935

Pseudo Random Stimulus Response of Combustion Systems.

DTIC Science & Technology

1980-01-01

is also 7 applicable to the coalescence/dispersion (C/D) micromixing model In the C/D model, micromixing is simulated by considering the reacting...the turbulent fluctuations on the local heat release rate. Thus the micromixing ’noise’ measurements will not be valid, however, deductions

Validating selective breeding approaches for disease resistance

USDA-ARS?s Scientific Manuscript database

Selective breeding of rainbow trout at the USDA/ARS National Center for Cool and Cold Water Aquaculture (NCCCWA) in Leetown, West Virginia is designed to accomplish four goals: 1) define commercially important traits such as disease resistance, growth rate, stress response, and feed efficiency; 2) d...

Reliability, validity and responsiveness of the Arabic version of the Disability of Arm, Shoulder and Hand (DASH-Arabic).

PubMed

Alotaibi, Naser M; Aljadi, Sameera H; Alrowayeh, Hesham N

2016-12-01

To investigate the psychometric properties (reliability, validity and responsiveness) of the DASH-Arabic in a cohort of Arabic patients presenting with various upper extremity conditions. Participants were 139 patients with various upper extremity conditions, who completed the DASH-Arabic at the baseline, 2-5 days later and 30-36 days later. Participants completed demographic data forms, the SF-36 and VAS at baseline, and a Global Rating of Change scale at first and second follow-ups. Cronbach's alpha of the DASH-Arabic was 0.94. Test-retest reliability was excellent with an ICC of 0.97. The SEM was 3.50 and the MDC95 was 9.28. Construct validity of the DASH-Arabic with the SF-36 subscales and VAS scores ranged from r -0.32 to -0.57, all statistically significant (p < 0.001). The effect size (ES) for the DASH-Arabic was 1.39 and its standard response mean was 1.51. The area under the curve was 0.82 (95% CI = 0.72-0.92, p < 0.001). The optimally efficient cutoff for an improvement was found to be a difference of 15 DASH points. The DASH-Arabic is a reliable, valid and responsive upper extremity outcome measure for patients whose primary language is Arabic; it can be used to document patient status and outcomes and support evidence-based practice. Implications for Rehabilitation The DASH-Arabic demonstrated sound psychometric properties of reliability, validity and responsiveness. It is an effective patient status and outcome tool that will support evidence-based practice. This tool is recommended for evaluating upper extremity work-related injuries and tracking therapeutic outcomes.

Evaluation of the Validity and Response Burden of Patient Self-Report Measures of the Pain Assessment Screening Tool and Outcomes Registry (PASTOR).

PubMed

Cook, Karon F; Kallen, Michael A; Buckenmaier, Chester; Flynn, Diane M; Hanling, Steven R; Collins, Teresa S; Joltes, Kristin; Kwon, Kyung; Medina-Torne, Sheila; Nahavandi, Parisa; Suen, Joshua; Gershon, Richard

2017-07-01

In 2009, the Army Pain Management Task Force was chartered. On the basis of their findings, the Department of Defense recommended a comprehensive pain management strategy that included development of a standardized pain assessment system that would collect patient-reported outcomes data to inform the patient-provider clinical encounter. The result was the Pain Assessment Screening Tool and Outcomes Registry (PASTOR). The purpose of this study was to assess the validity and response burden of the patient-reported outcome measures in PASTOR. Data for analyses were collected from 681 individuals who completed PASTOR at baseline and follow-up as part of their routine clinical care. The survey tool included self-report measures of pain severity and pain interference (measured using the National Institutes of Health Patient-Reported Outcome Measurement Information System [PROMIS] and the Defense and Veterans Pain Rating scale). PROMIS measures of pain correlates also were administered. Validation analyses included estimation of score associations among measures, comparison of scores of known groups, responsiveness, ceiling and floor effects, and response burden. Results of psychometric testing provided substantial evidence for the validity of PASTOR self-report measures in this population. Expected associations among scores largely supported the concurrent validity of the measures. Scores effectively distinguished among respondents on the basis of their self-reported impressions of general health. PROMIS measures were administered using computer adaptive testing and each, on average, required less than 1 minute to administer. Statistical and graphical analyses demonstrated the responsiveness of PASTOR measures over time. Reprint & Copyright © 2017 Association of Military Surgeons of the U.S.

Are validated outcome measures used in distal radial fractures truly valid?

PubMed Central

Nienhuis, R. W.; Bhandari, M.; Goslings, J. C.; Poolman, R. W.; Scholtes, V. A. B.

2016-01-01

Objectives Patient-reported outcome measures (PROMs) are often used to evaluate the outcome of treatment in patients with distal radial fractures. Which PROM to select is often based on assessment of measurement properties, such as validity and reliability. Measurement properties are assessed in clinimetric studies, and results are often reviewed without considering the methodological quality of these studies. Our aim was to systematically review the methodological quality of clinimetric studies that evaluated measurement properties of PROMs used in patients with distal radial fractures, and to make recommendations for the selection of PROMs based on the level of evidence of each individual measurement property. Methods A systematic literature search was performed in PubMed, EMbase, CINAHL and PsycINFO databases to identify relevant clinimetric studies. Two reviewers independently assessed the methodological quality of the studies on measurement properties, using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Level of evidence (strong / moderate / limited / lacking) for each measurement property per PROM was determined by combining the methodological quality and the results of the different clinimetric studies. Results In all, 19 out of 1508 identified unique studies were included, in which 12 PROMs were rated. The Patient-rated wrist evaluation (PRWE) and the Disabilities of Arm, Shoulder and Hand questionnaire (DASH) were evaluated on most measurement properties. The evidence for the PRWE is moderate that its reliability, validity (content and hypothesis testing), and responsiveness are good. The evidence is limited that its internal consistency and cross-cultural validity are good, and its measurement error is acceptable. There is no evidence for its structural and criterion validity. The evidence for the DASH is moderate that its responsiveness is good. The evidence is limited that its reliability and the validity on hypothesis testing are good. There is no evidence for the other measurement properties. Conclusion According to this systematic review, there is, at best, moderate evidence that the responsiveness of the PRWE and DASH are good, as are the reliability and validity of the PRWE. We recommend these PROMs in clinical studies in patients with distal radial fractures; however, more clinimetric studies of higher methodological quality are needed to adequately determine the other measurement properties. Cite this article: Dr Y. V. Kleinlugtenbelt. Are validated outcome measures used in distal radial fractures truly valid?: A critical assessment using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Bone Joint Res 2016;5:153–161. DOI: 10.1302/2046-3758.54.2000462. PMID:27132246

The shoulder pain and disability index: the construct validity and responsiveness of a region-specific disability measure.

PubMed

Heald, S L; Riddle, D L; Lamb, R L

1997-10-01

The purposes of this study were (1) to assess the construct validity of the Shoulder Pain and Disability Index (SPADI) and (2) to determine whether the SPADI is more responsive than the Sickness Impact Profile (SIP), a generic health status measure. The sample consisted of 94 patients who were diagnosed with a shoulder problem and referred to six outpatient physical therapy clinics. Clinically meaningful change was determined by use of an ordinal rating scale designed to determine whether the patient's shoulder function was improved, the same, or worse following treatment. Spearman rho correlations were calculated for the initial visit SPADI and SIP scores. The standardized response mean (SRM) was used to measure responsiveness for the patients who were judged to be improved. One-tailed paired t tests (alpha = .01) were used to determine whether differences existed among SRM values. Correlations between the SPADI and SIP scores ranged from r = .01 to r = .57. The SRM value was higher for the SPADI total score (SRM = 1.38) than for the SIP total score (SRM = 0.79). Most correlations between SPADI and SIP scores provided support for the construct validity of the SPADI. The SPADI does not appear to strongly reflect occupational and recreational disability and is more responsive than the SIP.

Pressure ulcer prevention algorithm content validation: a mixed-methods, quantitative study.

PubMed

van Rijswijk, Lia; Beitz, Janice M

2015-04-01

Translating pressure ulcer prevention (PUP) evidence-based recommendations into practice remains challenging for a variety of reasons, including the perceived quality, validity, and usability of the research or the guideline itself. Following the development and face validation testing of an evidence-based PUP algorithm, additional stakeholder input and testing were needed. Using convenience sampling methods, wound care experts attending a national wound care conference and a regional wound ostomy continence nursing (WOCN) conference and/or graduates of a WOCN program were invited to participate in an Internal Review Board-approved, mixed-methods quantitative survey with qualitative components to examine algorithm content validity. After participants provided written informed consent, demographic variables were collected and participants were asked to comment on and rate the relevance and appropriateness of each of the 26 algorithm decision points/steps using standard content validation study procedures. All responses were anonymous. Descriptive summary statistics, mean relevance/appropriateness scores, and the content validity index (CVI) were calculated. Qualitative comments were transcribed and thematically analyzed. Of the 553 wound care experts invited, 79 (average age 52.9 years, SD 10.1; range 23-73) consented to participate and completed the study (a response rate of 14%). Most (67, 85%) were female, registered (49, 62%) or advanced practice (12, 15%) nurses, and had > 10 years of health care experience (88, 92%). Other health disciplines included medical doctors, physical therapists, nurse practitioners, and certified nurse specialists. Almost all had received formal wound care education (75, 95%). On a Likert-type scale of 1 (not relevant/appropriate) to 4 (very relevant and appropriate), the average score for the entire algorithm/all decision points (N = 1,912) was 3.72 with an overall CVI of 0.94 (out of 1). The only decision point/step recommendation with a CVI of ≤ 0.70 was the recommendation to provide medical-grade sheepskin for patients at high risk for friction/shear. Many positive and substantive suggestions for minor modifications including color, flow, and algorithm orientation were received. The high overall and individual item rating scores and CVI further support the validity and appropriateness of the PUP algorithm with the addition of the minor modifications. The generic recommendations facilitate individualization, and future research should focus on construct validation testing.

Validity of physical activity and cardiorespiratory fitness in the Danish cohort "Diet, Cancer and Health-Next Generations".

PubMed

Lerche, L; Olsen, A; Petersen, K E N; Rostgaard-Hansen, A L; Dragsted, L O; Nordsborg, N B; Tjønneland, A; Halkjaer, J

2017-12-01

Valid assessments of physical activity (PA) and cardiorespiratory fitness (CRF) are essential in epidemiological studies to define dose-response relationship for formulating thorough recommendations of an appropriate pattern of PA to maintain good health. The aim of this study was to validate the Danish step test, the physical activity questionnaire Active-Q, and self-rated fitness against directly measured maximal oxygen uptake (VO 2 max). A population-based subsample (n=125) was included from the "Diet, Cancer and Health-Next Generations" (DCH-NG) cohort which is under establishment. Validity coefficients, which express the correlation between measured and "true" exposure, were calculated, and misclassification across categories was evaluated. The validity of the Danish step test was moderate (women: r=.66, and men: r=.56); however, men were systematically underestimated (43% misclassification). When validating the questionnaire-derived measures of PA, leisure-time physical activity was not correlated with VO 2 max. Positive correlations were found for sports overall, but these were only significant for men: total hours per week of sports (r=.26), MET-hours per week of sports (r=.28) and vigorous sports (0.28) alone were positively correlated with VO 2 max. Finally, the percentage of misclassification was low for self-rated fitness (women: 9% and men: 13%). Thus, self-rated fitness was found to be a superior method to the Danish step test, as well as being less cost prohibitive and more practical than the VO 2 max method. Finally, even if correlations were low, they support the potential for questionnaire outcomes, particularly sports, vigorous sports, and self-rated fitness to be used to estimate CRF. © 2017 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Translation, Cross-Cultural Adaptation, and Validation of the Activity Rating Scale for Disorders of the Knee

PubMed Central

Flosadottir, Vala; Roos, Ewa M.; Ageberg, Eva

2017-01-01

Background: The Activity Rating Scale (ARS) for disorders of the knee evaluates the level of activity by the frequency of participation in 4 separate activities with high demands on knee function, with a score ranging from 0 (none) to 16 (pivoting activities 4 times/wk). Purpose: To translate and cross-culturally adapt the ARS into Swedish and to assess measurement properties of the Swedish version of the ARS. Study Design: Cohort study (diagnosis); Level of evidence, 2. Methods: The COSMIN guidelines were followed. Participants (N = 100 [55 women]; mean age, 27 years) who were undergoing rehabilitation for a knee injury completed the ARS twice for test-retest reliability. The Knee injury and Osteoarthritis Outcome Score (KOOS), Tegner Activity Scale (TAS), and modernized Saltin-Grimby Physical Activity Level Scale (SGPALS) were administered at baseline to validate the ARS. Construct validity and responsiveness of the ARS were evaluated by testing predefined hypotheses regarding correlations between the ARS, KOOS, TAS, and SGPALS. The Cronbach alpha, intraclass correlation coefficients, absolute reliability, standard error of measurement, smallest detectable change, and Spearman rank-order correlation coefficients were calculated. Results: The ARS showed good internal consistency (α ≈ 0.96), good test-retest reliability (intraclass correlation coefficient >0.9), and no systematic bias between measurements. The standard error of measurement was less than 2 points, and the smallest detectable change was less than 1 point at the group level and less than 5 points at the individual level. More than 75% of the hypotheses were confirmed, indicating good construct validity and good responsiveness of the ARS. Conclusion: The Swedish version of the ARS is valid, reliable, and responsive for evaluating the level of activity based on the frequency of participation in high-demand knee sports activities in young adults with a knee injury. PMID:28979920

Clinical decision making in response to performance validity test failure in a psychiatric setting.

PubMed

Marcopulos, Bernice A; Caillouet, Beth A; Bailey, Christopher M; Tussey, Chriscelyn; Kent, Julie-Ann; Frederick, Richard

2014-01-01

This study examined the clinical utility of a performance validity test (PVT) for screening consecutive referrals (N = 436) to a neuropsychology service at a state psychiatric hospital treating both civilly committed and forensic patients. We created a contingency table with Test of Memory Malingering (TOMM) pass/fail (355/81) and secondary gain present/absent (181/255) to examine pass rates associated with patient demographic, clinical and forensic status characteristics. Of the 81 failed PVTs, 48 had secondary gain defined as active criminal legal charges; 33 failed PVTs with no secondary gain. These individuals tended to be older, female, Caucasian, and civilly committed compared with the group with secondary gain who failed. From estimations of TOMM False Positive Rate and True Positive Rate we estimated base rates of neurocognitive malingering for our clinical population using the Test Validation Summary (TVS; Frederick & Bowden, 2009 ). Although PVT failure is clearly more common in a group with secondary gain (31%), there were a number of false positives (11%). Clinical ratings of patients without gain who failed suggested cognitive deficits, behavioral issues, and inattention. Low scores on PVTs in the absence of secondary gain provide useful information on test engagement and can inform clinical decisions about testing.

Prevalence of rheumatoid arthritis in Dublin, Ireland: a population based survey.

PubMed

Power, D; Codd, M; Ivers, L; Sant, S; Barry, M

1999-01-01

The prevalence of Rheumatoid Arthritis (RA) in Ireland has never been established. Studies from different countries show varying rates, being almost 100 per cent greater in the highlands of Scotland (10/1,000) than in rural Lesotho (6/1,000). A recent study also suggests a fall in the prevalence of RA among women in the London urban area. Given these variations the validity of extrapolating prevalence rates established for other countries to Ireland is questionable. This study aimed to establish a prevalence rate for RA in a defined Dublin population. A self-administered questionnaire was sent to 2,500 people chosen at random from the electoral register. The questionnaire was designed to select out both undiagnosed patients and those with definite arthritis. Respondents whose replies indicated an arthritic process, but in whom no diagnosis had been made, were asked to attend for further assessment and investigations as appropriate. Those who responded that they had been diagnosed with arthritis were asked for consent to inspect their hospital or general practitioner records. A diagnosis of RA was based on American Rheumatism Association (ARA) criteria. Valid responses were received from 1,227 people surveyed (response rate = 49 per cent). Six cases of RA were identified including 2 previously undiagnosed cases. A prevalence rate of 5/1,000 has been estimated based on these findings.

Clinician versus Veteran ratings on the Mayo-Portland Participation Index in veterans with a history of mild traumatic brain injury.

PubMed

McCulloch, Katie; Pastorek, Nicholas J; Miller, Brian I; Romesser, Jennifer; Linck, John; Sim, Anita H; Troyanskaya, Maya; Maestas, Kacey Little

2015-01-01

The Department of Veterans Affairs is encouraging administration of the Mayo-Portland Adaptability Inventory-4 Participation Index (M2PI) to identify long-term psychosocial outcomes of Operation Enduring Freedom (OEF), Operation Iraqi Freedom (OIF), and Operation New Dawn (OND) Veterans with a history of traumatic brain injury (TBI). To evaluate clinician and Veteran interrater reliability and how response validity influences M2PI item ratings. A total of 122 OEF/OIF/OND Veterans who reported a history consistent with mild TBI during deployment and were referred for neuropsychological evaluation following Comprehensive TBI Evaluation. Interrater reliability study. M2PI; Minnesota Multiphasic Personality Inventory-2 Symptom Validity Scale (FBS). Veterans reported greater perceived restrictions than clinicians across all M2PI items and total score. Interrater correlations ranged from rs = 0.27 (residence) to rs = 0.58 (money management) across items, with a total score correlation of rs = 0.60. When response bias was indicated, both Veterans and clinicians reported greater participation restrictions than those reported by Veterans without evidenced response bias. Low interrater correlation is consistent with previous findings. As ratings of clinicians and Veterans should not be interpreted as equivalent, documenting the rater's identity is important for interpretation. Using objective indicators of functional outcome may assist clinician raters, particularly when self-report may be biased.

Combining the test of memory malingering trial 1 with behavioral responses improves the detection of effort test failure.

PubMed

Denning, John Henry

2014-01-01

Validity measures derived from the Test of Memory Malingering Trial 1 (TOMM1) and errors across the first 10 items of TOMM1 (TOMMe10) may be further enhanced by combining these scores with "embedded" behavioral responses while patients complete these measures. In a sample of nondemented veterans (n = 151), five possible behavioral responses observed during completion of the first 10 items of the TOMM were combined with TOMM1 and TOMMe10 to assess any increased sensitivity in predicting Medical Symptom Validity Test (MSVT) performance. Both TOMM1 and TOMMe10 alone were highly accurate overall in predicting MSVT performance (TOMM1 [area under the curve (AUC)] = .95, TOMMe10 [AUC] = .92). The combination of TOMM measures and behavioral responses did not increase overall accuracy rates; however, when specificity was held at approximately 90%, there was a slight increase in sensitivity (+7%) for both TOMM measures when combined with the number of "point and name" responses. Examples are provided demonstrating that at a given TOMM score (TOMM1 or TOMMe10), with an increase in "point and name" responses, there is an incremental increase in the probability of failing the MSVT. Exploring the utility of combining freestanding or embedded validity measures with behavioral features during test administration should be encouraged.

A two-question method for assessing gender categories in the social and medical sciences.

PubMed

Tate, Charlotte Chuck; Ledbetter, Jay N; Youssef, Cris P

2013-01-01

Three studies (N = 990) assessed the statistical reliability of two methods of determining gender identity that can capture transgender spectrum identities (i.e., current gender identities different from birth-assigned gender categories). Study 1 evaluated a single question with four response options (female, male, transgender, other) on university students. The missing data rate was higher than the valid response rates for transgender and other options using this method. Study 2 evaluated a method of asking two separate questions (i.e., one for current identity and another for birth-assigned category), with response options specific to each. Results showed no missing data and two times the transgender spectrum response rate compared to Study 1. Study 3 showed that the two-question method also worked in community samples, producing near-zero missing data. The two-question method also identified cisgender identities (same birth-assigned and current gender identity), making it a dynamic and desirable measurement tool for the social and medical sciences.

Fecal glucocorticoid metabolites and assay validation: Stress response evaluation in captive brown howler monkeys (Alouatta clamitans).

PubMed

Eleonora Madeira Buti, Thais; Kugelmeier, Tatiana; Sobral, Gisela; Viau Furtado, Priscila; do Valle Dutra de Andrade Neves, Dafne; Alvarenga de Oliveira, Claudio

2018-04-25

The advent of non-invasive methods provides a powerful alternative to stress studies as the use of stressful handling techniques is no longer needed. However, many factors influence hormone metabolism such as sex, diet, and metabolic rate. Thus, validation should be species- and matrix-specific. To assess stress response in brown howler monkeys Alouatta clamitans, we adopted an ACTH challenge test and parallelism to provide physiological and laboratorial validation. Radioimmunoassay was used to measure fecal levels of corticosterone. All challenged animals presented a peak in fecal glucocorticoids levels the day after the treatment, while control animals did not. There were no significant sex differences, but females with infants had higher levels of corticosterone. Corticosterone levels showed parallelism to the standard curve of the diagnostics kit. Collectively, the data suggest that the method was validated and is useful for monitoring stress, thereby helping in conservation programs both in captivity and in the wild. Transit time information may be coupled with travel distance in seed dispersal studies. © 2018 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Family's difficulty scale in end-of-life home care: a new measure of the family's difficulties in caring for patients with cancer at the end of life at home from bereaved family's perspective.

PubMed

Ishii, Yoko; Miyashita, Mitsunori; Sato, Kazuki; Ozawa, Taketoshi

2012-02-01

The aim of this study was to develop a tool to measure the family's difficulties in caring for cancer patients at the end of life at home: Family's Difficulty Scale in end-of-life home care (FDS). The draft of the FDS was derived from a pilot interview survey and literature reviews. The questionnaires were sent to 395 bereaved family caregivers whose family members were patients with terminal cancer receiving home service. We obtained 306 responses (response rate, 81%). Factor analysis resulted in 29 items and 8 factors: Burden of Care, Concerns about Home Care Doctor, Balance of Work and Care, Patient's Pain and Condition, Concerns about Visiting Nurse, Concerns about Home Care Service, Relationship between Family Caregivers and their Families, and Funeral Preparations. The cumulative rate of contribution was 71.8%. Cronbach coefficient α for the FDS was 0.73-0.75; the intraclass correlation coefficient in the test-retest examination was 0.75-0.85. Evidence for construct validity was confirmed by convergent and divergent validity. Concurrent validity was confirmed by significant correlations between identified factors and concurrent measures. The validity and reliability of this new instrument were confirmed. This scale should help home care providers to assess and focus on family difficulties and provide individualized care for the family who cares for a patient with terminal cancer at home.

Reliability and Construct Validity of the Psychopathic Personality Inventory-Revised in a Swedish Non-Criminal Sample - A Multimethod Approach including Psychophysiological Correlates of Empathy for Pain.

PubMed

Sörman, Karolina; Nilsonne, Gustav; Howner, Katarina; Tamm, Sandra; Caman, Shilan; Wang, Hui-Xin; Ingvar, Martin; Edens, John F; Gustavsson, Petter; Lilienfeld, Scott O; Petrovic, Predrag; Fischer, Håkan; Kristiansson, Marianne

2016-01-01

Cross-cultural investigation of psychopathy measures is important for clarifying the nomological network surrounding the psychopathy construct. The Psychopathic Personality Inventory-Revised (PPI-R) is one of the most extensively researched self-report measures of psychopathic traits in adults. To date however, it has been examined primarily in North American criminal or student samples. To address this gap in the literature, we examined PPI-R's reliability, construct validity and factor structure in non-criminal individuals (N = 227) in Sweden, using a multimethod approach including psychophysiological correlates of empathy for pain. PPI-R construct validity was investigated in subgroups of participants by exploring its degree of overlap with (i) the Psychopathy Checklist: Screening Version (PCL:SV), (ii) self-rated empathy and behavioral and physiological responses in an experiment on empathy for pain, and (iii) additional self-report measures of alexithymia and trait anxiety. The PPI-R total score was significantly associated with PCL:SV total and factor scores. The PPI-R Coldheartedness scale demonstrated significant negative associations with all empathy subscales and with rated unpleasantness and skin conductance responses in the empathy experiment. The PPI-R higher order Self-Centered Impulsivity and Fearless Dominance dimensions were associated with trait anxiety in opposite directions (positively and negatively, respectively). Overall, the results demonstrated solid reliability (test-retest and internal consistency) and promising but somewhat mixed construct validity for the Swedish translation of the PPI-R.

Reliability and Construct Validity of the Psychopathic Personality Inventory-Revised in a Swedish Non-Criminal Sample – A Multimethod Approach including Psychophysiological Correlates of Empathy for Pain

PubMed Central

Sörman, Karolina; Nilsonne, Gustav; Howner, Katarina; Tamm, Sandra; Caman, Shilan; Wang, Hui-Xin; Ingvar, Martin; Edens, John F.; Gustavsson, Petter; Lilienfeld, Scott O; Petrovic, Predrag; Fischer, Håkan; Kristiansson, Marianne

2016-01-01

Cross-cultural investigation of psychopathy measures is important for clarifying the nomological network surrounding the psychopathy construct. The Psychopathic Personality Inventory-Revised (PPI-R) is one of the most extensively researched self-report measures of psychopathic traits in adults. To date however, it has been examined primarily in North American criminal or student samples. To address this gap in the literature, we examined PPI-R’s reliability, construct validity and factor structure in non-criminal individuals (N = 227) in Sweden, using a multimethod approach including psychophysiological correlates of empathy for pain. PPI-R construct validity was investigated in subgroups of participants by exploring its degree of overlap with (i) the Psychopathy Checklist: Screening Version (PCL:SV), (ii) self-rated empathy and behavioral and physiological responses in an experiment on empathy for pain, and (iii) additional self-report measures of alexithymia and trait anxiety. The PPI-R total score was significantly associated with PCL:SV total and factor scores. The PPI-R Coldheartedness scale demonstrated significant negative associations with all empathy subscales and with rated unpleasantness and skin conductance responses in the empathy experiment. The PPI-R higher order Self-Centered Impulsivity and Fearless Dominance dimensions were associated with trait anxiety in opposite directions (positively and negatively, respectively). Overall, the results demonstrated solid reliability (test-retest and internal consistency) and promising but somewhat mixed construct validity for the Swedish translation of the PPI-R. PMID:27300292

Implementation of Improved Transverse Shear Calculations and Higher Order Laminate Theory Into Strain Rate Dependent Analyses of Polymer Matrix Composites

NASA Technical Reports Server (NTRS)

Zhu, Lin-Fa; Kim, Soo; Chattopadhyay, Aditi; Goldberg, Robert K.

2004-01-01

A numerical procedure has been developed to investigate the nonlinear and strain rate dependent deformation response of polymer matrix composite laminated plates under high strain rate impact loadings. A recently developed strength of materials based micromechanics model, incorporating a set of nonlinear, strain rate dependent constitutive equations for the polymer matrix, is extended to account for the transverse shear effects during impact. Four different assumptions of transverse shear deformation are investigated in order to improve the developed strain rate dependent micromechanics model. The validities of these assumptions are investigated using numerical and theoretical approaches. A method to determine through the thickness strain and transverse Poisson's ratio of the composite is developed. The revised micromechanics model is then implemented into a higher order laminated plate theory which is modified to include the effects of inelastic strains. Parametric studies are conducted to investigate the mechanical response of composite plates under high strain rate loadings. Results show the transverse shear stresses cannot be neglected in the impact problem. A significant level of strain rate dependency and material nonlinearity is found in the deformation response of representative composite specimens.

School-Based Asthma Case Finding: The Arkansas Experience

ERIC Educational Resources Information Center

Vargas, Perla A.; Magee, James S.; Bushmiaer, Margo; Simpson, Pippa M.; Jones, Craig A.; Feild, Charles R.; Jones, Stacie M.

2006-01-01

This population-based case-finding study sought to determine asthma prevalence and characterize disease severity and burden among school-aged children in the Little Rock School District. Asthma cases were identified by validated algorithm and parental report of asthma diagnosis. The overall response rate was low. Among schools with greater than…

Expectancy Theory Outcomes and Student Evaluations of Teaching

ERIC Educational Resources Information Center

Ernst, David

2014-01-01

As student evaluation of teaching (SET) instruments are increasingly administered online, research has found that the response rates have dropped significantly. Validity concerns have necessitated research that explores student motivation for completing SETs. This study uses Vroom's [(1964). "Work and motivation" (3rd ed.). New York, NY:…

Assessing Assertion: An Investigation of Construct Validity and Reliability.

ERIC Educational Resources Information Center

Kern, Jeffrey M.; MacDonald, Marian L.

The reliability and meaning of assertiveness tests were explored using 120 female undergraduates. Several self-report inventories (the College Self-Expression Scale, Conflict Resolution Inventory, and a global rating from one to seven) were administered, as were three anxiety measures (Timed Behavior Checklist, response latency, and response…

Translation, cross-cultural adaptation and psychometric properties of the Nepali versions of numerical pain rating scale and global rating of change.

PubMed

Sharma, Saurab; Palanchoke, Joshna; Reed, Darren; Haxby Abbott, J

2017-12-04

Pain intensity and patients' impression of global improvement are widely used patient-reported outcome measures (PROMs) in clinical practice and research. They are commonly assessed using the Numerical Pain Rating Scale (NPRS) and Global Rating of Change (GROC) questionnaires. The GROC is essential as an anchor for evaluating the psychometric properties of PROMs. Both of these PROMs are translated to many languages and have shown excellent psychometric properties. Their availability in Nepali would facilitate pain research and cross-cultural comparison of research findings. Therefore, the objectives of this study were to translate and cross-culturally adapt the NPRS and GROC into Nepali and to assess the psychometric properties of the Nepali version of the NPRS (NPRS-NP). After translating and cross-culturally adapting the NPRS and GROC into Nepali using recommended guidelines, NPRS-NP was administered to 104 individuals with musculoskeletal pain twice. The Nepali version of the GROC (GROC-NP) was administered at the follow-up for anchor-based assessment. (1) Test-retest reliability and minimum detectable change (MDC) among the stable group, (2) construct validity (by single sample t-test within the improved group and independent sample t-test between groups), and (3) concurrent validity were assessed. Receiver operating characteristic (ROC) curves were plotted to determine the responsiveness of the NPRS-NP using the area under the curve (AUC), and minimum important changes (MIC) for small, medium and large improvements. Significant cultural adaptations were required to obtain relevant Nepali versions of both the NPRS and GROC. The NPRS-NP showed excellent test-retest reliability and a MDC of 1.13 points. NPRS-NP demonstrated a good construct validity by significant within-group difference in mean of NPRS score- t(63)= 7.57, P < 0.001 and statistically significant difference of mean score- t(98)= -4.24, P < .001 between the stable and improved groups. It demonstrated moderate concurrent correlation with the GROC-NP; r = 0.43, P < 0.01. Responsiveness of the NPRS-NP was shown at three levels with AUC = 0.68-0.82, and MIC = 1.17-1.33. The NPRS and GROC were successfully translated and culturally adapted into Nepali. The NPRS-NP demonstrated good reliability, validity and responsiveness in assessing musculoskeletal pain intensity in a Nepali population.

Validation of auditory detection response task method for assessing the attentional effects of cognitive load.

PubMed

Stojmenova, Kristina; Sodnik, Jaka

2018-07-04

There are 3 standardized versions of the Detection Response Task (DRT), 2 using visual stimuli (remote DRT and head-mounted DRT) and one using tactile stimuli. In this article, we present a study that proposes and validates a type of auditory signal to be used as DRT stimulus and evaluate the proposed auditory version of this method by comparing it with the standardized visual and tactile version. This was a within-subject design study performed in a driving simulator with 24 participants. Each participant performed 8 2-min-long driving sessions in which they had to perform 3 different tasks: driving, answering to DRT stimuli, and performing a cognitive task (n-back task). Presence of additional cognitive load and type of DRT stimuli were defined as independent variables. DRT response times and hit rates, n-back task performance, and pupil size were observed as dependent variables. Significant changes in pupil size for trials with a cognitive task compared to trials without showed that cognitive load was induced properly. Each DRT version showed a significant increase in response times and a decrease in hit rates for trials with a secondary cognitive task compared to trials without. Similar and significantly better results in differences in response times and hit rates were obtained for the auditory and tactile version compared to the visual version. There were no significant differences in performance rate between the trials without DRT stimuli compared to trials with and among the trials with different DRT stimuli modalities. The results from this study show that the auditory DRT version, using the signal implementation suggested in this article, is sensitive to the effects of cognitive load on driver's attention and is significantly better than the remote visual and tactile version for auditory-vocal cognitive (n-back) secondary tasks.

Characterization of nonGaussian atmospheric turbulence for prediction of aircraft response statistics

NASA Technical Reports Server (NTRS)

Mark, W. D.

1977-01-01

Mathematical expressions were derived for the exceedance rates and probability density functions of aircraft response variables using a turbulence model that consists of a low frequency component plus a variance modulated Gaussian turbulence component. The functional form of experimentally observed concave exceedance curves was predicted theoretically, the strength of the concave contribution being governed by the coefficient of variation of the time fluctuating variance of the turbulence. Differences in the functional forms of response exceedance curves and probability densities also were shown to depend primarily on this same coefficient of variation. Criteria were established for the validity of the local stationary assumption that is required in the derivations of the exceedance curves and probability density functions. These criteria are shown to depend on the relative time scale of the fluctuations in the variance, the fluctuations in the turbulence itself, and on the nominal duration of the relevant aircraft impulse response function. Metrics that can be generated from turbulence recordings for testing the validity of the local stationary assumption were developed.

THE PEDIATRIC RHEUMATOLOGY INTERNATIONAL TRIALS ORGANIZATION PROVISIONAL CRITERIA FOR THE EVALUATION OF RESPONSE TO THERAPY IN JUVENILE DERMATOMYOSITIS

PubMed Central

Ruperto, Nicolino; Pistorio, Angela; Ravelli, Angelo; Rider, Lisa G.; Pilkington, Clarissa; Oliveira, Sheila; Wulffraat, Nico; Espada, Graciela; Garay, Stella; Cuttica, Ruben; Hofer, Michael; Quartier, Pierre; Melo-Gomes, Jose; Reed, Ann M.; Wierzbowska, Malgorzata; Feldman, Brian M.; Harjacek, Miroslav; Huppertz, Hans-Iko; Nielsen, Susan; Flato, Berit; Lahdenne, Pekka; Michels, Harmut; Murray, Kevin J.; Punaro, Lynn; Rennebohm, Robert; Russo, Ricardo; Balogh, Zsolt; Rooney, Madeleine; Pachman, Lauren M.; Wallace, Carol; Hashkes, Philip; Lovell, Daniel J.; Giannini, Edward H.; Martini, Alberto

2010-01-01

Objective To develop a provisional definition for the evaluation of response to therapy in juvenile dermatomyositis (JDM) based on the PRINTO JDM core set of variables. Methods Thirty-seven experienced pediatric rheumatologists from 27 countries, achieved consensus on 128 difficult patient profiles as clinically improved or not improved using a stepwise approach (patients rating, statistical analysis, definition selection). Using the physicians’ consensus ratings as the “gold-standard measure”, chi-square, sensitivity, specificity, false positive and negative rate, area under the ROC, and kappa agreement for candidate definitions of improvement were calculated. Definitions with kappa >0.8 were multiplied with the face validity score to select the top definitions. Results The top definition of improvement was: at least 20% improvement from baseline in 3/6 core set variables with no more than 1 of the remaining worsening by more than 30%, which cannot be muscle strength. The second highest scoring definition was at least 20% improvement from baseline in 3/6 core set variables with no more than 2 of the remaining worsening by more than 25%, which cannot be muscle strength which is definition P1 selected by the IMACS group. The third is similar to the second with the maximum amount of worsening set to 30%. This indicates convergent validity of the process. Conclusion we proposes a provisional data driven definition of improvement that reflects well the consensus rating of experienced clinicians, which incorporates clinically meaningful change in core set variables in a composite endpoint for the evaluation of global response to therapy in JDM. PMID:20583105

Validity of instruments to assess students' travel and pedestrian safety

PubMed Central

2010-01-01

Background Safe Routes to School (SRTS) programs are designed to make walking and bicycling to school safe and accessible for children. Despite their growing popularity, few validated measures exist for assessing important outcomes such as type of student transport or pedestrian safety behaviors. This research validated the SRTS school travel survey and a pedestrian safety behavior checklist. Methods Fourth grade students completed a brief written survey on how they got to school that day with set responses. Test-retest reliability was obtained 3-4 hours apart. Convergent validity of the SRTS travel survey was assessed by comparison to parents' report. For the measure of pedestrian safety behavior, 10 research assistants observed 29 students at a school intersection for completion of 8 selected pedestrian safety behaviors. Reliability was determined in two ways: correlations between the research assistants' ratings to that of the Principal Investigator (PI) and intraclass correlations (ICC) across research assistant ratings. Results The SRTS travel survey had high test-retest reliability (κ = 0.97, n = 96, p < 0.001) and convergent validity (κ = 0.87, n = 81, p < 0.001). The pedestrian safety behavior checklist had moderate reliability across research assistants' ratings (ICC = 0.48) and moderate correlation with the PI (r = 0.55, p =< 0.01). When two raters simultaneously used the instrument, the ICC increased to 0.65. Overall percent agreement (91%), sensitivity (85%) and specificity (83%) were acceptable. Conclusions These validated instruments can be used to assess SRTS programs. The pedestrian safety behavior checklist may benefit from further formative work. PMID:20482778

Comment on Hall et al. (2017), "How to Choose Between Measures of Tinnitus Loudness for Clinical Research? A Report on the Reliability and Validity of an Investigator-Administered Test and a Patient-Reported Measure Using Baseline Data Collected in a Phase IIa Drug Trial".

PubMed

Sabour, Siamak

2018-03-08

The purpose of this letter, in response to Hall, Mehta, and Fackrell (2017), is to provide important knowledge about methodology and statistical issues in assessing the reliability and validity of an audiologist-administered tinnitus loudness matching test and a patient-reported tinnitus loudness rating. The author uses reference textbooks and published articles regarding scientific assessment of the validity and reliability of a clinical test to discuss the statistical test and the methodological approach in assessing validity and reliability in clinical research. Depending on the type of the variable (qualitative or quantitative), well-known statistical tests can be applied to assess reliability and validity. The qualitative variables of sensitivity, specificity, positive predictive value, negative predictive value, false positive and false negative rates, likelihood ratio positive and likelihood ratio negative, as well as odds ratio (i.e., ratio of true to false results), are the most appropriate estimates to evaluate validity of a test compared to a gold standard. In the case of quantitative variables, depending on distribution of the variable, Pearson r or Spearman rho can be applied. Diagnostic accuracy (validity) and diagnostic precision (reliability or agreement) are two completely different methodological issues. Depending on the type of the variable (qualitative or quantitative), well-known statistical tests can be applied to assess validity.

A design of experiments approach to validation sampling for logistic regression modeling with error-prone medical records.

PubMed

Ouyang, Liwen; Apley, Daniel W; Mehrotra, Sanjay

2016-04-01

Electronic medical record (EMR) databases offer significant potential for developing clinical hypotheses and identifying disease risk associations by fitting statistical models that capture the relationship between a binary response variable and a set of predictor variables that represent clinical, phenotypical, and demographic data for the patient. However, EMR response data may be error prone for a variety of reasons. Performing a manual chart review to validate data accuracy is time consuming, which limits the number of chart reviews in a large database. The authors' objective is to develop a new design-of-experiments-based systematic chart validation and review (DSCVR) approach that is more powerful than the random validation sampling used in existing approaches. The DSCVR approach judiciously and efficiently selects the cases to validate (i.e., validate whether the response values are correct for those cases) for maximum information content, based only on their predictor variable values. The final predictive model will be fit using only the validation sample, ignoring the remainder of the unvalidated and unreliable error-prone data. A Fisher information based D-optimality criterion is used, and an algorithm for optimizing it is developed. The authors' method is tested in a simulation comparison that is based on a sudden cardiac arrest case study with 23 041 patients' records. This DSCVR approach, using the Fisher information based D-optimality criterion, results in a fitted model with much better predictive performance, as measured by the receiver operating characteristic curve and the accuracy in predicting whether a patient will experience the event, than a model fitted using a random validation sample. The simulation comparisons demonstrate that this DSCVR approach can produce predictive models that are significantly better than those produced from random validation sampling, especially when the event rate is low. © The Author 2015. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Feasibility, reliability, and validity of the Japanese version of the 12-item World Health Organization Disability Assessment Schedule-2 in preoperative patients.

PubMed

Ida, Mitsuru; Naito, Yusuke; Tanaka, Yuu; Matsunari, Yasunori; Inoue, Satoki; Kawaguchi, Masahiko

2017-08-01

The avoidance of postoperative functional disability is one of the most important concerns of patients facing surgery, but methods to evaluate disability have not been definitively established. The aim of our study was to evaluate the feasibility, reliability, and validity of the Japanese version of the 12-item World Health Organization Disability Assessment Schedule-2 (WHODAS 2.0-J) in preoperative patients. Individuals aged ≥55 years who were scheduled to undergo surgery in a tertiary-care hospital in Japan between April 2016 and September 2016 were eligible for enrolment in the study. All patients were assessed preoperatively using the WHODAS 2.0-J, the 8-Item Short Form (SF-8) questionnaire, and the Tokyo Metropolitan Institute of Gerontology Index (TMIG Index). The feasibility, reliability, and validity of WHODAS2.0-J were evaluated using response rate, Cronbach's alpha (a measure of reliability), and the correlation between the WHODAS 2.0-J and the SF-8 questionnaire and TMIG Index, respectively. A total of 934 patients were enrolled in the study during the study period, of whom 930 completed the WHODAS 2.0-J (response rate 99.5%) preoperatively. Reliability and validity were assessed in the 898 patients who completed all three assessment tools (WHODAS 2.0-J, SF-8 questionnaire, and TMIG Index) and for whom all demographic data were available. Cronbach's alpha was 0.92. The total score of the WHODAS 2.0-J showed a mild or moderate correlation with the SF-8 questionnaire and TMIG Index (r = -0.63 to -0.34). The WHODAS 2.0-J is a feasible, reliable, and valid instrument for evaluating preoperative functional disability in surgical patients.

Construct validity and reliability of a real-time multidimensional smartphone app to assess pain in children and adolescents with cancer.

PubMed

Stinson, Jennifer N; Jibb, Lindsay A; Nguyen, Cynthia; Nathan, Paul C; Maloney, Anne Marie; Dupuis, L Lee; Gerstle, J Ted; Hopyan, Sevan; Alman, Benjamin A; Strahlendorf, Caron; Portwine, Carol; Johnston, Donna L

2015-12-01

We evaluated the construct validity (including responsiveness), reliability, and feasibility of the Pain Squad multidimensional smartphone-based pain assessment application (app) in children and adolescents with cancer, using 2 descriptive studies with repeated measures. Participants (8-18 years) undergoing cancer treatment were drawn from 4 pediatric cancer centers. In study 1, 92 participants self-reported their level of pain twice daily for 2 weeks using the Pain Squad app to assess app construct validity and reliability. In study 2, 14 participants recorded their level of pain twice a day for 1 week before and 2 weeks after cancer-related surgery to determine app responsiveness. Participants in both studies completed multiple measures to determine the construct validity and feasibility of the Pain Squad app. Correlations between average weekly pain ratings on the Pain Squad app and recalled least, average, and worst weekly pain were moderate to high (0.43-0.68). Correlations with health-related quality of life and pain coping (measured with PedsQL Inventory 4.0, PedsQL Cancer Module, and Pain Coping Questionnaire) were -0.46 to 0.29. The app showed excellent internal consistency (α = 0.96). Pain ratings changed because of surgery with large effect sizes between baseline and the first week postsurgery (>0.85) and small effect sizes between baseline and the second week postsurgery (0.13-0.32). These findings provide evidence of the construct validity, reliability, and feasibility of the Pain Squad app in children and adolescents with cancer. Use of real-time data capture approaches should be considered in future studies of childhood cancer pain. A video accompanying this abstract is available online as Supplemental Digital Content at http://links.lww.com/PAIN/A169.

Sediment acoustic index method for computing continuous suspended-sediment concentrations

USGS Publications Warehouse

Landers, Mark N.; Straub, Timothy D.; Wood, Molly S.; Domanski, Marian M.

2016-07-11

Once developed, sediment acoustic index ratings must be validated with additional suspended-sediment samples, beyond the period of record used in the rating development, to verify that the regression model continues to adequately represent sediment conditions within the stream. Changes in ADVM configuration or installation, or replacement with another ADVM, may require development of a new rating. The best practices described in this report can be used to develop continuous estimates of suspended-sediment concentration and load using sediment acoustic surrogates to enable more informed and accurate responses to diverse sedimentation issues.

Validity of a questionnaire measuring the world health organization concept of health system responsiveness with respect to perinatal services in the Dutch obstetric care system.

PubMed

van der Kooy, Jacoba; Valentine, Nicole B; Birnie, Erwin; Vujkovic, Marijana; de Graaf, Johanna P; Denktaş, Semiha; Steegers, Eric A P; Bonsel, Gouke J

2014-12-03

The concept of responsiveness, introduced by the World Health Organization (WHO), addresses non-clinical aspects of health service quality that are relevant regardless of provider, country, health system or health condition. Responsiveness refers to "aspects related to the way individuals are treated and the environment in which they are treated" during health system interactions. This paper assesses the psychometric properties of a newly developed responsiveness questionnaire dedicated to evaluating maternal experiences of perinatal care services, called the Responsiveness in Perinatal and Obstetric Health Care Questionnaire (ReproQ), using the eight-domain WHO concept. The ReproQ was developed between October 2009 and February 2010 by adapting the WHO Responsiveness Questionnaire items to the perinatal care context. The psychometric properties of feasibility, construct validity, and discriminative validity were empirically assessed in a sample of Dutch women two weeks post partum. A total of 171 women consented to participation. Feasibility: the interviews lasted between 20 and 40 minutes and the overall missing rate was 8%. Construct validity: mean Cronbach's alphas for the antenatal, birth and postpartum phase were: 0.73 (range 0.57-0.82), 0.84 (range 0.66-0.92), and 0.87 (range 0.62-0.95) respectively. The item-own scale correlations within all phases were considerably higher than most of the item-other scale correlations. Within the antenatal care, birth care and post partum phases, the eight factors explained 69%, 69%, and 76% of variance respectively. Discriminative validity: overall responsiveness mean sum scores were higher for women whose children were not admitted. This confirmed the hypothesis that dissatisfaction with health outcomes is transferred to their judgement on responsiveness of the perinatal services. The ReproQ interview-based questionnaire demonstrated satisfactory psychometric properties to describe the quality of perinatal care in the Netherlands, with the potential to discriminate between different levels of quality of care. In view of the relatively small sample, further testing and research is recommended.

A call for randomized controlled cost-effectiveness analysis of percutaneous transluminal coronary angioplasty.

PubMed

Holly, N

1988-01-01

A rapidly evolving technology, percutaneous transluminal coronary angioplasty, is increasingly favored over bypass surgery for treating some types of coronary stenosis because of its less traumatic invasion, better recovery response, and lower initial cost. However, substantially higher failure rates in initial procedures offset PTCA's savings to an unknown extent and cloud analysis of its overall impact. Lack of randomized clinical data precludes valid cost-effectiveness comparison of the technologies at this time. Criteria for establishing valid data and evaluations of currently available data are described in this paper.

Author Response to Sabour (2018), "Comment on Hall et al. (2017), 'How to Choose Between Measures of Tinnitus Loudness for Clinical Research? A Report on the Reliability and Validity of an Investigator-Administered Test and a Patient-Reported Measure Using Baseline Data Collected in a Phase IIa Drug Trial'".

PubMed

Hall, Deborah A; Mehta, Rajnikant L; Fackrell, Kathryn

2018-03-08

The authors respond to a letter to the editor (Sabour, 2018) concerning the interpretation of validity in the context of evaluating treatment-related change in tinnitus loudness over time. The authors refer to several landmark methodological publications and an international standard concerning the validity of patient-reported outcome measurement instruments. The tinnitus loudness rating performed better against our reported acceptability criteria for (face and convergent) validity than did the tinnitus loudness matching test. It is important to distinguish between tests that evaluate the validity of measuring treatment-related change over time and tests that quantify the accuracy of diagnosing tinnitus as a case and non-case.

Surrogate clinical endpoints to predict overall survival in non-small cell lung cancer trials-are we in a new era?

PubMed

Clarke, Jeffrey M; Wang, Xiaofei; Ready, Neal E

2015-12-01

Surrogate endpoints for clinical trials in oncology offer an alternative metric for measuring clinical benefit, allowing for shorter trial duration, smaller patient cohorts, and single arm design. The correlation of surrogate endpoints with overall survival (OS) in therapeutic studies is a central consideration to their validity. The Food and Drug Administration (FDA) recently published an analysis of fourteen clinical trials in advanced non-small cell lung cancer (NSCLC), and discovered a strong association between response rate and progression free survival. Furthermore, a correlation between response rate and OS is demonstrated when analyzing the experimental treatment arm separately, minimizing bias from patient crossover. We also highlight multiple, important considerations when using response as an endpoint in clinical trials involving NSCLC patients.

Isolated Limb Perfusion for Malignant Melanoma: Systematic Review on Effectiveness and Safety

PubMed Central

de la Cruz-Merino, Luis; Ferrandiz, Lara; Villegas-Portero, Roman; Nieto-Garcia, Adoracion

2010-01-01

Background. Isolated limb perfusion (ILP) involves the administration of chemotherapy drugs directly into a limb involved by locoregional metastases. Unresectable locally advanced melanoma of the limbs represents one of the clinical settings in which ILP has demonstrated benefits. Methods. A systematic review of the literature on ILP for patients with unresectable locally advanced melanoma of the limbs was conducted. MEDLINE, EMBASE, and Cochrane database searches were conducted to identify studies fulfilling the following inclusion criteria: hyper- or normothermic ILP with melphalan with or without tumor necrosis factor (TNF) or other drugs providing valid data on clinical response, survival, or toxicity. To allocate levels of evidence and grades of recommendation the Scottish Intercollegiate Guidelines Network system was used. Results. Twenty-two studies including 2,018 ILPs were selected with a clear predominance of observational studies (90.90%) against experimental studies (9.10%). The median complete response rate to ILP was of 58.20%, with a median overall response rate of 90.35%. ILP with melphalan yielded a median complete response rate of 46.50%, against a 68.90% median complete response rate for melphalan plus TNF ILP. The median 5-year overall-survival rate was 36.50%, with a median overall survival interval of 36.70 months. The Wieberdink IV and V regional toxicity rates were 2.00% and 0.65%, respectively. Conclusions. ILP is effective in achieving clinical responses in patients with unresectable locally advanced melanoma of the limbs. The disease-free and overall survival rates provided by ILP are acceptable. ILP is safe, with a low incidence of severe regional and systemic toxicity. PMID:20348274

A validity test of movie, television, and video-game ratings.

PubMed

Walsh, D A; Gentile, D A

2001-06-01

Numerous studies have documented the potential effects on young audiences of violent content in media products, including movies, television programs, and computer and video games. Similar studies have evaluated the effects associated with sexual content and messages. Cumulatively, these effects represent a significant public health risk for increased aggressive and violent behavior, spread of sexually transmitted diseases, and pediatric pregnancy. In partial response to these risks and to public and legislative pressure, the movie, television, and gaming industries have implemented ratings systems intended to provide information about the content and appropriate audiences for different films, shows, and games. To test the validity of the current movie-, television-, and video game-rating systems. Panel study. Participants used the KidScore media evaluation tool, which evaluates films, television shows, and video games on 10 aspects, including the appropriateness of the media product for children based on age. When an entertainment industry rates a product as inappropriate for children, parent raters agree that it is inappropriate for children. However, parent raters disagree with industry usage of many of the ratings designating material suitable for children of different ages. Products rated as appropriate for adolescents are of the greatest concern. The level of disagreement varies from industry to industry and even from rating to rating. Analysis indicates that the amount of violent content and portrayals of violence are the primary markers for disagreement between parent raters and industry ratings. As 1 part of a solution to the complex public health problems posed by violent and sexually explicit media products, ratings can have value if used with caution. Parents and caregivers relying on the ratings systems to guide their children's use of media products should continue to monitor content independently. Industry ratings systems should be revised with input from the medical and scientific communities to improve their reliability and validity. A single ratings system, applied universally across industries, would greatly simplify the efforts of parents and caregivers to use the system as well as the efforts of outside parties to monitor the use and validity of the system.

Blast Loading of Epoxy Panels Using a Shock Tube

NASA Technical Reports Server (NTRS)

Pankow, Mark; Waas, Anthony M.; Bednarcyk, Brett

2010-01-01

The high strain rate mechanical response of thin polymer plates has been studied using a modified shock tube. Diagnostics include the pressure-time history of the incident and reflected pulses and the use of digital image correlation (DIC) techniques to extract the time-history of the out-of-plane displacement distribution. Additionally, finite element models have been developed to understand the plate response and to validate and modify plate material constitutive models that have been proposed.

Reliability, construct validity, and responsiveness of the neck disability index, patient-specific functional scale, and numeric pain rating scale in patients with cervical radiculopathy.

PubMed

Young, Ian A; Cleland, Joshua A; Michener, Lori A; Brown, Chris

2010-10-01

To examine the psychometric properties of the Neck Disability Index, Patient-Specific Functional Scale, and the Numeric Pain Rating Scale in a cohort of patients with cervical radiculopathy. A single-group repeated-measures design. Patients (n = 165) presenting to physical therapy with cervical radiculopathy completed the Neck Disability Index, Patient-Specific Functional Scale, and Numeric Pain Rating Scale at the baseline examination and at a follow-up. At the time of follow-up, all patients also completed the Global Rating of Change, which was used to dichotomize patients as improved or stable. Baseline and follow-up scores were used to determine the test-retest reliability, construct validity, and minimal levels of detectable and clinically important change for the Neck Disability Index, Patient-Specific Functional Scale, and Numeric Pain Rating Scale. Both the Neck Disability Index and Numeric Pain Rating Scale exhibited fair test-retest reliability, whereas the Patient-Specific Functional Scale exhibited poor reliability in patients with cervical radiculopathy. All three outcome measures showed adequate responsiveness in this patient population. The minimal detectable change was 13.4 for the Neck Disability Index, 3.3 for the Patient-Specific Functional Scale, and 4.1 for the Numeric Pain Rating Scale. The threshold for the minimal clinically important difference was 8.5 for the Neck Disability Index and 2.2 for both the Patient-Specific Functional Scale and Numeric Pain Rating Scale. In light of the varied distribution of symptoms in patients with cervical radiculopathy, future studies should investigate the psychometric properties of other neck-related disability measures in this patient population.

Validity of a heart rate monitor during work in the laboratory and on the Space Shuttle

NASA Technical Reports Server (NTRS)

Moore, A. D. Jr; Lee, S. M.; Greenisen, M. C.; Bishop, P.

1997-01-01

Accurate heart rate measurement during work is required for many industrial hygiene and ergonomics situations. The purpose of this investigation was to determine the validity of heart rate measurements obtained by a simple, lightweight, commercially available wrist-worn heart rate monitor (HRM) during work (cycle exercise) sessions conducted in the laboratory and also during the particularly challenging work environment of space flight. Three different comparisons were made. The first compared HRM data to simultaneous electrocardiogram (ECG) recordings of varying heart rates that were generated by an ECG simulator. The second compared HRM data to ECG recordings collected during work sessions of 14 subjects in the laboratory. Finally, ECG downlink and HRM data were compared in four astronauts who performed cycle exercise during space flight. The data were analyzed using regression techniques. The results were that the HRM recorded virtually identical heart rates compared with ECG recordings for the data set generated by an ECG simulator. The regression equation for the relationship between ECG versus HRM heart rate data during work in the laboratory was: ECG HR = 0.99 x (HRM) + 0.82 (r2 = 0.99). Finally, the agreement between ECG downlink data and HRM data during space flight was also very high, with the regression equation being: Downlink ECG HR = 1.05 x (HRM) -5.71 (r2 = 0.99). The results of this study indicate that the HRM provides accurate data and may be used to reliably obtain valid data regarding heart rate responses during work.

Validation of Digital Spiral Analysis as Outcome Parameter for Clinical Trials in Essential Tremor

PubMed Central

Haubenberger, Dietrich; Kalowitz, Daniel; Nahab, Fatta B.; Toro, Camilo; Ippolito, Dominic; Luckenbaugh, David A.; Wittevrongel, Loretta; Hallett, Mark

2014-01-01

Essential tremor, one of the most prevalent movement disorders, is characterized by kinetic and postural tremor affecting activities of daily living. Spiral drawing is commonly used to visually rate tremor intensity, as part of the routine clinical assessment of tremor and as a tool in clinical trials. We present a strategy to quantify tremor severity from spirals drawn on a digitizing tablet. We validate our method against a well-established visual spiral rating method and compare both methods on their capacity to capture a therapeutic effect, as defined by the change in clinical essential tremor rating scale after an ethanol challenge. Fifty-four Archimedes spirals were drawn using a digitizing tablet by nine ethanol-responsive patients with essential tremor before and at five consecutive time points after the administration of ethanol in a standardized treatment intervention. Quantitative spiral tremor severity was estimated from the velocity tremor peak amplitude after numerical derivation and Fourier transformation of pen-tip positions. In randomly ordered sets, spirals were scored by seven trained raters, using Bain and Findley’s 0 to 10 rating scale. Computerized scores correlated with visual ratings (P < 0.0001). The correlation was significant at each time point before and after ethanol (P < 0.005). Quantitative ratings provided better sensitivity than visual rating to capture the effects of an ethanol challenge (P < 0.05). Using a standardized treatment approach, we were able to demonstrate that spirography time-series analysis is a valid, reliable method to document tremor intensity and a more sensitive measure for small effects than currently available visual spiral rating methods. PMID:21714004

The development and validation of the speech quality instrument.

PubMed

Chen, Stephanie Y; Griffin, Brianna M; Mancuso, Dean; Shiau, Stephanie; DiMattia, Michelle; Cellum, Ilana; Harvey Boyd, Kelly; Prevoteau, Charlotte; Kohlberg, Gavriel D; Spitzer, Jaclyn B; Lalwani, Anil K

2017-12-08

Although speech perception tests are available to evaluate hearing, there is no standardized validated tool to quantify speech quality. The objective of this study is to develop a validated tool to measure quality of speech heard. Prospective instrument validation study of 35 normal hearing adults recruited at a tertiary referral center. Participants listened to 44 speech clips of male/female voices reciting the Rainbow Passage. Speech clips included original and manipulated excerpts capturing goal qualities such as mechanical and garbled. Listeners rated clips on a 10-point visual analog scale (VAS) of 18 characteristics (e.g. cartoonish, garbled). Skewed distribution analysis identified mean ratings in the upper and lower 2-point limits of the VAS (ratings of 8-10, 0-2, respectively); items with inconsistent responses were eliminated. The test was pruned to a final instrument of nine speech clips that clearly define qualities of interest: speech-like, male/female, cartoonish, echo-y, garbled, tinny, mechanical, rough, breathy, soothing, hoarse, like, pleasant, natural. Mean ratings were highest for original female clips (8.8) and lowest for not-speech manipulation (2.1). Factor analysis identified two subsets of characteristics: internal consistency demonstrated Cronbach's alpha of 0.95 and 0.82 per subset. Test-retest reliability of total scores was high, with an intraclass correlation coefficient of 0.76. The Speech Quality Instrument (SQI) is a concise, valid tool for assessing speech quality as an indicator for hearing performance. SQI may be a valuable outcome measure for cochlear implant recipients who, despite achieving excellent speech perception, often experience poor speech quality. 2b. Laryngoscope, 2017. © 2017 The American Laryngological, Rhinological and Otological Society, Inc.

Evaluating symptom outcomes in gastroparesis clinical trials: validity and responsiveness of the Gastroparesis Cardinal Symptom Index-Daily Diary (GCSI-DD).

PubMed

Revicki, D A; Camilleri, M; Kuo, B; Szarka, L A; McCormack, J; Parkman, H P

2012-05-01

Patient-reported symptom scales are needed to evaluate treatments for gastroparesis. The Gastroparesis Cardinal Symptom Index-Daily Diary (GCSI-DD) was developed to assess daily symptoms of gastroparesis. This study evaluated the validity and responsiveness of the GCSI-DD in patients with gastroparesis. Symptomatic patients were started with a new treatment for gastroparesis. Patients completed the GCSI-DD each evening during a baseline week and for 8 weeks of treatment. Responders were defined based on patient and clinician global rating of change. Minimal important differences (MID) were estimated based on baseline to 4 week changes in symptoms scores for small improvements. Of 69 patients participating, 46 had idiopathic, 19 diabetic, and four postfundoplication gastroparesis. Excellent test-retest reliability was seen for GCSI-DD scores, and there were significant correlations between GCSI-DD scores and clinician ratings of symptom severity. Responders to treatment reported improvements in nausea [effect size (ES) = 0.42, P < 0.001], postprandial fullness, ES = 0.83, P < 0.001), bloating (ES = 0.34, P < 0.001), early satiety (ES = 0.53, P < 0.001), but lower responses for upper abdominal pain (ES = 0.29), and vomiting (ES = 0.22; P = 0.119). MIDs were 0.55 for nausea, 0.97 for excessive fullness, 0.63 for bloating, 0.77 for postprandial fullness, and 0.30 for abdominal pain. A composite score of four symptoms (Composite-1; nausea, bloating, excessive fullness, postprandial fullness) had ES of 0.61 and MID of 0.73. Composite-2 score (nausea, early satiety, bloating, abdominal pain) had a lower ES of 0.47. Symptoms of early satiety, nausea, postprandial fullness, and bloating were responsive to treatment for gastroparesis. A composite of these symptoms also demonstrates validity and responsiveness to treatment for gastroparesis, and may represent an acceptable endpoint for evaluating the effectiveness of medical treatments in clinical trials for gastroparesis. © 2012 Blackwell Publishing Ltd.

Design and validity of a clinic-based case-control study on the molecular epidemiology of lymphoma

PubMed Central

Cerhan, James R; Fredericksen, Zachary S; Wang, Alice H; Habermann, Thomas M; Kay, Neil E; Macon, William R; Cunningham, Julie M; Shanafelt, Tait D; Ansell, Stephen M; Call, Timothy G; Witzig, Thomas E; Slager, Susan L; Liebow, Mark

2011-01-01

We present the design features and implementation of a clinic-based case-control study on the molecular epidemiology of lymphoma conducted at the Mayo Clinic (Rochester, Minnesota, USA), and then assess the internal and external validity of the study. Cases were newly diagnosed lymphoma patients from Minnesota, Iowa and Wisconsin seen at Mayo and controls were patients from the same region without lymphoma who had a pre-scheduled general medical examination, frequency matched on age, sex and residence. Overall response rates were 67% for cases and 70% for controls; response rates were lower for cases and controls over age 70 years, cases with more aggressive disease, and controls from the local area, although absolute differences were modest. Cases and controls were well-balanced on age, sex, and residence characteristics. Demographic and disease characteristics of NHL cases were similar to population-based cancer registry data. Control distributions were similar to population-based data on lifestyle factors and minor allele frequencies of over 500 SNPs, although smoking rates were slightly lower. Associations with NHL in the Mayo study for smoking, alcohol use, family history of lymphoma, autoimmune disease, asthma, eczema, body mass index, and single nucleotide polymorphisms in TNF (rs1800629), LTA (rs909253), and IL10 (rs1800896) were at a magnitude consistent with estimates from pooled studies in InterLymph, with history of any allergy the only directly discordant result in the Mayo study. These data suggest that this study should have strong internal and external validity. This framework may be useful to others who are designing a similar study. PMID:21686124

Pharmacogenetics-based area-under-curve model can predict efficacy and adverse events from axitinib in individual patients with advanced renal cell carcinoma.

PubMed

Yamamoto, Yoshiaki; Tsunedomi, Ryouichi; Fujita, Yusuke; Otori, Toru; Ohba, Mitsuyoshi; Kawai, Yoshihisa; Hirata, Hiroshi; Matsumoto, Hiroaki; Haginaka, Jun; Suzuki, Shigeo; Dahiya, Rajvir; Hamamoto, Yoshihiko; Matsuyama, Kenji; Hazama, Shoichi; Nagano, Hiroaki; Matsuyama, Hideyasu

2018-03-30

We investigated the relationship between axitinib pharmacogenetics and clinical efficacy/adverse events in advanced renal cell carcinoma (RCC) and established a model to predict clinical efficacy and adverse events using pharmacokinetic and gene polymorphisms related to drug metabolism and efflux in a phase II trial. We prospectively evaluated the area under the plasma concentration-time curve (AUC) of axitinib, objective response rate, and adverse events in 44 consecutive advanced RCC patients treated with axitinib. To establish a model for predicting clinical efficacy and adverse events, polymorphisms in genes including ABC transporters ( ABCB1 and ABCG2 ), UGT1A , and OR2B11 were analyzed by whole-exome sequencing, Sanger sequencing, and DNA microarray. To validate this prediction model, calculated AUC by 6 gene polymorphisms was compared with actual AUC in 16 additional consecutive patients prospectively. Actual AUC significantly correlated with the objective response rate ( P = 0.0002) and adverse events (hand-foot syndrome, P = 0.0055; and hypothyroidism, P = 0.0381). Calculated AUC significantly correlated with actual AUC ( P < 0.0001), and correctly predicted objective response rate ( P = 0.0044) as well as adverse events ( P = 0.0191 and 0.0082, respectively). In the validation study, calculated AUC prior to axitinib treatment precisely predicted actual AUC after axitinib treatment ( P = 0.0066). Our pharmacogenetics-based AUC prediction model may determine the optimal initial dose of axitinib, and thus facilitate better treatment of patients with advanced RCC.

Pharmacogenetics-based area-under-curve model can predict efficacy and adverse events from axitinib in individual patients with advanced renal cell carcinoma

PubMed Central

Yamamoto, Yoshiaki; Tsunedomi, Ryouichi; Fujita, Yusuke; Otori, Toru; Ohba, Mitsuyoshi; Kawai, Yoshihisa; Hirata, Hiroshi; Matsumoto, Hiroaki; Haginaka, Jun; Suzuki, Shigeo; Dahiya, Rajvir; Hamamoto, Yoshihiko; Matsuyama, Kenji; Hazama, Shoichi; Nagano, Hiroaki; Matsuyama, Hideyasu

2018-01-01

We investigated the relationship between axitinib pharmacogenetics and clinical efficacy/adverse events in advanced renal cell carcinoma (RCC) and established a model to predict clinical efficacy and adverse events using pharmacokinetic and gene polymorphisms related to drug metabolism and efflux in a phase II trial. We prospectively evaluated the area under the plasma concentration–time curve (AUC) of axitinib, objective response rate, and adverse events in 44 consecutive advanced RCC patients treated with axitinib. To establish a model for predicting clinical efficacy and adverse events, polymorphisms in genes including ABC transporters (ABCB1 and ABCG2), UGT1A, and OR2B11 were analyzed by whole-exome sequencing, Sanger sequencing, and DNA microarray. To validate this prediction model, calculated AUC by 6 gene polymorphisms was compared with actual AUC in 16 additional consecutive patients prospectively. Actual AUC significantly correlated with the objective response rate (P = 0.0002) and adverse events (hand-foot syndrome, P = 0.0055; and hypothyroidism, P = 0.0381). Calculated AUC significantly correlated with actual AUC (P < 0.0001), and correctly predicted objective response rate (P = 0.0044) as well as adverse events (P = 0.0191 and 0.0082, respectively). In the validation study, calculated AUC prior to axitinib treatment precisely predicted actual AUC after axitinib treatment (P = 0.0066). Our pharmacogenetics-based AUC prediction model may determine the optimal initial dose of axitinib, and thus facilitate better treatment of patients with advanced RCC. PMID:29682213

The diagnostic utility of the Rarely Missed Index of the Wechsler Memory Scale-Third Edition in detecting response bias in an adult male incarcerated setting.

PubMed

D'Amato, Christopher P; Denney, Robert L

2008-09-01

The purpose of this study was to utilize a known-group research design to evaluate the diagnostic utility of the Rarely Missed Index (RMI) of the Wechsler Memory Scale-Third Edition [Wechsler, D. (1997). Wechsler Adult Intelligence Test-3rd Edition. San Antonio, TX: The Psychological Corporation] in assessing response bias in an adult male incarcerated setting. Archival data from a sample of 60 adult male inmates who presented for neuropsychological testing were reviewed. Evaluees were assigned to one of two groups; probable malingerers (PM; n=30) and a group of valid test responders (n=30) (1999). Using the recommended cut-off score of 136 or less, the sensitivity of the RMI was extremely low at 33%. Its specificity was 83%. The positive predictive power of the RMI with the published base rate of 22.8 was 38%; with a negative predictive power of 81%. The positive predictive power of the RMI with a published base rate of 70.5 was 82%. The negative predictive power using a base rate of 70.5% was 34%. Results of the receiver operating characteristics (ROC) analysis indicated that the RMI score with a cut-off 136 or less performed only slightly better than chance in delineating probable malingerers from valid responders in this setting. Overall, the findings suggest that the RMI may not be a reliable index for detecting response bias in this setting and perhaps in similar settings.

Measurement carbon dioxide concentration does not affect root respiration of nine tree species in the field

Treesearch

Andrew J. Burton; Kurt S. Pregitzer

2002-01-01

Inhibition of respiration has been reported as a short-term response of tree roots to elevated measurement CO2 concentration ([CO2]), calling into question the validity of root respiration rates determined at CO2 concentrations that differ from the soil [CO2] in the rooting zone...

What Does Ratemyprofessors.com Actually Rate?

ERIC Educational Resources Information Center

Clayson, Dennis E.

2014-01-01

This research looks closely at claims that ratemyprofessors.com creates a valid measure of teaching effectiveness because student responses are consistent with a learning model. While some evidence for this contention was found in three datasets taken from the site, the majority of the evidence indicates that the instrument is biassed by a halo…

Self-Rating and Respondent Anonymity

ERIC Educational Resources Information Center

Goh, Jonathan W. P.; Lee, Ong Kim; Salleh, Hairon

2010-01-01

Background: Most empirical investigations in survey research have been conducted using self-reported or self-evaluated item responses. Such measures are common because they are relatively easy to obtain and are often the only feasible way to assess constructs of interest. In order to improve on the validity of self-reports it has become a common…

Exploring the Reliability and Validity of Pilot Teacher Ratings in a Large California School District

ERIC Educational Resources Information Center

Makkonen, Reino

2013-01-01

Many states and school districts have recently instituted revamped teacher evaluation policies in response to incentives from the federal government as well as a changing political climate favoring holding teachers accountable for the performance of their students. Many of these overhauls have mandated the incorporation of multiple performance…

A Snapshot of Organizational Climate: Perceptions of Extension Faculty

ERIC Educational Resources Information Center

Tower, Leslie E.; Bowen, Elaine; Alkadry, Mohamad G.

2011-01-01

This article provides a snapshot of the perceptions of workplace climate of Extension faculty at a land-grant, research-high activity university, compared with the perceptions of non-Extension faculty at the same university. An online survey was conducted with a validated instrument. The response rate for university faculty was 44% (968); the…

Confirmatory Factor Analysis on the Professional Suitability Scale for Social Work Practice

ERIC Educational Resources Information Center

Tam, Dora M. Y.; Twigg, Robert C.; Boey, Kam-Wing; Kwok, Siu-Ming

2013-01-01

Objective: This article presents a validation study to examine the factor structure of an instrument designed to measure professional suitability for social work practice. Method: Data were collected from registered social workers in a provincial mailed survey. The response rate was 23.2%. After eliminating five cases with multivariate outliers,…

The Process of Identifying Gifted Children in Elementary Education: Teachers' Evaluations of Creativity

ERIC Educational Resources Information Center

Garcia-Ros, Rafael; Talaya, Isabel; Perez-Gonzalez, Francisco

2012-01-01

This study describes the importance of creativity in the identification of gifted elementary-aged children and presents the process of validating a scale for rating the creativity of the students through the teachers' responses. The results show the instrument's unifactorial structure, satisfactory levels of internal consistency, as well as…

Development and validation of the Dimensional Anhedonia Rating Scale (DARS) in a community sample and individuals with major depression.

PubMed

Rizvi, Sakina J; Quilty, Lena C; Sproule, Beth A; Cyriac, Anna; Michael Bagby, R; Kennedy, Sidney H

2015-09-30

Anhedonia, a core symptom of Major Depressive Disorder (MDD), is predictive of antidepressant non-response. In contrast to the definition of anhedonia as a "loss of pleasure", neuropsychological studies provide evidence for multiple facets of hedonic function. The aim of the current study was to develop and validate the Dimensional Anhedonia Rating Scale (DARS), a dynamic scale that measures desire, motivation, effort and consummatory pleasure across hedonic domains. Following item selection procedures and reliability testing using data from community participants (N=229) (Study 1), the 17-item scale was validated in an online study with community participants (N=150) (Study 2). The DARS was also validated in unipolar or bipolar depressed patients (n=52) and controls (n=50) (Study 3). Principal components analysis of the 17-item DARS revealed a 4-component structure mapping onto the domains of anhedonia: hobbies, food/drink, social activities, and sensory experience. Reliability of the DARS subscales was high across studies (Cronbach's α=0.75-0.92). The DARS also demonstrated good convergent and divergent validity. Hierarchical regression analysis revealed the DARS showed additional utility over the Snaith-Hamilton Pleasure Scale (SHAPS) in predicting reward function and distinguishing MDD subgroups. These studies provide support for the reliability and validity of the DARS. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Materials Database Development for Ballistic Impact Modeling

NASA Technical Reports Server (NTRS)

Pereira, J. Michael

2007-01-01

A set of experimental data is being generated under the Fundamental Aeronautics Program Supersonics project to help create and validate accurate computational impact models of jet engine impact events. The data generated will include material property data generated at a range of different strain rates, from 1x10(exp -4)/sec to 5x10(exp 4)/sec, over a range of temperatures. In addition, carefully instrumented ballistic impact tests will be conducted on flat plates and curved structures to provide material and structural response information to help validate the computational models. The material property data and the ballistic impact data will be generated using materials from the same lot, as far as possible. It was found in preliminary testing that the surface finish of test specimens has an effect on measured high strain rate tension response of AL2024. Both the maximum stress and maximum elongation are greater on specimens with a smoother finish. This report gives an overview of the testing that is being conducted and presents results of preliminary testing of the surface finish study.

Provider-patient in-office discussions of response to hepatitis C antiviral therapy and impact on patient comprehension.

PubMed

Hamilton, Heidi E; Nelson, Meaghan; Martin, Paul; Cotler, Scott J

2006-04-01

Providers need to communicate projected response rates effectively to enable patients with hepatitis C virus to make informed decisions about therapy. This study used interactional sociolinguistics (1) to evaluate how gastroenterologists and allied health professionals communicate information regarding response rates to antiviral therapy, (2) to determine how these discussions relate to where the patient is in the continuum of evaluation and treatment, (3) to assess whether patients were aligned with providers in their perceptions of response rates after office visits, and (4) to identify factors that improve provider-patient alignment. Gastroenterologists, allied health professionals, and patients with hepatitis C virus were videotaped and audiotaped during regularly scheduled visits. Postvisit interviews were conducted separately with patients and providers. Visits and postvisits were transcribed and analyzed using validated sociolinguistic techniques. The phase of hepatitis C virus treatment shaped the benchmarks of response talk, although across the treatment continuum providers overwhelmingly made strategic use of positive statistics, providing motivation. In postvisit interviews, 55% of providers and patients were aligned on response rates. Patients with a favorable outcome and patients who asked response-related questions in the visit were more likely to be aligned with providers. Areas identified for improvement included the tendency to discuss response rates before an individualized assessment could be made, balancing motivation and accuracy, and assessing the patient's perspective before delivering any bad news, if necessary. Sociolinguistic analysis provides a powerful tool to evaluate provider-patient interactions and to identify ways to improve in-office communication regarding antiviral therapy.

Performance Ratings: Designs for Evaluating Their Validity and Accuracy.

DTIC Science & Technology

1986-07-01

ratees with substantial validity and with little bias due to the ethod for rating. Convergent validity and discriminant validity account for approximately...The expanded research design suggests that purpose for the ratings has little influence on the multitrait-multimethod properties of the ratings...Convergent and discriminant validity again account for substantial differences in the ratings of performance. Little method bias is present; both methods of

What does it cost to prevent on-duty firefighter cardiac events? A content valid method for calculating costs.

PubMed

Patterson, P Daniel; Suyama, Joe; Reis, Steven E; Weaver, Matthew D; Hostler, David

2013-01-01

Cardiac arrest is a leading cause of mortality among firefighters. We sought to develop a valid method for determining the costs of a workplace prevention program for firefighters. In 2012, we developed a draft framework using human resource accounting and in-depth interviews with experts in the firefighting and insurance industries. The interviews produced a draft cost model with 6 components and 26 subcomponents. In 2013, we randomly sampled 100 fire chiefs out of >7,400 affiliated with the International Association of Fire Chiefs. We used the Content Validity Index (CVI) to identify the content valid components of the draft cost model. This was accomplished by having fire chiefs rate the relevancy of cost components using a 4-point Likert scale (highly relevant to not relevant). We received complete survey data from 65 fire chiefs (65% response rate). We retained 5 components and 21 subcomponents based on CVI scores ≥0.70. The five main components include, (1) investment costs, (2) orientation and training costs, (3) medical and pharmaceutical costs, (4) education and continuing education costs, and (5) maintenance costs. Data from a diverse sample of fire chiefs has produced a content valid method for calculating the cost of a prevention program among firefighters.

What Does It Cost to Prevent On-Duty Firefighter Cardiac Events? A Content Valid Method for Calculating Costs

PubMed Central

Patterson, P. Daniel; Suyama, Joe; Reis, Steven E.; Weaver, Matthew D.; Hostler, David

2013-01-01

Cardiac arrest is a leading cause of mortality among firefighters. We sought to develop a valid method for determining the costs of a workplace prevention program for firefighters. In 2012, we developed a draft framework using human resource accounting and in-depth interviews with experts in the firefighting and insurance industries. The interviews produced a draft cost model with 6 components and 26 subcomponents. In 2013, we randomly sampled 100 fire chiefs out of >7,400 affiliated with the International Association of Fire Chiefs. We used the Content Validity Index (CVI) to identify the content valid components of the draft cost model. This was accomplished by having fire chiefs rate the relevancy of cost components using a 4-point Likert scale (highly relevant to not relevant). We received complete survey data from 65 fire chiefs (65% response rate). We retained 5 components and 21 subcomponents based on CVI scores ≥0.70. The five main components include, (1) investment costs, (2) orientation and training costs, (3) medical and pharmaceutical costs, (4) education and continuing education costs, and (5) maintenance costs. Data from a diverse sample of fire chiefs has produced a content valid method for calculating the cost of a prevention program among firefighters. PMID:24455288

Developing a tool for the preparation of GMP audit of pharmaceutical contract manufacturer.

PubMed

Linna, Anu; Korhonen, Mirka; Mannermaa, Jukka-Pekka; Airaksinen, Marja; Juppo, Anne Mari

2008-06-01

Outsourcing is rapidly growing in the pharmaceutical industry. When the manufacturing activities are outsourced, control of the product's quality has to be maintained. One way to confirm contract manufacturer's GMP (Good Manufacturing Practice) compliance is auditing. Audits can be supported for instance by using GMP questionnaires. The objective of this study was to develop a tool for the audit preparation of pharmaceutical contract manufacturers and to validate its contents by using Delphi method. At this phase of the study the tool was developed for non-sterile finished product contract manufacturers. A modified Delphi method was used with expert panel consisting of 14 experts from pharmaceutical industry, authorities and university. The content validity of the developed tool was assessed by a Delphi questionnaire round. The response rate in Delphi questionnaire round was 86%. The tool consisted of 103 quality items, from which 90 (87%) achieved the pre-defined agreement rate level (75%). Thirteen quality items which did not achieve the pre-defined agreement rate were excluded from the tool. The expert panel suggested only minor changes to the tool. The results show that the content validity of the developed audit preparation tool was good.

Statistical Application and Cost Saving in a Dental Survey.

PubMed

Chyou, Po-Huang; Schroeder, Dixie; Schwei, Kelsey; Acharya, Amit

2017-06-01

To effectively achieve a robust survey response rate in a timely manner, an alternative approach to survey distribution, informed by statistical modeling, was applied to efficiently and cost-effectively achieve the targeted rate of return. A prospective environmental scan surveying adoption of health information technology utilization within their practices was undertaken in a national pool of dental professionals (N=8000) using an alternative method of sampling. The piloted approach to rate of cohort sampling targeted a response rate of 400 completed surveys from among randomly targeted eligible providers who were contacted using replicated subsampling leveraging mailed surveys. Two replicated subsample mailings (n=1000 surveys/mailings) were undertaken to project the true response rate and estimate the total number of surveys required to achieve the final target. Cost effectiveness and non-response bias analyses were performed. The final mailing required approximately 24% fewer mailings compared to targeting of the entire cohort, with a final survey capture exceeding the expected target. An estimated $5000 in cost savings was projected by applying the alternative approach. Non-response analyses found no evidence of bias relative to demographics, practice demographics, or topically-related survey questions. The outcome of this pilot study suggests that this approach to survey studies will accomplish targeted enrollment in a cost effective manner. Future studies are needed to validate this approach in the context of other survey studies. © 2017 Marshfield Clinic.

Statistical Application and Cost Saving in a Dental Survey

PubMed Central

Chyou, Po-Huang; Schroeder, Dixie; Schwei, Kelsey; Acharya, Amit

2017-01-01

Objective To effectively achieve a robust survey response rate in a timely manner, an alternative approach to survey distribution, informed by statistical modeling, was applied to efficiently and cost-effectively achieve the targeted rate of return. Design A prospective environmental scan surveying adoption of health information technology utilization within their practices was undertaken in a national pool of dental professionals (N=8000) using an alternative method of sampling. The piloted approach to rate of cohort sampling targeted a response rate of 400 completed surveys from among randomly targeted eligible providers who were contacted using replicated subsampling leveraging mailed surveys. Methods Two replicated subsample mailings (n=1000 surveys/mailings) were undertaken to project the true response rate and estimate the total number of surveys required to achieve the final target. Cost effectiveness and non-response bias analyses were performed. Results The final mailing required approximately 24% fewer mailings compared to targeting of the entire cohort, with a final survey capture exceeding the expected target. An estimated $5000 in cost savings was projected by applying the alternative approach. Non-response analyses found no evidence of bias relative to demographics, practice demographics, or topically-related survey questions. Conclusion The outcome of this pilot study suggests that this approach to survey studies will accomplish targeted enrollment in a cost effective manner. Future studies are needed to validate this approach in the context of other survey studies. PMID:28373286

The development and validation of the On-the-job Learning Styles Questionnaire for the Nursing Profession.

PubMed

Berings, Marjolein G M C; Poell, Rob F; Simons, P Robert-Jan; van Veldhoven, Marc J P M

2007-06-01

This paper is a report of a study to develop and test the psychometric properties of the On-the-job Learning Style Questionnaire for the Nursing Profession. Although numerous questionnaires measuring learning styles have been developed, none are suitable for working environments. Existing instruments do not meet the requirements for use in workplace settings and tend to ignore the influence of different learning situations. The questionnaire was constructed using a situation-response design, measuring learning activities in different on-the-job learning situations. Content validity was ensured by basing the questionnaire on interview studies. The questionnaire was distributed to 912 Registered Nurses working in different departments of 13 general hospitals in the Netherlands at the end of 2005. The response rate was 41% (372 questionnaires). The internal factor structure of the questionnaire was partly based on the learning activities in which nurses participate and partly on the learning situation in which they are performed. The internal consistency was good. The situation-response design of the questionnaire demonstrated its added value. Construct validity was estimated using intercorrelations between the scales, and criterion validity was estimated based on the relationships of the scales with perceived professional competence. The On-the-job Learning Styles Questionnaire for the Nursing Profession is well suited to describing nurses' learning styles in on-the-job settings and has satisfactory psychometric properties.

Finite element modeling of human brain response to football helmet impacts.

PubMed

Darling, T; Muthuswamy, J; Rajan, S D

2016-10-01

The football helmet is used to help mitigate the occurrence of impact-related traumatic (TBI) and minor traumatic brain injuries (mTBI) in the game of American football. While the current helmet design methodology may be adequate for reducing linear acceleration of the head and minimizing TBI, it however has had less effect in minimizing mTBI. The objectives of this study are (a) to develop and validate a coupled finite element (FE) model of a football helmet and the human body, and (b) to assess responses of different regions of the brain to two different impact conditions - frontal oblique and crown impact conditions. The FE helmet model was validated using experimental results of drop tests. Subsequently, the integrated helmet-human body FE model was used to assess the responses of different regions of the brain to impact loads. Strain-rate, strain, and stress measures in the corpus callosum, midbrain, and brain stem were assessed. Results show that maximum strain-rates of 27 and 19 s(-1) are observed in the brain-stem and mid-brain, respectively. This could potentially lead to axonal injuries and neuronal cell death during crown impact conditions. The developed experimental-numerical framework can be used in the study of other helmet-related impact conditions.

Measurement properties of existing clinical assessment methods evaluating scapular positioning and function. A systematic review.

PubMed

Larsen, Camilla Marie; Juul-Kristensen, Birgit; Lund, Hans; Søgaard, Karen

2014-10-01

The aims were to compile a schematic overview of clinical scapular assessment methods and critically appraise the methodological quality of the involved studies. A systematic, computer-assisted literature search using Medline, CINAHL, SportDiscus and EMBASE was performed from inception to October 2013. Reference lists in articles were also screened for publications. From 50 articles, 54 method names were identified and categorized into three groups: (1) Static positioning assessment (n = 19); (2) Semi-dynamic (n = 13); and (3) Dynamic functional assessment (n = 22). Fifteen studies were excluded for evaluation due to no/few clinimetric results, leaving 35 studies for evaluation. Graded according to the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN checklist), the methodological quality in the reliability and validity domains was "fair" (57%) to "poor" (43%), with only one study rated as "good". The reliability domain was most often investigated. Few of the assessment methods in the included studies that had "fair" or "good" measurement property ratings demonstrated acceptable results for both reliability and validity. We found a substantially larger number of clinical scapular assessment methods than previously reported. Using the COSMIN checklist the methodological quality of the included measurement properties in the reliability and validity domains were in general "fair" to "poor". None were examined for all three domains: (1) reliability; (2) validity; and (3) responsiveness. Observational evaluation systems and assessment of scapular upward rotation seem suitably evidence-based for clinical use. Future studies should test and improve the clinimetric properties, and especially diagnostic accuracy and responsiveness, to increase utility for clinical practice.

Expert assessment of physical ergonomics at video-display unit workstations: repeatability, validity and responsiveness to changes.

PubMed

Ketola, Ritva; Toivonen, Risto; Luukkonen, Ritva; Takala, Esa-Pekka; Viikari-Juntura, Eira

2004-08-01

Inter-observer repeatability, validity and responsiveness to change were determined for an expert assessment method for video-display unit (VDU) workstation ergonomics. The aim was to determine to what extent the expert assessment of ergonomics is related to the technical measurements, tidiness and space, work chair ergonomics and responds to changes in these characteristics. Technical measurements and video-recordings before and 2 months after an ergonomic intervention were made for 109 VDU office workstations. Two experts in ergonomics analysed and rated the ergonomics of the workstations. A researcher analysed tidiness and available space. A physiotherapist classified the work chairs used according to their ergonomic properties. The intra-class correlation coefficient between the workstation ergonomic ratings of the two experts was 0.74 at the baseline and 0.81 at the follow-up. Workstation tidiness and space, and work chair ergonomics, had a strong effect on the assessments of both experts. For both experts a change in the locations of the mouse, the screen and the keyboard and values of tidiness and space and work chair ergonomics during the intervention showed a significant association with the ratings. The assessment method studied can be utilized by an expert in a repeatable manner both in cross-sectional and in longitudinal settings.

Poor early response to methotrexate portends inadequate long-term outcomes in patients with moderate-to-severe psoriasis: Evidence from 2 phase 3 clinical trials.

PubMed

Gordon, Kenneth B; Betts, Keith A; Sundaram, Murali; Signorovitch, James E; Li, Junlong; Xie, Meng; Wu, Eric Q; Okun, Martin M

2017-12-01

Most methotrexate-treated psoriasis patients do not achieve a long-term PASI75 (75% reduction from baseline Psoriasis Area and Severity Index score) response. Indications of nonresponse can be apparent after only 4 weeks of treatment. To develop a prediction rule to identify patients unlikely to respond adequately to methotrexate. Patient-level data from CHAMPION (NCT00235820, N = 110) was used to construct a prediction model for week 16 PASI75 by using patient baseline characteristics and week 4 PASI25. A prediction rule was determined on the basis of the sensitivity and specificity and validated in terms of week 16 PASI75 response in an independent validation sample from trial M10-255 (NCT00679731, N = 163). PASI25 achievement at week 4 (odds ratio = 8.917) was highly predictive of response with methotrexate at week 16. Patients with a predicted response probability <30% were recommended to discontinue methotrexate. The rates of week 16 PASI75 response were 65.8% and 21.1% (P < .001) for patients recommended to continue and discontinue methotrexate, respectively. The CHAMPION trial excluded patients previously treated with biologics, and the M10-255 trial had no restrictions. A prediction rule was developed and validated to identify patients unlikely to respond adequately to methotrexate. The rule indicates that 4 weeks of methotrexate might be sufficient to predict long-term response with limited safety risk. Copyright © 2017 American Academy of Dermatology, Inc. Published by Elsevier Inc. All rights reserved.

Danish translation and validation of the Oslo Sports Trauma Research Centre questionnaires on overuse injuries and health problems.

PubMed

Jorgensen, J E; Rathleff, C R; Rathleff, M S; Andreasen, J

2016-12-01

The Oslo Sports Trauma Research Centre Overuse Injury Questionnaire (OSTRC-O) and the Oslo Sports Trauma Research Centre questionnaire on Health Problems (The OSTRC-H) make it possible to monitor illness and injury at regular intervals capturing prevalence and incidence of acute injury, overuse injury, and illnesses. The aim of this study was to translate, culturally adapt, and establish the face validity of the OSTRC-O and the OSTRC-H into a Danish context (DK) through cognitive interviews and the assessment of test-retest reliability. The OSTRC-O.DK was distributed to 57 heterogenous respondents; response rate was 89%. The OSTRC-H was distributed to 58 heterogenous respondents; response rate was 86%. No major disagreements were observed between the original and translated versions of the questionnaires. The OSTRC-O had high internal consistency (Cronbach's alpha 0.80-0.93). The primary reliability analyses including all participants, showed reliability ICC: 0.62 (95% CI: 0.42-0.77. The secondary reliability analyses that only included subjects who did not change injury region from the test to the retest showed an ICC of 0.86 (95% CI: 0.77-0.92).The questionnaires were found to be valid, reliable, and acceptable for use in a Danish population. © 2015 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Effects of Extended Camera Baseline and Image Magnification on Target Detection Time and Target Recognition with a Stereoscopic TV System.

DTIC Science & Technology

1986-02-01

rates. Target detection times were calculated by averaging response times for all trials within a treatment condition, excluding trials in which...responses in a treatment condition by the total number of valid trials within that condition. Each of these dependent measures was subjected to its own...or 1905 mm). Comparisons among the various treatment means for this effect revealed 13 4~ ~ q-. ~ ~ .-..... 2.309 A EXPERIMENT ONE. 2.29- 0 0 z 2.19

Are You Bleeding? Validation of a Machine-learning Algorithm for Determination of Blood Volume Status: Application to Remote Triage

DTIC Science & Technology

2014-01-09

workloads were determined by matching heart rate responses from each LBNP level. Heart rate and stroke volume (SV) were measured via Finom- eter. ECG, heat...learning algorithm for the assessment of central blood volume via pulse pressure [a noninvasive surrogate of stroke volume (SV)]. These data...30 130 125 120 115 110 105 100 Actual - Finometer Predicted - Algorithm Fig. 3. Comparison of average stroke volume (SV) derived from the

Cardiovascular function in space flight

NASA Astrophysics Data System (ADS)

Nicgossian, A. E.; Charles, J. B.; Bungo, M. W.; Leach-Huntoon, C. S.

Changes in orthostatic heart rate have been noted universally in Soviet and U.S. crewmembers post space flight. The magnitude of these changes appears to be influenced by mission duration, with increasing orthostatic intolerance for the first 7-10 days of flight and then a partial recovery in the orthostatic heart rate response. Fluid loading has been used as a countermeasure to this postflight orthostatic intolerance. Previous reports have documented the effectiveness of this technique, but it has also been noted that the effectiveness of volume expansion diminishes as flight duration exceeds one week. The response of carotid baroreceptor function was investigated utilizing a commercially available neck collar which could apply positive and negative pressure to effect receptor stimulation. Bedrest studies had validated the usefulness and validity of the device. In these studies it was shown that carotid baroreceptor function curves demonstrated less responsiveness to orthostatic stimulation than control individuals. Twelve Space Shuttle crewmembers were examined pre- and postflight from flights lasting from 4-5 days. Plots of baroreceptor function were constructed and plotted as change in R-R interval vs. carotid distending pressure (an orthostatic stimulus). Typical sigmoidal curves were obtained. Postflight the resting heart rate was higher (smaller R-R interval) and the range of R-R value and the slope of the carotid sigmoidal response were both depressed. These changes were not significant immediately postflight (L+O), but did become significant by the second day postflight (L+2), and remained suppressed for several days thereafter. It is hypothesized that the early adaptation to space flight involves a central fluid shift during the initial days of flight, but subsequent alterations in neural controlling mechanisms (such as carotid baroreceptor function) contribute to orthostatic intolerance.

Cardiovascular function in space flight

NASA Technical Reports Server (NTRS)

Nicogossian, A. E.; Charles, J. B.; Bungo, M. W.; Leach-Huntoon, C. S.; Nicgossian, A. E.

1991-01-01

Changes in orthostatic heart rate have been noted universally in Soviet and U.S. crewmembers post space flight. The magnitude of these changes appears to be influenced by mission duration, with increasing orthostatic intolerance for the first 7-10 days of flight and then a partial recovery in the orthostatic heart rate response. Fluid loading has been used as a countermeasure to this postflight orthostatic intolerance. Previous reports have documented the effectiveness of this technique, but it has also been noted that the effectiveness of volume expansion diminishes as flight duration exceeds one week. The response of carotid baroreceptor function was investigated utilizing a commercially available neck collar which could apply positive and negative pressure to effect receptor stimulation. Bedrest studies had validated the usefulness and validity of the device. In these studies it was shown that carotid baroreceptor function curves demonstrated less responsiveness to orthostatic stimulation than control individuals. Twelve Space Shuttle crewmembers were examined pre- and postflight from flights lasting from 4-5 days. Plots of baroreceptor function were constructed and plotted as change in R-R interval vs. carotid distending pressure (an orthostatic stimulus). Typical sigmoidal curves were obtained. Postflight the resting heart rate was higher (smaller R-R interval) and the range of R-R value and the slope of the carotid sigmoidal response were both depressed. These changes were not significant immediately postflight (L + O), but did become significant by the second day postflight (L + 2), and remained suppressed for several days thereafter. It is hypothesized that the early adaptation to space flight involves a central fluid shift during the initial days of flight, but subsequent alterations in neural controlling mechanisms (such as carotid baroreceptor function) contribute to orthostatic intolerance.

Validity of the patient-reported Clinical Global Impression of Change as a measure of treatment response in men with premature ejaculation.

PubMed

Althof, Stanley E; Brock, Gerald B; Rosen, Raymond C; Rowland, David L; Aquilina, Joseph W; Rothman, Margaret; Tesfaye, Fisseha; Bull, Scott

2010-06-01

The Clinical Global Impression of Change (CGIC) measures have high utility in clinical practice. However, it is unknown whether the CGIC is valued for assessing premature ejaculation (PE) symptoms and/or the relationship between CGIC and other validated PE patient-reported measures. The study aims to assess the validity of the patient-reported CGIC measure in men with PE and to examine the relationship between CGIC ratings and assessments of control, satisfaction, personal distress, and interpersonal difficulty. Data from a randomized, double-blind, 24-week phase 3 trial in 1,162 men with PE who received dapoxetine (30 mg or 60 mg) or placebo on demand provided the basis for the analysis. Patients were ≥18 years, in a stable monogamous relationship for ≥6 months, met the Diagnostic and Statistical Manual of Mental Disorders-Fourth Edition-Text Revision criteria for PE for ≥6 months, and had an intravaginal ejaculatory latency time (IELT) ≤2 minutes in ≥75% of intercourse episodes. The CGIC asked patients to rate improvement or worsening of their PE compared with the start of the study using a 7-point response scale; other patient-reported measures were control over ejaculation, satisfaction with sexual intercourse, interpersonal difficulty, and personal distress related to ejaculation. Stopwatch-measured IELT was recorded. Associations between CGIC and change in other measures at study end point were assessed. The magnitude of IELT increased for each category of improvement on the CGIC: 1.63, 4.03, and 7.15 minutes for slightly better, better, and much better, respectively. Higher CGIC ratings were correlated with greater improvement in control (r = 0.73), satisfaction (r = 0.62), greater reduction in distress (r = -0.52), and interpersonal difficulty (r = -0.39). Total variance accounted for was 57.4%: control (48.7%), satisfaction (4.5%), IELT (2.8%), and distress (1.15%). The analyses support the validity of the CGIC measure in men with PE. The CGIC can provide clinicians in practice with a valid and brief outcome assessment of their patient's condition.

The Paediatric Rheumatology International Trials Organisation provisional criteria for the evaluation of response to therapy in juvenile dermatomyositis.

PubMed

Ruperto, Nicolino; Pistorio, Angela; Ravelli, Angelo; Rider, Lisa G; Pilkington, Clarissa; Oliveira, Sheila; Wulffraat, Nico; Espada, Graciela; Garay, Stella; Cuttica, Ruben; Hofer, Michael; Quartier, Pierre; Melo-Gomes, Jose; Reed, Ann M; Wierzbowska, Malgorzata; Feldman, Brian M; Harjacek, Miroslav; Huppertz, Hans-Iko; Nielsen, Susan; Flato, Berit; Lahdenne, Pekka; Michels, Harmut; Murray, Kevin J; Punaro, Lynn; Rennebohm, Robert; Russo, Ricardo; Balogh, Zsolt; Rooney, Madeleine; Pachman, Lauren M; Wallace, Carol; Hashkes, Philip; Lovell, Daniel J; Giannini, Edward H; Gare, Boel Andersson; Martini, Alberto

2010-11-01

To develop a provisional definition for the evaluation of response to therapy in juvenile dermatomyositis (DM) based on the Paediatric Rheumatology International Trials Organisation juvenile DM core set of variables. Thirty-seven experienced pediatric rheumatologists from 27 countries achieved consensus on 128 difficult patient profiles as clinically improved or not improved using a stepwise approach (patient's rating, statistical analysis, definition selection). Using the physicians' consensus ratings as the "gold standard measure," chi-square, sensitivity, specificity, false-positive and-negative rates, area under the receiver operating characteristic curve, and kappa agreement for candidate definitions of improvement were calculated. Definitions with kappa values >0.8 were multiplied by the face validity score to select the top definitions. The top definition of improvement was at least 20% improvement from baseline in 3 of 6 core set variables with no more than 1 of the remaining worsening by more than 30%, which cannot be muscle strength. The second-highest scoring definition was at least 20% improvement from baseline in 3 of 6 core set variables with no more than 2 of the remaining worsening by more than 25%, which cannot be muscle strength (definition P1 selected by the International Myositis Assessment and Clinical Studies group). The third is similar to the second with the maximum amount of worsening set to 30%. This indicates convergent validity of the process. We propose a provisional data-driven definition of improvement that reflects well the consensus rating of experienced clinicians, which incorporates clinically meaningful change in core set variables in a composite end point for the evaluation of global response to therapy in juvenile DM. Copyright © 2010 by the American College of Rheumatology.

Rule-based reasoning is fast and belief-based reasoning can be slow: Challenging current explanations of belief-bias and base-rate neglect.

PubMed

Newman, Ian R; Gibb, Maia; Thompson, Valerie A

2017-07-01

It is commonly assumed that belief-based reasoning is fast and automatic, whereas rule-based reasoning is slower and more effortful. Dual-Process theories of reasoning rely on this speed-asymmetry explanation to account for a number of reasoning phenomena, such as base-rate neglect and belief-bias. The goal of the current study was to test this hypothesis about the relative speed of belief-based and rule-based processes. Participants solved base-rate problems (Experiment 1) and conditional inferences (Experiment 2) under a challenging deadline; they then gave a second response in free time. We found that fast responses were informed by rules of probability and logical validity, and that slow responses incorporated belief-based information. Implications for Dual-Process theories and future research options for dissociating Type I and Type II processes are discussed. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Content validation of behaviours and autonomic responses for the assessment of pain in critically ill adults with a brain injury.

PubMed

Gélinas, Céline; Puntillo, Kathleen A; Boitor, Madalina; Bérubé, Mélanie; Topolovec-Vranic, Jane; Ramelet, Anne-Sylvie; Joffe, Aaron M; Richard-Lalonde, Melissa; Bernard, Francis; Streiner, David L

2018-05-01

The evidence shows that brain-injured patients express behaviours that are related to their level of consciousness (LOC), and different from other patients in the intensive care unit (ICU). Therefore, existing behavioural scales should be revised to enhance their content and validity for use in these patients. The aim was to evaluate the content relevance of behaviours and autonomic responses for pain assessment of brain-injured ICU patients from the perspective of critical care clinicians. A total of 77 clinicians from four adult neuroscience ICUs (three from Canada and one from the United States) participated in this descriptive study. A physician/nurse ratio of 21% (13/61) was reached in this quota sample, and three physiotherapists also participated. They completed a content validation questionnaire of 19 items rated on clarity and relevance based on the patient's LOC. Item Content Validity Index (I-CVI), and modified kappa (κ*) were calculated. Values higher than 0.78 and 0.75 respectively were considered excellent. Regardless of the patient's LOC, brow lowering, grimacing, and trying to reach the pain site were rated as the most relevant behaviours by clinicians, with excellent values of I-CVI>0.78 and κ*>0.75. Eyes tightly closed, moaning and verbal complaints of pain also obtained excellent values in altered LOC and conscious patients. Eye weeping obtained excellent values only in conscious patients. Other items showed fair (0.40-0.59) to good (0.60-0.74) values, while blinking and coughing showed poor values (<0.40) at various LOC. Facial expressions, movements towards the pain site, and vocalisation of pain were the most relevant pain-related behaviours rated by critical care clinicians. The relevance of some behaviours (e.g., moaning and verbal complaints of pain) varied across LOCs, thereby calling forth adaptations of behavioural pain scales to allow for interpretation in the context of a patient's LOC and ability to express specific behaviours. Copyright © 2017. Published by Elsevier Ltd.

Screening and Treatment for Alcohol, Tobacco and Opioid Use Disorders: A Survey of Family Physicians across Ontario

PubMed Central

Loheswaran, Genane; Soklaridis, Sophie; Selby, Peter; Le Foll, Bernard

2015-01-01

Introduction As a primary point of contact within the health care system, family physicians are able to play a vital role in identifying individuals with substance use disorders and connecting them to the appropriate treatment. However, there is very little data available on whether family physicians are actively screening for and treating substance use disorders. The objective of the current survey was to assess whether family physicians in Ontario are screening for alcohol, opioid and tobacco use disorders, using validated tools and providing treatment. Methods An online survey consisting of a series of 38 primarily close-ended questions was circulated to family physicians in Ontario. Rates of screening for alcohol, opioid and tobacco dependence, use of validated tools for screening, providing treatment for dependent individuals and the current barriers to the prescription of pharmacotherapies for these drug dependences were assessed. Results The use of validated screening tools was limited for all three substances. Screening by family physicians for the substance use disorders among adolescents was much lower than screening among adults. Pharmacotherapy was more commonly used as an intervention for tobacco dependence than for alcohol and opioid dependence. This was explained by the lack of knowledge among family physicians on the pharmacotherapies for alcohol and opioid dependence. Conclusions Findings from the current study suggest there is a need for family physicians to integrate screening for substance use disorders using validated tools into their standard medical practice. Furthermore, there is a need for increased knowledge on pharmacotherapies for alcohol and opioid use disorders. It is important to note that the low response rate is a major limitation to this study. One possible reason for this low response rate may be a lack of interest and awareness among family physicians on the importance of screening and treatment of substance use disorders in Ontario. PMID:25923976

FLUKA simulation of TEPC response to cosmic radiation.

PubMed

Beck, P; Ferrari, A; Pelliccioni, M; Rollet, S; Villari, R

2005-01-01

The aircrew exposure to cosmic radiation can be assessed by calculation with codes validated by measurements. However, the relationship between doses in the free atmosphere, as calculated by the codes and from results of measurements performed within the aircraft, is still unclear. The response of a tissue-equivalent proportional counter (TEPC) has already been simulated successfully by the Monte Carlo transport code FLUKA. Absorbed dose rate and ambient dose equivalent rate distributions as functions of lineal energy have been simulated for several reference sources and mixed radiation fields. The agreement between simulation and measurements has been well demonstrated. In order to evaluate the influence of aircraft structures on aircrew exposure assessment, the response of TEPC in the free atmosphere and on-board is now simulated. The calculated results are discussed and compared with other calculations and measurements.

Determination of Heritage SSME Pogo Suppressor Resistance and Inertance from Waterflow Pulse Testing

NASA Technical Reports Server (NTRS)

McDougal, Chris; Eberhart, Chad; Lee, Erik

2016-01-01

Waterflow tests of a heritage Space Shuttle Main Engine pogo suppressor were performed to experimentally quantify the resistance and inertance provided by the suppressor. Measurements of dynamic pressure and flow rate in response to pulsing flow were made throughout the test loop. A unique system identification methodology combined all sensor measurements with a one-dimensional perturbational flow model of the complete water flow loop to spatially translate physical measurements to the device under test. Multiple techniques were then employed to extract the effective resistance and inertance for the pogo suppressor. Parameters such as steady flow rate, perturbational flow rate magnitude, and pulse frequency were investigated to assess their influence on the behavior of the pogo suppressor dynamic response. These results support validation of the RS-25 pogo suppressor performance for use on the Space Launch System Core Stage.

Development and testing of a scale to assess physician attitudes about handheld computers with decision support.

PubMed

Ray, Midge N; Houston, Thomas K; Yu, Feliciano B; Menachemi, Nir; Maisiak, Richard S; Allison, Jeroan J; Berner, Eta S

2006-01-01

The authors developed and evaluated a rating scale, the Attitudes toward Handheld Decision Support Software Scale (H-DSS), to assess physician attitudes about handheld decision support systems. The authors conducted a prospective assessment of psychometric characteristics of the H-DSS including reliability, validity, and responsiveness. Participants were 82 Internal Medicine residents. A higher score on each of the 14 five-point Likert scale items reflected a more positive attitude about handheld DSS. The H-DSS score is the mean across the fourteen items. Attitudes toward the use of the handheld DSS were assessed prior to and six months after receiving the handheld device. Cronbach's Alpha was used to assess internal consistency reliability. Pearson correlations were used to estimate and detect significant associations between scale scores and other measures (validity). Paired sample t-tests were used to test for changes in the mean attitude scale score (responsiveness) and for differences between groups. Internal consistency reliability for the scale was alpha = 0.73. In testing validity, moderate correlations were noted between the attitude scale scores and self-reported Personal Digital Assistant (PDA) usage in the hospital (correlation coefficient = 0.55) and clinic (0.48), p < 0.05 for both. The scale was responsive, in that it detected the expected increase in scores between the two administrations (3.99 (s.d. = 0.35) vs. 4.08, (s.d. = 0.34), p < 0.005). The authors' evaluation showed that the H-DSS scale was reliable, valid, and responsive. The scale can be used to guide future handheld DSS development and implementation.

Neural biomarkers for assessing different types of imagery in pictorial health warning labels for cigarette packaging: a cross-sectional study

PubMed Central

Newman-Norlund, Roger D; Thrasher, James F; Fridriksson, Johann; Brixius, William; Froeliger, Brett; Hammond, David; Cummings, Michael K

2014-01-01

Objective Countries around the world have increasingly adopted pictorial health warning labels (HWLs) for tobacco packages to warn consumers about smoking-related risks. Research on how pictorial HWLs work has primarily analysed self-reported responses to HWLs; studies at the neural level comparing the brain's response to different types of HWLs may provide an important complement to prior studies, especially if self-reported responses are systematically biased. In this study we characterise the brain's response to three types of pictorial HWLs for which prior self-report studies indicated different levels of efficacy. Methods Current smokers rated pictorial HWLs and then observed the same HWLs during functional MRI (fMRI) scanning. Fifty 18–50-year-old current adult smokers who were free from neurological disorders were recruited from the general population and participated in the study. Demographics, smoking-related behaviours and self-reported ratings of pictorial HWL stimuli were obtained prior to scanning. Brain responses to HWLs were assessed using fMRI, focusing on a priori regions of interest. Results Pictorial HWL stimuli elicited activation in a broad network of brain areas associated with visual processing and emotion. Participants who rated the stimuli as more emotionally arousing also showed greater neural responses at these sites. Conclusions Self-reported ratings of pictorial HWLs are correlated with neural responses in brain areas associated with visual and emotional processing. Study results cross-validate self-reported ratings of pictorial HWLs and provide insights into how pictorial HWLs are processed. PMID:25552613

Development and validation of the simulation-based learning evaluation scale.

PubMed

Hung, Chang-Chiao; Liu, Hsiu-Chen; Lin, Chun-Chih; Lee, Bih-O

2016-05-01

The instruments that evaluate a student's perception of receiving simulated training are English versions and have not been tested for reliability or validity. The aim of this study was to develop and validate a Chinese version Simulation-Based Learning Evaluation Scale (SBLES). Four stages were conducted to develop and validate the SBLES. First, specific desired competencies were identified according to the National League for Nursing and Taiwan Nursing Accreditation Council core competencies. Next, the initial item pool was comprised of 50 items related to simulation that were drawn from the literature of core competencies. Content validity was established by use of an expert panel. Finally, exploratory factor analysis and confirmatory factor analysis were conducted for construct validity, and Cronbach's coefficient alpha determined the scale's internal consistency reliability. Two hundred and fifty students who had experienced simulation-based learning were invited to participate in this study. Two hundred and twenty-five students completed and returned questionnaires (response rate=90%). Six items were deleted from the initial item pool and one was added after an expert panel review. Exploratory factor analysis with varimax rotation revealed 37 items remaining in five factors which accounted for 67% of the variance. The construct validity of SBLES was substantiated in a confirmatory factor analysis that revealed a good fit of the hypothesized factor structure. The findings tally with the criterion of convergent and discriminant validity. The range of internal consistency for five subscales was .90 to .93. Items were rated on a 5-point scale from 1 (strongly disagree) to 5 (strongly agree). The results of this study indicate that the SBLES is valid and reliable. The authors recommend that the scale could be applied in the nursing school to evaluate the effectiveness of simulation-based learning curricula. Copyright © 2016 Elsevier Ltd. All rights reserved.

Reliability and validity of the Dutch version of the Consultation and Relational Empathy Measure in primary care.

PubMed

van Dijk, Inge; Scholten Meilink Lenferink, Nick; Lucassen, Peter L B J; Mercer, Stewart W; van Weel, Chris; Olde Hartman, Tim C; Speckens, Anne E M

2017-02-01

Empathy is an essential skill in doctor-patient communication with positive effects on compliance, patient satisfaction and symptom duration. There are no validated patient-rated empathy measures available in Dutch. To investigate the validity and reliability of a Dutch version of the Consultation and Relational Empathy (CARE) Measure, a widely used 10-item patient-rated questionnaire of physician empathy. After translation and back translation, the Dutch CARE Measure was distributed among patients from 19 general practitioners in 5 primary care centers. Tests of internal reliability and validity included Cronbach's alpha, item total correlations and factor analysis. Seven items of the QUality Of care Through the patient's Eyes (QUOTE) questionnaire assessing 'affective performance' of the physician were included in factor analysis and used to investigate convergent validity. Of the 800 distributed questionnaires, 655 (82%) were returned. Acceptability and face validity were supported by a low number of 'does not apply' responses (range 0.2%-11.9%). Internal reliability was high (Cronbach's alpha 0.974). Corrected item total correlations were at a minimum of 0.837. Factor analysis on the 10 items of the CARE Measure and 7 QUOTE items resulted in two factors (Eigenvalue > 1), the first containing the CARE Measure items and the second containing the QUOTE items. Convergent construct validity between the CARE Measure and QUOTE was confirmed with a modest positive correlation (r = 0.34, n = 654, P < 0.001). The findings support the preliminary validity and reliability of the Dutch CARE Measure. Future research is required to investigate divergent validity and discriminant ability between doctors. © The Author 2016. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Interaction of heat production, strain rate and stress power in a plastically deforming body under tensile test

NASA Technical Reports Server (NTRS)

Paglietti, A.

1982-01-01

At high strain rates the heat produced by plastic deformation can give rise to a rate dependent response even if the material has rate independent constitutive equations. This effect has to be evaluated when interpreting a material test, or else it could erroneously be ascribed to viscosity. A general thermodynamic theory of tensile testing of elastic-plastic materials is given in this paper; it is valid for large strain at finite strain rates. It enables discovery of the parameters governing the thermodynamic strain rate effect, provides a method for proper interpretation of the results of the tests of dynamic plasticity, and suggests a way of planning experiments in order to detect the real contribution of viscosity.

Reliability, Validity and Treatment Sensitivity of the Schizophrenia Cognition Rating Scale

PubMed Central

Keefe, Richard S.E.; Davis, Vicki G.; Spagnola, Nathan B.; Hilt, Dana; Dgetluck, Nancy; Ruse, Stacy; Patterson, Thomas L.; Narasimhan, Meera; Harvey, Philip D.

2014-01-01

Cognitive functioning can be assessed with performance-based assessments such as neuropsychological tests and with interview-based assessments. Both assessment methods have the potential to assess whether treatments for schizophrenia improve clinically relevant aspects of cognitive impairment. However, little is known about the reliability, validity and treatment responsiveness of interview-based measures, especially in the context of clinical trials. Data from two studies were utilized to assess these features of the Schizophrenia Cognition Rating Scale (SCoRS). One of the studies was a validation study involving 79 patients with schizophrenia assessed at 3 academic research centers in the US. The other study was a 32-site clinical trial conducted in the US and Europe comparing the effects of encenicline, an alpha-7 nicotine agonist, to placebo in 319 patients with schizophrenia. The SCoRS interviewer ratings demonstrated excellent test-retest reliability in several different circumstances, including those that did not involve treatment (ICC> 0.90), and during treatment (ICC>0.80). SCoRS interviewer ratings were related to cognitive performance as measured by the MCCB (r= −0.35), and demonstrated significant sensitivity to treatment with encenicline compared to placebo (P<.001). These data suggest that the SCoRS has potential as a clinically relevant measure in clinical trials aiming to improve cognition in schizophrenia, and may be useful for clinical practice. The weaknesses of the SCoRS include its reliance on informant information, which is not available for some patients, and reduced validity when patient self-report is the sole information source. PMID:25028065

Reliability, validity and treatment sensitivity of the Schizophrenia Cognition Rating Scale.

PubMed

Keefe, Richard S E; Davis, Vicki G; Spagnola, Nathan B; Hilt, Dana; Dgetluck, Nancy; Ruse, Stacy; Patterson, Thomas D; Narasimhan, Meera; Harvey, Philip D

2015-02-01

Cognitive functioning can be assessed with performance-based assessments such as neuropsychological tests and with interview-based assessments. Both assessment methods have the potential to assess whether treatments for schizophrenia improve clinically relevant aspects of cognitive impairment. However, little is known about the reliability, validity and treatment responsiveness of interview-based measures, especially in the context of clinical trials. Data from two studies were utilized to assess these features of the Schizophrenia Cognition Rating Scale (SCoRS). One of the studies was a validation study involving 79 patients with schizophrenia assessed at 3 academic research centers in the US. The other study was a 32-site clinical trial conducted in the US and Europe comparing the effects of encenicline, an alpha-7 nicotine agonist, to placebo in 319 patients with schizophrenia. The SCoRS interviewer ratings demonstrated excellent test-retest reliability in several different circumstances, including those that did not involve treatment (ICC> 0.90), and during treatment (ICC>0.80). SCoRS interviewer ratings were related to cognitive performance as measured by the MCCB (r=-0.35), and demonstrated significant sensitivity to treatment with encenicline compared to placebo (P<.001). These data suggest that the SCoRS has potential as a clinically relevant measure in clinical trials aiming to improve cognition in schizophrenia, and may be useful for clinical practice. The weaknesses of the SCoRS include its reliance on informant information, which is not available for some patients, and reduced validity when patient's self-report is the sole information source. Copyright © 2014 Elsevier B.V. and ECNP. All rights reserved.

The Impact of World Englishes on Language Assessment: Rater Attitude, Rating Behavior, and Challenges

ERIC Educational Resources Information Center

Hsu, Huei-Lien

2012-01-01

By centralizing the issue of test fairness in language proficiency assessments, this study responds to a call by researchers for developing greater social responsibility in the language testing agenda. As inquiries into language attitude and psychology indicate, there is an underlying uncertainty pertaining to the validity of test use and score…

Flight instrument and telemetry response and its inversion

NASA Technical Reports Server (NTRS)

Weinberger, M. R.

1971-01-01

Mathematical models of rate gyros, servo accelerometers, pressure transducers, and telemetry systems were derived and their parameters were obtained from laboratory tests. Analog computer simulations were used extensively for verification of the validity for fast and large input signals. An optimal inversion method was derived to reconstruct input signals from noisy output signals and a computer program was prepared.

Revalidate Forms of Presence in Training Effectiveness: Mediating Effect of Self-Efficacy

ERIC Educational Resources Information Center

Lin, Shinyi; Hung, Tze-Chien; Lee, Chia-Tsung

2015-01-01

With the community of inquiry framework, this study seeks to explore the relationship among forms of presence, self-efficacy, and training effectiveness. A total of 210 working professionals participated to the study via online survey and email communication with a valid response rate of 29.53%. The technique of partial least square was used to…

Application of a Method of Estimating DIF for Polytomous Test Items.

ERIC Educational Resources Information Center

Camilli, Gregory; Congdon, Peter

1999-01-01

Demonstrates a method for studying differential item functioning (DIF) that can be used with dichotomous or polytomous items and that is valid for data that follow a partial credit Item Response Theory model. A simulation study shows that positively biased Type I error rates are in accord with results from previous studies. (SLD)

Computer Usage and the Validity of Self-Assessed Computer Competence among First-Year Business Students

ERIC Educational Resources Information Center

Ballantine, Joan A.; McCourt Larres, Patricia; Oyelere, Peter

2007-01-01

This study evaluates the reliability of self-assessment as a measure of computer competence. This evaluation is carried out in response to recent research which has employed self-reported ratings as the sole indicator of students' computer competence. To evaluate the reliability of self-assessed computer competence, the scores achieved by students…

Experimental validation of the RATE tool for inferring HLA restrictions of T cell epitopes.

PubMed

Paul, Sinu; Arlehamn, Cecilia S Lindestam; Schulten, Veronique; Westernberg, Luise; Sidney, John; Peters, Bjoern; Sette, Alessandro

2017-06-21

The RATE tool was recently developed to computationally infer the HLA restriction of given epitopes from immune response data of HLA typed subjects without additional cumbersome experimentation. Here, RATE was validated using experimentally defined restriction data from a set of 191 tuberculosis-derived epitopes and 63 healthy individuals with MTB infection from the Western Cape Region of South Africa. Using this experimental dataset, the parameters utilized by the RATE tool to infer restriction were optimized, which included relative frequency (RF) of the subjects responding to a given epitope and expressing a given allele as compared to the general test population and the associated p-value in a Fisher's exact test. We also examined the potential for further optimization based on the predicted binding affinity of epitopes to potential restricting HLA alleles, and the absolute number of individuals expressing a given allele and responding to the specific epitope. Different statistical measures, including Matthew's correlation coefficient, accuracy, sensitivity and specificity were used to evaluate performance of RATE as a function of these criteria. Based on our results we recommend selection of HLA restrictions with cutoffs of p-value < 0.01 and RF ≥ 1.3. The usefulness of the tool was demonstrated by inferring new HLA restrictions for epitope sets where restrictions could not be experimentally determined due to lack of necessary cell lines and for an additional data set related to recognition of pollen derived epitopes from allergic patients. Experimental data sets were used to validate RATE tool and the parameters used by the RATE tool to infer restriction were optimized. New HLA restrictions were identified using the optimized RATE tool.

French adaptation of the new Knee Society Scoring System for total knee arthroplasty.

PubMed

Debette, C; Parratte, S; Maucort-Boulch, D; Blanc, G; Pauly, V; Lustig, S; Servien, E; Neyret, P; Argenson, J N

2014-09-01

In November 2011, the Knee Society published its new KSS score to evaluate objective clinical data and also patient expectations, satisfaction and knee function during various physical activities before and after total knee arthroplasty (TKA). We undertook the French cross-cultural adaptation of this scoring system according to current recommendations. The French version of the new KSS score is a consistent, feasible, reliable and discriminating score. Eighty patients with knee osteoarthritis were recruited from two centers: one group of 40 patients had a TKA indication, while the other group of 40 patients had an indication for conservative treatment. After the new KSS score was translated and back-translated, it was compared to three other validated instruments (KOOS, AMIQUAL and SF-12) to determine construct validity, discriminating power, feasibility in terms of response rate and existence of floor or ceiling effect, internal consistency with Chronbach's alpha and reliability based on reproducibility and sensitivity to change (responsiveness). Due to missing data, two cases were eliminated. We found that the score could discriminate between groups; it had a nearly 100% response rate, a ceiling effect in the "expectations" domain, satisfactory Chronbach's alpha, excellent reproducibility and good responsiveness. These results confirm that the French version of the new KSS score is reliable, feasible, discriminating, consistent and responsive. The novelty of this scoring system resides in the "expectations" and "satisfaction" domains, its availability as a self-assessment questionnaire and the evaluation of function during various activities. Level III. Copyright © 2014 Elsevier Masson SAS. All rights reserved.

Transformational, transactional among physician and laissez-faire leadership among physician executives.

PubMed

Xirasagar, Sudha

2008-01-01

The purpose of this paper is to examine the empirical validity of transformational, transactional and laissez-faire leadership and their sub-scales among physician managers. A nation-wide, anonymous mail survey was carried out in the United States, requesting community health center executive directors to provide ratings of their medical director's leadership behaviors (34 items) and effectiveness (nine items), using the Multifactor Leadership Questionnaire 5X-Short, on a five-point Likert scale. The survey response rate was 40.9 percent, for a total 269 responses. Exploratory factor analysis was done, using principal factor extraction, followed by promax rotation). The data yielded a three-factor structure, generally aligned with Bass and Avolio's constructs of transformational, transactional and laissez-faire leadership. Data do not support the factorial independence of their subscales (idealized influence, inspirational motivation, individualized consideration, and intellectual stimulation under transformational leadership; contingent reward, management-by-exception active, and management-by-exception passive under transactional leadership). Two contingent reward items loaded on transformational leadership, and all items of management-by-exception passive loaded on laissez-faire. A key limitation is that supervisors were surveyed for ratings of the medical directors' leadership style. Although past research in other fields has shown that supervisor ratings are strongly correlated with subordinate ratings, further research is needed to validate the findings by surveying physician and other clinical subordinates. Such research will also help to develop appropriate content of leadership training for clinical leaders. This study represents an important step towards establishing the empirical evidence for the full range of leadership constructs among physician leaders.

Development and validation of a generic high-performance liquid chromatography for the simultaneous separation and determination of six cough ingredients: Robustness study on core-shell particles.

PubMed

Yehia, Ali Mohamed; Essam, Hebatallah Mohamed

2016-09-01

A generally applicable high-performance liquid chromatographic method for the qualitative and quantitative determination of pharmaceutical preparations containing phenylephrine hydrochloride, paracetamol, ephedrine hydrochloride, guaifenesin, doxylamine succinate, and dextromethorphan hydrobromide is developed. Optimization of chromatographic conditions was performed for the gradient elution using different buffer pH values, flow rates and two C18 stationary phases. The method was developed using a Kinetex® C18 column as a core-shell stationary phase with a gradient profile using buffer pH 5.0 and acetonitrile at 2.0 mL/min flow rate. Detection was carried out at 220 nm and linear calibrations were obtained for all components within the studied ranges. The method was fully validated in agreement with ICH guidelines. The proposed method is specific, accurate and precise (RSD% < 3%). Limits of detection are lower than 2.0 μg/mL. Qualitative and quantitative responses were evaluated using experimental design to assist the method robustness. The method was proved to be highly robust against 10% change in buffer pH and flow rate (RSD% < 10%), however, the flow rate may significantly influence the quantitative responses of phenylephrine, paracetamol, and doxylamine (RSD% > 10%). Satisfactory results were obtained for commercial combinations analyses. Statistical comparison between the proposed chromatographic and official methods revealed no significant difference. © 2016 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.

The Brighton musculoskeletal Patient-Reported Outcome Measure (BmPROM): An assessment of validity, reliability, and responsiveness.

PubMed

Bryant, Elizabeth; Murtagh, Shemane; Finucane, Laura; McCrum, Carol; Mercer, Christopher; Smith, Toby; Canby, Guy; Rowe, David A; Moore, Ann P

2018-05-11

In response for the need of a freely available, stand-alone, validated outcome measure for use within musculoskeletal (MSK) physiotherapy practice, sensitive enough to measure clinical effectiveness, we developed an MSK patient reported outcome measure. This study examined the validity and reliability of the newly developed Brighton musculoskeletal Patient-Reported Outcome Measure (BmPROM) within physiotherapy outpatient settings. Two hundred twenty-four patients attending physiotherapy outpatient departments in South East England with an MSK condition participated in this study. The BmPROM was assessed for user friendliness (rated feedback, N = 224), reliability (internal consistency and test-retest reliability, n = 42), validity (internal and external construct validity, N = 224), and responsiveness (internal, n = 25). Exploratory factor analysis indicated that a two-factor model provides a good fit to the data. Factors were representative of "Functionality" and "Wellbeing". Correlations observed between the BmPROM and SF-36 domains provided evidence of convergent validity. Reliability results indicated that both subscales were internally consistent with alphas above the acceptable limits for both "Functionality" (α = .85, 95% CI [.81, .88]) and 'Wellbeing' (α = .80, 95% CI [.75, .84]). Test-retest analyses (n = 42) demonstrated a high degree of reliability between "Functionality" (ICC = .84; 95% CI [.72, .91]) and "Wellbeing" scores (ICC = .84; 95% CI [.72, .91]). Further examination of test-retest reliability through the Bland-Altman analysis demonstrated that the difference between "Functionality" and "Wellbeing" test scores did not vary as a function of absolute test score. Large treatment effect sizes were found for both subscales (Functionality d = 1.10; Wellbeing 1.03). The BmPROM is a reliable and valid outcome measure for use in evaluating physiotherapy treatment of MSK conditions. Copyright © 2018 John Wiley & Sons, Ltd.

The development and validation of the core competencies scale (CCS) for the college and university students.

PubMed

Ruan, Bin; Mok, Magdalena Mo Ching; Edginton, Christopher R; Chin, Ming Kai

2012-01-01

This article describes the development and validation of the Core Competencies Scale (CCS) using Bok's (2006) competency framework for undergraduate education. The framework included: communication, critical thinking, character development, citizenship, diversity, global understanding, widening of interest, and career and vocational development. The sample comprised 70 college and university students. Results of analysis using Rasch rating scale modelling showed that there was strong empirical evidence on the validity of the measures in contents, structure, interpretation, generalizability, and response options of the CCS scale. The implication of having developed Rasch-based valid and dependable measures in this study for gauging the value added of college and university education to their students is that the feedback generated from CCS will enable evidence-based decision and policy making to be implemented and strategized. Further, program effectiveness can be measured and thus accountability on the achievement of the program objectives.

Validity, Sensitivity, and Responsiveness of the 11-Face Faces Pain Scale to Postoperative Pain in Adult Orthopedic Surgery Patients.

PubMed

Van Giang, Nguyen; Chiu, Hsiao-Yean; Thai, Duong Hong; Kuo, Shu-Yu; Tsai, Pei-Shan

2015-10-01

Pain is common in patients after orthopedic surgery. The 11-face Faces Pain Scale has not been validated for use in adult patients with postoperative pain. To assess the validity of the 11-face Faces Pain Scale and its ability to detect responses to pain medications, and to determine whether the sensitivity of the 11-face Faces Pain Scale for detecting changes in pain intensity over time is associated with gender differences in adult postorthopedic surgery patients. The 11-face Faces Pain Scale was translated into Vietnamese using forward and back translation. Postoperative pain was assessed using an 11-point numerical rating scale and the 11-face Faces Pain Scale on the day of surgery, and before (Time 1) and every 30 minutes after (Times 2-5) the patients had taken pain medications on the first postoperative day. The 11-face Faces Pain Scale highly correlated with the numerical rating scale (r = 0.78, p < .001). When the scores from each follow-up test (Times 2-5) were compared with those from the baseline test (Time 1), the effect sizes were -0.70, -1.05, -1.20, and -1.31, and the standardized response means were -1.17, -1.59, -1.66, and -1.82, respectively. The mean change in pain intensity, but not gender-time interaction effect, over the five time points was significant (F = 182.03, p < .001). Our results support that the 11-face Faces Pain Scale is appropriate for measuring acute postoperative pain in adults. Copyright © 2015 American Society for Pain Management Nursing. Published by Elsevier Inc. All rights reserved.

Validation of sentinel lymph node biopsy in breast cancer women N1-N2 with complete axillary response after neoadjuvant chemotherapy. Multicentre study in Tarragona.

PubMed

Carrera, D; de la Flor, M; Galera, J; Amillano, K; Gomez, M; Izquierdo, V; Aguilar, E; López, S; Martínez, M; Martínez, S; Serra, J M; Pérez, M; Martin, L

2016-01-01

The aim of our study was to evaluate sentinel lymph node biopsy as a diagnostic test for assessing the presence of residual metastatic axillary lymph nodes after neoadjuvant chemotherapy, replacing the need for a lymphadenectomy in negative selective lymph node biopsy patients. A multicentre, diagnostic validation study was conducted in the province of Tarragona, on women with T1-T3, N1-N2 breast cancer, who presented with a complete axillary response after neoadjuvant chemotherapy. Study procedures consisted of performing an selective lymph node biopsy followed by lymphadenectomy. A total of 53 women were included in the study. Surgical detection rate was 90.5% (no sentinel node found in 5 patients). Histopathological analysis of the lymphadenectomy showed complete disease regression of axillary nodes in 35.4% (17/48) of the patients, and residual axillary node involvement in 64.6% (31/48) of them. In lymphadenectomy positive patients, 28 had a positive selective lymph node biopsy (true positive), while 3 had a negative selective lymph node biopsy (false negative). Of the 28 true selective lymph node biopsy positives, the sentinel node was the only positive node in 10 cases. All lymphadenectomy negative cases were selective lymph node biopsy negative. These data yield a sensitivity of 93.5%, a false negative rate of 9.7%, and a global test efficiency of 93.7%. Selective lymph node biopsy after chemotherapy in patients with a complete axillary response provides valid and reliable information regarding axillary status after neoadjuvant treatment, and might prevent lymphadenectomy in cases with negative selective lymph node biopsy. Copyright © 2016 Elsevier España, S.L.U. and SEMNIM. All rights reserved.

A Latent Variables Examination of Processing Speed, Response Inhibition, and Working Memory during Typical Development

PubMed Central

McAuley, Tara; White, Desirée

2010-01-01

The present study addressed three related aims: (1) to replicate and extend previous work regarding the non-unitary nature of processing speed, response inhibition, and working memory during development, (2) to quantify the rate at which processing speed, response inhibition, and working memory develop and the extent to which the development of these latter abilities reflect general changes in processing speed, and (3) to evaluate whether commonly used tasks of processing speed, response inhibition, and working memory are valid and reliable when used with a developmentally diverse group. To address these aims, a latent variables approach was used to analyze data from 147 participants 6 to 24 years of age. Results showed that processing speed, response inhibition, and working memory were separable abilities and that the extent of this separability was stable cross the age range of participants. All three constructs improved as a function of age; however, only the effect of age on working memory remained significant after processing speed was controlled. The psychometric properties of tasks used to assess the constructs were age invariant, thus validating their use in studies of executive development. PMID:20888572

Workforce perceptions of hospital safety culture: development and validation of the patient safety climate in healthcare organizations survey.

PubMed

Singer, Sara; Meterko, Mark; Baker, Laurence; Gaba, David; Falwell, Alyson; Rosen, Amy

2007-10-01

To describe the development of an instrument for assessing workforce perceptions of hospital safety culture and to assess its reliability and validity. Primary data collected between March 2004 and May 2005. Personnel from 105 U.S. hospitals completed a 38-item paper and pencil survey. We received 21,496 completed questionnaires, representing a 51 percent response rate. Based on review of existing safety climate surveys, we developed a list of key topics pertinent to maintaining a culture of safety in high-reliability organizations. We developed a draft questionnaire to address these topics and pilot tested it in four preliminary studies of hospital personnel. We modified the questionnaire based on experience and respondent feedback, and distributed the revised version to 42,249 hospital workers. We randomly divided respondents into derivation and validation samples. We applied exploratory factor analysis to responses in the derivation sample. We used those results to create scales in the validation sample, which we subjected to multitrait analysis (MTA). We identified nine constructs, three organizational factors, two unit factors, three individual factors, and one additional factor. Constructs demonstrated substantial convergent and discriminant validity in the MTA. Cronbach's alpha coefficients ranged from 0.50 to 0.89. It is possible to measure key salient features of hospital safety climate using a valid and reliable 38-item survey and appropriate hospital sample sizes. This instrument may be used in further studies to better understand the impact of safety climate on patient safety outcomes.

Using process elicitation and validation to understand and improve chemotherapy ordering and delivery.

PubMed

Mertens, Wilson C; Christov, Stefan C; Avrunin, George S; Clarke, Lori A; Osterweil, Leon J; Cassells, Lucinda J; Marquard, Jenna L

2012-11-01

Chemotherapy ordering and administration, in which errors have potentially severe consequences, was quantitatively and qualitatively evaluated by employing process formalism (or formal process definition), a technique derived from software engineering, to elicit and rigorously describe the process, after which validation techniques were applied to confirm the accuracy of the described process. The chemotherapy ordering and administration process, including exceptional situations and individuals' recognition of and responses to those situations, was elicited through informal, unstructured interviews with members of an interdisciplinary team. The process description (or process definition), written in a notation developed for software quality assessment purposes, guided process validation (which consisted of direct observations and semistructured interviews to confirm the elicited details for the treatment plan portion of the process). The overall process definition yielded 467 steps; 207 steps (44%) were dedicated to handling 59 exceptional situations. Validation yielded 82 unique process events (35 new expected but not yet described steps, 16 new exceptional situations, and 31 new steps in response to exceptional situations). Process participants actively altered the process as ambiguities and conflicts were discovered by the elicitation and validation components of the study. Chemotherapy error rates declined significantly during and after the project, which was conducted from October 2007 through August 2008. Each elicitation method and the subsequent validation discussions contributed uniquely to understanding the chemotherapy treatment plan review process, supporting rapid adoption of changes, improved communication regarding the process, and ensuing error reduction.

Changes in Gene Expression Predicting Local Control in Cervical Cancer: Results from Radiation Therapy Oncology Group 0128

PubMed Central

Weidhaas, Joanne B.; Li, Shu-Xia; Winter, Kathryn; Ryu, Janice; Jhingran, Anuja; Miller, Bridgette; Dicker, Adam P.; Gaffney, David

2009-01-01

Purpose To evaluate the potential of gene expression signatures to predict response to treatment in locally advanced cervical cancer treated with definitive chemotherapy and radiation. Experimental Design Tissue biopsies were collected from patients participating in Radiation Therapy Oncology Group (RTOG) 0128, a phase II trial evaluating the benefit of celecoxib in addition to cisplatin chemotherapy and radiation for locally advanced cervical cancer. Gene expression profiling was done and signatures of pretreatment, mid-treatment (before the first implant), and “changed” gene expression patterns between pre- and mid-treatment samples were determined. The ability of the gene signatures to predict local control versus local failure was evaluated. Two-group t test was done to identify the initial gene set separating these end points. Supervised classification methods were used to enrich the gene sets. The results were further validated by leave-one-out and 2-fold cross-validation. Results Twenty-two patients had suitable material from pretreatment samples for analysis, and 13 paired pre- and mid-treatment samples were obtained. The changed gene expression signatures between the pre- and mid-treatment biopsies predicted response to treatment, separating patients with local failures from those who achieved local control with a seven-gene signature. The in-sample prediction rate, leave-one-out prediction rate, and 2-fold prediction rate are 100% for this seven-gene signature. This signature was enriched for cell cycle genes. Conclusions Changed gene expression signatures during therapy in cervical cancer can predict outcome as measured by local control. After further validation, such findings could be applied to direct additional therapy for cervical cancer patients treated with chemotherapy and radiation. PMID:19509178

Separating spatial search and efficiency rates as components of predation risk

PubMed Central

DeCesare, Nicholas J.

2012-01-01

Predation risk is an important driver of ecosystems, and local spatial variation in risk can have population-level consequences by affecting multiple components of the predation process. I use resource selection and proportional hazard time-to-event modelling to assess the spatial drivers of two key components of risk—the search rate (i.e. aggregative response) and predation efficiency rate (i.e. functional response)—imposed by wolves (Canis lupus) in a multi-prey system. In my study area, both components of risk increased according to topographic variation, but anthropogenic features affected only the search rate. Predicted models of the cumulative hazard, or risk of a kill, underlying wolf search paths validated well with broad-scale variation in kill rates, suggesting that spatial hazard models provide a means of scaling up from local heterogeneity in predation risk to population-level dynamics in predator–prey systems. Additionally, I estimated an integrated model of relative spatial predation risk as the product of the search and efficiency rates, combining the distinct contributions of spatial heterogeneity to each component of risk. PMID:22977145

Performance of the Swedish version of the Revised Piper Fatigue Scale.

PubMed

Jakobsson, Sofie; Taft, Charles; Östlund, Ulrika; Ahlberg, Karin

2013-12-01

The Revised Piper Fatigue scale is one of the most widely used instruments internationally to assess cancer-related fatigue. The aim of the present study was to evaluate selected psychometric properties of a Swedish version of the RPFS (SPFS). An earlier translation of the SPFS was further evaluated and developed. The new version was mailed to 300 patients undergoing curative radiotherapy. The internal validity was assessed using Principal Axis Factor Analysis with oblimin rotation and multitrait analysis. External validity was examined in relation to the Multidimensional Fatigue Inventory-20 (MFI-20) and in known-groups analyses. Totally 196 patients (response rate = 65%) returned evaluable questionnaires. Principal axis factoring analysis yielded three factors (74% of the variance) rather than four as in the original RPFS. Multitrait analyses confirmed the adequacy of scaling assumptions. Known-groups analyses failed to support the discriminative validity. Concurrent validity was satisfactory. The new Swedish version of the RPFS showed good acceptability, reliability and convergent and- discriminant item-scale validity. Our results converge with other international versions of the RPFS in failing to support the four-dimension conceptual model of the instrument. Hence, RPFS suitability for use in international comparisons may be limited which also may have implications for cross-cultural validity of the newly released 12-item version of the RPFS. Further research on the Swedish version should address reasons for high missing rates for certain items in the subscale of affective meaning, further evaluation of the discriminative validity and assessment of its sensitivity in detecting changes over time. Copyright © 2013 Elsevier Ltd. All rights reserved.

Validating dental and medical students' evaluations of faculty teaching in an integrated, multi-instructor course.

PubMed

Stratton, Terry D; Witzke, Donald B; Freund, Mary Jane; Wilson, Martha T; Jacob, Robert J

2005-06-01

As more students from various health professions are combined into integrated courses, evaluating the teaching quality of individual faculty in these typically large, multi-instructor contexts becomes increasingly difficult. Indeed, students who lack sufficient recall of a given faculty member or are not committed to the evaluation process may respond by marking identical responses to all evaluation items (e.g., 3-3-3-3-3), regardless of the specific content of the items on the faculty evaluation questionnaire. These "straight-lining" behaviors-more formally referred to as monotonic response patterns (MRPs)-often reflect students' inattention to the task at hand or lack of motivation to be discriminating, which may result in invalid data. This study examines the prevalence of MRP ratings in relation to indicators reflective of students' lack of attention to evaluating the quality of faculty teaching. Dental and medical students in a required, second-year (medicine) basic science course conducted by the medical school and taught primarily by medical school faculty completed seven-item faculty evaluation forms, along with an anonymous questionnaire measuring their need to evaluate, attitudes toward faculty evaluation, and recall of instructors. MRP ratings failed to correlate significantly with students' need to evaluate or their attitudes toward faculty evaluation. However, among medical students, MRP "straight-line" responses were more prevalent for raters who recalled faculty members "very well" (p=.04). For dental students, MRPs were associated with less accurate recall (p=.01). As such, the validity of faculty evaluations within integrated, multi-instructor courses may vary when students rate distinct aspects of a teacher's performance identically. In this case-in which medical students' greater recall of instructors coincides with MRPs-ratings may suffice as global, holistic assessments of an instructor's teaching. For dental students, similar ratings may be less viable. Individual item analysis is cautioned under any circumstances.

Cross-cultural adaptation of the German version of the spinal stenosis measure.

PubMed

Wertli, Maria M; Steurer, Johann; Wildi, Lukas M; Held, Ulrike

2014-06-01

To validate the German version of the spinal stenosis measure (SSM), a disease-specific questionnaire assessing symptom severity, physical function, and satisfaction with treatment in patients with lumbar spinal stenosis. After translation, cross-cultural adaptation, and pilot testing, we assessed internal consistency, test-retest reliability, construct validity, and responsiveness of the SSM subscales. Data from a large Swiss multi-center prospective cohort study were used. Reference scales for the assessment of construct validity and responsiveness were the numeric rating scale, pain thermometer, and the Roland Morris Disability Questionnaire. One hundred and eight consecutive patients were included in this validation study, recruited from five different centers. Cronbach's alpha was above 0.8 for all three subscales of the SSM. The objectivity of the SSM was assessed using a partial credit approach. The model showed a good global fit to the data. Of the 108 patients 78 participated in the test-retest procedure. The ICC values were above 0.8 for all three subscales of the SSM. Correlations with reference scales were above 0.7 for the symptom and function subscales. For satisfaction subscale, it was 0.66 or above. Clinically meaningful changes of the reference scales over time were associated with significantly more improvement in all three SSM subscales (p < 0.001). Conclusion: The proposed version of the SSM showed very good measurement properties and can be considered validated for use in the German language.

Data Mining of Historical Human Data to Assess the Risk of Injury due to Dynamic Loads

NASA Technical Reports Server (NTRS)

Wells, Jesica; Somers, Jeffrey T.; Newby, N.; Gernhardt, Michael

2014-01-01

The NASA Occupant Protection Group is charged with ensuring crewmembers are protected during all dynamic phases of spaceflight. Previous work with outside experts has led to the development of a definition of acceptable risk (DAR) for space capsule vehicles. The DAR defines allowable probability rates for various categories of injuries. An important question is how to validate these probabilities for a given vehicle. One approach is to impact test human volunteers under projected nominal landing loads. The main drawback is the large number of subject tests required to attain a reasonable level of confidence that the injury probability rates would meet those outlined in the DAR. An alternative is to mine existing databases containing human responses to impact. Testing an anthropomorphic test device (ATD) at the same human-exposure levels could yield a range of ATD responses that would meet DAR. As one aspect of future vehicle validation, the ATD could be tested in the vehicle's seat and suit configuration at nominal landing loads and compared with the ATD responses supported by the human data set. This approach could reduce the number of human-volunteer tests NASA would need to conduct to validate that a vehicle meets occupant protection standards. METHODS: The U.S. Air Force has recorded hundreds of human responses to frontal, lateral, and spinal impacts at many acceleration levels and pulse durations. All of this data are stored on the Collaborative Biomechanics Data Network (CBDN), which is maintained by the Wright Patterson Air Force Base (WPAFB). The test device for human occupant restraint (THOR) ATD was impact tested on WPAFB's horizontal impulse accelerator (HIA) matching human-volunteer exposures on the HIA to 5 frontal and 3 spinal loading conditions. No human injuries occurred as a result of these impact conditions. Peak THOR response variables for neck axial tension and compression, and thoracic-spine axial compression were collected. Maximal chest deflection was determined from motion capture video of the impact test. HIC- 15 and BRIC were calculated from head acceleration responses. Given the number of human subjects for each test condition a confidence interval of injury probability will be obtained. RESULTS: Results will be discussed in terms of injury-risk probability estimates based on the human data set evaluated. Also, gaps in the data set will be identified. These gaps could be one of two types. One is areas where additional THOR testing would increase the comparable human data set, thereby improving confidence in the injury probability rate. The other is where additional human testing would assist in obtaining information on other acceleration levels or directions. DISCUSSION: The historical human data showed validity of the THOR ATD for supplemental testing. The historical human data are limited in scope, however. Further data are needed to characterize the effects of sex, age, anthropometry, and deconditioning due to spaceflight on risk of injury

Cross-validation of the PAI Negative Distortion Scale for feigned mental disorders: a research report.

PubMed

Rogers, Richard; Gillard, Nathan D; Wooley, Chelsea N; Kelsey, Katherine R

2013-02-01

A major strength of the Personality Assessment Inventory (PAI) is its systematic assessment of response styles, including feigned mental disorders. Recently, Mogge, Lepage, Bell, and Ragatz developed and provided the initial validation for the Negative Distortion Scale (NDS). Using rare symptoms as its detection strategy for feigning, the usefulness of NDS was examined via a known-groups comparison. The current study sought to cross-validate the NDS by implementing a between-subjects simulation design. Simulators were asked to feign total disability in an effort to secure unwarranted compensation from their insurance company. Even in an inpatient sample with severe Axis I disorders and concomitant impairment, the NDS proved effective as a rare-symptom strategy with low levels of item endorsement that remained mostly stable across genders. For construct validity, the NDS was moderately correlated with the Structured Interview of Reported Symptoms-Second Edition and other PAI feigning scales. For discriminant validity, it yielded a very large effect size (d = 1.81), surpassing the standard PAI feigning indicators. Utility estimates appeared to be promising for both ruling-out (low probability of feigning) and ruling-in (high probability of feigning) determinations at different base rates. Like earlier research, the data supported the creation of well-defined groups with indeterminate scores (i.e., the cut score ± 1 SEM) removed to avoid high rates of misclassifications for this narrow band.

Construct Validity and Responsiveness of the Pediatric Quality of Life Inventory 4.0 Generic Core Scales and Infant Scales in the PICU.

PubMed

Aspesberro, François; Fesinmeyer, Megan D; Zhou, Chuan; Zimmerman, Jerry J; Mangione-Smith, Rita

2016-06-01

To assess the construct validity and the responsiveness of the Pediatric Quality of Life Inventory 4.0 Generic Core Scales and Infant Scales in the medical-surgical (PICU) and cardiac PICU. Prospective cohort study of 367 inpatients admitted either to the PICU or the cardiac ICU at Seattle Children's Hospital from January 2012 to June 2013. Parent/caregiver and child (≥ 8 yr old, developmentally appropriate, and critical illness resolved) Pediatric Quality of Life Inventory scores were obtained within 24 hours of PICU/cardiac ICU discharge and subsequently at 4-12 weeks following hospital discharge. Of the 491 eligible participants invited to participate, 367 (74.7% response rate) completed the Pediatric Quality of Life Inventory survey at ICU discharge, and of these, 263 (71.7% follow-up response rate) completed the follow-up survey 4-12 weeks after hospital discharge. Responsiveness was assessed by calculating improvement scores (difference between follow-up and ICU discharge scores, Δ Pediatric Quality of Life Inventory). Construct validity was examined by comparing mean improvement scores for known groups differing by medical complexity. At follow-up, [INCREMENT] Pediatric Quality of Life Inventory scores were as follows (mean ± SD): physical domain, 34.8 ± 32.0; and psychosocial domain, 23.1 ± 23.5. Patients with complex chronic or noncomplex chronic disease had physical functioning improvement scores that were 17.4 points (95% CI, -28.3 to -6.5; p < 0.001) and 19.5 points (95% CI, -30.4 to -8.5; p < 0.002) lower than children with no chronic illness, respectively. Patients with complex chronic disease exhibited psychosocial improvement scores that were 9.6 points (95% CI, -18.4 to -0.8; p < 0.033) lower than patients without chronic disease. Patients with noncomplex chronic disease had similar psychosocial improvement scores when compared with patients without chronic disease. As a measure of health-related quality of live, Pediatric Quality of Life Inventory demonstrated responsiveness and construct validity in a broad population of critically ill children. This measure represents a patient-centered clinically meaningful patient-or-parent-reported outcome measure for pediatric research assessing the clinical effectiveness of PICU/cardiac ICU interventions. When using health-related quality of life recovery as an outcome measure to assess clinical effectiveness in the PICU/cardiac ICU setting, measuring and controlling for the level of medical complexity is important in order to understand the true impact of clinical interventions.

Validation of jump squats as a practical measure of post-activation potentiation.

PubMed

Nibali, Maria L; Chapman, Dale W; Robergs, Robert A; Drinkwater, Eric J

2013-03-01

To determine if post-activation potentiation (PAP) can augment sports performance, it is pertinent that researchers be confident that any enhancement in performance is attributable to the PAP phenomenon. However, obtaining mechanistic measures of PAP in the daily training environment of highly trained athletes is impractical. We sought to validate jump squats as a practical measure with ecological validity to sports performance against a mechanistic measure of PAP. We assessed the evoked muscle twitch properties of the knee extensors and jump squat kinetics of 8 physically trained males in response to a 5-repetition-maximum back squat conditioning stimulus (CS). Evoked muscle twitch, followed by 3 jump squats, was assessed before and at 4, 8, and 12 min post CS. Time intervals were assessed on separate occasions using a Latin square design. Linear regression was used to determine the relationship between post-pre changes in kinetic variables and muscle twitch peak force (Ft) and twitch rate of force development (RFDt). Large correlations were observed for both concentric relative and absolute mean power and Ft (r = 0.50 ± 0.30) and RFDt (r = 0.56 ± 0.27 and r = 0.58 ± 0.26). Concentric rate of force development (RFD) showed moderate correlations with Ft (r = 0.45 ± 0.33) and RFDt (r = 0.49 ± 0.32). Small-to-moderate correlations were observed for a number of kinetic variables (r = -0.42-0.43 ± 0.32-0.38). Jump squat concentric mean power and RFD are valid ecological measures of muscle potentiation, capable of detecting changes in athletic performance in response to the PAP phenomenon.

A new scale for disaster nursing core competencies: Development and psychometric testing.

PubMed

Al Thobaity, Abdulellah; Williams, Brett; Plummer, Virginia

2016-02-01

All nurses must have core competencies in preparing for, responding to and recovering from a disaster. In the Kingdom of Saudi Arabia (KSA), as in many other countries, disaster nursing core competencies are not fully understood and lack reliable, validated tools. Thus, it is imperative to develop a scale for exploring disaster nursing core competencies, roles and barriers in the KSA. This study's objective is to develop a valid, reliable scale that identifies and explores core competencies of disaster nursing, nurses' roles in disaster management and barriers to developing disaster nursing in the KSA. This study developed a new scale testing its validity and reliability. A principal component analysis (PCA) was used to develop and test psychometric properties of the new scale. The PCA used a purposive sample of nurses from emergency departments in two hospitals in the KSA. Participants rated 93 paper-based, self-report questionnaire items from 1 to 10 on a Likert scale. PCA using Varimax rotation was conducted to explore factors emerging from responses. The study's participants were 132 nurses (66% response rate). PCA of the 93 questionnaire items revealed 49 redundant items (which were deleted) and 3 factors with eigenvalues of >1. The remaining 44 items accounted for 77.3% of the total variance. The overall Cronbach's alpha was 0.96 for all factors: 0.98 for Factor 1, 0.92 for Factor 2 and 0.86 for Factor 3. This study provided a validated, reliable scale for exploring nurses' core competencies, nurses' roles and barriers to developing disaster nursing in the KSA. The new scale has many implications, such as for improving education, planning and curricula. Crown Copyright © 2015. Published by Elsevier Ltd. All rights reserved.

Validation of a High Sampling Rate Inertial Measurement Unit for Acceleration During Running.

PubMed

Provot, Thomas; Chiementin, Xavier; Oudin, Emeric; Bolaers, Fabrice; Murer, Sébastien

2017-08-25

The musculo-skeletal response of athletes to various activities during training exercises has become a critical issue in order to optimize their performance and minimize injuries. However, dynamic and kinematic measures of an athlete's activity are generally limited by constraints in data collection and technology. Thus, the choice of reliable and accurate sensors is crucial for gathering data in indoor and outdoor conditions. The aim of this study is to validate the use of the accelerometer of a high sampling rate ( 1344 Hz ) Inertial Measurement Unit (IMU) in the frame of running activities. To this end, two validation protocols are imposed: a classical one on a shaker, followed by another one during running, the IMU being attached to a test subject. For each protocol, the response of the IMU Accelerometer (IMUA) is compared to a calibrated industrial accelerometer, considered as the gold standard for dynamic and kinematic data collection. The repeatability, impact of signal frequency and amplitude (on shaker) as well as the influence of speed (while running) are investigated. Results reveal that the IMUA exhibits good repeatability. Coefficient of Variation CV is 1 % 8.58 ± 0.06 m / s 2 on the shaker and 3 % 26.65 ± 0.69 m / s 2 while running. However, the shaker test shows that the IMUA is affected by the signal frequency (error exceeds 10 % beyond 80 Hz ), an observation confirmed by the running test. Nevertheless, the IMUA provides a reliable measure in the range 0-100 Hz, i.e., the most relevant part in the energy spectrum over the range 0-150 Hz during running. In our view, these findings emphasize the validity of IMUs for the measurement of acceleration during running.

Interpretation of change and longitudinal validity of the quality of life for respiratory illness questionnaire (QoLRIQ) in inpatient pulmonary rehabilitation.

PubMed

van Stel, Henk F; Maillé, A Rianne; Colland, Vivian T; Everaerd, Walter

2003-03-01

The quality of life for respiratory illness questionnaire (QoLRIQ) is an outcome measure for patients with asthma or chronic obstructive pulmonary disease (COPD). This study assessed the longitudinal validity, reliability of the change score and the interpretation of changes on the QoLRIQ in inpatient pulmonary rehabilitation, completed by 108 patients with moderate to severe asthma (39) or COPD (69). Domains and total score of the QoLRIQ changed significant (all p < 0.0002) with standardized response means from 0.46 to 0.90. All QoLRIQ-change scores were significantly correlated with self-rated change in health and in disease symptoms and with change in self-assessed health status (r from 0.2 to 0.61). There were several significant correlations between QoLRIQ-change scores and change in experienced invalidity, emotional well-being, anxiety, depressive symptoms and Rand-36-domains (r from 0.2 to 0.68). The intraclass correlation coefficient of change was 0.90. The size of a minimal important difference (MID), computed from a retrospective global rating of change by the patients and with the standard error of measurement, was 0.5 points on a 7-point response scale. Computation of the MID from retrospective assessment of change may not be valid because this change was significantly correlated to post-treatment health status and significantly higher than serial assessment of change. We conclude that the QoLRIQ is sensitive to change, longitudinally valid and reliable, with a MID of 0.5 points. These results enable the use of the QoLRIQ as an outcome measure in clinical trials with patients with moderate to severe asthma or COPD. The longitudinal measurement properties in less severe patients still need to be studied.

In-Flight Validation of a Pilot Rating Scale for Evaluating Failure Transients in Electronic Flight Control Systems

NASA Technical Reports Server (NTRS)

Kalinowski, Kevin F.; Tucker, George E.; Moralez, Ernesto, III

2006-01-01

Engineering development and qualification of a Research Flight Control System (RFCS) for the Rotorcraft Aircrew Systems Concepts Airborne Laboratory (RASCAL) JUH-60A has motivated the development of a pilot rating scale for evaluating failure transients in fly-by-wire flight control systems. The RASCAL RFCS includes a highly-reliable, dual-channel Servo Control Unit (SCU) to command and monitor the performance of the fly-by-wire actuators and protect against the effects of erroneous commands from the flexible, but single-thread Flight Control Computer. During the design phase of the RFCS, two piloted simulations were conducted on the Ames Research Center Vertical Motion Simulator (VMS) to help define the required performance characteristics of the safety monitoring algorithms in the SCU. Simulated failures, including hard-over and slow-over commands, were injected into the command path, and the aircraft response and safety monitor performance were evaluated. A subjective Failure/Recovery Rating (F/RR) scale was developed as a means of quantifying the effects of the injected failures on the aircraft state and the degree of pilot effort required to safely recover the aircraft. A brief evaluation of the rating scale was also conducted on the Army/NASA CH-47B variable stability helicopter to confirm that the rating scale was likely to be equally applicable to in-flight evaluations. Following the initial research flight qualification of the RFCS in 2002, a flight test effort was begun to validate the performance of the safety monitors and to validate their design for the safe conduct of research flight testing. Simulated failures were injected into the SCU, and the F/RR scale was applied to assess the results. The results validate the performance of the monitors, and indicate that the Failure/Recovery Rating scale is a very useful tool for evaluating failure transients in fly-by-wire flight control systems.

Measuring preparedness for mammography in women with intellectual disabilities: a validation study of the Mammography Preparedness Measure.

PubMed

Wang, Claire Tienwey; Greenwood, Nechama; White, Laura F; Wilkinson, Joanne

2015-05-01

Women with intellectual disabilities have similar breast cancer rates as the general population, but lower rates of regular mammography and higher breast cancer mortality rates. Although prior qualitative work demonstrates that women with intellectual disabilities face unique, disability-specific barriers to mammography, the present authors lack standardized, validated instruments for measuring knowledge of breast cancer screening in this population. In addition, much research related to adults with intellectual disabilities focuses on family or carer perspectives, rather than involving women with intellectual disabilities, themselves. The present authors first pilot tested a general population instrument measuring breast cancer knowledge, and found that it did not perform adequately in women with intellectual disabilities. In response, the present authors developed the Mammography Preparedness Measure (MPM), a direct short interview tool to measure knowledge and preparedness in women with intellectual disabilities, themselves, rather than relying on caregiver or other reports, and using inclusive methodology. The present authors validated the MPM by assessing test-retest reliability. Average test-retest per cent agreement of 84%, ranging from 74 to 91% agreement per item, with an overall kappa of 0.59. The MPM appears to be a valid instrument appropriate for measuring mammography preparedness in women with intellectual disabilities. The success of this innovative tool suggests that direct, rather than informant-directed tools can be developed to measure health knowledge and cancer screening readiness in adults with intellectual disabilities, an important measure in studying and reducing disparities. © 2014 John Wiley & Sons Ltd.

HIV-1 Strategies of Immune Evasion

NASA Astrophysics Data System (ADS)

Castiglione, F.; Bernaschi, M.

We simulate the progression of the HIV-1 infection in untreated host organisms. The phenotype features of the virus are represented by the replication rate, the probability of activating the transcription, the mutation rate and the capacity to stimulate an immune response (the so-called immunogenicity). It is very difficult to study in-vivo or in-vitro how these characteristics of the virus influence the evolution of the disease. Therefore we resorted to simulations based on a computer model validated in previous studies. We observe, by means of computer experiments, that the virus continuously evolves under the selective pressure of an immune response whose effectiveness downgrades along with the disease progression. The results of the simulations show that immunogenicity is the most important factor in determining the rate of disease progression but, by itself, it is not sufficient to drive the disease to a conclusion in all cases.

Assessing anger regulation in middle childhood: development and validation of a behavioral observation measure.

PubMed

Rohlf, Helena L; Krahé, Barbara

2015-01-01

An observational measure of anger regulation in middle childhood was developed that facilitated the in situ assessment of five maladaptive regulation strategies in response to an anger-eliciting task. 599 children aged 6-10 years (M = 8.12, SD = 0.92) participated in the study. Construct validity of the measure was examined through correlations with parent- and self-reports of anger regulation and anger reactivity. Criterion validity was established through links with teacher-rated aggression and social rejection measured by parent-, teacher-, and self-reports. The observational measure correlated significantly with parent- and self-reports of anger reactivity, whereas it was unrelated to parent- and self-reports of anger regulation. It also made a unique contribution to predicting aggression and social rejection.

Assessing anger regulation in middle childhood: development and validation of a behavioral observation measure

PubMed Central

Rohlf, Helena L.; Krahé, Barbara

2015-01-01

An observational measure of anger regulation in middle childhood was developed that facilitated the in situ assessment of five maladaptive regulation strategies in response to an anger-eliciting task. 599 children aged 6–10 years (M = 8.12, SD = 0.92) participated in the study. Construct validity of the measure was examined through correlations with parent- and self-reports of anger regulation and anger reactivity. Criterion validity was established through links with teacher-rated aggression and social rejection measured by parent-, teacher-, and self-reports. The observational measure correlated significantly with parent- and self-reports of anger reactivity, whereas it was unrelated to parent- and self-reports of anger regulation. It also made a unique contribution to predicting aggression and social rejection. PMID:25964767

Parental self-efficacy in childhood overweight: validation of the Lifestyle Behavior Checklist in the Netherlands.

PubMed

Gerards, Sanne M P L; Hummel, Karin; Dagnelie, Pieter C; de Vries, Nanne K; Kremers, Stef P J

2013-01-18

Evaluating whether parental challenges and self-efficacy toward managing children's lifestyle behaviors are successfully addressed by interventions requires valid instruments. The Lifestyle Behavior Checklist (LBC) has recently been developed in the Australian context. It consists of two subscales: the Problem scale, which measures parental perceptions of children's behavioral problems related to overweight and obesity, and the Confidence scale, measuring parental self-efficacy in dealing with these problems. The aim of the current study was to systematically translate the questionnaire into Dutch and to evaluate its internal consistency, construct validity and test-retest reliability. The LBC was systematically translated by four experts at Maastricht University. In total, 392 parents of 3-to13-year-old children were invited to fill out two successive online questionnaires with a two-week interval. Of these, 273 parents responded to the first questionnaire (test, response rate = 69.6%), and of the 202 who could be invited for the second questionnaire (retest), 100 responded (response rate = 49.5%). We assessed the questionnaire's internal consistency (Cronbach's α), construct validity (Spearman's Rho correlation tests, using the criterion measures: restrictiveness, nurturance, and psychological control), and test-retest reliability (Spearman's Rho correlation tests). Both scales had high internal consistency (Cronbach's α ≥ 0.90). Spearman correlation coefficients indicated acceptable test-retest reliability for both the Problem scale (rs = 0.74) and the Confidence scale (rs = 0.70). The LBC Problem scale was significantly correlated to all criterion scales (nurturance, restrictiveness, psychological control) in the hypothesized direction, and the LBC Confidence scale was significantly correlated with nurturance and psychological control in the hypothesized direction, but not with restrictiveness. The Dutch translation of the LBC was found to be a reliable and reasonably valid questionnaire to measure parental perceptions of children's weight-related problem behavior and the extent to which parents feel confident to manage these problems.

Impact of Electronic Resources and Usage in Academic Libraries in Ghana: Evidence from Koforidua Polytechnic & All Nations University College, Ghana

ERIC Educational Resources Information Center

Akussah, Maxwell; Asante, Edward; Adu-Sarkodee, Rosemary

2015-01-01

The study investigates the relationship between impact of electronic resources and its usage in academic libraries in Ghana: evidence from Koforidua Polytechnic & All Nations University College, Ghana. The study was a quantitative approach using questionnaire to gather data and information. A valid response rate of 58.5% was assumed. SPSS…

Major Factors Affecting Students' Perception towards Faculty Evaluation of Teaching (SET)

ERIC Educational Resources Information Center

Dev, Smitha; Qayyum, Nudrat

2017-01-01

Gathering students' feedback and evaluation during the end of every semester is believed to be valuable for instructors' growth and development. The present study is aimed to find out the validity of students' responses and various factors involved in their rating towards faculty. A total of 150 students from 1 st to 4th year of Abu Dhabi…

Sample Selectivity and the Validity of International Student Achievement Tests in Economic Research. NBER Working Paper No. 15867

ERIC Educational Resources Information Center

Hanushek, Eric A.; Woessmann, Ludger

2010-01-01

Critics of international student comparisons argue that results may be influenced by differences in the extent to which countries adequately sample their entire student populations. In this research note, we show that larger exclusion and non-response rates are related to better country average scores on international tests, as are larger…

Understanding mail survey response rates among male reserve component Gulf War era veterans.

PubMed

Schumm, W R; Bollman, S R; Jurich, A P; Castelo, C; Sanders, D; Webb, F J

2000-12-01

In this study of current and former male Reserve and National Guard members from the State of Ohio, it was expected that veterans who were older, had more years of military service, who had participated in the Persian Gulf War, who were Euro-Americans, who were higher in rank, who had higher residential stability in Ohio, who belonged to the Air Force, who had higher formal education, and who belonged to the National Guard would have a greater investment in U.S. society as defined by 11 demographic variables. It was assumed that those with greater investment in society would more often have valid addresses and would be more likely to respond to a survey on military issues, thereby biasing sample outcomes in those directions. Results for male veterans were consistent with the hypothesis that investment in the society system would predict validity of addresses and response rates. In other words, results supported the idea that those veterans who might be expected to have a greater investment in U.S. society were more likely to be located and to respond (once located) to a survey concerning Desert Storm-era military service and its aftermath. Implications for future Desert Storm research are discussed.

Importance-satisfaction analysis for primary care physicians' perspective on EHRs in Taiwan.

PubMed

Ho, Cheng-Hsun; Wene, Hsyien-Chia; Chu, Chi-Ming; Wu, Yi-Syuan; Wang, Jen-Leng

2014-06-06

The Taiwan government has been promoting Electronic Health Records (EHRs) to primary care physicians. How to extend EHRs adoption rate by measuring physicians' perspective of importance and performance of EHRs has become one of the critical issues for healthcare organizations. We conducted a comprehensive survey in 2010 in which a total of 1034 questionnaires which were distributed to primary care physicians. The project was sponsored by the Department of Health to accelerate the adoption of EHRs. 556 valid responses were analyzed resulting in a valid response rate of 53.77%. The data were analyzed based on a data-centered analytical framework (5-point Likert scale). The mean of importance and satisfaction of four dimensions were 4.16, 3.44 (installation and maintenance), 4.12, 3.51 (product effectiveness), 4.10, 3.31 (system function) and 4.34, 3.70 (customer service) respectively. This study provided a direction to government by focusing on attributes which physicians found important but were dissatisfied with, to close the gap between actual and expected performance of the EHRs. The authorities should emphasize the potential advantages in meaningful use and provide training programs, conferences, technical assistance and incentives to enhance the national level implementation of EHRs for primary physicians.

Yo-Yo IR2 testing of elite and sub-elite soccer players: performance, heart rate response and correlations to other interval tests.

PubMed

Ingebrigtsen, Jørgen; Bendiksen, Mads; Randers, Morten Bredsgaard; Castagna, Carlo; Krustrup, Peter; Holtermann, Andreas

2012-01-01

We examined performance, heart rate response and construct validity of the Yo-Yo IR2 test by testing 111 elite and 92 sub-elite soccer players from Norway and Denmark. VO₂max, Yo-Yo IR1 and repeated sprint tests (RSA) (n = 51) and match-analyses (n = 39) were also performed. Yo-Yo IR2 and Yo-Yo IR1 performance was 41 and 25% better (P < 0.01) for elite than sub-elite players, respectively, and heart rate after 2 and 4 min of the Yo-Yo IR2 test was 20 and 15 bpm (9 and 6% HRmax), respectively, lower (P < 0.01) for elite players. RSA performance and VO₂max was not different between competitive levels (P > 0.05). For top-teams, Yo-Yo IR2 performance (28%) and sprinting distance (25%) during match were greater (P < 0.05) than for bottom-teams. For elite and sub-elite players, Yo-Yo IR2 performance was correlated (P < 0.05) with Yo-Yo IR1 performance (r = 0.74 and 0.76) and mean RSA time (r = -0.74 and -0.34). We conclude that the Yo-Yo IR2 test has a high discriminant and concurrent validity, as it discriminates between players of different within- and between-league competitive levels and is correlated to other frequently used intermittent elite soccer tests.

Compact fluorescent lights and the impact of convenience and knowledge on household recycling rates.

PubMed

Wagner, Travis P

2011-06-01

Increased energy costs, social marketing campaigns, public subsidies, and reduced retail prices have dramatically increased the number of compact fluorescent lights (CFLs) installed worldwide. CFLs provide many benefits, but they contain a very small amount of mercury. Given the billions of CFLs in use worldwide, they represent a significant source of mercury unless CFLs are recycled and the mercury recovered in an environmentally sound manner. In the state of Maine (northeast United States), despite mandated recycling of CFLs and availability of free CFL recycling, the household CFL recycling rate is very low. A study was undertaken to identify the primary factors responsible for low recycling. The first step was to survey householders who use CFLs. The 520 survey responses indicated that insufficient knowledge regarding recycling and inconvenience of the collection system are the two primary factors for the low recycling rate. To validate these findings, the second step was an examination of the current collection system to assess (a) the knowledge requirements necessary for recycling and (b) the convenience of the collection system. The results of this examination validated that knowledge requirements were excessively difficult to fulfill and the collection system is not sufficiently convenient. Based on these results, waste managers should focus on increasing convenience and simplifying access to information when designing or improving household collection and recycling of CFLs. Copyright © 2011 Elsevier Ltd. All rights reserved.

RhinAsthma patient perspective: A Rasch validation study.

PubMed

Molinengo, Giorgia; Baiardini, Ilaria; Braido, Fulvio; Loera, Barbara

2018-02-01

In daily practice, Health-Related Quality of Life (HRQoL) tools are useful for supplementing clinical data with the patient's perspective. To encourage their use by clinicians, the availability of tools that can quickly provide valid results is crucial. A new HRQoL tool has been proposed for patients with asthma and rhinitis: the RhinAsthma Patient Perspective-RAPP. The aim of this study was to evaluate the psychometric robustness of the RAPP using the Item Response Theory (IRT) approach, to evaluate the scalability of items and test whether or not patients use the items response scale correctly. 155 patients (53.5% women, mean age 39.1, range 16-76) were recruited during a multicenter study. RAPP metric properties were investigated using IRT models. Differential item functioning (DIF) was used for gender, age, and asthma control test (ACT). The RAPP adequately fitted the Rating Scale model, demonstrating the equality of the rating scale structure for all items. All statistics on items were satisfactory. The RAPP had adequate internal reliability and showed good ability to discriminate among different groups of participants. DIF analysis indicated that there were no differential item functioning issues for gender. One item showed a DIF by age and four items by ACT. The psychometric evaluation performed using IRT models demonstrated that the RAPP met all the criteria to be considered a reliable and valid method of measurement. From a clinical perspective, this will allow physicians to confidently interpret scores as good indicators of Quality of Life of patients with asthma.

Primary Blast Injury Criteria for Animal/Human TBI Models using Field Validated Shock Tubes

DTIC Science & Technology

2016-09-01

Software, Inc., San Jose, CA). Dose-response models for heart rate and pulmonary injury were fitted with Origin 9.0 software (OriginLab Corp...impulse. We observed only a few cases where pathological score exceeded 21 for the blast 7 strength higher than 300 kPa BOP with high standard...average heart rates (ΔHR) decreased gradually with increase in blast intensity: -29±10 (60 kPa), - 26±20 (100 kPa), -43±26 (130 kPa), -62±21 (190

Furthering the Validity of a Tool to Assess Simulated Pregnancy Options Counseling Skills.

PubMed

Lupi, Carla; Ward-Peterson, Melissa; Coxe, Stefany; Minor, Suzanne; Eliacin, Irmanie; Obeso, Vivian

2016-10-01

To further the validity of a tool to assess nondirective pregnancy options counseling skills. Using a cross-sectional design, we explored four sources of construct validity evidence for an objective structured clinical examination for training and assessment of nondirective pregnancy options counseling: content, response process, internal structure, and relations to other variables. Content of the previously developed tool was enhanced through input from five family medicine educators. The objective structured clinical examination was implemented in a family medicine clerkship with third-year medical students from 2014 to 2015 using trained raters. Response process was addressed after a pilot round. Three new raters evaluated videotapes of 46 performances. Cronbach's alpha, intraclass correlation coefficients, and Spearman's rho were estimated with 95% confidence intervals. The content validity was affirmed. Cronbach's alpha was 0.71. According to Landis and Koch's criteria, all but two items unique to the clinical situation of pregnancy options counseling generated substantial to perfect agreement (0.62-1.00). Relations to other variables within the checklist were strong, ranging from 0.66 to 0.87. This tool for assessing pregnancy options counseling skills has excellent content and strong internal structure. Further work to improve the Global Rating Scale may be necessary for summative use.

Validity of the prenatal risk overview for detecting drug use disorders in pregnancy.

PubMed

Harrison, Patricia A; Godecker, Amy; Sidebottom, Abbey

2012-11-01

To validate the Prenatal Risk Overview (PRO) drug use questions against a structured diagnostic interview among pregnant women. Prenatal care patients were administered the PRO at intake and then asked to consent to a research diagnostic interview. Of 1,367 women asked to participate, 1,274 consented and 745 completed the study. Three drug use items comprised one of 13 PRO psychosocial risk domains. The Structured Clinical Interview for DSM-IV (SCID) was used as the validation instrument. To assess criterion validity, the Moderate/High and High Risk classifications were cross-tabulated with SCID Drug Use Disorder diagnoses. In response to the PRO, almost one third of participants (29.4%) reported drug use during the 12 months pre-pregnancy awareness and 11.0% reported use post-pregnancy awareness; 7.0% met SCID diagnostic criteria for Drug Abuse, Drug Dependence, or both, primarily for marijuana use. Drug Use Disorder sensitivity and specificity rates for the PRO Moderate/High Risk classifications were 88.5% and 74.3%, respectively, and for High Risk only, 78.8% and 87.3%. The PRO yielded substantial self-reporting of drug use before and after pregnancy awareness with high sensitivity and specificity for detecting Drug Use Disorders. PRO results can inform decisions about appropriate clinical responses. © 2012 Wiley Periodicals, Inc.

Histologic Appearance After Preoperative Radiation Therapy for Soft Tissue Sarcoma: Assessment of the European Organization for Research and Treatment of Cancer–Soft Tissue and Bone Sarcoma Group Response Score

DOE Office of Scientific and Technical Information (OSTI.GOV)

Schaefer, Inga-Marie; Hornick, Jason L.; Barysauskas, Constance M.

Purpose: To critically assess the prognostic value of the European Organization for Research and Treatment of Cancer–Soft Tissue and Bone Sarcoma Group (EORTC-STBSG) response score and define histologic appearance after preoperative radiation therapy (RT) for soft tissue sarcoma (STS). Methods and Materials: For a cohort of 100 patients with STS of the extremity/trunk treated at our institution with preoperative RT followed by resection, 2 expert sarcoma pathologists evaluated the resected specimens for percent residual viable cells, necrosis, hyalinization/fibrosis, and infarction. The EORTC response score and other predictors of recurrence-free survival (RFS) and overall survival (OS) were assessed by Kaplan-Meier and proportionalmore » hazard models. Results: Median tumor size was 7.5 cm; 92% were intermediate or high grade. Most common histologies were unclassified sarcoma (34%) and myxofibrosarcoma (25%). Median follow-up was 60 months. The 5-year local recurrence rate was 5%, 5-year RFS was 68%, and 5-year OS was 75%. Distribution of cases according to EORTC response score tiers was as follows: no residual viable tumor for 9 cases (9% pathologic complete response); <1% viable tumor for 0, ≥1% to <10% for 9, ≥10% to <50% for 44, and ≥50% for 38. There was no association between EORTC-STBSG response score and RFS or OS. Conversely, hyalinization/fibrosis was a significant independent favorable predictor for RFS (hazard ratio 0.49, P=.007) and OS (hazard ratio 0.36, P=.02). Conclusion: Histologic evaluation after preoperative RT for STS showed a 9% pathologic complete response rate. The EORTC-STBSG response score and percent viable cells were not prognostic. Hyalinization/fibrosis was associated with favorable outcome, and if validated, may become a valid endpoint for neoadjuvant trials.« less

A meta-analysis of an implicit measure of personality functioning: the Mutuality of Autonomy Scale.

PubMed

Graceffo, Robert A; Mihura, Joni L; Meyer, Gregory J

2014-01-01

The Mutuality of Autonomy scale (MA) is a Rorschach variable designed to capture the degree to which individuals mentally represent self and other as mutually autonomous versus pathologically destructive (Urist, 1977). Discussions of the MA's validity found in articles and chapters usually claim good support, which we evaluated by a systematic review and meta-analysis of its construct validity. Overall, in a random effects analysis across 24 samples (N = 1,801) and 91 effect sizes, the MA scale was found to maintain a relationship of r =.20, 95% CI [.16,.25], with relevant validity criteria. We hypothesized that MA summary scores that aggregate more MA response-level data would maintain the strongest relationship with relevant validity criteria. Results supported this hypothesis (aggregated scoring method: r =.24, k = 57, S = 24; nonaggregated scoring methods: r =.15, k = 34, S = 10; p =.039, 2-tailed). Across 7 exploratory moderator analyses, only 1 (criterion method) produced significant results. Criteria derived from the Thematic Apperception Test produced smaller effects than clinician ratings, diagnostic differentiation, and self-attributed characteristics; criteria derived from observer reports produced smaller effects than clinician ratings and self-attributed characteristics. Implications of the study's findings are discussed in terms of both research and clinical work.

Development of a novel parallel-spool pilot operated high-pressure solenoid valve with high flow rate and high speed

NASA Astrophysics Data System (ADS)

Dong, Dai; Li, Xiaoning

2015-03-01

High-pressure solenoid valve with high flow rate and high speed is a key component in an underwater driving system. However, traditional single spool pilot operated valve cannot meet the demands of both high flow rate and high speed simultaneously. A new structure for a high pressure solenoid valve is needed to meet the demand of the underwater driving system. A novel parallel-spool pilot operated high-pressure solenoid valve is proposed to overcome the drawback of the current single spool design. Mathematical models of the opening process and flow rate of the valve are established. Opening response time of the valve is subdivided into 4 parts to analyze the properties of the opening response. Corresponding formulas to solve 4 parts of the response time are derived. Key factors that influence the opening response time are analyzed. According to the mathematical model of the valve, a simulation of the opening process is carried out by MATLAB. Parameters are chosen based on theoretical analysis to design the test prototype of the new type of valve. Opening response time of the designed valve is tested by verifying response of the current in the coil and displacement of the main valve spool. The experimental results are in agreement with the simulated results, therefore the validity of the theoretical analysis is verified. Experimental opening response time of the valve is 48.3 ms at working pressure of 10 MPa. The flow capacity test shows that the largest effective area is 126 mm2 and the largest air flow rate is 2320 L/s. According to the result of the load driving test, the valve can meet the demands of the driving system. The proposed valve with parallel spools provides a new method for the design of a high-pressure valve with fast response and large flow rate.

Observed Emotional and Behavioral Indicators of Motivation Predict School Readiness in Head Start Graduates

PubMed Central

Berhenke, Amanda; Miller, Alison L.; Brown, Eleanor; Seifer, Ronald; Dickstein, Susan

2011-01-01

Emotions and behaviors observed during challenging tasks are hypothesized to be valuable indicators of young children's motivation, the assessment of which may be particularly important for children at risk for school failure. The current study demonstrated reliability and concurrent validity of a new observational assessment of motivation in young children. Head Start graduates completed challenging puzzle and trivia tasks during their kindergarten year. Children's emotion expression and task engagement were assessed based on their observed facial and verbal expressions and behavioral cues. Hierarchical regression analyses revealed that observed persistence and shame predicted teacher ratings of children's academic achievement, whereas interest, anxiety, pride, shame, and persistence predicted children's social skills and learning-related behaviors. Children's emotional and behavioral responses to challenge thus appeared to be important indicators of school success. Observation of such responses may be a useful and valid alternative to self-report measures of motivation at this age. PMID:21949599

[Construct validity of a Portuguese version of the Female Sexual Function Index].

PubMed

Pacagnella, Rodolfo de Carvalho; Martinez, Edson Zangiacomi; Vieira, Elisabeth Meloni

2009-11-01

This study aimed to evaluate the construct validity of a version of the Female Sexual Function Index (FSFI). The version was inserted into a multidimensional questionnaire and applied face-to-face to 235 sterilized women. Non-response rate was 1.7%. The sample proved to be highly homogeneous, with low income and education. Cronbach's alpha of 0.948 indicated high internal consistency. Factor analysis showed that the instrument was measuring four factors: desire/arousal, lubrication, orgasm/satisfaction, and pain. This may reflect characteristics of the instrument itself, female sexual response, or even the sample's cultural peculiarities, which can affect understanding of the questions or concepts with which the instrument deals. This study emphasizes the need for further research in the general population to determine the psychometric properties of the FSFI, such as its factor composition and definition of appropriate cut-off points for the Brazilian population.

Observed Emotional and Behavioral Indicators of Motivation Predict School Readiness in Head Start Graduates.

PubMed

Berhenke, Amanda; Miller, Alison L; Brown, Eleanor; Seifer, Ronald; Dickstein, Susan

2011-01-01

Emotions and behaviors observed during challenging tasks are hypothesized to be valuable indicators of young children's motivation, the assessment of which may be particularly important for children at risk for school failure. The current study demonstrated reliability and concurrent validity of a new observational assessment of motivation in young children. Head Start graduates completed challenging puzzle and trivia tasks during their kindergarten year. Children's emotion expression and task engagement were assessed based on their observed facial and verbal expressions and behavioral cues. Hierarchical regression analyses revealed that observed persistence and shame predicted teacher ratings of children's academic achievement, whereas interest, anxiety, pride, shame, and persistence predicted children's social skills and learning-related behaviors. Children's emotional and behavioral responses to challenge thus appeared to be important indicators of school success. Observation of such responses may be a useful and valid alternative to self-report measures of motivation at this age.

Next-generation negative symptom assessment for clinical trials: validation of the Brief Negative Symptom Scale.

PubMed

Strauss, Gregory P; Keller, William R; Buchanan, Robert W; Gold, James M; Fischer, Bernard A; McMahon, Robert P; Catalano, Lauren T; Culbreth, Adam J; Carpenter, William T; Kirkpatrick, Brian

2012-12-01

The current study examined the psychometric properties of the Brief Negative Symptom Scale (BNSS), a next-generation rating instrument developed in response to the NIMH sponsored consensus development conference on negative symptoms. Participants included 100 individuals with a DSM-IV diagnosis of schizophrenia or schizoaffective disorder who completed a clinical interview designed to assess negative, positive, disorganized, and general psychiatric symptoms, as well as functional outcome. A battery of anhedonia questionnaires and neuropsychological tests were also administered. Results indicated that the BNSS has excellent internal consistency and temporal stability, as well as good convergent and discriminant validity in its relationships with other symptom rating scales, functional outcome, self-reported anhedonia, and neuropsychological test scores. Given its brevity (13-items, 15-minute interview) and good psychometric characteristics, the BNSS can be considered a promising new instrument for use in clinical trials. Copyright © 2012 Elsevier B.V. All rights reserved.

Simultaneous wavelength conversion of ASK and DPSK signals based on four-wave-mixing in dispersion engineered silicon waveguides.

PubMed

Xu, Lin; Ophir, Noam; Menard, Michael; Lau, Ryan Kin Wah; Turner-Foster, Amy C; Foster, Mark A; Lipson, Michal; Gaeta, Alexander L; Bergman, Keren

2011-06-20

We experimentally demonstrate four-wave-mixing (FWM)-based continuous wavelength conversion of optical differential-phase-shift-keyed (DPSK) signals with large wavelength conversion ranges as well as simultaneous wavelength conversion of dual-wavelength channels with mixed modulation formats in 1.1-cm-long dispersion-engineered silicon waveguides. We first validate up to 100-nm wavelength conversion range for 10-Gb/s DPSK signals, showcasing the capability to perform phase-preserving operations at high bit rates in chip-scale devices over wide conversion ranges. We further validate the wavelength conversion of dual-wavelength channels modulated with 10-Gb/s packetized phase-shift-keyed (PSK) and amplitude-shift-keyed (ASK) signals; demonstrate simultaneous operation on multiple channels with mixed formats in chip-scale devices. For both configurations, we measure the spectral and temporal responses and evaluate the performances using bit-error-rate (BER) measurements.

Kinetic modeling of growth and lipid body induction in Chlorella pyrenoidosa under heterotrophic conditions.

PubMed

Sachdeva, Neha; Kumar, G Dinesh; Gupta, Ravi Prakash; Mathur, Anshu Shankar; Manikandan, B; Basu, Biswajit; Tuli, Deepak Kumar

2016-10-01

The aim of the present work was to develop a mathematical model to describe the biomass and (total) lipid productivity of Chlorella pyrenoidosa NCIM 2738 under heterotrophic conditions. Biomass growth rate was predicted by Droop's cell quota model, while changes observed in cell quota (utilization) under carbon excess conditions were used for the modeling and predicting the lipid accumulation rate. The model was simulated under non-limiting (excess) carbon and limiting nitrate concentration and validated with experimental data for the culture grown in batch (flask) mode under different nitrate concentrations. The present model incorporated two modes (growth and stressed) for the prediction of endogenous lipid synthesis/induction and aimed to predict the effect and response of the microalgae under nutrient starvation (stressed) conditions. MATLAB and Genetic Algorithm were employed for the prediction and validation of the model parameters. Copyright © 2016 Elsevier Ltd. All rights reserved.

Validating (d,p gamma) as a Surrogate for Neutron Capture

DOE PAGES

Ratkiewicz, A.; Cizewski, J.A.; Pain, S.D.; ...

2015-05-28

The r-process is responsible for creating roughly half of the elements heavier than iron. It has recently become understood that the rates at which neutron capture reactions proceed at late times in the r-process may dramatically affect the final abundance pattern. However, direct measurements of neutron capture reaction rates on exotic nuclei are exceptionally difficult, necessitating the development of indirect approaches such as the surrogate technique. The (d,pγ) reaction at low energies was identified as a promising surrogate for the (n,γ) reaction, as both reactions share many characteristics. We report on a program to validate (d,pγ) as a surrogate formore » (n,γ) using 95Mo as a target. The experimental campaign includes direct measurements of the γ-ray intensities from the decay of excited states populated in the 95Mo(n,γ) and 95Mo(d,pγ) reactions.« less

Functioning in the Real World: Using Storytelling to Improve Validity in the Assessment of Executive Functions.

PubMed

Annotti, Lee A; Teglasi, Hedwig

2017-01-01

Real-world contexts differ in the clarity of expectations for desired responses, as do assessment procedures, ranging along a continuum from maximal conditions that provide well-defined expectations to typical conditions that provide ill-defined expectations. Executive functions guide effective social interactions, but relations between them have not been studied with measures that are matched in the clarity of response expectations. In predicting teacher-rated social competence (SC) from kindergarteners' performance on tasks of executive functions (EFs), we found better model-data fit indexes when both measures were similar in the clarity of response expectations for the child. The maximal EF measure, the Developmental Neuropsychological Assessment, presents well-defined response expectations, and the typical EF measure, 5 scales from the Thematic Apperception Test (TAT), presents ill-defined response expectations (i.e., Abstraction, Perceptual Integration, Cognitive-Experiential Integration, and Associative Thinking). To assess SC under maximal and typical conditions, we used 2 teacher-rated questionnaires, with items, respectively, that emphasize well-defined and ill-defined expectations: the Behavior Rating Inventory: Behavioral Regulation Index and the Social Skills Improvement System: Social Competence Scale. Findings suggest that matching clarity of expectations improves generalization across measures and highlight the usefulness of the TAT to measure EF.

Real-Time Gas Identification by Analyzing the Transient Response of Capillary-Attached Conductive Gas Sensor

PubMed Central

Bahraminejad, Behzad; Basri, Shahnor; Isa, Maryam; Hambli, Zarida

2010-01-01

In this study, the ability of the Capillary-attached conductive gas sensor (CGS) in real-time gas identification was investigated. The structure of the prototype fabricated CGS is presented. Portions were selected from the beginning of the CGS transient response including the first 11 samples to the first 100 samples. Different feature extraction and classification methods were applied on the selected portions. Validation of methods was evaluated to study the ability of an early portion of the CGS transient response in target gas (TG) identification. Experimental results proved that applying extracted features from an early part of the CGS transient response along with a classifier can distinguish short-chain alcohols from each other perfectly. Decreasing time of exposition in the interaction between target gas and sensing element improved the reliability of the sensor. Classification rate was also improved and time of identification was decreased. Moreover, the results indicated the optimum interval of the early transient response of the CGS for selecting portions to achieve the best classification rates. PMID:22219666

Guidelines for Reporting Case Studies on Extracorporeal Treatments in Poisonings: Methodology

PubMed Central

Lavergne, Valéry; Ouellet, Georges; Bouchard, Josée; Galvao, Tais; Kielstein, Jan T; Roberts, Darren M; Kanji, Salmaan; Mowry, James B; Calello, Diane P; Hoffman, Robert S; Gosselin, Sophie; Nolin, Thomas D; Goldfarb, David S; Burdmann, Emmanuel A; Dargan, Paul I; Decker, Brian Scott; Hoegberg, Lotte C; Maclaren, Robert; Megarbane, Bruno; Sowinski, Kevin M; Yates, Christopher; Mactier, Robert; Wiegand, Timothy; Ghannoum, Marc

2014-01-01

A literature review performed by the EXtracorporeal TReatments In Poisoning (EXTRIP) workgroup highlighted deficiencies in the existing literature, especially the reporting of case studies. Although general reporting guidelines exist for case studies, there are none in the specific field of extracorporeal treatments in toxicology. Our goal was to construct and propose a checklist that systematically outlines the minimum essential items to be reported in a case study of poisoned patients undergoing extracorporeal treatments. Through a modified two-round Delphi technique, panelists (mostly chosen from the EXTRIP workgroup) were asked to vote on the pertinence of a set of items to identify those considered minimally essential for reporting complete and accurate case reports. Furthermore, independent raters validated the clarity of each selected items between each round of voting. All case reports containing data on extracorporeal treatments in poisoning published in Medline in 2011 were reviewed during the external validation rounds. Twenty-one panelists (20 from the EXTRIP workgroup and an invited expert on pharmacology reporting guidelines) participated in the modified Delphi technique. This group included journal editors and experts in nephrology, clinical toxicology, critical care medicine, emergency medicine, and clinical pharmacology. Three independent raters participated in the validation rounds. Panelists voted on a total of 144 items in the first round and 137 items in the second round, with response rates of 96.3% and 98.3%, respectively. Twenty case reports were evaluated at each validation round and the independent raters' response rate was 99.6% and 98.8% per validation round. The final checklist consists of 114 items considered essential for case study reporting. This methodology of alternate voting and external validation rounds was useful in developing the first reporting guideline for case studies in the field of extracorporeal treatments in poisoning. We believe that this guideline will improve the completeness and transparency of published case reports and that the systematic aggregation of information from case reports may provide early signals of effectiveness and/or harm, thereby improving healthcare decision-making. PMID:24890576

A High Throughput Model of Post-Traumatic Osteoarthritis using Engineered Cartilage Tissue Analogs

PubMed Central

Mohanraj, Bhavana; Meloni, Gregory R.; Mauck, Robert L.; Dodge, George R.

2014-01-01

(1) Objective A number of in vitro models of post-traumatic osteoarthritis (PTOA) have been developed to study the effect of mechanical overload on the processes that regulate cartilage degeneration. While such frameworks are critical for the identification therapeutic targets, existing technologies are limited in their throughput capacity. Here, we validate a test platform for high-throughput mechanical injury incorporating engineered cartilage. (2) Method We utilized a high throughput mechanical testing platform to apply injurious compression to engineered cartilage and determined their strain and strain rate dependent responses to injury. Next, we validated this response by applying the same injury conditions to cartilage explants. Finally, we conducted a pilot screen of putative PTOA therapeutic compounds. (3) Results Engineered cartilage response to injury was strain dependent, with a 2-fold increase in GAG loss at 75% compared to 50% strain. Extensive cell death was observed adjacent to fissures, with membrane rupture corroborated by marked increases in LDH release. Testing of established PTOA therapeutics showed that pan-caspase inhibitor (ZVF) was effective at reducing cell death, while the amphiphilic polymer (P188) and the free-radical scavenger (NAC) reduced GAG loss as compared to injury alone. (4) Conclusions The injury response in this engineered cartilage model replicated key features of the response from cartilage explants, validating this system for application of physiologically relevant injurious compression. This study establishes a novel tool for the discovery of mechanisms governing cartilage injury, as well as a screening platform for the identification of new molecules for the treatment of PTOA. PMID:24999113

Non-response to sad mood induction: implications for emotion research.

PubMed

Rottenberg, Jonathan; Kovacs, Maria; Yaroslavsky, Ilya

2018-05-01

Experimental induction of sad mood states is a mainstay of laboratory research on affect and cognition, mood regulation, and mood disorders. Typically, the success of such mood manipulations is reported as a statistically significant pre- to post-induction change in the self-rated intensity of the target affect. The present commentary was motivated by an unexpected finding in one of our studies concerning the response rate to a well-validated sad mood induction. Using the customary statistical approach, we found a significant mean increase in self-rated sadness intensity with a moderate effect size, verifying the "success" of the mood induction. However, that "success" masked that, between one-fifth and about one-third of our samples (adolescents who had histories of childhood-onset major depressive disorder and healthy controls) reported absolutely no sadness in response to the mood induction procedure. We consider implications of our experience for emotion research by (1) commenting upon the typically overlooked phenomenon of nonresponse, (2) suggesting changes in reporting practices regarding mood induction success, and (3) outlining future directions to help scientists determine why some subjects do not respond to experimental mood induction.

Response Distortion in Adolescents Who Smoke: a Pilot Study*

PubMed Central

Stein, L. A. R.; Colby, Suzanne M.; O'Leary, Tracy A.; Monti, Peter M.; Rohsenow, Damaris J.; Spirito, Anthony; Riggs, Suzanne; Barnett, Nancy P.

2010-01-01

A wide range of data are obtained with self-report. Information obtained from persons using substances is generally reliable and valid, however, many studies show that some proportion of self-reports regarding substance use are inaccurate. This study examines self-reported response distortion in adolescents who received a brief intervention to reduce their smoking. Findings indicate that age and ethnicity of respondent may influence reported response distortion. Factors that appear to influence under- and over-reporting include social desirability and fear of repercussion. Response distortion does not appear to affect rated usefulness of the intervention, nor does intervention type appear to influence whether respondents thought the researcher wanted them to report less use. Results point to the need for further research regarding adolescents and response distortion. PMID:12556133

[Development and validation of a questionnaire on knowledge and personal hygiene habits in childhood (HICORIN®)].

PubMed

Moreno-Martínez, Francisco José; Ruzafa-Martínez, María; Ramos-Morcillo, Antonio Jesús; Gómez García, Carmen Isabel; Hernández-Susarte, Ana María

2015-01-01

To develop and validate a questionnaire on the integral assessment of the habits and knowledge in personal hygiene in children between 7 to 12 years old in the educational, social and health environment. Cross-sectional study for the validation of a questionnaire. One primary and secondary school and one children's home in the Region of Murcia, Spain. A total of 86 children were included (80 from a primary and secondary school; 6 from a children's home), as well as 7 experts. Content validation by experts; qualitative assessment; identify difficulties related to some questions, item response analysis, and test-retest reliability. After the literature search, 20 tools that included items related to child body hygiene were obtained. The researchers selected 34 items and drafted 48 additional ones. After content validity by the experts, the questionnaire (HICORIN®) was reduced to 63 items, and consisted of 7 dimensions of child personal hygiene (skin, hair, hands, oral, feet, ears, and intimate hygiene). After with the children some terms were adapted to improve their understanding. Only two items had non-response rates that exceeded 10%. The test-retest showed that 84.1% of the items had between very good and moderate reliability. HICORIN® is a reliable and valid instrument that integrally assesses the habits and knowledge in personal hygiene in children between 7-12 years old. It is applicable in educative and social and health environments and in children from different socioeconomic levels. Copyright © 2014 Elsevier España, S.L.U. All rights reserved.

Workforce Perceptions of Hospital Safety Culture: Development and Validation of the Patient Safety Climate in Healthcare Organizations Survey

PubMed Central

Singer, Sara; Meterko, Mark; Baker, Laurence; Gaba, David; Falwell, Alyson; Rosen, Amy

2007-01-01

Objective To describe the development of an instrument for assessing workforce perceptions of hospital safety culture and to assess its reliability and validity. Data Sources/Study Setting Primary data collected between March 2004 and May 2005. Personnel from 105 U.S. hospitals completed a 38-item paper and pencil survey. We received 21,496 completed questionnaires, representing a 51 percent response rate. Study Design Based on review of existing safety climate surveys, we developed a list of key topics pertinent to maintaining a culture of safety in high-reliability organizations. We developed a draft questionnaire to address these topics and pilot tested it in four preliminary studies of hospital personnel. We modified the questionnaire based on experience and respondent feedback, and distributed the revised version to 42,249 hospital workers. Data Collection We randomly divided respondents into derivation and validation samples. We applied exploratory factor analysis to responses in the derivation sample. We used those results to create scales in the validation sample, which we subjected to multitrait analysis (MTA). Principal Findings We identified nine constructs, three organizational factors, two unit factors, three individual factors, and one additional factor. Constructs demonstrated substantial convergent and discriminant validity in the MTA. Cronbach's α coefficients ranged from 0.50 to 0.89. Conclusions It is possible to measure key salient features of hospital safety climate using a valid and reliable 38-item survey and appropriate hospital sample sizes. This instrument may be used in further studies to better understand the impact of safety climate on patient safety outcomes. PMID:17850530

Psychometric properties of the Norwegian version of the Safety Attitudes Questionnaire (SAQ), Generic version (Short Form 2006).

PubMed

Deilkås, Ellen T; Hofoss, Dag

2008-09-22

How to protect patients from harm is a question of universal interest. Measuring and improving safety culture in care giving units is an important strategy for promoting a safe environment for patients. The Safety Attitudes Questionnaire (SAQ) is the only instrument that measures safety culture in a way which correlates with patient outcome. We have translated the SAQ to Norwegian and validated the translated version. The psychometric properties of the translated questionnaire are presented in this article. The questionnaire was translated with the back translation technique and tested in 47 clinical units in a Norwegian university hospital. SAQ's (the Generic version (Short Form 2006) the version with the two sets of questions on perceptions of management: on unit management and on hospital management) were distributed to 1911 frontline staff. 762 were distributed during unit meetings and 1149 through the postal system. Cronbach alphas, item-to-own correlations, and test-retest correlations were calculated, and response distribution analysis and confirmatory factor analysis were performed, as well as early validity tests. 1306 staff members completed and returned the questionnaire: a response rate of 68%. Questionnaire acceptability was good. The reliability measures were acceptable. The factor structure of the responses was tested by confirmatory factor analysis. 36 items were ascribed to seven underlying factors: Teamwork Climate, Safety Climate, Stress Recognition, Perceptions of Hospital Management, Perceptions of Unit Management, Working conditions, and Job satisfaction. Goodness-of-Fit Indices showed reasonable, but not indisputable, model fit. External validity indicators - recognizability of results, correlations with "trigger tool"-identified adverse events, with patient satisfaction with hospitalization, patient reports of possible maltreatment, and patient evaluation of organization of hospital work - provided preliminary validation. Based on the data from Akershus University Hospital, we conclude that the Norwegian translation of the SAQ showed satisfactory internal psychometric properties. With data from one hospital only, we cannot draw strong conclusions on its external validity. Further validation studies linking the SAQ-scores to patient outcome data should be performed.

Assessing the Culture of Residency Using the C - Change Resident Survey: Validity Evidence in 34 U.S. Residency Programs.

PubMed

Pololi, Linda H; Evans, Arthur T; Civian, Janet T; Shea, Sandy; Brennan, Robert T

2017-07-01

A practical instrument is needed to reliably measure the clinical learning environment and professionalism for residents. To develop and present evidence of validity of an instrument to assess the culture of residency programs and the clinical learning environment. During 2014-2015, we surveyed residents using the C - Change Resident Survey to assess residents' perceptions of the culture in their programs. Residents in all years of training in 34 programs in internal medicine, pediatrics, and general surgery in 14 geographically diverse public and private academic health systems. The C - Change Resident Survey assessed residents' perceptions of 13 dimensions of the culture: Vitality, Self-Efficacy, Institutional Support, Relationships/Inclusion, Values Alignment, Ethical/Moral Distress, Respect, Mentoring, Work-Life Integration, Gender Equity, Racial/Ethnic Minority Equity, and self-assessed Competencies. We measured the internal reliability of each of the 13 dimensions and evaluated response process, content validity, and construct-related evidence validity by assessing relationships predicted by our conceptual model and prior research. We also assessed whether the measurements were sensitive to differences in specialty and across institutions. A total of 1708 residents completed the survey [internal medicine: n = 956, pediatrics: n = 411, general surgery: n = 311 (51% women; 16% underrepresented in medicine minority)], with a response rate of 70% (range across programs, 51-87%). Internal consistency of each dimension was high (Cronbach α: 0.73-0.90). The instrument was able to detect significant differences in the learning environment across programs and sites. Evidence of validity was supported by a good response process and the demonstration of several relationships predicted by our conceptual model. The C - Change Resident Survey assesses the clinical learning environment for residents, and we encourage further study of validity in different contexts. Results could be used to facilitate and monitor improvements in the clinical learning environment and resident well-being.

Optimizing DER Participation in Inertial and Primary-Frequency Response

DOE Office of Scientific and Technical Information (OSTI.GOV)

Dall-Anese, Emiliano; Zhao, Changhong; Guggilam, Swaroop

This paper develops an approach to enable the optimal participation of distributed energy resources (DERs) in inertial and primary-frequency response alongside conventional synchronous generators. Leveraging a reduced-order model description of frequency dynamics, DERs' synthetic inertias and droop coefficients are designed to meet time-domain performance objectives of frequency overshoot and steady-state regulation. Furthermore, an optimization-based method centered around classical economic dispatch is developed to ensure that DERs share the power injections for inertial- and primary-frequency response in proportion to their power ratings. Simulations for a modified New England test-case system composed of ten synchronous generators and six instances of the IEEEmore » 37-node test feeder with frequency-responsive DERs validate the design strategy.« less

Tumor shrinkage and objective response rates: gold standard for oncology efficacy screening trials, or an outdated end point?

PubMed

Bradbury, Penelope; Seymour, Lesley

2009-01-01

Phase II clinical trials have long been used to screen new cancer therapeutics for antitumor activity ("efficacy") worthy of further evaluation. Traditionally, the primary end point used in these screening trials has been objective response rate (RR), with the desired rate being arbitrarily set by the researchers before initiation of the trial. For cytotoxic agents, especially in common tumor types, response has been a reasonably robust and validated surrogate of benefit. Phase II trials with response as an end point have a modest sample size (15-40 patients) and are completed rapidly allowing early decisions regarding future development of a given agent. More recently, a number of new agents have proven successful in pivotal phase III studies, despite a low or very modest RR demonstrated in early clinical trials. Researchers have postulated that these novel agents, as a class, may not induce significant regression of tumors, and that the use of RR as an end point for phase II studies will result in false negative results, and point out that not all available data is used in making the decision. Others have pointed out that even novel agents have proven unsuccessful in pivotal trials if objective responses are not demonstrated in early clinical trials. We review here the historical and current information regarding objective tumor response.

Brain Responses to Smoking Cues Differ Based on Nicotine Metabolism Rate

PubMed Central

Falcone, Mary; Cao, Wen; Bernardo, Leah; Tyndale, Rachel F; Loughead, James; Lerman, Caryn

2017-01-01

Background Inherited differences in the rate of metabolism of nicotine, the addictive chemical in tobacco, affect smoking behavior and quitting success. The nicotine metabolite ratio (NMR, 3′-hydroxycotinine/cotinine) is a reliable measure of nicotine clearance, and a well validated predictive biomarker of response to pharmacotherapy. To clarify the mechanisms underlying these associations, we investigated the neural responses to smoking cues in normal and slow nicotine metabolizers. Methods Sixty-nine treatment-seeking smokers (30 slow, 39 normal metabolizers) completed a visual cue reactivity task during functional magnetic resonance imaging on two separate occasions: once during smoking satiety and once following 24 hours of smoking abstinence. Results In whole brain analysis, normal (compared to slow) metabolizers exhibited heightened abstinence-induced neural responses to smoking cues in the left caudate, left inferior frontal gyrus, and left frontal pole. These effects were even more pronounced when extreme groups of slow and normal metabolizers were examined. Greater activation in the left caudate and left frontal pole was associated with abstinence-induced subjective cravings to smoke. Conclusion Inherited differences in rate of nicotine elimination may drive neural responses to smoking cues during early abstinence, providing a plausible mechanism to explain differences in smoking behaviors and response to cessation treatment. Normal metabolizers may benefit from adjunctive behavioral smoking cessation treatments, such as cue exposure therapy. PMID:26805583

Brain Responses to Smoking Cues Differ Based on Nicotine Metabolism Rate.

PubMed

Falcone, Mary; Cao, Wen; Bernardo, Leah; Tyndale, Rachel F; Loughead, James; Lerman, Caryn

2016-08-01

Inherited differences in the rate of metabolism of nicotine, the addictive chemical in tobacco, affect smoking behavior and quitting success. The nicotine metabolite ratio (3'-hydroxycotinine/cotinine) is a reliable measure of nicotine clearance and a well-validated predictive biomarker of response to pharmacotherapy. To clarify the mechanisms underlying these associations, we investigated the neural responses to smoking cues in normal and slow nicotine metabolizers. Treatment-seeking smokers (N = 69; 30 slow metabolizers and 39 normal metabolizers) completed a visual cue reactivity task during functional magnetic resonance imaging on two separate occasions: once during smoking satiety and once after 24 hours of smoking abstinence. In whole-brain analysis, normal (compared with slow) metabolizers exhibited heightened abstinence-induced neural responses to smoking cues in the left caudate, left inferior frontal gyrus, and left frontal pole. These effects were more pronounced when extreme groups of slow and normal metabolizers were examined. Greater activation in the left caudate and left frontal pole was associated with abstinence-induced subjective cravings to smoke. Inherited differences in rate of nicotine elimination may drive neural responses to smoking cues during early abstinence, providing a plausible mechanism to explain differences in smoking behaviors and response to cessation treatment. Normal metabolizers may benefit from adjunctive behavioral smoking cessation treatments, such as cue exposure therapy. Copyright © 2016 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

Self-administered physical activity questionnaires for the elderly: a systematic review of measurement properties.

PubMed

Forsén, Lisa; Loland, Nina Waaler; Vuillemin, Anne; Chinapaw, Mai J M; van Poppel, Mireille N M; Mokkink, Lidwine B; van Mechelen, Willem; Terwee, Caroline B

2010-07-01

To systematically review and appraise studies examining self-administered physical activity questionnaires (PAQ) for the elderly. This article is one of a group of four articles in Sports Medicine on the content and measurement properties of PAQs. LITERATURE SEARCH METHODOLOGY: Searches in PubMed, EMBASE and SportDiscu (until May 2009) on self-administered PAQ. Inclusion criteria were as follows: (i) the study examined (at least one of) the measurement properties of a self-administered PAQ; (ii) the questionnaire aimed to measure physical activity (PA) in older people; (iii) the average age of the study population was >55 years; (iv) the article was written in English. We excluded PA interviews, diaries and studies that evaluated the measurement properties of a self-administered PAQ in a specific population, such as patients. We used a standard checklist (qualitative attributes and measurement properties of PA questionnaires [QAPAQ]) for appraising the measurement properties of PAQs. Eighteen articles on 13 PAQs were reviewed, including 16 reliability analyses and 25 validity analyses (of which 15 were on construct validity, seven on health/functioning associations, two on known-groups validity and one on responsiveness). Many studies suffered from methodological flaws, e.g. too small sample size or inadequate time interval between test and retest. Three PAQs received a positive rating on reliability: IPAQ-C (International Physical Activity Questionnaire-Chinese), intraclass correlation coefficient (ICC) > or = 0.81; WHI-PAQ (Women's Health Initiative-PAQ), ICC = 0.76; and PASE (Physical Activity Scale for the Elderly), Pearson correlation coefficient (r) = 0.84. However, PASE was negatively rated on reliability in another study (ICC = 0.65). One PAQ received a positive rating on construct validity: PASE against Mini-Logger (r > 0.52), but PASE was negatively rated in another study against accelerometer and another PAQ, Spearman correlation coefficient = 0.17 and 0.48, respectively. Three of the 13 PAQs were tested for health/functioning associations and all three were positively rated in some categories of PA in many studies (r > 0.30). Even though several studies showed an association between the tested PAQ and health/functioning variables, the knowledge about reliability and construct validity of self-administrated PAQs for older adults is still scarce and more high-quality validation studies are needed.

Can the PHS model (ISO7933) predict reasonable thermophysiological responses while wearing protective clothing in hot environments?

PubMed

Wang, Faming; Kuklane, Kalev; Gao, Chuansi; Holmér, Ingvar

2011-02-01

In this paper, the prediction accuracy of the PHS (predicted heat strain) model on human physiological responses while wearing protective clothing ensembles was examined. Six human subjects (aged 29 ± 3 years) underwent three experimental trials in three different protective garments (clothing thermal insulation I(cl) ranges from 0.63 to 2.01 clo) in two hot environments (40 °C, relative humidities: 30% and 45%). The observed and predicted mean skin temperature, core body temperature and sweat rate were presented and statistically compared. A significant difference was found in the metabolic rate between FIRE (firefighting clothing) and HV (high visibility clothing) or MIL (military clothing) (p < 0.001). Also, the development of heart rate demonstrated the significant effects of the exposure time and clothing ensembles. In addition, the predicted evaporation rate during HV, MIL and FIRE was much lower than the experimental values. Hence, the current PHS model is not applicable for protective clothing with intrinsic thermal insulations above 1.0 clo. The results showed that the PHS model generated unreliable predictions on body core temperature when human subjects wore thick protective clothing such as firefighting clothing (I(cl) > 1.0 clo). The predicted mean skin temperatures in three clothing ensembles HV, MIL and FIRE were also outside the expected limits. Thus, there is a need for further extension for the clothing insulation validation range of the PHS model. It is recommended that the PHS model should be amended and validated by individual algorithms, physical or physiological parameters, and further subject studies.

Estimated prevalence of compulsive buying behavior in the United States.

PubMed

Koran, Lorrin M; Faber, Ronald J; Aboujaoude, Elias; Large, Michael D; Serpe, Richard T

2006-10-01

Compulsive buying (uncontrolled urges to buy, with resulting significant adverse consequences) has been estimated to affect from 1.8% to 16% of the adult U.S. population. To the authors' knowledge, no study has used a large general population sample to estimate its prevalence. The authors conducted a random sample, national household telephone survey in the spring and summer of 2004 and interviewed 2,513 adults. The interviews addressed buying attitudes and behaviors, their consequences, and the respondents' financial and demographic data. The authors used a clinically validated screening instrument, the Compulsive Buying Scale, to classify respondents as either compulsive buyers or not. The rate of response was 56.3%, which compares favorably with rates in federal national health surveys. The cooperation rate was 97.6%. Respondents included a higher percentage of women and people ages 55 and older than the U.S. adult population. The estimated point prevalence of compulsive buying among respondents was 5.8% (by gender: 6.0% for women, 5.5% for men). The gender-adjusted prevalence rate was 5.8%. Compared with other respondents, compulsive buyers were younger, and a greater proportion reported incomes under 50,000 US dollars. They exhibited more maladaptive responses on most consumer behavior measures and were more than four times less likely to pay off credit card balances in full. A study using clinically valid interviews is needed to evaluate these results. The emotional and functional toll of compulsive buying and the frequency of comorbid psychiatric disorders suggests that studies of treatments and social interventions are warranted.

Reliability and Validity of a Submaximal Warm-up Test for Monitoring Training Status in Professional Soccer Players.

PubMed

Rabbani, Alireza; Kargarfard, Mehdi; Twist, Craig

2018-02-01

Rabbani, A, Kargarfard, M, and Twist, C. Reliability and validity of a submaximal warm-up test for monitoring training status in professional soccer players. J Strength Cond Res 32(2): 326-333, 2018-Two studies were conducted to assess the reliability and validity of a submaximal warm-up test (SWT) in professional soccer players. For the reliability study, 12 male players performed an SWT over 3 trials, with 1 week between trials. For the validity study, 14 players of the same team performed an SWT and a 30-15 intermittent fitness test (30-15IFT) 7 days apart. Week-to-week reliability in selected heart rate (HR) responses (exercise heart rate [HRex], heart rate recovery [HRR] expressed as the number of beats recovered within 1 minute [HRR60s], and HRR expressed as the mean HR during 1 minute [HRpost1]) was determined using the intraclass correlation coefficient (ICC) and typical error of measurement expressed as coefficient of variation (CV). The relationships between HR measures derived from the SWT and the maximal speed reached at the 30-15IFT (VIFT) were used to assess validity. The range for ICC and CV values was 0.83-0.95 and 1.4-7.0% in all HR measures, respectively, with the HRex as the most reliable HR measure of the SWT. Inverse large (r = -0.50 and 90% confidence limits [CLs] [-0.78 to -0.06]) and very large (r = -0.76 and CL, -0.90 to -0.45) relationships were observed between HRex and HRpost1 with VIFT in relative (expressed as the % of maximal HR) measures, respectively. The SWT is a reliable and valid submaximal test to monitor high-intensity intermittent running fitness in professional soccer players. In addition, the test's short duration (5 minutes) and simplicity mean that it can be used regularly to assess training status in high-level soccer players.

The Effects of Acute Stress on Cognitive Performance. A Pilot Study

DTIC Science & Technology

2010-12-01

Correlation Matrix – Stress Response Measures. ................................ 13  Table 4. Non-significant HRV Results...validity and reliability. The State-Trait Anxiety Index (or STAI; Spielberger and Sydeman, 1994) is a popular self-report instrument of this type...and provides distinct scores for state anxiety (a property of the situation) and trait anxiety (a property of the individual) using a 4-point rating

A Study of United States Army Product Support Manager (PSM) Training

DTIC Science & Technology

2016-03-25

relevant policy and data associated with Product Support Manager (PSM) responsibilities, measure the current status of PSM training and selection, and...Year (FY) 16 (U.S. Department of Defense, 2015) which encompasses a need for processes, procedures, policies and regulations by which to accomplish...availability rates , and reduce operation and sustainment costs (C) Conduct appropriate cost analyses to validate the product support strategy

Using the Sampling Margin of Error to Assess the Interpretative Validity of Student Evaluations of Teaching

ERIC Educational Resources Information Center

James, David E.; Schraw, Gregory; Kuch, Fred

2015-01-01

We present an equation, derived from standard statistical theory, that can be used to estimate sampling margin of error for student evaluations of teaching (SETs). We use the equation to examine the effect of sample size, response rates and sample variability on the estimated sampling margin of error, and present results in four tables that allow…

Triage capabilities of medical trainees in Ghana using the South African triage scale: an opportunity to improve emergency care

PubMed Central

Gyedu, Adam; Agbedinu, Kwabena; Dalwai, Mohammed; Osei-Ampofo, Maxwell; Nakua, Emmanuel Kweku; Oteng, Rockefeller; Stewart, Barclay

2016-01-01

Introduction The incidence of emergency conditions is increasing worldwide, particularly in low- and middle-income countries (LMICs). However, triage and emergency care training has not been prioritized in LMICs. We aimed to assess the reliability and validity of the South African Triage Scale (SATS) when used by providers not specifically trained in SATS, as well as to compare triage capabilities between senior medical students and senior house officers to examine the effectiveness of our curriculum for house officer training with regards to triage. Methods Sixty each of senior medical students and senior house officers who had not undergone specific triage or SATS training were asked to triage 25 previously validated emergency vignettes using the SATS. Estimates of reliability and validity were calculated. Additionally, over- and under-triage, as well as triage performance between the medical students and house officers was assessed against a reference standard. Results Fifty-nine senior medical students (98% response rate) and 43 senior house officers (72% response rate) completed the survey (84% response rate overall). A total of 2,550 triage assignments were included in the analysis (59 medical student and 43 house officer triage assignments for 25 vignettes each; 1,475 and 1,075 triage assignments, respectively). Inter-rater reliability was moderate (quadratically weighted κ 0.59 and 0.60 for medical students and house officers, respectively). Triage using SATS performed by these groups had low sensitivity (medical students: 54%, 95% CI 49–59; house officers: 55%, 95% CI 48–60) and moderate specificity (medical students: 84%, 95% CI 82 - 89; house officers: 84%, 95% CI 82 - 97). Both groups under-triaged most ‘emergency’ level vignette patients (i.e. SATS Red; 80 and 82% for medical students and house officers, respectively). There was no difference between the groups for any metric. Conclusion Although the SATS has proven utility in a number of different settings in LMICs, its success relies on its use by trained providers. Given the large and growing burden of emergency conditions, training current and future emergency care providers in triage is imperative. PMID:28154649

Triage capabilities of medical trainees in Ghana using the South African triage scale: an opportunity to improve emergency care.

PubMed

Gyedu, Adam; Agbedinu, Kwabena; Dalwai, Mohammed; Osei-Ampofo, Maxwell; Nakua, Emmanuel Kweku; Oteng, Rockefeller; Stewart, Barclay

2016-01-01

The incidence of emergency conditions is increasing worldwide, particularly in low- and middle-income countries (LMICs). However, triage and emergency care training has not been prioritized in LMICs. We aimed to assess the reliability and validity of the South African Triage Scale (SATS) when used by providers not specifically trained in SATS, as well as to compare triage capabilities between senior medical students and senior house officers to examine the effectiveness of our curriculum for house officer training with regards to triage. Sixty each of senior medical students and senior house officers who had not undergone specific triage or SATS training were asked to triage 25 previously validated emergency vignettes using the SATS. Estimates of reliability and validity were calculated. Additionally, over- and under-triage, as well as triage performance between the medical students and house officers was assessed against a reference standard. Fifty-nine senior medical students (98% response rate) and 43 senior house officers (72% response rate) completed the survey (84% response rate overall). A total of 2,550 triage assignments were included in the analysis (59 medical student and 43 house officer triage assignments for 25 vignettes each; 1,475 and 1,075 triage assignments, respectively). Inter-rater reliability was moderate (quadratically weighted κ 0.59 and 0.60 for medical students and house officers, respectively). Triage using SATS performed by these groups had low sensitivity (medical students: 54%, 95% CI 49-59; house officers: 55%, 95% CI 48-60) and moderate specificity (medical students: 84%, 95% CI 82 - 89; house officers: 84%, 95% CI 82 - 97). Both groups under-triaged most 'emergency' level vignette patients (i.e. SATS Red; 80 and 82% for medical students and house officers, respectively). There was no difference between the groups for any metric. Although the SATS has proven utility in a number of different settings in LMICs, its success relies on its use by trained providers. Given the large and growing burden of emergency conditions, training current and future emergency care providers in triage is imperative.

Assessing Health Status in Inflammatory Bowel Disease using a Novel Single-Item Numeric Rating Scale

PubMed Central

Surti, Bijal; Spiegel, Brennan; Ippoliti, Andrew; Vasiliauskas, Eric; Simpson, Peter; Shih, David; Targan, Stephan; McGovern, Dermot; Melmed, Gil Y.

2014-01-01

Background Current instruments used to measure disease activity and health-related quality of life (HRQOL) in patients with Crohn’s disease (CD) and ulcerative colitis (UC) are often cumbersome, time-consuming, and expensive; although used in clinical trials, they are not convenient for clinical practice. A numeric rating scale (NRS) is a quick, inexpensive, and convenient patient-reported outcome (PRO) that can capture the patient’s overall perception of health. Aims To assess the validity, reliability, and responsiveness of an NRS and evaluate its use in clinical practice in patients with CD and UC. Methods We prospectively evaluated patient-reported NRS scores and measured correlations between NRS and a range of severity measures, including physician-reported NRS, Crohn’s disease activity index (CDAI), Harvey-Bradshaw index (HBI), inflammatory bowel disease questionnaire (IBDQ), and C-reactive protein (CRP) in patients with CD. Subsequently, we evaluated the correlation between the NRS and standard measures of health status (HBI or simple colitis clinical activity index [SCCAI]) and laboratory tests (sedimentation rate [ESR], CRP, and fecal calprotectin) in patients with CD and UC. Results The patient-reported NRS showed excellent correlation with CDAI (R2=0.59, p<0.0001), IBDQ (R2=0.66, p<0.0001), and HBI (R2=0.32, p<0.0001) in patients with CD. The NRS showed poor, but statistically significant correlation with SCCAI (R2=0.25, p<0.0001) in patients with UC. The NRS did not correlate with CRP, ESR, or calprotectin. The NRS was reliable and responsive to change. Conclusions The NRS is a valid, reliable, and responsive measure that may be useful to evaluate patients with CD and possibly UC. PMID:23250673

Assessing health status in inflammatory bowel disease using a novel single-item numeric rating scale.

PubMed

Surti, Bijal; Spiegel, Brennan; Ippoliti, Andrew; Vasiliauskas, Eric A; Simpson, Peter; Shih, David Q; Targan, Stephan R; McGovern, Dermot P B; Melmed, Gil Y

2013-05-01

Current instruments used to measure disease activity and health-related quality of life in patients with Crohn's disease (CD) and ulcerative colitis (UC) are often cumbersome, time-consuming, and expensive; although used in clinical trials, they are not convenient for clinical practice. A numeric rating scale (NRS) is a quick, inexpensive, and convenient patient-reported outcome that can capture the patient's overall perception of health. The aim of this study was to assess the validity, reliability, and responsiveness of an NRS and evaluate its use in clinical practice in patients with CD and UC. We prospectively evaluated patient-reported NRS scores and measured correlations between NRS and a range of severity measures, including physician-reported NRS, Crohn's disease activity index (CDAI), Harvey-Bradshaw index (HBI), inflammatory bowel disease questionnaire (IBDQ), and C-reactive protein (CRP) in patients with CD. Subsequently, we evaluated the correlation between the NRS and standard measures of health status (HBI or simple colitis clinical activity index [SCCAI]) and laboratory tests (sedimentation rate [ESR], CRP, and fecal calprotectin) in patients with CD and UC. The patient-reported NRS showed excellent correlation with CDAI (R (2) = 0.59, p < 0.0001), IBDQ (R (2) = 0.66, p < 0.0001), and HBI (R (2) = 0.32, p < 0.0001) in patients with CD. The NRS showed poor, but statistically significant correlation with SCCAI (R (2) = 0.25, p < 0.0001) in patients with UC. The NRS did not correlate with CRP, ESR, or calprotectin. The NRS was reliable and responsive to change. The NRS is a valid, reliable, and responsive measure that may be useful to evaluate patients with CD and possibly UC.

Assessing the validity and reliability of the Pool Activity Level (PAL) Checklist for use with older people with dementia.

PubMed

Wenborn, Jennifer; Challis, David; Pool, Jackie; Burgess, Jane; Elliott, Nicola; Orrell, Martin

2008-03-01

Activity is key to maintaining physical and mental health and well-being. However, as dementia affects the ability to engage in activity, care-givers can find it difficult to provide appropriate activities. The Pool Activity Level (PAL) Checklist guides the selection of appropriate, personally meaningful activities. The aim of this study was to assess the reliability and validity of the PAL Checklist when used with older people with dementia. A postal questionnaire sent to activity providers assessed content validity. Validity and reliability were measured in a sample of 60 older people with dementia. The questionnaire response rate was 83% (102/122). Most respondents felt no important items were missing. Seven of the nine activities were ranked as 'very important' or 'essential' by at least 77% of the sample, indicating very good content validity. Correlation with measures of cognition, severity of dementia and activity performance demonstrated strong concurrent validity. Inter-item correlation indicated strong construct validity. Cronbach's alpha coefficient measured internal consistency as excellent (0.95). All items achieved acceptable test-retest reliability, and the majority demonstrated acceptable inter-rater reliability. We conclude that the PAL Checklist demonstrates adequate validity and reliability when used with older people with dementia and appears a useful tool for a variety of care settings.

WHO systematic review of prevalence of chronic pelvic pain: a neglected reproductive health morbidity

PubMed Central

Latthe, Pallavi; Latthe, Manish; Say, Lale; Gülmezoglu, Metin; Khan, Khalid S

2006-01-01

Background Health care planning for chronic pelvic pain (CPP), an important cause of morbidity amongst women is hampered due to lack of clear collated summaries of its basic epidemiological data. We systematically reviewed worldwide literature on the prevalence of different types of CPP to assess the geographical distribution of data, and to explore sources of variation in its estimates. Methods We identified data available from Medline (1966 to 2004), Embase (1980 to 2004), PsycINFO (1887 to 2003), LILACS (1982 to 2004), Science Citation index, CINAHL (January 1980 to 2004) and hand searching of reference lists. Two reviewers extracted data independently, using a piloted form, on participants' characteristics, study quality and rates of CPP. We considered a study to be of high quality (valid) if had at least three of the following features: prospective design, validated measurement tool, adequate sampling method, sample size estimation and response rate >80%. We performed both univariate and multivariate meta-regression analysis to explore heterogeneity of results across studies. Results There were 178 studies (459975 participants) in 148 articles. Of these, 106 studies were (124259 participants) on dysmenorrhoea, 54 (35973 participants) on dyspareunia and 18 (301756 participants) on noncyclical pain. There were only 19/95 (20%) less developed and 1/45 (2.2%) least developed countries with relevant data in contrast to 22/43 (51.2%) developed countries. Meta-regression analysis showed that rates of pain varied according to study quality features. There were 40 (22.5%) high quality studies with representative samples. Amongst them, the rate of dysmenorrhoea was 16.8 to 81%, that of dyspareunia was 8 to 21.8%, and that for noncyclical pain was 2.1 to 24%. Conclusion There were few valid population based estimates of disease burden due to CPP from less developed countries. The variation in rates of CPP worldwide was due to variable study quality. Where valid data were available, a high disease burden of all types of pelvic pain was found. PMID:16824213

Development and Construct Validation of the Interprofessional Attitudes Scale

PubMed Central

Norris, Jeffrey; Carpenter, Joan G.; Eaton, Jacqueline; Guo, Jia-Wen; Lassche, Madeline; Pett, Marjorie A.; Blumenthal, Donald K.

2015-01-01

Purpose Training of health professionals requires development of interprofessional competencies and assessment of these competencies. No validated tools exist to assess all four competency domains described in the 2011 Core Competencies for Interprofessional Collaborative Practice (the IPEC Report). The purpose of this study was to develop and validate a scale based on the IPEC competency domains that assesses interprofessional attitudes of students in the health professions. Method In 2012, a survey tool was developed and administered to 1,549 students from the University of Utah Health Science Center, an academic health center composed of four schools and colleges (Health, Medicine, Nursing, and Pharmacy). Exploratory and confirmatory factor analyses (EFA and CFA) were performed to validate the assessment tool, eliminate redundant questions, and to identify subscales. Results The EFA and CFA focused on aligning subscales with IPEC core competencies, and demonstrating good construct validity and internal consistency reliability. A response rate of 45% (n = 701) was obtained. Responses with complete data (n=678) were randomly split into two datasets which were independently analyzed using EFA and CFA. The EFA produced a 27-item scale, with five subscales (Cronbach’s alpha coefficients: 0.62 to 0.92). CFA indicated the content of the five subscales was consistent with the EFA model. Conclusions The Interprofessional Attitudes Scale (IPAS) is a novel tool that, compared to previous tools, better reflects current trends in interprofessional competencies. The IPAS should be useful to health sciences educational institutions and others training people to work collaboratively in interprofessional teams. PMID:25993280

Disease Severity and Progression in Progressive Supranuclear Palsy and Multiple System Atrophy: Validation of the NNIPPS – PARKINSON PLUS SCALE

PubMed Central

Payan, Christine A. M.; Viallet, François; Landwehrmeyer, Bernhard G.; Bonnet, Anne-Marie; Borg, Michel; Durif, Franck; Lacomblez, Lucette; Bloch, Frédéric; Verny, Marc; Fermanian, Jacques; Agid, Yves; Ludolph, Albert C.

2011-01-01

Background The Natural History and Neuroprotection in Parkinson Plus Syndromes (NNIPPS) study was a large phase III randomized placebo-controlled trial of riluzole in Progressive Supranuclear Palsy (PSP, n = 362) and Multiple System Atrophy (MSA, n = 398). To assess disease severity and progression, we constructed and validated a new clinical rating scale as an ancillary study. Methods and Findings Patients were assessed at entry and 6-montly for up to 3 years. Evaluation of the scale's psychometric properties included reliability (n = 116), validity (n = 760), and responsiveness (n = 642). Among the 85 items of the initial scale, factor analysis revealed 83 items contributing to 15 clinically relevant dimensions, including Activity of daily Living/Mobility, Axial bradykinesia, Limb bradykinesia, Rigidity, Oculomotor, Cerebellar, Bulbar/Pseudo-bulbar, Mental, Orthostatic, Urinary, Limb dystonia, Axial dystonia, Pyramidal, Myoclonus and Tremor. All but the Pyramidal dimension demonstrated good internal consistency (Cronbach α≥0.70). Inter-rater reliability was high for the total score (Intra-class coefficient = 0.94) and 9 dimensions (Intra-class coefficient = 0.80–0.93), and moderate (Intra-class coefficient = 0.54–0.77) for 6. Correlations of the total score with other clinical measures of severity were good (rho≥0.70). The total score was significantly and linearly related to survival (p<0.0001). Responsiveness expressed as the Standardized Response Mean was high for the total score slope of change (SRM = 1.10), though higher in PSP (SRM = 1.25) than in MSA (SRM = 1.0), indicating a more rapid progression of PSP. The slope of change was constant with increasing disease severity demonstrating good linearity of the scale throughout disease stages. Although MSA and PSP differed quantitatively on the total score at entry and on rate of progression, the relative contribution of clinical dimensions to overall severity and progression was similar. Conclusions The NNIPPS-PPS has suitable validity, is reliable and sensitive, and therefore is appropriate for use in clinical studies with PSP or MSA. Trial Registration ClinicalTrials.gov NCT00211224 PMID:21829612

Minimizing false positive error with multiple performance validity tests: response to Bilder, Sugar, and Hellemann (2014 this issue).

PubMed

Larrabee, Glenn J

2014-01-01

Bilder, Sugar, and Hellemann (2014 this issue) contend that empirical support is lacking for use of multiple performance validity tests (PVTs) in evaluation of the individual case, differing from the conclusions of Davis and Millis (2014), and Larrabee (2014), who found no substantial increase in false positive rates using a criterion of failure of ≥ 2 PVTs and/or Symptom Validity Tests (SVTs) out of multiple tests administered. Reconsideration of data presented in Larrabee (2014) supports a criterion of ≥ 2 out of up to 7 PVTs/SVTs, as keeping false positive rates close to and in most cases below 10% in cases with bona fide neurologic, psychiatric, and developmental disorders. Strategies to minimize risk of false positive error are discussed, including (1) adjusting individual PVT cutoffs or criterion for number of PVTs failed, for examinees who have clinical histories placing them at risk for false positive identification (e.g., severe TBI, schizophrenia), (2) using the history of the individual case to rule out conditions known to result in false positive errors, (3) using normal performance in domains mimicked by PVTs to show that sufficient native ability exists for valid performance on the PVT(s) that have been failed, and (4) recognizing that as the number of PVTs/SVTs failed increases, the likelihood of valid clinical presentation decreases, with a corresponding increase in the likelihood of invalid test performance and symptom report.

On the experimental validation of model-based dose calculation algorithms for 192Ir HDR brachytherapy treatment planning

NASA Astrophysics Data System (ADS)

Pappas, Eleftherios P.; Zoros, Emmanouil; Moutsatsos, Argyris; Peppa, Vasiliki; Zourari, Kyveli; Karaiskos, Pantelis; Papagiannis, Panagiotis

2017-05-01

There is an acknowledged need for the design and implementation of physical phantoms appropriate for the experimental validation of model-based dose calculation algorithms (MBDCA) introduced recently in 192Ir brachytherapy treatment planning systems (TPS), and this work investigates whether it can be met. A PMMA phantom was prepared to accommodate material inhomogeneities (air and Teflon), four plastic brachytherapy catheters, as well as 84 LiF TLD dosimeters (MTS-100M 1  ×  1  ×  1 mm3 microcubes), two radiochromic films (Gafchromic EBT3) and a plastic 3D dosimeter (PRESAGE). An irradiation plan consisting of 53 source dwell positions was prepared on phantom CT images using a commercially available TPS and taking into account the calibration dose range of each detector. Irradiation was performed using an 192Ir high dose rate (HDR) source. Dose to medium in medium, Dmm , was calculated using the MBDCA option of the same TPS as well as Monte Carlo (MC) simulation with the MCNP code and a benchmarked methodology. Measured and calculated dose distributions were spatially registered and compared. The total standard (k  =  1) spatial uncertainties for TLD, film and PRESAGE were: 0.71, 1.58 and 2.55 mm. Corresponding percentage total dosimetric uncertainties were: 5.4-6.4, 2.5-6.4 and 4.85, owing mainly to the absorbed dose sensitivity correction and the relative energy dependence correction (position dependent) for TLD, the film sensitivity calibration (dose dependent) and the dependencies of PRESAGE sensitivity. Results imply a LiF over-response due to a relative intrinsic energy dependence between 192Ir and megavoltage calibration energies, and a dose rate dependence of PRESAGE sensitivity at low dose rates (<1 Gy min-1). Calculations were experimentally validated within uncertainties except for MBDCA results for points in the phantom periphery and dose levels  <20%. Experimental MBDCA validation is laborious, yet feasible. Further work is required for the full characterization of dosimeter response for 192Ir and the reduction of experimental uncertainties.

Development and validation of the Medical Student Scholar-Ideal Mentor Scale (MSS-IMS).

PubMed

Sozio, Stephen M; Chan, Kitty S; Beach, Mary Catherine

2017-08-08

Programs encouraging medical student research such as Scholarly Concentrations (SC) are increasing nationally. However, there are few validated measures of mentoring quality tailored to medical students. We sought to modify and validate a mentoring scale for use in medical student research experiences. SC faculty created a scale evaluating how medical students assess mentors in the research setting. A validated graduate student scale of mentorship, the Ideal Mentor Scale, was modified by selecting 10 of the 34 original items most relevant for medical students and adding an item on project ownership. We administered this 11-item assessment to second year medical students in the Johns Hopkins University SC Program from 2011 to 2016, and performed exploratory factor analysis with oblique rotation to determine included items and subscales. We correlate overall mentoring quality scale and subscales with four student outcomes: 'very satisfied' with mentor, 'more likely' to do future research, project accepted at a national meeting, and highest SC faculty rating of student project. Five hundred ninety-eight students responded (87% response rate). After factor analysis, we eliminated three items producing a final scale of overall mentoring quality (8 items, Cronbach's alpha = 0.92) with three subscales: advocacy, responsiveness, and assistance. The overall mentoring quality scale was significantly associated with all four student outcomes, including mentor satisfaction: OR [(95% CI), p-value] 1.66 [(1.53-1.79), p < 0.001]; likelihood of future research: OR 1.06 [(1.03-1.09), p < 0.001]; abstract submission to national meetings: OR 1.05 [(1.02-1.08), p = 0.002]; and SC faculty rating of student projects: OR 1.08 [(1.03-1.14), p = 0.004]. Each subscale also correlated with overall mentor satisfaction, and the strongest relationship of each subscale was seen with 'mentor advocacy.' Mentor quality can be reliably measured and associates with important medical student scholarly outcomes. Given the lack of tools, this scale can be used by other SC Programs to advance medical students' scholarship.

A framework for evaluating the appropriateness of clinical decision support alerts and responses

PubMed Central

Waitman, Lemuel R; Lewis, Julia B; Wright, Julie A; Choma, David P; Miller, Randolph A; Peterson, Josh F

2011-01-01

Objective Alerting systems, a type of clinical decision support, are increasingly prevalent in healthcare, yet few studies have concurrently measured the appropriateness of alerts with provider responses to alerts. Recent reports of suboptimal alert system design and implementation highlight the need for better evaluation to inform future designs. The authors present a comprehensive framework for evaluating the clinical appropriateness of synchronous, interruptive medication safety alerts. Methods Through literature review and iterative testing, metrics were developed that describe successes, justifiable overrides, provider non-adherence, and unintended adverse consequences of clinical decision support alerts. The framework was validated by applying it to a medication alerting system for patients with acute kidney injury (AKI). Results Through expert review, the framework assesses each alert episode for appropriateness of the alert display and the necessity and urgency of a clinical response. Primary outcomes of the framework include the false positive alert rate, alert override rate, provider non-adherence rate, and rate of provider response appropriateness. Application of the framework to evaluate an existing AKI medication alerting system provided a more complete understanding of the process outcomes measured in the AKI medication alerting system. The authors confirmed that previous alerts and provider responses were most often appropriate. Conclusion The new evaluation model offers a potentially effective method for assessing the clinical appropriateness of synchronous interruptive medication alerts prior to evaluating patient outcomes in a comparative trial. More work can determine the generalizability of the framework for use in other settings and other alert types. PMID:21849334

Results of the 2015 Perfusionist Salary Study

PubMed Central

Lewis, Doreen M.; Dove, Steven; Jordan, Ralph E.

2016-01-01

Abstract: Presently, there exists no published valid and reliable salary study of clinical perfusionists. The objective of the 2015 Perfusionist Salary Study was to gather verifiable employee information to determine current compensation market rates (salary averages) of clinical perfusionists working in the United States. A salary survey was conducted between April 2015 and March 2016. The survey required perfusionists to answer questions about work volume, scheduling, and employer-paid compensation including benefits. Participants were also required to submit a de-identified pay stub to validate the income they reported. Descriptive statistics were calculated for all survey questions (e.g., percentages, means, and ranges). The study procured 481 responses, of which 287 were validated (i.e., respondents provided income verification that matched reported earnings). Variables that were examined within the validated sample population include job title, type of institution of employment, education level, years of experience, and geographic region, among others. Additional forms of compensation which may affect base compensation rates were also calculated including benefits, call time, bonuses, and pay for ancillary services (e.g., extracorporeal membrane oxygenation and ventricular assist device). In conclusion, in 2015, the average salary for all perfusionists is $127,600 with 19 years' experience. This research explores the average salary within subpopulations based on other factors such as position role, employer type, and geography. Information from this study is presented to guide employer compensation programs and suggests the need for further study in consideration of attrition rates and generational changes (i.e., perfusionists reaching retirement age) occurring alongside the present perfusionist staffing shortage affecting many parts of the country. PMID:27994258

Results of the 2015 Perfusionist Salary Study.

PubMed

Lewis, Doreen M; Dove, Steven; Jordan, Ralph E

2016-12-01

Presently, there exists no published valid and reliable salary study of clinical perfusionists. The objective of the 2015 Perfusionist Salary Study was to gather verifiable employee information to determine current compensation market rates (salary averages) of clinical perfusionists working in the United States. A salary survey was conducted between April 2015 and March 2016. The survey required perfusionists to answer questions about work volume, scheduling, and employer-paid compensation including benefits. Participants were also required to submit a de-identified pay stub to validate the income they reported. Descriptive statistics were calculated for all survey questions (e.g., percentages, means, and ranges). The study procured 481 responses, of which 287 were validated (i.e., respondents provided income verification that matched reported earnings). Variables that were examined within the validated sample population include job title, type of institution of employment, education level, years of experience, and geographic region, among others. Additional forms of compensation which may affect base compensation rates were also calculated including benefits, call time, bonuses, and pay for ancillary services (e.g., extracorporeal membrane oxygenation and ventricular assist device). In conclusion, in 2015, the average salary for all perfusionists is $127,600 with 19 years' experience. This research explores the average salary within subpopulations based on other factors such as position role, employer type, and geography. Information from this study is presented to guide employer compensation programs and suggests the need for further study in consideration of attrition rates and generational changes (i.e., perfusionists reaching retirement age) occurring alongside the present perfusionist staffing shortage affecting many parts of the country.

Children's Food Allergies: Development of the Food Allergy Management and Adaptation Scale.

PubMed

Klinnert, Mary D; McQuaid, Elizabeth L; Fedele, David A; Faino, Anna; Strand, Matthew; Robinson, Jane; Atkins, Dan; Fleischer, David M; Hourihane, Jonathan O'B; Cohen, Sophia; Fransen, Hannah

2015-07-01

Develop a measure that evaluates effective pediatric food allergy (FA) management, child and parent FA anxiety, and integration of FA into family life. A semistructured family interview was developed to evaluate FA management using a pilot sample (n = 27). Rating scales evaluated eight dimensions of FA management (FAMComposite), child anxiety, parent anxiety, and overall balanced integration (BI). Families of children with IgE-mediated food allergies (n = 60, child age: 6-12) were recruited for interview and rating scale validation. FAMComposite was correlated with physician ratings for families' food avoidance and reaction response readiness. FA anxiety was correlated with general anxiety measures for children, but not parents. Parents' FA anxiety was correlated with expectations of negative outcomes from FA. Low BI was associated with poor quality of life and negative impact on family functioning. Preliminary analyses support Food Allergy Management and Adaptation Scale validity as a measure of family adaptation to pediatric FA. © The Author 2015. Published by Oxford University Press on behalf of the Society of Pediatric Psychology. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Using Chinese Version of MYMOP in Chinese Medicine Evaluation: Validity, Responsiveness and Minimally Important Change

PubMed Central

2010-01-01

Background Measure Yourself Medical Outcome Profile (MYMOP) is a patient generated outcome instrument applicable in the evaluation of both allopathic and complementary medicine treatment. This study aims to adapt MYMOP into Chinese, and to assess its validity, responsiveness and minimally important change values in a sample of patients using Chinese medicine (CM) services. Methods A Chinese version of MYMOP (CMYMOP) is developed by forward-backward-forward translation strategy, expert panel assessment and pilot testing amongst patients. 272 patients aged 18 or above with subjective symptoms in the past 2 weeks were recruited at a CM clinic, and were invited to complete a set of questionnaire containing CMYMOP and SF-36. Follow ups were performed at 2nd and 4th week after consultation, using the same set of questionnaire plus a global rating of change question. Criterion validity of CMYMOP was assessed by its correlation with SF-36 at baseline, and responsiveness was evaluated by calculating the Cohen effect size (ES) of change at two follow ups. Minimally important difference (MID) values were estimated via anchor based method, while minimally detectable difference (MDC) figures were calculated by distribution based method. Results Criterion validity of CMYMOP was demonstrated by negative correlation between CMYMOP Profile scores and all SF-36 domain and summary scores at baseline. For responsiveness between baseline and 4th week follow up, ES of CMYMOP Symptom 1, Activity and Profile reached the moderate change threshold (ES>0.5), while Symptom 2 and Wellbeing reached the weak change threshold (ES>0.2). None of the SF-36 scores reached the moderate change threshold, implying CMYMOP's stronger responsiveness in CM setting. At 2nd week follow up, MID values for Symptom 1, Symptom 2, Wellbeing and Profile items were 0.894, 0.580, 0.263 and 0.516 respectively. For Activity item, MDC figure of 0.808 was adopted to estimate MID. Conclusions The findings support the validity and responsiveness of CMYMOP for capturing patient centred clinical changes within 2 weeks in a CM clinical setting. Further researches are warranted (1) to estimate Activity item MID, (2) to assess the test-retest reliability of CMYMOP, and (3) to perform further MID evaluation using multiple, item specific anchor questions. PMID:20920284

Noninvasive method to estimate anaerobic threshold in individuals with type 2 diabetes.

PubMed

Sales, Marcelo M; Campbell, Carmen Sílvia G; Morais, Pâmella K; Ernesto, Carlos; Soares-Caldeira, Lúcio F; Russo, Paulo; Motta, Daisy F; Moreira, Sérgio R; Nakamura, Fábio Y; Simões, Herbert G

2011-01-12

While several studies have identified the anaerobic threshold (AT) through the responses of blood lactate, ventilation and blood glucose others have suggested the response of the heart rate variability (HRV) as a method to identify the AT in young healthy individuals. However, the validity of HRV in estimating the lactate threshold (LT) and ventilatory threshold (VT) for individuals with type 2 diabetes (T2D) has not been investigated yet. To analyze the possibility of identifying the heart rate variability threshold (HRVT) by considering the responses of parasympathetic indicators during incremental exercise test in type 2 diabetics subjects (T2D) and non diabetics individuals (ND). Nine T2D (55.6 ± 5.7 years, 83.4 ± 26.6 kg, 30.9 ± 5.2 kg.m2(-1)) and ten ND (50.8 ± 5.1 years, 76.2 ± 14.3 kg, 26.5 ± 3.8 kg.m2(-1)) underwent to an incremental exercise test (IT) on a cycle ergometer. Heart rate (HR), rate of perceived exertion (RPE), blood lactate and expired gas concentrations were measured at the end of each stage. HRVT was identified through the responses of root mean square successive difference between adjacent R-R intervals (RMSSD) and standard deviation of instantaneous beat-to-beat R-R interval variability (SD1) by considering the last 60 s of each incremental stage, and were known as HRVT by RMSSD and SD1 (HRVT-RMSSD and HRVT-SD1), respectively. No differences were observed within groups for the exercise intensities corresponding to LT, VT, HRVT-RMSSD and HHVT-SD1. Furthermore, a strong relationship were verified among the studied parameters both for T2D (r = 0.68 to 0.87) and ND (r = 0.91 to 0.98) and the Bland & Altman technique confirmed the agreement among them. The HRVT identification by the proposed autonomic indicators (SD1 and RMSSD) were demonstrated to be valid to estimate the LT and VT for both T2D and ND.

The reliability and validity of the rating scale of criminal responsibility for mentally disordered offenders.

PubMed

Cai, Weixiong; Zhang, Qingting; Huang, Fuyin; Guan, Wei; Tang, Tao; Liu, Chao

2014-03-01

In China, the criminal responsibility of the mentally disordered offenders is divided into three levels, there are the whole responsibility, diminished responsibility and irresponsibility. According to the Criminal Law, "If a mental disordered patient causes harmful consequences at a time when he is unable to recognize or control his own conduct, upon verification and confirmation through legal procedure, he shall not bear criminal responsibility." That means there are two standards of assessing criminal responsibility, namely volitional and cognitive capacity. It is as equal as the Mc'Naughton Rule and the Irresistible Impulse Test. But for a long time, the criminal responsibility was assessed mainly by experience because of lacking of standardized assessment instrument. Recently, we have developed "the rating scale of criminal responsibility for mentally disordered offenders (RSCRs)". The scale includes eighteen items, namely criminal motivation, aura before offense, inducement of crime, time and place and object and tool selectivity of crime, emotion during the crime, shirking responsibility after offense, concealing the truth during inquest, camouflage, understanding the nature of the offense, estimating the consequence of the offense, impairment of life ability, impairment of learning or work, impairment of insight, impairment of reality testing, and impairment of self-control. This scale can be applicable for all cases and easy to use. This scale had been tried out in several forensic psychiatry institutes, the Cronbach α of the scale is 0.93, and all items have high correlation with the total score of the scale (r=0.50-0.89). Two factors were extracted by the factorial analysis, and the cumulative squared loading was 68.62%. The scores of the three levels were 9.66 ± 5.11, 26.54 ± 5.21 and 40.08 ± 7.90 respectively and highly significant differences were observed among groups. By establishing discrimination analysis among three levels, classification results suggested that 88.90% of the original grouped cases were correctly classified, and the discriminant value had high conformity with the experts' opinions. The data showed that the scale would be the best validated instrument for the criminal responsibility in China. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

Transfer of training for aerospace operations: How to measure, validate, and improve it

NASA Technical Reports Server (NTRS)

Cohen, Malcolm M.

1993-01-01

It has been a commonly accepted practice to train pilots and astronauts in expensive, extremely sophisticated, high fidelity simulators, with as much of the real-world feel and response as possible. High fidelity and high validity have often been assumed to be inextricably interwoven, although this assumption may not be warranted. The Project Mercury rate-damping task on the Naval Air Warfare Center's Human Centrifuge Dynamic Flight Simulator, the shuttle landing task on the NASA-ARC Vertical Motion Simulator, and the almost complete acceptance by the airline industry of full-up Boeing 767 flight simulators, are just a few examples of this approach. For obvious reasons, the classical models of transfer of training have never been adequately evaluated in aerospace operations, and there have been few, if any, scientifically valid replacements for the classical models. This paper reviews some of the earlier work involving transfer of training in aerospace operations, and discusses some of the methods by which appropriate criteria for assessing the validity of training may be established.

Cholinergic stimulation enhances Bayesian belief updating in the deployment of spatial attention.

PubMed

Vossel, Simone; Bauer, Markus; Mathys, Christoph; Adams, Rick A; Dolan, Raymond J; Stephan, Klaas E; Friston, Karl J

2014-11-19

The exact mechanisms whereby the cholinergic neurotransmitter system contributes to attentional processing remain poorly understood. Here, we applied computational modeling to psychophysical data (obtained from a spatial attention task) under a psychopharmacological challenge with the cholinesterase inhibitor galantamine (Reminyl). This allowed us to characterize the cholinergic modulation of selective attention formally, in terms of hierarchical Bayesian inference. In a placebo-controlled, within-subject, crossover design, 16 healthy human subjects performed a modified version of Posner's location-cueing task in which the proportion of validly and invalidly cued targets (percentage of cue validity, % CV) changed over time. Saccadic response speeds were used to estimate the parameters of a hierarchical Bayesian model to test whether cholinergic stimulation affected the trial-wise updating of probabilistic beliefs that underlie the allocation of attention or whether galantamine changed the mapping from those beliefs to subsequent eye movements. Behaviorally, galantamine led to a greater influence of probabilistic context (% CV) on response speed than placebo. Crucially, computational modeling suggested this effect was due to an increase in the rate of belief updating about cue validity (as opposed to the increased sensitivity of behavioral responses to those beliefs). We discuss these findings with respect to cholinergic effects on hierarchical cortical processing and in relation to the encoding of expected uncertainty or precision. Copyright © 2014 the authors 0270-6474/14/3415735-08$15.00/0.

Validation of the breast evaluation questionnaire for breast hypertrophy and breast reduction.

PubMed

Lewin, Richard; Elander, Anna; Lundberg, Jonas; Hansson, Emma; Thorarinsson, Andri; Claudelin, Malin; Bladh, Helena; Lidén, Mattias

2018-06-13

There is a lack of published, validated questionnaires for evaluating psychosocial morbidity in patients with breast hypertrophy undergoing breast reduction surgery. To validate the breast evaluation questionnaire (BEQ), originally developed for the assessment of breast augmentation patients, for the assessment of psychosocial morbidity in patients with breast hypertrophy undergoing breast reduction surgery. Validation study Subjects: Women with macromastia Methods: The validation of the BEQ, adapted to breast reduction, was performed in several steps. Content validity, reliability, construct validity and responsiveness were assessed. The original version was adjusted according to the results for content validity and resulted in item reduction and a modified BEQ (mBEQ) that was then assessed for reliability, construct validity and responsiveness. Internal and external validation was performed for the modified BEQ. Convergent validity was tested against Breast-Q (reduction) and discriminate validity was tested against the SF-36. Known-groups validation revealed significant differences between the normal population and patients undergoing breast reduction surgery. The BEQ showed good reliability by test-re-test analysis and high responsiveness. The modified BEQ may be reliable, valid and responsive instrument for assessing women who undergo breast reduction.

[Validity of the Child Psychiatric Hospital Teacher Questionnaire for the assessment of ADHD. Teacher's version].

PubMed

Ulloa, R E; Narváez, M R; Arroyo, E; del Bosque, J; de la Peña, F

2009-01-01

Teacher's rating scales for the evaluation of attention deficit and superactivity disorder (TDAH) and conduct disorders have been shown to be useful and valid tools. The Child Psychiatric Hospital Teacher Questionnaire (CPHTQ) of the Hospital Psiquiátrico Infantil Dr. Juan N. Navarro was designed for the assessment of ADHD symptoms, externalizing symptoms and school functioning difficulties of children and adolescents. Internal consistency, criterion validity, construct validity and sensitivity of the scale to changes in symptom severity were evaluated in this study. The scale was administered to 282 teachers of children and adolescents aged 5 to 17 years who came to a unit specialized in child psychiatry. The validity analysis of the instrument showed that the internal consistency measured by Cronbach's alpha was 0.94. The factorial analysis yielded 5 factors accounting for 59.1% of the variance: hyperactivity and conduct symptoms, predatory, conduct disorder, inattentive, poor functioning and motor disturbances. The CPHTQ scores on the scale showed positive correlation with the Clinical Global impression (CGI) scale in the patients' response to drug treatment. The CPHTQ shows adequate validity characteristics that demonstrate its utility in the evaluation of patients with ADHD and its comorbidity with other behavior disorders.

Parents rate the ratings: a test of the validity of the American movie, television, and video game ratings.

PubMed

Walsh, D A; Gentile, D A; Van Brederode, T M

2002-02-01

Numerous studies have documented the potential effects on young audiences of violent content in media products, including movies, television programs, and computer and video games. Similar studies have evaluated the effects associated with sexual content and messages. Cumulatively, these effects represent a significant public health risk for increased aggressive and violent behavior, spread of sexually transmitted diseases, and pediatric pregnancy. In partial response to these risks and to public and legislative pressure, the movie, television, and gaming industries have implemented ratings systems intended to provide information about the content and appropriate audiences for different films, shows, and games. We conducted a panel study to test the validity of the current movie, television, and video game rating systems. Participants used the KidScore media evaluation tool, which evaluates films, television shows, and video and computer games on 10 aspects, including the appropriateness of the media product for children on the basis of age. Results revealed that when an entertainment industry rates a product as inappropriate for children, parent raters agree that it is inappropriate for children. However, parent raters disagree with industry usage of many of the ratings designating material suitable for children of different ages. Products rated as appropriate for adolescents are of the greatest concern. The level of disagreement varies from industry to industry and even from rating to rating. Analysis indicates that the amount of violent content and portrayals of violence are the primary markers for disagreement between parent raters and industry ratings. Short-term and long-term recommendations are suggested.

Validity, cut-points, and minimally important differences for two hot flash-related daily interference scales.

PubMed

Carpenter, Janet S; Bakoyannis, Giorgos; Otte, Julie L; Chen, Chen X; Rand, Kevin L; Woods, Nancy; Newton, Katherine; Joffe, Hadine; Manson, JoAnn E; Freeman, Ellen W; Guthrie, Katherine A

2017-08-01

To conduct psychometric analyses to condense the Hot Flash-Related Daily Interference Scale (HFRDIS) into a shorter form termed the Hot Flash Interference (HFI) scale; evaluate cut-points for both scales; and establish minimally important differences (MIDs) for both scales. We analyzed baseline and postrandomization patient-reported data pooled across three randomized trials aimed at reducing vasomotor symptoms (VMS) in 899 midlife women. Trials were conducted across five MsFLASH clinical sites between July 2009 and October 2012. We eliminated HFRDIS items based on experts' content validity ratings and confirmatory factor analysis, and evaluated cut-points and established MIDs by mapping HFRDIS and HFI to other measures. The three-item HFI (interference with sleep, mood, and concentration) demonstrated strong internal consistency (alphas of 0.830 and 0.856), showed good fit to the unidimensional "hot flash interference factor," and strong convergent validity with HFRDIS scores, diary VMS, and menopausal quality of life. For both scales, cut-points of mild (0-3.9), moderate (4-6.9), and severe (7-10) interference were associated with increasing diary VMS ratings, sleep, and anxiety. The average MID was 1.66 for the HFRDIS and 2.34 for the HFI. The HFI is a brief assessment of VMS interference and will be useful in busy clinics to standardize VMS assessment or in research studies where response burden may be an issue. The scale cut-points and MIDs should prove useful in targeting those most in need of treatment, monitoring treatment response, and interpreting existing and future research findings.

The development of an instrument for evaluating clinical teachers: involving stakeholders to determine content validity.

PubMed

Stalmeijer, Renée E; Dolmans, Diana H J M; Wolfhagen, Ineke H A P; Muijtjens, Arno M M; Scherpbier, Albert J J A

2008-01-01

Research indicates that the quality of supervision strongly influences the learning of medical students in clinical practice. Clinical teachers need feedback to improve their supervisory skills. The available instruments either lack a clear theoretical framework or are not suitable for providing feedback to individual teachers. We developed an evaluation instrument based on the 'cognitive apprenticeship model'. The aim was to estimate the content validity of the developed instrument. Item relevance was rated on a five-point scale (1 = highly irrelevant, 5 = highly relevant) by three groups of stakeholders in undergraduate clinical teaching: educationalists (N = 12), doctors (N = 16) and students (N = 12). Additionally, stakeholders commented on content, wording and omission of items. The items were generally rated as very relevant (Mean = 4.3, SD = 0.38, response = 95%) and any differences between the stakeholder groups were small. The results led to elimination of 4 items, rewording of 13 items and addition of 1 item. The cognitive apprenticeship model appears to offer a useful framework for the development of an evaluation instrument aimed at providing feedback to individual clinical teachers on the quality of student supervision. Further studies in larger populations will have to establish the instrument's statistical validity and generalizability.

A Psychometric Properties of the Malay-version Police Stress Questionnaire

PubMed Central

IRNIZA, Rasdi; EMILIA, Zainal Abidin; MUHAMMAD SALILUDDIN, Suhainizam; NIZAM ISHA, Ahmad Shahrul

2014-01-01

Background: Police Stress Questionnaire (PSQ) was developed to measure police-specific stressors. The present study was the first to have translated the PSQ to Malay. This study aims to test the reliability, construct validity, and component structure of the Malay-version PSQ. Methods: A set of survey consisted of the Malay-version PSQ, General Health Questionnaire (GHQ-12), Job Content Questionnaire (JCQ), Global Stress Questionnaire (GSQ) and General Self-rated Health (GSRH) were distributed to 300 traffic police officers in Kuala Lumpur and all traffic police officers in a few districts of Pahang and Negeri Sembilan. Results: The response rate was 65.5% (N = 262). The reported Cronbach’s alpha coefficient was 0.93 for Operational PSQ (PSQ-Op) and 0.94 for Organisational PSQ (PSQ-Org). Findings indicated that the PSQ had positive construct validity with the GSRH, GSQ, and GHQ. After excluding four factors related to lifestyles, all police-specific stressors were highly loaded (0.50) in one component. Conclusion: It is confirmed that the Malay-version PSQ, excluding the four factors related to lifestyle, was uni-dimensional, reliable, and a valid questionnaire. This study proffers a potentially better instrument for assessing the stressors among Malaysian police. PMID:25977621

Improved Adherence Rates and Clinical Outcomes of an Integrated, Closed-Loop, Pharmacist-Led Oral Chemotherapy Management Program.

PubMed

Muluneh, Benyam; Schneider, Molly; Faso, Aimee; Amerine, Lindsey; Daniels, Rowell; Crisp, Brett; Valgus, John; Savage, Scott

2018-06-01

To address the growing use of oral anticancer therapy, an integrated, closed-loop, pharmacist-led oral chemotherapy management program was created within an academic medical center. An integrated, closed-loop, pharmacy-led oral chemotherapy management program was established. From September 2014 until June 2015, demographic information, rates of adherence, patient understanding of treatment, pharmacist interventions, patient and provider satisfaction, and molecular response rates in patients with chronic myeloid leukemia (CML) were collected. After full implementation, 107 patients were enrolled in our oral chemotherapy management program from September 2014 until June 2015. All patients were educated before starting oral chemotherapy, and using pre- and postassessment tests, comprehension of oral chemotherapy treatment increased from 43% to 95%. Patient-reported adherence was 86% and 94.7% for the GI/breast and malignant hematology patient populations, respectively, and these were validated with medication possession ratio, revealing adherence rates of 85% and 93.9% for the GI/breast and malignant hematology patient populations, respectively. A total of 350 encounters with a clinical pharmacist and 318 adverse effects were reported, which led to 235 interventions. This program led to a higher major molecular response rate (83%) in our CML population compared with published clinical trials (average major molecular response rates, 40% and 60% with 1- and 2-year follow-up, respectively). An innovative model was developed and resulted in improved patient knowledge regarding oral chemotherapy, improved adherence rates that exceeded nationally established thresholds, and superior major molecular response outcomes for patients with CML compared with published literature. As a result, this model has produced the gold standard in managing patients receiving oral chemotherapy.

Determining the mechanical constitutive properties of metals as a function of strain rate and temperature: A combined experimental and modeling approach

DOE Office of Scientific and Technical Information (OSTI.GOV)

I. M. Robertson; A. Beaudoin; J. Lambros

2004-01-05

OAK-135 Development and validation of constitutive models for polycrystalline materials subjected to high strain rate loading over a range of temperatures are needed to predict the response of engineering materials to in-service type conditions (foreign object damage, high-strain rate forging, high-speed sheet forming, deformation behavior during forming, response to extreme conditions, etc.). To account accurately for the complex effects that can occur during extreme and variable loading conditions, requires significant and detailed computational and modeling efforts. These efforts must be closely coupled with precise and targeted experimental measurements that not only verify the predictions of the models, but also providemore » input about the fundamental processes responsible for the macroscopic response. Achieving this coupling between modeling and experimentation is the guiding principle of this program. Specifically, this program seeks to bridge the length scale between discrete dislocation interactions with grain boundaries and continuum models for polycrystalline plasticity. Achieving this goal requires incorporating these complex dislocation-interface interactions into the well-defined behavior of single crystals. Despite the widespread study of metal plasticity, this aspect is not well understood for simple loading conditions, let alone extreme ones. Our experimental approach includes determining the high-strain rate response as a function of strain and temperature with post-mortem characterization of the microstructure, quasi-static testing of pre-deformed material, and direct observation of the dislocation behavior during reloading by using the in situ transmission electron microscope deformation technique. These experiments will provide the basis for development and validation of physically-based constitutive models, which will include dislocation-grain boundary interactions for polycrystalline systems. One aspect of the program will involve the dire ct observation of specific mechanisms of micro-plasticity, as these will indicate the boundary value problem that should be addressed. This focus on the pre-yield region in the quasi-static effort (the elasto-plastic transition) is also a tractable one from an experimental and modeling viewpoint. In addition, our approach will minimize the need to fit model parameters to experimental data to obtain convergence. These are critical steps to reach the primary objective of simulating and modeling material performance under extreme loading conditions. In this annual report, we describe the progress made in the first year of this program.« less

A comparison of global rating scale and checklist scores in the validation of an evaluation tool to assess performance in the resuscitation of critically ill patients during simulated emergencies (abbreviated as "CRM simulator study IB").

PubMed

Kim, John; Neilipovitz, David; Cardinal, Pierre; Chiu, Michelle

2009-01-01

Crisis resource management (CRM) skills are a set of nonmedical skills required to manage medical emergencies. There is currently no gold standard for evaluation of CRM performance. A prior study examined the use of a global rating scale (GRS) to evaluate CRM performance. This current study compared the use of a GRS and a checklist as formal rating instruments to evaluate CRM performance during simulated emergencies. First-year and third-year residents participated in two simulator scenarios each. Three raters then evaluated resident performance in CRM using edited video recordings using both a GRS and a checklist. The Ottawa GRS provides a seven-point anchored ordinal scale for performance in five categories of CRM, and an overall performance score. The Ottawa CRM checklist provides 12 items in the five categories of CRM, with a maximum cumulative score of 30 points. Construct validity was measured on the basis of content validity, response process, internal structure, and response to other variables. T-test analysis of Ottawa GRS scores was conducted to examine response to the variable of level of training. Intraclass correlation coefficient (ICC) scores were used to measure inter-rater reliability for both scenarios. Thirty-two first-year and 28 third-year residents participated in the study. Third-year residents produced higher mean scores for overall CRM performance than first-year residents (P < 0.05), and in all individual categories within the Ottawa GRS (P < 0.05) and the Ottawa CRM checklist (P < 0.05). This difference was noted for both scenarios and for each individual rater (P < 0.05). No statistically significant difference in resident scores was observed between scenarios for both instruments. ICC scores of 0.59 and 0.61 were obtained for Scenarios 1 and 2 with the Ottawa GRS, whereas ICC scores of 0.63 and 0.55 were obtained with the Ottawa CRM checklist. Users indicated a strong preference for the Ottawa GRS given ease of scoring, presence of an overall score, and the potential for formative evaluation. Construct validity seems to be present when using both the Ottawa GRS and CRM checklist to evaluate CRM performance during simulated emergencies. Data also indicate the presence of moderate inter-rater reliability when using both the Ottawa GRS and CRM checklist.

Entry Descent and Landing Workshop Proceedings. Volume 1; The Mars Science Laboratory (MSL) Entry, Descent and Landing Instrumentation (MEDLI) Hardware

NASA Technical Reports Server (NTRS)

Munk, Michelle M.; Little, Alan; Kuhl, Chris; Bose, Deepak; Santos, Jose

2013-01-01

Objectives: Measure Pressure: a) Confirm spacecraft aerodynamics. b) Independently measure attitude. c) Determine density profile. d) Determine wind component. Measure Temperature: a) Verify heating levels on spacecraft surface. b) Determine recession amount and rate. c) Validate material response at Mars conditions. The better we understand the Mars entry environment, the better we can design the next spacecraft.

Zr Extrusion – Direct Input for Models & Validation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Cerreta, Ellen Kathleen

As we examine differences in the high strain rate, high strain tensile response of high purity, highly textured Zr as a function of loading direction, temperature and extrusion velocity with primarily post mortem characterization techniques, we have also developed a technique for characterizing the in-situ extrusion process. This particular measurement is useful for partitioning energy of the system during the extrusion process: friction, kinetic energy, and temperature

Response to comment on "Hydrogen mapping of the lunar South Pole using the LRO neutron detector experiment LEND".

PubMed

Mitrofanov, I G; Boynton, W V; Litvak, M L; Sanin, A B; Starr, R D

2011-11-25

Critical comments from Lawrence et al. are considered on the capability of the collimated neutron telescope Lunar Exploration Neutron Detector (LEND) on NASA's Lunar Reconnaissance Orbiter (LRO) for mapping lunar epithermal neutrons, as presented in our paper. We present two different analyses to show that our previous estimated count rates are valid and support the conclusions of that paper.

RBF kernel based support vector regression to estimate the blood volume and heart rate responses during hemodialysis.

PubMed

Javed, Faizan; Chan, Gregory S H; Savkin, Andrey V; Middleton, Paul M; Malouf, Philip; Steel, Elizabeth; Mackie, James; Lovell, Nigel H

2009-01-01

This paper uses non-linear support vector regression (SVR) to model the blood volume and heart rate (HR) responses in 9 hemodynamically stable kidney failure patients during hemodialysis. Using radial bias function (RBF) kernels the non-parametric models of relative blood volume (RBV) change with time as well as percentage change in HR with respect to RBV were obtained. The e-insensitivity based loss function was used for SVR modeling. Selection of the design parameters which includes capacity (C), insensitivity region (e) and the RBF kernel parameter (sigma) was made based on a grid search approach and the selected models were cross-validated using the average mean square error (AMSE) calculated from testing data based on a k-fold cross-validation technique. Linear regression was also applied to fit the curves and the AMSE was calculated for comparison with SVR. For the model based on RBV with time, SVR gave a lower AMSE for both training (AMSE=1.5) as well as testing data (AMSE=1.4) compared to linear regression (AMSE=1.8 and 1.5). SVR also provided a better fit for HR with RBV for both training as well as testing data (AMSE=15.8 and 16.4) compared to linear regression (AMSE=25.2 and 20.1).

Importance-Satisfaction Analysis for Primary Care Physicians’ Perspective on EHRs in Taiwan †

PubMed Central

Ho, Cheng-Hsun; Wen, Hsyien-Chia; Chu, Chi-Ming; Wu, Yi-Syuan; Wang, Jen-Leng

2014-01-01

The Taiwan government has been promoting Electronic Health Records (EHRs) to primary care physicians. How to extend EHRs adoption rate by measuring physicians’ perspective of importance and performance of EHRs has become one of the critical issues for healthcare organizations. We conducted a comprehensive survey in 2010 in which a total of 1034 questionnaires which were distributed to primary care physicians. The project was sponsored by the Department of Health to accelerate the adoption of EHRs. 556 valid responses were analyzed resulting in a valid response rate of 53.77%. The data were analyzed based on a data-centered analytical framework (5-point Likert scale). The mean of importance and satisfaction of four dimensions were 4.16, 3.44 (installation and maintenance), 4.12, 3.51 (product effectiveness), 4.10, 3.31 (system function) and 4.34, 3.70 (customer service) respectively. This study provided a direction to government by focusing on attributes which physicians found important but were dissatisfied with, to close the gap between actual and expected performance of the EHRs. The authorities should emphasize the potential advantages in meaningful use and provide training programs, conferences, technical assistance and incentives to enhance the national level implementation of EHRs for primary physicians. PMID:24914640

Experimental rhinovirus infection in volunteers.

PubMed

Bardin, P G; Sanderson, G; Robinson, B S; Holgate, S T; Tyrrell, D A

1996-11-01

Experimental viral disease studies in volunteers have clarified many aspects of the pathogenesis of human viral disease. Recently, interest has focused on rhinovirus-associated asthma exacerbations, and new volunteer studies have suggested that airway responsiveness (AR) is enhanced during a cold. For scientific, ethical and safety reasons, it is important to use validated methods for the preparation of a virus inoculum and that the particular virological characteristics and host responses should not be altered. We have prepared a new human rhinovirus (HRV) inoculum using recent guidelines and assessed whether disease characteristics (for example, severity of colds or changes in AR) were retained. Studies were conducted in 25 clinically healthy volunteers using a validated HRV inoculum in the first 17 and a new inoculum in the subsequent eight subjects. Severity of cold symptoms, nasal wash albumin levels and airway responsiveness were measured, and the new inoculum was prepared from nasal washes obtained during the cold. The new inoculum was tested using standard virological and serological techniques, as well as a polymerase chain reaction for Mycoplasma pneumoniae. No contaminating viruses or organisms were detected and the methods suggested were workable. Good clinical colds developed in 20 of the 25 subjects and median symptom scores were similar in the validated and new inoculum groups (18 and 17.5, respectively; p=0.19). All subjects shed virus, and there were no differences noted in viral culture scores, nasal wash albumin and rates of seroconversion in the two groups. Although airway responsiveness increased in both groups (p=0.02 and p=0.05), the degree of change was similar. We have performed experimental rhinovirus infection studies and demonstrated similar clinical disease in two inoculum groups. Amplified airway responsiveness was induced; continuing studies will define the mechanisms and suggest modes of treatment.

Theoretical Evaluation of the Transient Response of Constant Head and Constant Flow-Rate Permeability Tests

USGS Publications Warehouse

Zhang, M.; Takahashi, M.; Morin, R.H.; Esaki, T.

1998-01-01

A theoretical analysis is presented that compares the response characteristics of the constant head and the constant flowrate (flow pump) laboratory techniques for quantifying the hydraulic properties of geologic materials having permeabilities less than 10-10 m/s. Rigorous analytical solutions that describe the transient distributions of hydraulic gradient within a specimen are developed, and equations are derived for each method. Expressions simulating the inflow and outflow rates across the specimen boundaries during a constant-head permeability test are also presented. These solutions illustrate the advantages and disadvantages of each method, including insights into measurement accuracy and the validity of using Darcy's law under certain conditions. The resulting observations offer practical considerations in the selection of an appropriate laboratory test method for the reliable measurement of permeability in low-permeability geologic materials.

Development and validation of a questionnaire to evaluate patient satisfaction with diabetes disease management.

PubMed

Paddock, L E; Veloski, J; Chatterton, M L; Gevirtz, F O; Nash, D B

2000-07-01

To develop a reliable and valid questionnaire to measure patient satisfaction with diabetes disease management programs. Questions related to structure, process, and outcomes were categorized into 14 domains defining the essential elements of diabetes disease management. Health professionals confirmed the content validity. Face validity was established by a patient focus group. The questionnaire was mailed to 711 patients with diabetes who participated in a disease management program. To reduce the number of questionnaire items, a principal components analysis was performed using a varimax rotation. The Scree test was used to select significant components. To further assess reliability and validity; Cronbach's alpha and product-moment correlations were calculated for components having > or =3 items with loadings >0.50. The validated 73-item mailed satisfaction survey had a 34.1% response rate. Principal components analysis yielded 13 components with eigenvalues > 1.0. The Scree test proposed a 6-component solution (39 items), which explained 59% of the total variation. Internal consistency reliabilities computed for the first 6 components (alpha = 0.79-0.95) were acceptable. The final questionnaire, the Diabetes Management Evaluation Tool (DMET), was designed to assess patient satisfaction with diabetes disease management programs. Although more extensive testing of the questionnaire is appropriate, preliminary reliability and validity of the DMET has been demonstrated.

Evaluation of Finite-Rate Gas/Surface Interaction Models for a Carbon Based Ablator

NASA Technical Reports Server (NTRS)

Chen, Yih-Kanq; Goekcen, Tahir

2015-01-01

Two sets of finite-rate gas-surface interaction model between air and the carbon surface are studied. The first set is an engineering model with one-way chemical reactions, and the second set is a more detailed model with two-way chemical reactions. These two proposed models intend to cover the carbon surface ablation conditions including the low temperature rate-controlled oxidation, the mid-temperature diffusion-controlled oxidation, and the high temperature sublimation. The prediction of carbon surface recession is achieved by coupling a material thermal response code and a Navier-Stokes flow code. The material thermal response code used in this study is the Two-dimensional Implicit Thermal-response and Ablation Program, which predicts charring material thermal response and shape change on hypersonic space vehicles. The flow code solves the reacting full Navier-Stokes equations using Data Parallel Line Relaxation method. Recession analyses of stagnation tests conducted in NASA Ames Research Center arc-jet facilities with heat fluxes ranging from 45 to 1100 wcm2 are performed and compared with data for model validation. The ablating material used in these arc-jet tests is Phenolic Impregnated Carbon Ablator. Additionally, computational predictions of surface recession and shape change are in good agreement with measurement for arc-jet conditions of Small Probe Reentry Investigation for Thermal Protection System Engineering.

The Dynamics of Conditioning and Extinction

PubMed Central

Killeen, Peter R.; Sanabria, Federico; Dolgov, Igor

2009-01-01

Pigeons responded to intermittently reinforced classical conditioning trials with erratic bouts of responding to the CS. Responding depended on whether the prior trial contained a peck, food, or both. A linear-persistence/learning model moved animals into and out of a response state, and a Weibull distribution for number of within-trial responses governed in-state pecking. Variations of trial and inter-trial durations caused correlated changes in rate and probability of responding, and model parameters. A novel prediction—in the protracted absence of food, response rates can plateau above zero—was validated. The model predicted smooth acquisition functions when instantiated with the probability of food, but a more accurate jagged learning curve when instantiated with trial-to-trial records of reinforcement. The Skinnerian parameter was dominant only when food could be accelerated or delayed by pecking. These experiments provide a framework for trial-by-trial accounts of conditioning and extinction that increases the information available from the data, permitting them to comment more definitively on complex contemporary models of momentum and conditioning. PMID:19839699

Quality improvement in multidisciplinary cancer teams: an investigation of teamwork and clinical decision-making and cross-validation of assessments.

PubMed

Lamb, B W; Sevdalis, N; Mostafid, H; Vincent, C; Green, J S A

2011-12-01

Teamworking and clinical decision-making are important in multidisciplinary cancer teams (MDTs). Our objective is to assess the quality of information presentation and MDT members' contribution to decision-making via expert observation and self-report, aiming to cross-validate the two methods and assess the insight of MDT members into their own team performance. Behaviors were scored using (i) a validated observational tool employing Likert scales with objective anchors, and (ii) a 29-question online self-report tool. Data were collected from observation of 164 cases in five MDTs, and 47 surveys from MDT members (response rate 70%). Presentation of information (case history, radiological, pathological, comorbidities, psychosocial, and patients' views) and quality of contribution to decision-making of MDT members (surgeons, oncologists, radiologists, pathologists, nurses, and MDT coordinators) were analyzed via descriptive statistics and the Jonckheere-Terpstra test. Correlation between observational and self-report assessments was assessed with Spearman's correlations. Quality of information presentation: Case histories and radiology information rated highest; patients' views and comorbidities/psychosocial issues rated lowest (observed: Z = 14.80, P ≤ 0.001; self-report: Z = 3.70, P < 0.001). Contribution to decision-making: Surgeons and oncologists rated highest, nurses and MDT coordinators rated lowest, and others in between (observed: Z = 20.00, P ≤ 0.001; self-report: Z = 8.10, P < 0.001). Correlations between observational and self-report assessments: Median Spearman's rho = 0.74 (range = 0.66-0.91; P < 0.05). The quality of teamworking and clinical decision-making in MDTs can reliably be assessed using observational and self-report metrics. MDT members have good insight into their own team performance. Such robust assessment methods could provide the basis of a toolkit for MDT team evaluation and improvement.

Implementing statistical equating for MRCP(UK) Parts 1 and 2.

PubMed

McManus, I C; Chis, Liliana; Fox, Ray; Waller, Derek; Tang, Peter

2014-09-26

The MRCP(UK) exam, in 2008 and 2010, changed the standard-setting of its Part 1 and Part 2 examinations from a hybrid Angoff/Hofstee method to statistical equating using Item Response Theory, the reference group being UK graduates. The present paper considers the implementation of the change, the question of whether the pass rate increased amongst non-UK candidates, any possible role of Differential Item Functioning (DIF), and changes in examination predictive validity after the change. Analysis of data of MRCP(UK) Part 1 exam from 2003 to 2013 and Part 2 exam from 2005 to 2013. Inspection suggested that Part 1 pass rates were stable after the introduction of statistical equating, but showed greater annual variation probably due to stronger candidates taking the examination earlier. Pass rates seemed to have increased in non-UK graduates after equating was introduced, but was not associated with any changes in DIF after statistical equating. Statistical modelling of the pass rates for non-UK graduates found that pass rates, in both Part 1 and Part 2, were increasing year on year, with the changes probably beginning before the introduction of equating. The predictive validity of Part 1 for Part 2 was higher with statistical equating than with the previous hybrid Angoff/Hofstee method, confirming the utility of IRT-based statistical equating. Statistical equating was successfully introduced into the MRCP(UK) Part 1 and Part 2 written examinations, resulting in higher predictive validity than the previous Angoff/Hofstee standard setting. Concerns about an artefactual increase in pass rates for non-UK candidates after equating were shown not to be well-founded. Most likely the changes resulted from a genuine increase in candidate ability, albeit for reasons which remain unclear, coupled with a cognitive illusion giving the impression of a step-change immediately after equating began. Statistical equating provides a robust standard-setting method, with a better theoretical foundation than judgemental techniques such as Angoff, and is more straightforward and requires far less examiner time to provide a more valid result. The present study provides a detailed case study of introducing statistical equating, and issues which may need to be considered with its introduction.

Communication at an online infertility expert forum: provider responses to patients' emotional and informational cues.

PubMed

Aarts, J W M; van Oers, A M; Faber, M J; Cohlen, B J; Nelen, W L D M; Kremer, J A M; van Dulmen, A M

2015-01-01

Online patient-provider communication has become increasingly popular in fertility care. However, it is not known to what extent patients express cues or concerns and how providers respond. In this study, we investigated cues and responses that occur in online patient-provider communication at an infertility-specific expert forum. We extracted 106 threads from the multidisciplinary expert forum of two Dutch IVF clinics. We performed the following analyses: (1) thematic analysis of patients' questions; and (2) rating patients' emotional and informational cues and subsequent professionals' responses using an adaptation of the validated Medical Interview Aural Rating Scale. Frequencies of themes, frequencies of cues and responses, and sequences (what cue is followed by what response) were extracted. Sixty-five infertile patients and 19 providers participated. The most common themes included medication and lifestyle. Patients gave more informational than emotional cues (106 versus 64). Responses to informational cues were mostly adequate (61%). The most common response to emotional cues was empathic acknowledgment (72%). Results indicate that an online expert forum could have a positive effect on patient outcomes, which should guide future research. Offering infertile patients an expert forum to communicate with providers can be a promising supplement to usual care in both providing information and addressing patients' concerns.

Increasing response rates to follow-up questionnaires in health intervention research: Randomized controlled trial of a gift card prize incentive.

PubMed

Morgan, Amy J; Rapee, Ronald M; Bayer, Jordana K

2017-08-01

Background/aims Achieving a high response rate to follow-up questionnaires in randomized controlled trials of interventions is important for study validity. Few studies have tested the value of incentives in increasing response rates to online questionnaires in clinical trials of health interventions. This study evaluated the effect of a gift card prize-draw incentive on response rates to follow-up questionnaires within a trial of an online health intervention. Method The study was embedded in a host randomized controlled trial of an online parenting program for child anxiety. A total of 433 participants were randomly allocated to one of two groups: (1) being informed that they would enter a gift card prize-draw if they completed the final study questionnaire (24-week follow-up) and (2) not informed about the prize-draw. All participants had a 1 in 20 chance of winning an AUD50 gift card after they completed the online questionnaire. Results The odds of the informed group completing the follow-up questionnaire were significantly higher than the uninformed group, (79.6% vs 68.5%, odds ratio = 1.79, 95% confidence interval = 1.15-2.79). This response rate increase of 11.1% (95% confidence interval = 2.8-19.1) occurred in both intervention and control groups in the host randomized controlled trial. The incentive was also effective in increasing questionnaire commencement (84.6% vs 75.9%, odds ratio = 1.74, 95% confidence interval = 1.07-2.84) and reducing the delay in completing the questionnaire (19.9 vs 22.6 days, hazard ratio = 1.34, 95% confidence interval = 1.07-1.67). Conclusion This study adds to evidence for the effectiveness of incentives to increase response rates to follow-up questionnaires in health intervention trials.

Five-Kilometers Time Trial: Preliminary Validation of a Short Test for Cycling Performance Evaluation.

PubMed

Dantas, Jose Luiz; Pereira, Gleber; Nakamura, Fabio Yuzo

2015-09-01

The five-kilometer time trial (TT5km) has been used to assess aerobic endurance performance without further investigation of its validity. This study aimed to perform a preliminary validation of the TT5km to rank well-trained cyclists based on aerobic endurance fitness and assess changes of the aerobic endurance performance. After the incremental test, 20 cyclists (age = 31.3 ± 7.9 years; body mass index = 22.7 ± 1.5 kg/m(2); maximal aerobic power = 360.5 ± 49.5 W) performed the TT5km twice, collecting performance (time to complete, absolute and relative power output, average speed) and physiological responses (heart rate and electromyography activity). The validation criteria were pacing strategy, absolute and relative reliability, validity, and sensitivity. Sensitivity index was obtained from the ratio between the smallest worthwhile change and typical error. The TT5km showed high absolute (coefficient of variation < 3%) and relative (intraclass coefficient correlation > 0.95) reliability of performance variables, whereas it presented low reliability of physiological responses. The TT5km performance variables were highly correlated with the aerobic endurance indices obtained from incremental test (r > 0.70). These variables showed adequate sensitivity index (> 1). TT5km is a valid test to rank the aerobic endurance fitness of well-trained cyclists and to differentiate changes on aerobic endurance performance. Coaches can detect performance changes through either absolute (± 17.7 W) or relative power output (± 0.3 W.kg(-1)), the time to complete the test (± 13.4 s) and the average speed (± 1.0 km.h(-1)). Furthermore, TT5km performance can also be used to rank the athletes according to their aerobic endurance fitness.

Validation of the Oxford Participation and Activities Questionnaire.

PubMed

Morley, David; Dummett, Sarah; Kelly, Laura; Dawson, Jill; Fitzpatrick, Ray; Jenkinson, Crispin

2016-01-01

There is growing interest in the management of long-term conditions and in keeping people active and participating in the community. Testing the effectiveness of interventions that aim to affect activities and participation can be challenging without a well-developed, valid, and reliable instrument. This study therefore aims to develop a patient-reported outcome measure, the Oxford Participation and Activities Questionnaire (Ox-PAQ), which is theoretically grounded in the World Health Organization's International Classification of Functioning, Disability, and Health (ICF) and fully compliant with current best practice guidelines. Questionnaire items generated from patient interviews and based on the nine chapters of the ICF were administered by postal survey to 386 people with three neurological conditions: motor neuron disease, multiple sclerosis, and Parkinson's disease. Participants also completed the Medical Outcomes Study (MOS) 36-Item Short Form Health Survey (SF-36) and EQ-5D-5L. Thus, 334 participants completed the survey, a response rate of 86.5%. Factor analysis techniques identified three Ox-PAQ domains, consisting of 23 items, accounting for 72.8% of variance. Internal reliability for the three domains was high (Cronbach's α: 0.81-0.96), as was test-retest reliability (intraclass correlation: 0.83-0.92). Concurrent validity was demonstrated through highly significant relationships with relevant domains of the MOS SF-36 and the EQ- 5D-5L. Assessment of known-groups validity identified significant differences in Ox-PAQ scores among the three conditions included in the survey. Results suggest that the Ox-PAQ is a valid and reliable measure of participation and activity. The measure will now be validated in a range of further conditions, and additional properties, such as responsiveness, will also be assessed in the next phase of the instrument's development.

Validation of the Oxford Participation and Activities Questionnaire

PubMed Central

Morley, David; Dummett, Sarah; Kelly, Laura; Dawson, Jill; Fitzpatrick, Ray; Jenkinson, Crispin

2016-01-01

Purpose There is growing interest in the management of long-term conditions and in keeping people active and participating in the community. Testing the effectiveness of interventions that aim to affect activities and participation can be challenging without a well-developed, valid, and reliable instrument. This study therefore aims to develop a patient-reported outcome measure, the Oxford Participation and Activities Questionnaire (Ox-PAQ), which is theoretically grounded in the World Health Organization’s International Classification of Functioning, Disability, and Health (ICF) and fully compliant with current best practice guidelines. Methods Questionnaire items generated from patient interviews and based on the nine chapters of the ICF were administered by postal survey to 386 people with three neurological conditions: motor neuron disease, multiple sclerosis, and Parkinson’s disease. Participants also completed the Medical Outcomes Study (MOS) 36-Item Short Form Health Survey (SF-36) and EQ-5D-5L. Results Thus, 334 participants completed the survey, a response rate of 86.5%. Factor analysis techniques identified three Ox-PAQ domains, consisting of 23 items, accounting for 72.8% of variance. Internal reliability for the three domains was high (Cronbach’s α: 0.81–0.96), as was test–retest reliability (intraclass correlation: 0.83–0.92). Concurrent validity was demonstrated through highly significant relationships with relevant domains of the MOS SF-36 and the EQ- 5D-5L. Assessment of known-groups validity identified significant differences in Ox-PAQ scores among the three conditions included in the survey. Conclusion Results suggest that the Ox-PAQ is a valid and reliable measure of participation and activity. The measure will now be validated in a range of further conditions, and additional properties, such as responsiveness, will also be assessed in the next phase of the instrument’s development. PMID:27366108

Determining the Scoring Validity of a Co-Constructed CEFR-Based Rating Scale

ERIC Educational Resources Information Center

Deygers, Bart; Van Gorp, Koen

2015-01-01

Considering scoring validity as encompassing both reliable rating scale use and valid descriptor interpretation, this study reports on the validation of a CEFR-based scale that was co-constructed and used by novice raters. The research questions this paper wishes to answer are (a) whether it is possible to construct a CEFR-based rating scale with…

Development of a questionnaire for assessing the childbirth experience (QACE).

PubMed

Carquillat, Pierre; Vendittelli, Françoise; Perneger, Thomas; Guittier, Marie-Julia

2017-08-30

Due to its potential impact on women's psychological health, assessing perceptions of their childbirth experience is important. The aim of this study was to develop a multidimensional self-reporting questionnaire to evaluate the childbirth experience. Factors influencing the childbirth experience were identified from a literature review and the results of a previous qualitative study. A total of 25 items were combined from existing instruments or were created de novo. A draft version was pilot tested for face validity with 30 women and submitted for evaluation of its construct validity to 477 primiparous women at one-month post-partum. The recruitment took place in two obstetric clinics from Swiss and French university hospitals. To evaluate the content validity, we compared item responses to general childbirth experience assessments on a numeric, 0 to 10 rating scale. We dichotomized two group assessment scores: "0 to 7" and "8 to 10". We performed an exploratory factor analysis to identify underlying dimensions. In total, 291 women completed the questionnaire (response rate = 61%). The responses to 22 items were statistically significant between the 0 to 7 and 8 to 10 groups for the general childbirth experience assessments. An exploratory factor analysis yielded four sub-scales, which were labelled "relationship with staff" (4 items), "emotional status" (3 items), "first moments with the new born," (3 items) and "feelings at one month postpartum" (3 items). All 4 scales had satisfactory internal consistency levels (alpha coefficients from 0.70 to 0.85). The full 25-item version can be used to analyse each item by itself, and the short 4-dimension version can be scored to summarize the general assessment of the childbirth experience. The Questionnaire for Assessing the Childbirth Experience (QACE) could be useful as a screening instrument to identify women with negative childbirth experiences. It can be used as both a research instrument in its short version and a questionnaire for use in clinical practice in its full version.

Medical end-of-life practices among Canadian physicians: a pilot study.

PubMed

Marcoux, Isabelle; Boivin, Antoine; Mesana, Laura; Graham, Ian D; Hébert, Paul

2016-01-01

Medical end-of-life practices are hotly debated in Canada, and data from other countries are used to support arguments. The objective of this pilot study was twofold: to adapt and validate a questionnaire designed to measure the prevalence of these practices in Canada and the underlying decision-making process, and to assess the feasibility of a nationally representative study. In phase 1, questionnaires from previous studies were adapted to the Canadian context through consultations with a multidisciplinary committee and based on a scoping review. The modified questionnaire was validated through cognitive interviews with 14 physicians from medical specialties associated with a higher probability of being involved with dying patients recruited by means of snowball sampling. In phase 2, we selected a stratified random sample of 300 Canadian physicians in active practice from a national medical directory and used the modified tailored method design for mail and Web surveys. There were 4 criteria for success: modified questions are clearly understood; response patterns for sensitive questions are similar to those for other questions; respondents are comparable to the overall sampling frame; and mean questionnaire completion time is less than 20 minutes. Phase 1: main modifications to the questionnaire were related to documentation of all other medical practices (including practices intended to prolong life) and a question on the proportionality of drugs used. The final questionnaire contained 45 questions in a booklet style. Phase 2: of the 280 physicians with valid addresses, 87 (31.1%) returned the questionnaire; 11 of the 87 declined to participate, for a response rate of 27.1% (n = 76). Most respondents (64 [84%]) completed the mail questionnaire. All the criteria for success were met. It is feasible to study medical end-of-life practices, even for practices that are currently illegal, including the intentional use of lethal drugs. Results from this pilot study support conducting a large national study, but additional strategies would be necessary to improve the response rate.

Development of Cardiovascular Quality Indicators for Rheumatoid Arthritis: Results from an International Expert Panel Using a Novel Online Process

PubMed Central

Barber, Claire E. H.; Marshall, Deborah A; Alvarez, Nanette; John Mancini, G. B.; Lacaille, Diane; Keeling, Stephanie; Aviña-Zubieta, J. Antonio; Khodyakov, Dmitry; Barnabe, Cheryl; Faris, Peter; Smith, Alexa; Noormohamed, Raheem; Hazlewood, Glen; Martin, Liam O.; Esdaile, John M.

2016-01-01

Objective Patients with rheumatoid arthritis (RA) have a high risk of premature cardiovascular disease (CVD). We developed CVD quality indicators (QIs) for screening and use in Rheumatology clinics. Methods A systematic review of the literature on CVD risk reduction in RA and the general population was conducted. Based on the best practices identified from this review, a draft set of 12 candidate QIs were presented to a Canadian panel of rheumatologists and cardiologists (n=6) from three academic centers to achieve consensus on the QI specifications. The resulting 11 QIs were then evaluated by an online modified-Delphi panel of multidisciplinary health professionals and patients (n = 43) to determine their relevance, validity and feasibility in three rounds of online voting and threaded discussion using a modified RAND/UCLA Appropriateness Methodology. Results Response rates for the online panel were 86%. All 11 QIs were rated as highly relevant, valid and feasible (median rating ≥7 on a 1–9 scale) with no significant disagreement. The final QI set addresses the following themes: communication to primary care about increased CV risk in RA, CV risk assessment, defining smoking status and providing cessation counseling, screening and addressing hypertension, dyslipidemia and diabetes, exercise recommendations, body mass index screening and lifestyle counseling, minimizing corticosteroid use and communicating to patients at high risk of CVD about the risks/benefits of non-steroidal anti-inflammatory drugs. Conclusion Eleven QIs for CVD care in RA patients have been developed and are rated as highly relevant, valid and feasible by an international multidisciplinary panel. PMID:26178275

Maximal oxygen uptake and cardiorespiratory response to maximal 400-m free swimming, running and cycling tests in competitive swimmers.

PubMed

Rodríguez, F A

2000-06-01

This study compared the cardiorespiratory response of trained swimmers to 400-m unimpeded front crawl swimming (SW), treadmill running (TR) and ergometer cycling (EC) maximal exercise tests, and evaluated the validity and specificity of a method to measure maximal aerobic power in swimming. Two series of experiments were conducted. In series A (n=15), comparisons were made between VO2peak and other cardiorespiratory variables in three maximal tests: after 400-m SW, and during incremental TR and EC. In series B, VO2 peak and related variables were measured after SW and during EC (n=33). No significant differences were observed between VO2peak and VE in the three modes of exercise, although SW values tended to be higher. After SW, maximal ventilatory response was characterized by higher tidal volumes (VT) and lower respiratory rates (fR) as compared with TR and EC. The highest heart rate values (fH) were also observed in TR, followed by EC and SW. In series B, no significant differences were observed either in peak VO2 or VE, but fH was also lower in SW. A maximal 400-m unimpeded freestyle SW test yields essentially equal or nonsignificantly higher peak VO2 and VE values than during maximal TR or EC tests in trained swimmers. The specific maximal cardiorespiratory response to the SW test is characterized by higher VT, lower fR, and lower fH. Breath-by-breath measurements during the immediate recovery after a 400-m voluntary maximal swim is proposed as a valid and specific test for directly measuring maximal metabolic parameters and evaluating specific maximal aerobic power in swimming.

The development and validation of the clinicians' awareness towards cognitive errors (CATChES) in clinical decision making questionnaire tool.

PubMed

Chew, Keng Sheng; Kueh, Yee Cheng; Abdul Aziz, Adlihafizi

2017-03-21

Despite their importance on diagnostic accuracy, there is a paucity of literature on questionnaire tools to assess clinicians' awareness toward cognitive errors. A validation study was conducted to develop a questionnaire tool to evaluate the Clinician's Awareness Towards Cognitive Errors (CATChES) in clinical decision making. This questionnaire is divided into two parts. Part A is to evaluate the clinicians' awareness towards cognitive errors in clinical decision making while Part B is to evaluate their perception towards specific cognitive errors. Content validation for both parts was first determined followed by construct validation for Part A. Construct validation for Part B was not determined as the responses were set in a dichotomous format. For content validation, all items in both Part A and Part B were rated as "excellent" in terms of their relevance in clinical settings. For construct validation using exploratory factor analysis (EFA) for Part A, a two-factor model with total variance extraction of 60% was determined. Two items were deleted. Then, the EFA was repeated showing that all factor loadings are above the cut-off value of >0.5. The Cronbach's alpha for both factors are above 0.6. The CATChES questionnaire tool is a valid questionnaire tool aimed to evaluate the awareness among clinicians toward cognitive errors in clinical decision making.

Development and initial validation of the NCCN/FACT symptom index for advanced kidney cancer.

PubMed

Rothrock, Nan E; Jensen, Sally E; Beaumont, Jennifer L; Abernethy, Amy P; Jacobsen, Paul B; Syrjala, Karen; Cella, David

2013-01-01

There is a need for a brief symptom index for advanced kidney cancer that includes perspectives of both patients and clinicians and is consistent with the Food and Drug Administration's guidance for patient-reported outcome measures. This study developed and examined the preliminary reliability and validity of the new National Comprehensive Cancer Network/Functional Assessment of Cancer Therapy (FACT)-Kidney Symptom Index 19. Fifty patients with advanced kidney cancer provided open-ended and survey responses ranking their most important symptoms. Responses were reconciled with published clinician reports of the most important symptoms. Ten experienced oncologists rated symptoms as disease- or treatment-related. Patients completed quality-of-life and performance status measures. A 19-item index was produced from symptoms that were rated as most important by patients or clinicians. It includes three subscales: disease-related symptoms (DRS), treatment side effects (TSE), and general function and well-being (FWB). Internal consistency was good for the full instrument (α = 0.83), the DRS subscale (α = 0.76), and the FWB subscale (α = 0.78) but lower for the TSE subscale (α = 0.59). Convergent validity was demonstrated through correlations with the FACT-General. Patients with differing performance status were distinguished by the total score (F2,47 = 17.37; P < .0001), the DRS subscale (F2,47 = 14.22; P < .0001), and the FWB subscale (F2,47 = 13.40; P < .0001) but not the TSE subscale (F2,47 =1.48; P = 0.2380). The National Comprehensive Cancer Network/FACT-Kidney Symptom Index 19 combines symptoms deemed most important by patients and clinicians. Preliminary evidence suggests that the total score and DRS and FWB subscales are reliable and valid as summary indexes. The TSE subscale may be least relevant given the advent of newer therapies. Copyright © 2013 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Measuring Nurses' Value, Implementation, and Knowledge of Evidence-Based Practice: Further Psychometric Testing of the Quick-EBP-VIK Survey.

PubMed

Connor, Linda; Paul, Fiona; McCabe, Margaret; Ziniel, Sonja

2017-02-01

The Quick-EBP-VIK is a new instrument for measuring nurses' value, implementation, and knowledge of EBP. Psychometric testing was conducted in two parts. Part 1 describes the tool development and validity testing which resulted in the development of a 25-item survey after receiving ≥0.80 Item-Level Content Validity Index for both clarity and relevance. Part 2 describes psychometric testing was necessary to assess additional types of validity and reliability. The purpose of this paper is to further describe the psychometric testing of the Quick-EBP-VIK survey instrument. This descriptive study was designed to assess test-retest reliability, internal consistency and construct validity via a web-based survey. The survey instrument was e-mailed to all nurses at the study hospital. Nurses who responded to the first survey (Wave 1) received another e-mail invitation to complete the survey instrument again (Wave 2) for the purpose of assessing the test-retest reliability of the instrument. A total of 1,177 deliverable e-mails were sent to all nursing staff at one free standing pediatric hospital with Magnet ® designation in the northeast. A total of 382 nurses returned completed surveys, indicating a 32.5% response rate for Wave 1. A total of 131 nurses responded to Wave 2 indicating a response rate of 34.3%. The intraclass correlation coefficients for the items included in the final instrument ranged from 0.43 to 0.80 and were deemed sufficient. These represent a sufficient intraclass correlation coefficient. The Cronbach's Alpha values for each of the three domains are all higher than 0.7 indicating that the items of each of the measurement dimension are internally consistent. However, the composite reliability of the third domain was slightly lower than 0.7 when using Raykov's Rho. The Quick-EBP-VIK instrument has gone through rigorous comprehensive testing and has demonstrated good psychometric properties. © 2016 Sigma Theta Tau International.

Measuring Constructs in Family Science: How Can Item Response Theory Improve Precision and Validity?

PubMed Central

Gordon, Rachel A.

2014-01-01

This article provides family scientists with an understanding of contemporary measurement perspectives and the ways in which item response theory (IRT) can be used to develop measures with desired evidence of precision and validity for research uses. The article offers a nontechnical introduction to some key features of IRT, including its orientation toward locating items along an underlying dimension and toward estimating precision of measurement for persons with different levels of that same construct. It also offers a didactic example of how the approach can be used to refine conceptualization and operationalization of constructs in the family sciences, using data from the National Longitudinal Survey of Youth 1979 (n = 2,732). Three basic models are considered: (a) the Rasch and (b) two-parameter logistic models for dichotomous items and (c) the Rating Scale Model for multicategory items. Throughout, the author highlights the potential for researchers to elevate measurement to a level on par with theorizing and testing about relationships among constructs. PMID:25663714

Ablation and Thermal Response Property Model Validation for Phenolic Impregnated Carbon Ablator

NASA Technical Reports Server (NTRS)

Milos, F. S.; Chen, Y.-K.

2009-01-01

Phenolic Impregnated Carbon Ablator was the heatshield material for the Stardust probe and is also a candidate heatshield material for the Orion Crew Module. As part of the heatshield qualification for Orion, physical and thermal properties were measured for newly manufactured material, included emissivity, heat capacity, thermal conductivity, elemental composition, and thermal decomposition rates. Based on these properties, an ablation and thermal-response model was developed for temperatures up to 3500 K and pressures up to 100 kPa. The model includes orthotropic and pressure-dependent thermal conductivity. In this work, model validation is accomplished by comparison of predictions with data from many arcjet tests conducted over a range of stagnation heat flux and pressure from 107 Watts per square centimeter at 2.3 kPa to 1100 Watts per square centimeter at 84 kPa. Over the entire range of test conditions, model predictions compare well with measured recession, maximum surface temperatures, and in depth temperatures.

Reliability of the sliding scale for collecting affective responses to words.

PubMed

Imbault, C; Shore, D; Kuperman, V

2018-01-25

Warriner, Shore, Schmidt, Imbault, and Kuperman, Canadian Journal of Experimental Psychology, 71; 71-88 (2017) have recently proposed a slider task in which participants move a manikin on a computer screen toward or further away from a word, and the distance (in pixels) is a measure of the word's valence. Warriner, Shore, Schmidt, Imbault, and Kuperman, Canadian Journal of Experimental Psychology, 71; 71-88 (2017) showed this task to be more valid than the widely used rating task, but they did not examine the reliability of the new methodology. In this study we investigated multiple aspects of this task's reliability. In Experiment 1 (Exps. 1.1-1.6), we showed that the sliding scale has high split-half reliability (r = .868 to .931). In Experiment 2, we also showed that the slider task elicits consistent repeated responses both within a single session (Exp. 2: r = .804) and across two sessions separated by one week (Exp. 3: r = .754). Overall, the slider task, in addition to having high validity, is highly reliable.

Invalid before impaired: an emerging paradox of embedded validity indicators.

PubMed

Erdodi, Laszlo A; Lichtenstein, Jonathan D

Embedded validity indicators (EVIs) are cost-effective psychometric tools to identify non-credible response sets during neuropsychological testing. As research on EVIs expands, assessors are faced with an emerging contradiction: the range of credible impairment disappears between the 'normal' and 'invalid' range of performance. We labeled this phenomenon as the invalid-before-impaired paradox. This study was designed to explore the origin of this psychometric anomaly, subject it to empirical investigation, and generate potential solutions. Archival data were analyzed from a mixed clinical sample of 312 (M Age  = 45.2; M Education  = 13.6) patients medically referred for neuropsychological assessment. The distribution of scores on eight subtests of the third and fourth editions of Wechsler Adult Intelligence Scale (WAIS) were examined in relation to the standard normal curve and two performance validity tests (PVTs). Although WAIS subtests varied in their sensitivity to non-credible responding, they were all significant predictors of performance validity. While subtests previously identified as EVIs (Digit Span, Coding, and Symbol Search) were comparably effective at differentiating credible and non-credible response sets, their classification accuracy was driven by their base rate of low scores, requiring different cutoffs to achieve comparable specificity. Invalid performance had a global effect on WAIS scores. Genuine impairment and non-credible performance can co-exist, are often intertwined, and may be psychometrically indistinguishable. A compromise between the alpha and beta bias on PVTs based on a balanced, objective evaluation of the evidence that requires concessions from both sides is needed to maintain/restore the credibility of performance validity assessment.

Assessing quality of maternity care in Hungary: expert validation and testing of the mother-centered prenatal care (MCPC) survey instrument.

PubMed

Rubashkin, Nicholas; Szebik, Imre; Baji, Petra; Szántó, Zsuzsa; Susánszky, Éva; Vedam, Saraswathi

2017-11-16

Instruments to assess quality of maternity care in Central and Eastern European (CEE) region are scarce, despite reports of poor doctor-patient communication, non-evidence-based care, and informal cash payments. We validated and tested an online questionnaire to study maternity care experiences among Hungarian women. Following literature review, we collated validated items and scales from two previous English-language surveys and adapted them to the Hungarian context. An expert panel assessed items for clarity and relevance on a 4-point ordinal scale. We calculated item-level Content Validation Index (CVI) scores. We designed 9 new items concerning informal cash payments, as well as 7 new "model of care" categories based on mode of payment. The final questionnaire (N = 111 items) was tested in two samples of Hungarian women, representative (N = 600) and convenience (N = 657). We conducted bivariate analysis and thematic analysis of open-ended responses. Experts rated pre-existing English-language items as clear and relevant to Hungarian women's maternity care experiences with an average CVI for included questions of 0.97. Significant differences emerged across the model of care categories in terms of informal payments, informed consent practices, and women's perceptions of autonomy. Thematic analysis (N = 1015) of women's responses identified 13 priority areas of the maternity care experience, 9 of which were addressed by the questionnaire. We developed and validated a comprehensive questionnaire that can be used to evaluate respectful maternity care, evidence-based practice, and informal cash payments in CEE region and beyond.

Psychometric properties of the 25-item National Eye Institute Visual Function Questionnaire (NEI VFQ-25), Japanese version.

PubMed

Suzukamo, Yoshimi; Oshika, Tetsuro; Yuzawa, Mitsuko; Tokuda, Yoshihiro; Tomidokoro, Atsuo; Oki, Kotaro; Mangione, Carol M; Green, Joseph; Fukuhara, Shunichi

2005-10-26

The importance of evaluating the outcomes of health care from the standpoint of the patient is now widely recognized. The purpose of this study is to develop and test a Japanese version of the National Eye Institute Visual Function Questionnaire (NEI VFQ-25). A Japanese version was developed with a previously standardized method. The questionnaire and optional items were completed by 245 patients with cataracts, glaucoma, or age-related macular degeneration, by 110 others before and after cataract surgery, and by a reference group (n = 31). We computed rates of missing data, measured reproducibility and internal consistency reliability, and tested for convergent and discriminant validity, concurrent validity, known-groups validity, factor structure, and responsiveness to change. Based on information from the participants, some items were changed to 2-step items (asking if an activity was done, and if it was done, then asking how difficult it was). The near-vision and distance-vision subscales each had 1 item that was endorsed by very few participants, so these items were replaced with items that were optional in the English version. For example, more than 60% of participants did not drive, so the driving question was excluded. Reliability and validity were adequate for all subscales except driving, ocular pain, color vision, and peripheral vision. With cataract surgery, most scores improved by at least 20 points. With minor modifications from the English version, the Japanese NEI VFQ-25 can give reliable, valid, responsive data on vision-related quality of life, for group-level comparisons or for tracking therapeutic outcomes.

Pain questionnaire development focusing on cross-cultural equivalence to the original questionnaire: the Japanese version of the Short-Form McGill Pain Questionnaire.

PubMed

Arimura, Tatsuyuki; Hosoi, Masako; Tsukiyama, Yoshihiro; Yoshida, Toshiyuki; Fujiwara, Daiki; Tanaka, Masanori; Tamura, Ryuichi; Nakashima, Yasunori; Sudo, Nobuyuki; Kubo, Chiharu

2012-04-01

The present study aimed to develop a Japanese version of the Short-Form McGill Pain Questionnaire (SF-MPQ-J) that focuses on cross-culturally equivalence to the original English version and to test its reliability and validity. Cross-sectional design. In study 1, SF-MPQ was translated and adapted into Japanese. It included construction of response scales equivalent to the original using a variation of the Thurstone method of equal-appearing intervals. A total of 147 undergraduate students and 44 pain patients participated in the development of the Japanese response scales. To measure the equivalence of pain descriptors, 62 pain patients in four diagnostic groups were asked to choose pain descriptors that described their pain. In study 2, chronic pain patients (N=126) completed the SF-MPQ-J, the Long-Form McGill Pain Questionnaire Japanese version (LF-MPQ-J), and the 11-point numerical rating scale of pain intensity. Correlation analysis examined the construct validity of the SF-MPQ-J. The results from study 1 were used to develop SF-MPQ-J, which is linguistically equivalent to the original questionnaire. Response scales from SF-MPQ-J represented the original scale values. All pain descriptors, except one, were used by >33% in at least one of the four diagnostic groups. Study 2 exhibited adequate internal consistency and test-retest reliability, with the construct validity of SF-MPQ-J comparable to the original. These findings suggested that SF-MPQ-J is reliable, valid, and cross-culturally equivalent to the original questionnaire. Researchers might consider using this scale in multicenter, multi-ethnical trials or cross-cultural studies that include Japanese-speaking patients. Wiley Periodicals, Inc.

Construct Validity of the Spanish Versions of the Memorial Symptom Assessment Scale Short Form and Condensed Form: Rasch Analysis of Responses in Oncology Outpatients.

PubMed

Llamas-Ramos, Inés; Llamas-Ramos, Rocío; Buz, José; Cortés-Rodríguez, María; Martín-Nogueras, Ana María

2018-06-01

The Memorial Symptom Assessment Scale (MSAS) is a self-rating instrument for the assessment of symptom distress in cancer patients. The Spanish version of the MSAS has recently been validated. However, we lack evidence of the internal construct validity of the shorter versions (short form [MSAS-SF] and condensed form [CMSAS]). In addition, rigorous testing of these scales with modern psychometric methods is needed. The aim of this study was to evaluate the internal construct validity and reliability of the Spanish versions of the MSAS-SF and CMSAS in oncology outpatients using Rasch analysis. Data from a convenience sample of oncology outpatients receiving chemotherapy (n = 306; mean age 60 years; 63% women) at a university hospital were analyzed. The Rasch unidimensional measurement model was used to examine response category functioning, item hierarchy, targeting, unidimensionality, reliability, and differential item functioning by age, gender, and marital status. The response category structure of the symptom distress items was improved by collapsing two categories. The scales were adequately targeted to the study patients, showed overall Rasch model fit (mean Infit MnSq ranged from 0.98 to 1.05), met criteria for unidimensionality, and the reliability of scores was good (person reliability > 0.80), except for the CMSAS prevalence scale. Only four items showed differential item functioning. The present study demonstrated that the Spanish versions of the MSAS-SF and CMSAS have adequate psychometric properties to evaluate symptom distress in oncology outpatients. Additional studies of the CMSAS are recommended. Copyright © 2018 American Academy of Hospice and Palliative Medicine. Published by Elsevier Inc. All rights reserved.

Development and evaluation of an instrument to measure health-related quality of life in Cuban breast cancer patients receiving radiotherapy.

PubMed

Lugo, Josefina; Nápoles, Misleidy; Pérez, Inés; Ordaz, Niurka; Luzardo, Mario; Fernández, Leticia

2014-01-01

INTRODUCTION Although modern technology has extended the survival of breast cancer patients, treatment's adverse effects impact their health-related quality of life. Currently, no instrument exists capable of identifying the range of problems affecting breast cancer patients receiving radiotherapy in Cuba's socioeconomic and cultural context. OBJECTIVES Construct and validate an instrument to measure the effects of breast cancer and radiotherapy on health-related quality of life in Cuban patients. METHODS The study was conducted at the Oncology and Radiobiology Institute, Havana, Cuba, from January 2010 through December 2011. Inclusion criteria were: adult female, histological diagnosis of breast cancer, treated with ambulatory radiotherapy, and written informed consent; patients unable to communicate orally or in writing, or who had neurologic or psychiatric conditions were excluded. Development phase: focus groups guided by a list of questions were carried out with 50 women. The patients reported 61 problems affecting their health-related quality-of-life. A nominal group (six oncologists and two nurses) identified the same problems. A syntactic analysis of the information was performed to create items for study and measurement scales. Content validity was determined by a nominal group of seven experts using professional judgment. Another 20 patients were selected to evaluate face validity. Validation phase: the instrument was applied to 230 patients at three different points: before radiotherapy, at the end of radiotherapy and four weeks after radiotherapy was concluded. Reliability, construct validity, discriminant validity, predictive validity, interpretability and response burden were evaluated. RESULTS The final instrument developed had 33 items distributed in 4 domains: physical functioning, psychological functioning, social and family relationships, and physical and emotional adverse effects of disease and treatment. There were two discrete items: perceived general health and perceived health-related quality of life. Content validity and face validity were assessed as acceptable, by experts and patients respectively. Homogeneity, construct validity, and discriminant validity were satisfactory. The best results were obtained with test-retest reliability, predictive validity, and interpretability; the low rate of unanswered questions indicated that the instrument did not produce excessive patient response burden. CONCLUSION The new instrument fulfilled the requirements for measuring impact of breast cancer and of radiotherapy on health-related quality of life in these Cuban patients, validating its usefulness for inclusion in clinical trial protocols.

Media ratings for movies, music, video games, and television: a review of the research and recommendations for improvements.

PubMed

Gentile, Douglas A; Humphrey, Jeremy; Walsh, David A

2005-06-01

This article review is organized by studies that are relevant for testing the reliability and validity of ratings systems. Specifically, the interrater reliability, consistency, temporal stability, content validity, construct validity, and criterion validity of media ratings systems are reviewed. Data that are related to testing the "forbidden fruit" and "tainted fruit" hypotheses also are reviewed. Several changes are recommended to improve the ratings systems, including the creation of a universal ratings system that could be applied equally to all media. The research reviewed here can provide a guide for how to construct a reliable, valid, and more useful ratings system. This is important because the decisions that parents make regarding their children's media use can be only as good as the information to which the parents have access.

Influence of Deformation Mechanisms on the Mechanical Behavior of Metals and Alloys: Experiments, Constitutive Modeling, and Validation

NASA Astrophysics Data System (ADS)

Gray, G. T.; Cerreta, E.; Chen, Shuh Rong; Maudlin, P. J.

2004-06-01

Jim Williams has made seminal contributions to the field of structure / property relations and its controlling effects on the mechanical behavior of metals and alloys. This talk will discuss experimental results illustrating the role of interstitial content, grain size, texture, temperature, and strain rate on the operative deformation mechanisms, mechanical behavior, and substructure evolution in titanium, zirconium, hafnium, and rhenium. Increasing grain size is shown to significantly decrease the dynamic flow strength of Ti and Zr while increasing work-hardening rates due to an increased incidence of deformation twinning. Increasing oxygen interstitial content is shown to significantly alter both the constitutive response and α-ω shock-induced phase transition in Zr. The influence of crystallographic texture on the mechanical behavior in Ti, Zr, and Hf is discussed in terms of slip system and deformation twinning activity. An example of the utility of incorporation of operative deformation mechanisms into a polycrystalline plasticity constitutive model and validation using Taylor cylinder impact testing is presented.

[Development of a New Scale for Gauging Smartphone Dependence].

PubMed

Toda, Masahiro; Nishio, Nobuhiro; Takeshita, Tatsuya

2015-01-01

We designed a scale to gauge smartphone dependence and assessed its reliability and validity. A prototype self-rating smartphone-dependence scale was tested on 133 medical students who use smartphones more frequently than other devices to access web pages. Each response was scored on a Likert scale (0, 1, 2, 3), with higher scores indicating greater dependence. To select items for the final scale, exploratory factor analysis was conducted. On the basis of factor analysis results, we designed the Wakayama Smartphone-Dependence Scale (WSDS) comprising 21 items with 3 subscales: immersion in Internet communication; using a smartphone for extended periods of time and neglecting social obligations and other tasks; using a smartphone while doing something else and neglect of etiquette. Our analysis confirmed the validity of the different elements of the WSDS: the reliability coefficient (Cronbach's alpha) values of all subscales and total WSDS were from 0.79 to 0.83 and 0.88, respectively. These findings suggest that the WSDS is a useful tool for rating smartphone dependence.

Experimental validation of a 0-D numerical model for phase change thermal management systems in lithium-ion batteries

NASA Astrophysics Data System (ADS)

Schweitzer, Ben; Wilke, Stephen; Khateeb, Siddique; Al-Hallaj, Said

2015-08-01

A lumped (0-D) numerical model has been developed for simulating the thermal response of a lithium-ion battery pack with a phase-change composite (PCC™) thermal management system. A small 10s4p battery pack utilizing PCC material was constructed and subjected to discharge at various C-rates in order to validate the lumped model. The 18650 size Li-ion cells used in the pack were electrically characterized to determine their heat generation, and various PCC materials were thermally characterized to determine their apparent specific heat as a function of temperature. Additionally, a 2-D FEA thermal model was constructed to help understand the magnitude of spatial temperature variation in the pack, and to understand the limitations of the lumped model. Overall, good agreement is seen between experimentally measured pack temperatures and the 0-D model, and the 2-D FEA model predicts minimal spatial temperature variation for PCC-based packs at C-rates of 1C and below.

Personalized prediction of chronic wound healing: an exponential mixed effects model using stereophotogrammetric measurement.

PubMed

Xu, Yifan; Sun, Jiayang; Carter, Rebecca R; Bogie, Kath M

2014-05-01

Stereophotogrammetric digital imaging enables rapid and accurate detailed 3D wound monitoring. This rich data source was used to develop a statistically validated model to provide personalized predictive healing information for chronic wounds. 147 valid wound images were obtained from a sample of 13 category III/IV pressure ulcers from 10 individuals with spinal cord injury. Statistical comparison of several models indicated the best fit for the clinical data was a personalized mixed-effects exponential model (pMEE), with initial wound size and time as predictors and observed wound size as the response variable. Random effects capture personalized differences. Other models are only valid when wound size constantly decreases. This is often not achieved for clinical wounds. Our model accommodates this reality. Two criteria to determine effective healing time outcomes are proposed: r-fold wound size reduction time, t(r-fold), is defined as the time when wound size reduces to 1/r of initial size. t(δ) is defined as the time when the rate of the wound healing/size change reduces to a predetermined threshold δ < 0. Healing rate differs from patient to patient. Model development and validation indicates that accurate monitoring of wound geometry can adaptively predict healing progression and that larger wounds heal more rapidly. Accuracy of the prediction curve in the current model improves with each additional evaluation. Routine assessment of wounds using detailed stereophotogrammetric imaging can provide personalized predictions of wound healing time. Application of a valid model will help the clinical team to determine wound management care pathways. Published by Elsevier Ltd.

Assessment of the face validity of two pain scales in Kenya: a validation study using cognitive interviewing

PubMed Central

2012-01-01

Background Patients in sub-Saharan Africa commonly experience pain, which often is un-assessed and undertreated. One hindrance to routine pain assessment in these settings is the lack of a single-item pain rating scale validated for the particular context. The goal of this study was to examine the face validity and cultural acceptability of two single-item pain scales, the Numerical Rating Scale (NRS) and the Faces Pain Scale-Revised (FPS-R), in a population of patients on the medical, surgical, and pediatric wards of Moi Teaching and Referral Hospital in Kenya. Methods Swahili versions of the NRS and FPS-R were developed by standard translation and back-translation. Cognitive interviews were performed with 15 patients at Moi Teaching and Referral Hospital in Eldoret, Kenya. Interview transcripts were analyzed on a question-by-question basis to identify major themes revealed through the cognitive interviewing process and to uncover any significant problems participants encountered with understanding and using the pain scales. Results Cognitive interview analysis demonstrated that participants had good comprehension of both the NRS and the FPS-R and showed rational decision-making processes in choosing their responses. Participants felt that both scales were easy to use. The FPS-R was preferred almost unanimously to the NRS. Conclusions The face validity and acceptability of the Swahili versions of the NRS and FPS-R has been demonstrated for use in Kenyan patients. The broader application of these scales should be evaluated and may benefit patients who currently suffer from pain. PMID:22512923

WHipple-ABACUS, a simple, validated risk score for 30-day mortality after pancreaticoduodenectomy developed using the ACS-NSQIP database.

PubMed

Gleeson, Elizabeth M; Shaikh, Mohammad F; Shewokis, Patricia A; Clarke, John R; Meyers, William C; Pitt, Henry A; Bowne, Wilbur B

2016-11-01

Pancreaticoduodenectomy needs simple, validated risk models to better identify 30-day mortality. The goal of this study is to develop a simple risk score to predict 30-day mortality after pancreaticoduodenectomy. We reviewed cases of pancreaticoduodenectomy from 2005-2012 in the American College of Surgeons-National Surgical Quality Improvement Program databases. Logistic regression was used to identify preoperative risk factors for morbidity and mortality from a development cohort. Scores were created using weighted beta coefficients, and predictive accuracy was assessed on the validation cohort using receiver operator characteristic curves and measuring area under the curve. The 30-day mortality rate was 2.7% for patients who underwent pancreaticoduodenectomy (n = 14,993). We identified 8 independent risk factors. The score created from weighted beta coefficients had an area under the curve of 0.71 (95% confidence interval, 0.66-0.77) on the validation cohort. Using the score WHipple-ABACUS (hypertension With medication + History of cardiac surgery + Age >62 + 2 × Bleeding disorder + Albumin <3.5 g/dL + 2 × disseminated Cancer + 2 × Use of steroids + 2 × Systemic inflammatory response syndrome), mortality rates increase with increasing score (P < .001). While other risk scores exist for 30-day mortality after pancreaticoduodenectomy, we present a simple, validated score developed using exclusively preoperative predictors surgeons could use to identify patients at risk for this procedure. Copyright © 2016 Elsevier Inc. All rights reserved.

Improving the residency admissions process by integrating a professionalism assessment: a validity and feasibility study.

PubMed

Bajwa, Nadia M; Yudkowsky, Rachel; Belli, Dominique; Vu, Nu Viet; Park, Yoon Soo

2017-03-01

The purpose of this study was to provide validity and feasibility evidence in measuring professionalism using the Professionalism Mini-Evaluation Exercise (P-MEX) scores as part of a residency admissions process. In 2012 and 2013, three standardized-patient-based P-MEX encounters were administered to applicants invited for an interview at the University of Geneva Pediatrics Residency Program. Validity evidence was gathered for P-MEX content (item analysis); response process (qualitative feedback); internal structure (inter-rater reliability with intraclass correlation and Generalizability); relations to other variables (correlations); and consequences (logistic regression to predict admission). To improve reliability, Kane's formula was used to create an applicant composite score using P-MEX, structured letter of recommendation (SLR), and structured interview (SI) scores. Applicant rank lists using composite scores versus faculty global ratings were compared using the Wilcoxon signed-rank test. Seventy applicants were assessed. Moderate associations were found between pairwise correlations of P-MEX scores and SLR (r = 0.25, P = .036), SI (r = 0.34, P = .004), and global ratings (r = 0.48, P < .001). Generalizability of the P-MEX using three cases was moderate (G-coefficient = 0.45). P-MEX scores had the greatest correlation with acceptance (r = 0.56, P < .001), were the strongest predictor of acceptance (OR 4.37, P < .001), and increased pseudo R-squared by 0.20 points. Including P-MEX scores increased composite score reliability from 0.51 to 0.74. Rank lists of applicants using composite score versus global rating differed significantly (z = 5.41, P < .001). Validity evidence supports the use of P-MEX scores to improve the reliability of the residency admissions process by improving applicant composite score reliability.

Development and validation of the Consumer Quality index instrument to measure the experience and priority of chronic dialysis patients.

PubMed

van der Veer, Sabine N; Jager, Kitty J; Visserman, Ella; Beekman, Robert J; Boeschoten, Els W; de Keizer, Nicolette F; Heuveling, Lara; Stronks, Karien; Arah, Onyebuchi A

2012-08-01

Patient experience is an established indicator of quality of care. Validated tools that measure both experiences and priorities are lacking for chronic dialysis care, hampering identification of negative experiences that patients actually rate important. We developed two Consumer Quality (CQ) index questionnaires, one for in-centre haemodialysis (CHD) and the other for peritoneal dialysis and home haemodialysis (PHHD) care. The instruments were validated using exploratory factor analyses, reliability analysis of identified scales and assessing the association between reliable scales and global ratings. We investigated opportunities for improvement by combining suboptimal experience with patient priority. Sixteen dialysis centres participated in our study. The pilot CQ index for CHD care consisted of 71 questions. Based on data of 592 respondents, we identified 42 core experience items in 10 scales with Cronbach's α ranging from 0.38 to 0.88; five were reliable (α ≥ 0.70). The instrument identified information on centres' fire procedures as the aspect of care exhibiting the biggest opportunity for improvement. The pilot CQ index PHHD comprised 56 questions. The response of 248 patients yielded 31 core experience items in nine scales with Cronbach's α ranging between 0.53 and 0.85; six were reliable. Information on kidney transplantation during pre-dialysis showed most room for improvement. However, for both types of care, opportunities for improvement were mostly limited. The CQ index reliably and validly captures dialysis patient experience. Overall, most care aspects showed limited room for improvement, mainly because patients participating in our study rated their experience to be optimal. To evaluate items with high priority, but with which relatively few patients have experience, more qualitative instruments should be considered.

Validating and assessing the sensitivity of the Health Assessment Questionnaire-Disability Index-derived Short Form-6D in patients with early aggressive rheumatoid arthritis.

PubMed

Amjadi, Sogol S; Maranian, Paul M; Paulus, Harold E; Kaplan, Robert M; Ranganath, Veena K; Furst, Daniel E; Khanna, Puja P; Khanna, Dinesh

2009-06-01

New methodologies allow the scores for the Health Assessment Questionnaire-Disability Index (HAQ-DI) to be translated into preferences/utility scores. We evaluated the construct validity of the HAQ-DI-derived Short Form-6D (SF-6D) score and assessed its responsiveness to change over 6- and 12-month followup periods in patients with early aggressive rheumatoid arthritis (RA). Patients (n=277) participating in an RA observational study completed self-reported measures of symptoms and the HAQ-DI at baseline and at 6 and 12 months. Total Sharp scores, C-reactive protein, and erythrocyte sedimentation rate were assessed along with clinical data. Construct validity was assessed by examining the association between SF-6D score and patient-reported and clinical measures using Spearman correlation coefficients. The responsiveness of SF-6D to change was assessed using patient and physician assessments of the disease as clinical anchors. The magnitude of responsiveness was calculated using SF-6D effect size (ES). Mean SF-6D scores were 0.690, 0.720, and 0.723 at baseline and 6 and 12-month followup, respectively. Baseline patient-reported measures had moderate to high correlations with baseline SF-6D (r=0.43 to 0.52); whereas clinical measures had negligible to low correlations with SF-6D (r=0.001 to 0.32). ES was moderate for the groups that were deemed to have improved (ES 0.63-0.75) but negligible to small for those that did not (ES 0.13-0.46). Our data support the validity and responsiveness of the HAQ-DI derived SF-6D score in an early RA cohort. These results support the use of the HAQ-DI derived SF-6D in RA cohorts and clinical trials lacking preference-based measures.

Modeling motivated misreports to sensitive survey questions.

PubMed

Böckenholt, Ulf

2014-07-01

Asking sensitive or personal questions in surveys or experimental studies can both lower response rates and increase item non-response and misreports. Although non-response is easily diagnosed, misreports are not. However, misreports cannot be ignored because they give rise to systematic bias. The purpose of this paper is to present a modeling approach that identifies misreports and corrects for them. Misreports are conceptualized as a motivated process under which respondents edit their answers before they report them. For example, systematic bias introduced by overreports of socially desirable behaviors or underreports of less socially desirable ones can be modeled, leading to more-valid inferences. The proposed approach is applied to a large-scale experimental study and shows that respondents who feel powerful tend to overclaim their knowledge.

The joy of heartfelt music: An examination of emotional and physiological responses.

PubMed

Lynar, Emily; Cvejic, Erin; Schubert, Emery; Vollmer-Conna, Ute

2017-10-01

Music-listening can be a powerful therapeutic tool for mood rehabilitation, yet quality evidence for its validity as a singular treatment is scarce. Specifically, the relationship between music-induced mood improvement and meaningful physiological change, as well as the influence of music- and person-related covariates on these outcomes are yet to be comprehensively explored. Ninety-four healthy participants completed questionnaires probing demographics, personal information, and musical background. Participants listened to two prescribed musical pieces (one classical, one jazz), an "uplifting" piece of their own choice, and an acoustic control stimulus (white noise) in randomised order. Physiological responses (heart rate, respiration, galvanic skin response) were recorded throughout. After each piece, participants rated their subjective responses on a series of Likert scales. Subjectively, the self-selected pieces induced the most joy, and the classical piece was perceived as most relaxing, consistent with the arousal ratings proposed by a music selection panel. These two stimuli led to the greatest overall improvement in composite emotional state from baseline. Psycho-physiologically, self-selected pieces often elicited a "eustress" response ("positive arousal"), whereas classical music was associated with the highest heart rate variability. Very few person-related covariates appeared to affect responses, and music-related covariates (besides self-selection) appeared arbitrary. These data provide strong evidence that optimal music for therapy varies between individuals. Our findings additionally suggest that the self-selected music was most effective for inducing a joyous state; while low arousal classical music was most likely to shift the participant into a state of relaxation. Therapy should attempt to find the most effective and "heartfelt" music for each listener, according to therapeutic goals. Copyright © 2017 Elsevier B.V. All rights reserved.

42 CFR 493.565 - Selection for validation inspection-laboratory responsibilities.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 42 Public Health 5 2010-10-01 2010-10-01 false Selection for validation inspection-laboratory... Program § 493.565 Selection for validation inspection—laboratory responsibilities. A laboratory selected for a validation inspection must do the following: (a) Authorize its accreditation organization or...

42 CFR 493.565 - Selection for validation inspection-laboratory responsibilities.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 42 Public Health 5 2012-10-01 2012-10-01 false Selection for validation inspection-laboratory... Program § 493.565 Selection for validation inspection—laboratory responsibilities. A laboratory selected for a validation inspection must do the following: (a) Authorize its accreditation organization or...

42 CFR 493.565 - Selection for validation inspection-laboratory responsibilities.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 42 Public Health 5 2011-10-01 2011-10-01 false Selection for validation inspection-laboratory... Program § 493.565 Selection for validation inspection—laboratory responsibilities. A laboratory selected for a validation inspection must do the following: (a) Authorize its accreditation organization or...

42 CFR 493.565 - Selection for validation inspection-laboratory responsibilities.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 42 Public Health 5 2013-10-01 2013-10-01 false Selection for validation inspection-laboratory... Program § 493.565 Selection for validation inspection—laboratory responsibilities. A laboratory selected for a validation inspection must do the following: (a) Authorize its accreditation organization or...

42 CFR 493.565 - Selection for validation inspection-laboratory responsibilities.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 42 Public Health 5 2014-10-01 2014-10-01 false Selection for validation inspection-laboratory... Program § 493.565 Selection for validation inspection—laboratory responsibilities. A laboratory selected for a validation inspection must do the following: (a) Authorize its accreditation organization or...

Heart Rate Monitoring in Team Sports-A Conceptual Framework for Contextualizing Heart Rate Measures for Training and Recovery Prescription.

PubMed

Schneider, Christoph; Hanakam, Florian; Wiewelhove, Thimo; Döweling, Alexander; Kellmann, Michael; Meyer, Tim; Pfeiffer, Mark; Ferrauti, Alexander

2018-01-01

A comprehensive monitoring of fitness, fatigue, and performance is crucial for understanding an athlete's individual responses to training to optimize the scheduling of training and recovery strategies. Resting and exercise-related heart rate measures have received growing interest in recent decades and are considered potentially useful within multivariate response monitoring, as they provide non-invasive and time-efficient insights into the status of the autonomic nervous system (ANS) and aerobic fitness. In team sports, the practical implementation of athlete monitoring systems poses a particular challenge due to the complex and multidimensional structure of game demands and player and team performance, as well as logistic reasons, such as the typically large number of players and busy training and competition schedules. In this regard, exercise-related heart rate measures are likely the most applicable markers, as they can be routinely assessed during warm-ups using short (3-5 min) submaximal exercise protocols for an entire squad with common chest strap-based team monitoring devices. However, a comprehensive and meaningful monitoring of the training process requires the accurate separation of various types of responses, such as strain, recovery, and adaptation, which may all affect heart rate measures. Therefore, additional information on the training context (such as the training phase, training load, and intensity distribution) combined with multivariate analysis, which includes markers of (perceived) wellness and fatigue, should be considered when interpreting changes in heart rate indices. The aim of this article is to outline current limitations of heart rate monitoring, discuss methodological considerations of univariate and multivariate approaches, illustrate the influence of different analytical concepts on assessing meaningful changes in heart rate responses, and provide case examples for contextualizing heart rate measures using simple heuristics. To overcome current knowledge deficits and methodological inconsistencies, future investigations should systematically evaluate the validity and usefulness of the various approaches available to guide and improve the implementation of decision-support systems in (team) sports practice.

Heart Rate Monitoring in Team Sports—A Conceptual Framework for Contextualizing Heart Rate Measures for Training and Recovery Prescription

PubMed Central

Schneider, Christoph; Hanakam, Florian; Wiewelhove, Thimo; Döweling, Alexander; Kellmann, Michael; Meyer, Tim; Pfeiffer, Mark; Ferrauti, Alexander

2018-01-01

A comprehensive monitoring of fitness, fatigue, and performance is crucial for understanding an athlete's individual responses to training to optimize the scheduling of training and recovery strategies. Resting and exercise-related heart rate measures have received growing interest in recent decades and are considered potentially useful within multivariate response monitoring, as they provide non-invasive and time-efficient insights into the status of the autonomic nervous system (ANS) and aerobic fitness. In team sports, the practical implementation of athlete monitoring systems poses a particular challenge due to the complex and multidimensional structure of game demands and player and team performance, as well as logistic reasons, such as the typically large number of players and busy training and competition schedules. In this regard, exercise-related heart rate measures are likely the most applicable markers, as they can be routinely assessed during warm-ups using short (3–5 min) submaximal exercise protocols for an entire squad with common chest strap-based team monitoring devices. However, a comprehensive and meaningful monitoring of the training process requires the accurate separation of various types of responses, such as strain, recovery, and adaptation, which may all affect heart rate measures. Therefore, additional information on the training context (such as the training phase, training load, and intensity distribution) combined with multivariate analysis, which includes markers of (perceived) wellness and fatigue, should be considered when interpreting changes in heart rate indices. The aim of this article is to outline current limitations of heart rate monitoring, discuss methodological considerations of univariate and multivariate approaches, illustrate the influence of different analytical concepts on assessing meaningful changes in heart rate responses, and provide case examples for contextualizing heart rate measures using simple heuristics. To overcome current knowledge deficits and methodological inconsistencies, future investigations should systematically evaluate the validity and usefulness of the various approaches available to guide and improve the implementation of decision-support systems in (team) sports practice. PMID:29904351

Self-Initiated Development of Leadership Capabilities: Toward Establishing the Validity of Key Motivational Constructs and Assessment Tools

DTIC Science & Technology

2010-11-01

such as pay increases, promotions, increases in leader- ship responsibility, leadership performance /behavior ratings, and satisfaction at work. The... Vroom , 1964), self-efficacy (or expectation that one will succeed at a task) is a sub-component or direct predictor of overall motivation to perform a... satisfaction . Comparing Motivation to Lead and Motivation to Develop Leadership in Predicting Leadership Performance and Career Success In this

Experimental Validation of a Coupled Fluid-Multibody Dynamics Model for Tanker Trucks

DTIC Science & Technology

2007-11-08

order to accurately predict the dynamic response of tanker trucks, the model must accurately account for the following effects : • Incompressible...computational code which uses a time- accurate explicit solution procedure is used to solve both the solid and fluid equations of motion. Many commercial...position vector, τ is the deviatoric stress tensor, D is the rate of deformation tensor, f r is the body force vector, r is the artificial

Prevention of Low Back Pain in The Military. A Randomized Clinical Trial

DTIC Science & Technology

2011-07-01

the web-based follow-up survey. These measures were collected at baseline using a variety of commonly uti - lized and previously validated self-report...computer literacy, which could certainly influ- ence response rates given the web-based platform uti - lized to assess follow-up in the POLM trial. Previous...measures of reliability. As research continues to explore the changes in rectus abdominis mus- culature associated with pregnancy and its potential

Prevention of Low Back Pain in the Military: A Randomized Clinical Trial

DTIC Science & Technology

2011-06-01

follow-up survey. These measures were collected at baseline using a variety of commonly uti - lized and previously validated self-report questionnaires...which could certainly influ- ence response rates given the web-based platform uti - lized to assess follow-up in the POLM trial. Previous research has...reliability. As research continues to explore the changes in rectus abdominis mus- culature associated with pregnancy and its potential impact on low

Chemomechanics with Molecular Force Probes

DTIC Science & Technology

2010-03-30

at scales >50 nm) [ 1 –5]. Such coupling affects the rate at which the chemical reaction occurs and therefore must be accounted for in any kinetic...reporting burden for the collection of information is estimated to average 1 hour per response, including the time for reviewing instructions, searching...it does not display a currently valid OMB control number. 1 . REPORT DATE 2010 2. REPORT TYPE 3. DATES COVERED 00-00-2010 to 00-00-2010 4

A Review of Player Monitoring Approaches in Basketball: Current Trends and Future Directions.

PubMed

Fox, Jordan L; Scanlan, Aaron T; Stanton, Robert

2017-07-01

Fox, JL, Scanlan, AT, and Stanton, R. A review of player monitoring approaches in basketball: current trends and future directions. J Strength Cond Res 31(7): 2021-2029, 2017-Effective monitoring of players in team sports such as basketball requires an understanding of the external demands and internal responses, as they relate to training phases and competition. Monitoring of external demands and internal responses allows coaching staff to determine the dose-response associated with the imposed training load (TL), and subsequently, if players are adequately prepared for competition. This review discusses measures reported in the literature for monitoring the external demands and internal responses of basketball players during training and competition. The external demands of training and competition were primarily monitored using time-motion analysis, with limited use of microtechnology being reported. Internal responses during training were typically measured using hematological markers, heart rate, various TL models, and perceptual responses such as rating of perceived exertion (RPE). Heart rate was the most commonly reported indicator of internal responses during competition with limited reporting of hematological markers or RPE. These findings show a large discrepancy between the reporting of external and internal measures and training and competition demands. Microsensors, however, may be a practical and convenient method of player monitoring in basketball to overcome the limitations associated with current approaches while allowing for external demands and internal responses to be recorded simultaneously. The triaxial accelerometers of microsensors seem well suited for basketball and warrant validation to definitively determine their place in the monitoring of basketball players. Coaching staff should make use of this technology by tracking individual player responses across the annual plan and using real-time monitoring to minimize factors such as fatigue and injury risk.

Construct Validation of Analytic Rating Scales in a Speaking Assessment: Reporting a Score Profile and a Composite

ERIC Educational Resources Information Center

Sawaki, Yasuyo

2007-01-01

This is a construct validation study of a second language speaking assessment that reported a language profile based on analytic rating scales and a composite score. The study addressed three key issues: score dependability, convergent/discriminant validity of analytic rating scales and the weighting of analytic ratings in the composite score.…

Cross-validation of Peak Oxygen Consumption Prediction Models From OMNI Perceived Exertion.

PubMed

Mays, R J; Goss, F L; Nagle, E F; Gallagher, M; Haile, L; Schafer, M A; Kim, K H; Robertson, R J

2016-09-01

This study cross-validated statistical models for prediction of peak oxygen consumption using ratings of perceived exertion from the Adult OMNI Cycle Scale of Perceived Exertion. 74 participants (men: n=36; women: n=38) completed a graded cycle exercise test. Ratings of perceived exertion for the overall body, legs, and chest/breathing were recorded each test stage and entered into previously developed 3-stage peak oxygen consumption prediction models. There were no significant differences (p>0.05) between measured and predicted peak oxygen consumption from ratings of perceived exertion for the overall body, legs, and chest/breathing within men (mean±standard deviation: 3.16±0.52 vs. 2.92±0.33 vs. 2.90±0.29 vs. 2.90±0.26 L·min(-1)) and women (2.17±0.29 vs. 2.02±0.22 vs. 2.03±0.19 vs. 2.01±0.19 L·min(-1)) participants. Previously developed statistical models for prediction of peak oxygen consumption based on subpeak OMNI ratings of perceived exertion responses were similar to measured peak oxygen consumption in a separate group of participants. These findings provide practical implications for the use of the original statistical models in standard health-fitness settings. © Georg Thieme Verlag KG Stuttgart · New York.

An exploratory study on scientific investigations in homeopathy using medical analyzer.

PubMed

Mishra, Nirupama; Muraleedharan, K Charan; Paranjpe, Akalpita Sriniwas; Munta, Devendra Kumar; Singh, Hari; Nayak, Chaturbhuja

2011-08-01

The action of homeopathic medicines, in ultra-high dilution, is not directly observable. An attempt was made to explore autonomic response of selective homeopathic medicines, in healthy persons, using Medical Analyzer System (Electronics Division, Bhabha Atomic Research Centre, Mumbai, India). The objective of the study was to observe the action of homeopathic medicines on physiologic variability of heart rate and blood flow. Pre- and postinterventional variability spectra of heart rate and blood flow of 77 subjects were recorded with the Medical Analyzer System, administering homeopathic preparations of Aconitum napellus (6c, 10M), Arsenicum album (200c, 1M), Gelsemium sempervirens (200c, 1M), Phosphorus (200c, 1M), Pulsatilla nigricans (200c) and Sulphur (200c, 1M) versus placebo control. The amplitude of the peaks viz. low-frequency, medium-frequency, and high-frequency was measured for postintervention analysis. An increase in the amplitude of any valid peak by 100% or a decrease by 50% was considered as significant change. Aconitum napellus produced a response in heart rate variability (HRV) with 30c potency and in blood flow variability with 1M potency. Sulphur 200c and 1M, Gelsemium 200c and Pulsatilla 200c, produced a 62.5% response in HRV against the placebo response of 16.6%. Gelsemium, Phosphorus, and Sulphur produced a response in blood flow variability with a 1M potency, similar to the response of Aconitum napellus 1M. These data suggest that it is possible to record the response of homeopathic medicines on physiologic parameters of the autonomic nervous system.

Race, ethnicity, and linguistic isolation as determinants of participation in public health surveillance surveys.

PubMed

Link, Michael W; Mokdad, Ali H; Stackhouse, Herbert F; Flowers, Nicole T

2006-01-01

To plan, implement, and evaluate programs designed to improve health conditions among racial and ethnic minority populations in the United States, public health officials and researchers require valid and reliable health surveillance data. Monitoring chronic disease and behavioral risk factors among such populations, however, is challenging. This study assesses the effects of race, ethnicity, and linguistic isolation on rates of participation in the Behavioral Risk Factor Surveillance System (BRFSS). County-level data from the 2003 BRFSS survey and 2000 U.S. census were used to examine the effects of race, ethnicity, and linguistic isolation on six measures of survey participation (i.e., rates of resolution, screening, cooperation, response, language barriers, and refusal). Participation rates were significantly lower in counties with higher percentages of black people and people who did not speak English. Response rates decreased by 4.6% in counties with the highest concentration of black residents compared with counties with few black residents. Likewise, response rates decreased by approximately 7% in counties in which a larger percentage of the population spoke only Spanish or another Indo-European language compared with counties in which all residents spoke English. The negative relationship between the percentage of Spanish-only-speaking households and participation rates is troubling given that the BRFSS is conducted in both Spanish and English. The findings also indicate that more needs to be done to improve participation among other minorities. Researchers are investigating several ways of addressing disparities in participation rates, such as using postsurvey adjustments, developing more culturally appropriate data-collection procedures, and offering surveys in multiple languages.

Urdu version of the neck disability index: a reliability and validity study.

PubMed

Farooq, Muhammad Nazim; Mohseni-Bandpei, Mohammad A; Gilani, Syed Amir; Hafeez, Ambreen

2017-04-08

Despite the wide use of the neck disability index (NDI) for assessing disability in patients with neck pain, the NDI has not yet been translated and validated in Urdu. The first purpose of the present study was to translate and cross-culturally adapt the NDI into the Urdu language (NDI-U). The second purpose was to investigate the reliability, validity and responsiveness of the NDI-U in Urdu-speaking patients experiencing chronic mechanical neck pain (CMNP). Translation and cross-cultural adaptation of the original version of the NDI were carried out using previously described procedures. Seventy-six patients with CMNP and thirty healthy participants were recruited for the study. NDI-U and visual analogue scales for pain intensity (VAS pain ) and disability (VAS disability ) were administered to all the participants at baseline and to the patients 3 weeks after receiving physiotherapy intervention. The global rating of change scale (GROC) was also administered at this time. Test-retest reliability and internal consistency were carried out on forty-six randomly selected patients two days after they completed the NDI-U. The NDI-U was evaluated for factor analysis, content validity, construct validity (discriminative and convergent validity) and responsiveness. An intra-class correlation coefficient (ICC 2,1 ) revealed excellent test-retest reliability for all items (ICC 2,1  = 0.86-0.98) and total scores (ICC 2,1  = 0.99) of the NDI-U. The NDI-U was found internally consistent with a Cronbach's alpha of 0.90 and a fair to good correlation between single items and the NDI-U total scores (r = 0.34 to 0.89). Factor analysis of the NDI-U produced two factors explaining 66.71% of the variance. Content validity was good, as no floor or ceiling effects were detected for the NDI-U total score. To determine discriminative validity, an independent t-test revealed a significant difference in the NDI-U total scores between the patients and healthy controls (P < 0.001). For convergent validity, Pearson's correlation coefficient showed a strong correlation between NDI-U and VAS disability (r = 0.83, P < 0.001) and a moderate correlation between NDI-U and VAS pain (r = 0.62, P < 0.001). To measure responsiveness, an independent t-test showed a significant difference in the NDI-U change scores between the stable and the improved groups (P < 0.001). Furthermore, moderate correlations were found between the NDI-U change scores and the GROC (r = 0.50, P < 0.001), VAS disability change scores (r = 0.58, P < 0.001) and VAS pain change scores (r = 0.55, P < 0.001). The results showed that the NDI-U is a reliable, valid and responsive questionnaire to measure disability in Urdu-speaking patients with CMNP.

Heart rate detection from an electronic weighing scale.

PubMed

González-Landaeta, R; Casas, O; Pallàs-Areny, R

2007-01-01

We propose a novel technique for heart rate detection on a subject that stands on a common electronic weighing scale. The detection relies on sensing force variations related to the blood acceleration in the aorta, works even if wearing footwear, and does not require any sensors attached to the body. We have applied our method to three different weighing scales, and estimated whether their sensitivity and frequency response suited heart rate detection. Scale sensitivities were from 490 nV/V/N to 1670 nV/V/N, all had an underdamped transient response and their dynamic gain error was below 19% at 10 Hz, which are acceptable values for heart rate estimation. We also designed a pulse detection system based on off-the-shelf integrated circuits, whose gain was about 70x10(3) and able to sense force variations about 240 mN. The signal-to-noise ratio (SNR) of the main peaks of the pulse signal detected was higher than 48 dB, which is large enough to estimate the heart rate by simple signal processing methods. To validate the method, the ECG and the force signal were simultaneously recorded on 12 volunteers. The maximal error obtained from heart rates determined from these two signals was +/-0.6 beats/minute.

Adolescent Personality: A Five-Factor Model Construct Validation

ERIC Educational Resources Information Center

Baker, Spencer T.; Victor, James B.; Chambers, Anthony L.; Halverson, Jr., Charles F.

2004-01-01

The purpose of this study was to investigate convergent and discriminant validity of the five-factor model of adolescent personality in a school setting using three different raters (methods): self-ratings, peer ratings, and teacher ratings. The authors investigated validity through a multitrait-multimethod matrix and a confirmatory factor…

Single-joint outcome measures: preliminary validation of patient-reported outcomes and physical examination.

PubMed

Heald, Alison E; Fudman, Edward J; Anklesaria, Pervin; Mease, Philip J

2010-05-01

To assess the validity, responsiveness, and reliability of single-joint outcome measures for determining target joint (TJ) response in patients with inflammatory arthritis. Patient-reported outcomes (PRO), consisting of responses to single questions about TJ global status on a 100-mm visual analog scale (VAS; TJ global score), function on a 100-mm VAS (TJ function score), and pain on a 5-point Likert scale (TJ pain score) were piloted in 66 inflammatory arthritis subjects in a phase 1/2 clinical study of an intraarticular gene transfer agent and compared to physical examination measures (TJ swelling, TJ tenderness) and validated function questionnaires (Disabilities of the Arm, Shoulder and Hand scale, Rheumatoid Arthritis Outcome Score, and the Health Assessment Questionnaire). Construct validity was assessed by evaluating the correlation between the single-joint outcome measures and validated function questionnaires using Spearman's rank correlation. Responsiveness or sensitivity to change was assessed through calculating effect size and standardized response means (SRM). Reliability of physical examination measures was assessed by determining interobserver agreement. The single-joint PRO were highly correlated with each other and correlated well with validated functional measures. The TJ global score exhibited modest effect size and modest SRM that correlated well with the patient's assessment of response on a 100-mm VAS. Physical examination measures exhibited high interrater reliability, but correlated less well with validated functional measures and the patient's assessment of response. Single-joint PRO, particularly the TJ global score, are simple to administer and demonstrate construct validity and responsiveness in patients with inflammatory arthritis. (ClinicalTrials.gov identifier NCT00126724).

Psychometric comparisons of the timed up and go, one-leg stand, functional reach, and Tinetti balance measures in community-dwelling older people.

PubMed

Lin, Mau-Roung; Hwang, Hei-Fen; Hu, Ming-Hsia; Wu, Hong-Dar Isaac; Wang, Yi-Wei; Huang, Fu-Chao

2004-08-01

To compare the practicality, reliability, validity, and responsiveness of the timed up and go (TUG), one-leg stand (OLS), functional reach (FR), and Tinetti balance (TB) performance measures in people aged 65 and older. A prospective study. Shin-Sher Township of Taichung County, west-central Taiwan. Twelve hundred community-dwelling older people. During an initial assessment at their residences, participants were interviewed for demographics, cognition, fall history, use of a walking aid, and activities of daily living (ADLs), in addition to completing the four balance tests. Falls were ascertained by telephone every 3 months for a 1-year follow-up; the four balance measures and ADLs were also reassessed at the end of the follow-up year. Of the four balance measures, the OLS had the lowest participation rate, and participation of people who were cognitively impaired had fallen in the previous year, used a walking aid, or suffered from an ADL disability was lower than for their counterparts. The time to complete the tests ranged from 58 seconds for OLS, to 160 seconds for the TB. All four balance measures exhibited excellent test-retest reliability and discriminant validity but poor responsiveness to fall status. The TB showed better discriminant, convergent, and predictive validities and responsiveness to ADL changes than the other three tests. According to psychometric properties, the most suitable performance measure for evaluating balance in community-dwelling older people was the TB, followed by the TUG.

Judgment skills, a missing component in health literacy: development of a tool for asthma patients in the Italian-speaking region of Switzerland.

PubMed

Moreno Londoño, Ana Maria; Schulz, Peter J

2014-04-01

Health literacy has been recognized as an important factor influencing health behaviors and health outcomes. However, its definition is still evolving, and the tools available for its measurement are limited in scope. Based on the conceptualization of health literacy within the Health Empowerment Model, the present study developed and validated a tool to assess patient's health knowledge use, within the context of asthma self-management. A review of scientific literature on asthma self-management, and several interviews with pulmonologists and asthma patients were conducted. From these, 19 scenarios with 4 response options each were drafted and assembled in a scenario-based questionnaire. Furthermore, a three round Delphi procedure was carried out, to validate the tool with the participation of 12 specialists in lung diseases. The face and content validity of the tool were achieved by face-to-face interviews with 2 pulmonologists and 5 patients. Consensus among the specialists on the adequacy of the response options was achieved after the three round Delphi procedure. The final tool has a 0.97 intra-class correlation coefficient (ICC), indicating a strong level of agreement among experts on the ratings of the response options. The ICC for single scenarios, range from 0.92 to 0.99. The newly developed tool provides a final score representing patient's health knowledge use, based on the specialist's consensus. This tool contributes to enriching the measurement of a more advanced health literacy dimension.

Examination of the Triarchic Assessment Procedure for Inconsistent Responding in six non-English language samples.

PubMed

Kelley, Shannon E; van Dongen, Josanne D M; Donnellan, M Brent; Edens, John F; Eisenbarth, Hedwig; Fossati, Andrea; Howner, Katarina; Somma, Antonella; Sörman, Karolina

2018-05-01

The Triarchic Assessment Procedure for Inconsistent Responding (TAPIR; Mowle et al., 2016) was recently developed to identify inattentiveness or comprehension difficulties that may compromise the validity of responses on the Triarchic Psychopathy Measure (TriPM; Patrick, 2010). The TAPIR initially was constructed and cross-validated using exclusively English-speaking participants from the United States; however, research using the TriPM has been increasingly conducted internationally, with numerous foreign language translations of the measure emerging. The present study examined the cross-language utility of the TAPIR in German, Dutch, Swedish, and Italian translations of the TriPM using 6 archival samples of community members, university students, forensic psychiatric inpatients, forensic detainees, and adolescents residing outside the United States (combined N = 5,404). Findings suggest that the TAPIR effectively detects careless responding across these 4 translated versions of the TriPM without the need for language-specific modifications. The TAPIR total score meaningfully discriminated genuine participant responses from both fully and partially randomly generated data in every sample, and demonstrated further utility in detecting fixed "all true" or "all false" response patterns. In addition, TAPIR scores were reliably associated with inconsistent responding scores from another psychopathy inventory. Specificity for a range of tentative cut scores for assessing profile validity was modestly reduced among our samples relative to rates previously obtained with the English version of the TriPM; however, overall the TAPIR appears to demonstrate satisfactory cross-language generalizability. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Blade loss transient dynamic analysis of turbomachinery

NASA Technical Reports Server (NTRS)

Stallone, M. J.; Gallardo, V.; Storace, A. F.; Bach, L. J.; Black, G.; Gaffney, E. F.

1982-01-01

This paper reports on work completed to develop an analytical method for predicting the transient non-linear response of a complete aircraft engine system due to the loss of a fan blade, and to validate the analysis by comparing the results against actual blade loss test data. The solution, which is based on the component element method, accounts for rotor-to-casing rubs, high damping and rapid deceleration rates associated with the blade loss event. A comparison of test results and predicted response show good agreement except for an initial overshoot spike not observed in test. The method is effective for analysis of large systems.

Feed additive production by fermentation of herb Polygonum hydropiper L. and cassava pulp with simultaneous flavonoid dissolution.

PubMed

Song, Zhen-Tao; Zhu, Ming-Jun

2017-03-01

Fermentation of herb Polygonum hydropiper L. (PHL) and cassava pulp (CP) for feed additive production with simultaneous flavonoid dissolution was investigated, and a two-stage response surface methodology (RSM) based on Plackett-Burman factorial design (PB design) was used to optimize the flavonoid dissolution and protein content. Using the screening function of PB design, four different significant factors for the two response variables were acquired: factors A (CP) and B (PHL) for the flavonoid dissolution versus factors G (inoculum size) and H (fermentation time) for protein content. Then, two RSMs were used sequentially to improve the values of the two response variables separately. The mutual corroboration of the experimental results in the present study confirmed the validity of the associated experimental design. The validation experiment showed a flavonoid dissolution rate of 94.00%, and a protein content of 18.20%, gaining an increase in 21.20% and 199.10% over the control, respectively. The present study confirms the feasibility of feed additive production by Saccharomyces cerevisiae with CP and PHL and simultaneous optimization of flavonoid dissolution and protein content using a two-stage RSM. © 2016 International Union of Biochemistry and Molecular Biology, Inc.

[Job stress and quality of life of primary care health-workers: evidence of validity of the PECVEC questionnaire].

PubMed

Fernández-López, Juan Antonio; Fernández-Fidalgo, María; Martín-Payo, Rubén; Rödel, Andreas

2007-08-01

To evaluate the relationship between Health-Related Quality of Life (HRQL) and stress at work among Primary Care workers, as evidence of the construct validity of the Spanish version (PECVEC) of the profile of quality of life in the chronically ill (PLC) questionnaire. In addition, to check its other psychometric properties. Cross-sectional study. Eighteen primary care centres in Health Area IV, Asturias (Oviedo), Spain, sharing similar socio-demographic conditions. Two hundred and thirty-three primary care nurses and physicians. HRQL was evaluated by the 6 general dimensions of the Spanish version of the PLC. Stress at work was evaluated by the three scales of the Effort-Reward Imbalance (ERI) questionnaire. The construct validity of the PECVEC was assessed by testing the inverse associations of QoL dimensions and job stress ones, when the most important confuser variables were monitored. The non-response rate was low (<3%), and no floor effects and only small ceiling effects were observed. Internal consistency analysis and exploratory and confirmatory factor analysis demonstrated high reliability, factorial validity and convergent/divergent validity of the PECVEC. The PECVEC demonstrates adequate psychometric properties for evaluating HRQL in healthy subjects.

[Methodological design of the National Health and Nutrition Survey 2016].

PubMed

Romero-Martínez, Martín; Shamah-Levy, Teresa; Cuevas-Nasu, Lucía; Gómez-Humarán, Ignacio Méndez; Gaona-Pineda, Elsa Berenice; Gómez-Acosta, Luz María; Rivera-Dommarco, Juan Ángel; Hernández-Ávila, Mauricio

2017-01-01

Describe the design methodology of the halfway health and nutrition national survey (Ensanut-MC) 2016. The Ensanut-MC is a national probabilistic survey whose objective population are the inhabitants of private households in Mexico. The sample size was determined to make inferences on the urban and rural areas in four regions. Describes main design elements: target population, topics of study, sampling procedure, measurement procedure and logistics organization. A final sample of 9 479 completed household interviews, and a sample of 16 591 individual interviews. The response rate for households was 77.9%, and the response rate for individuals was 91.9%. The Ensanut-MC probabilistic design allows valid statistical inferences about interest parameters for Mexico´s public health and nutrition, specifically on overweight, obesity and diabetes mellitus. Updated information also supports the monitoring, updating and formulation of new policies and priority programs.

On the validity and robustness of the scale error phenomenon in early childhood.

PubMed

DeLoache, Judy S; LoBue, Vanessa; Vanderborght, Mieke; Chiong, Cynthia

2013-02-01

Scale errors is a term referring to very young children's serious efforts to perform actions on miniature replica objects that are impossible due to great differences in the size of the child's body and the size of the target objects. We report three studies providing further documentation of scale errors and investigating the validity and robustness of the phenomenon. In the first, we establish that 2-year-olds' behavior in response to prompts to "pretend" with miniature replica objects differs dramatically from scale errors. The second and third studies address the robustness of the phenomenon and its relative imperviousness to attempts to influence the rate of scale errors. Copyright © 2012 Elsevier Inc. All rights reserved.

Validity of using a work habits scale for the daily evaluation of nurse anesthetists' clinical performance while controlling for the leniencies of the rating anesthesiologists.

PubMed

Dexter, Franklin; Ledolter, Johannes; Hindman, Bradley J

2017-11-01

Anesthesiologists can provide psychometrically reliable daily evaluations of certified registered nurse anesthetist (CRNA) work habits for purposes of the mandatory ongoing professional practice evaluation (OPPE). Our goal was to evaluate the validity of assessing CRNA work habits. Observational study. Large teaching hospital. N=77 anesthesiologists evaluated work habits of N=67 CRNAs. The non-technical attribute of work habits was measured on a 6-item scale (e.g., 1="Only assumed responsibility when forced to, and failed to follow through consistently" versus 5="Consistently identified tasks and completed them efficiently and thoroughly"). One year of scores were used to assess validity. Each daily evaluation could also be accompanied by a written comment. Content analysis of comments was performed using two years of data. Statistical analyses were performed using mixed effects logistic regression, treating each anesthesiologist as a fixed effect to compensate for the leniency of their ratings. The N=77 anesthesiologists' response rate was 97.3%, obtained at a mean 2.93days after the request. The internal consistency of the scale was large: Cronbach's alpha 0.952. Controlling the false discovery rate at 5.0%, among the 67 CRNAs, 8 were significantly below average (each P≤0.0048) and 6 were above average (each P≤0.0018). During the 6months after CRNAs knew that their work habits scores would be used for OPPE, there were significant increases in the scores compared with the preceding 6months (odds ratio 1.93, P<0.0001). Greater CRNA's qualitative annual evaluation scores made by the chief CRNA, without knowledge of the work habit scores or comments, were associated with greater odds of the CRNA's leniency-adjusted work habit scores equaling 5.00 (odds ratio 1.53, P=0.0004). Comments of negative sentiment made by the anesthesiologists were associated with greater odds of the leniency-adjusted work habit scores being <5.00 (odds ratio 54.5, P<0.0001). Even though the anesthesiologists were already providing information about work habits using the work habits scale, approximately half the comments of negative sentiment included the theme of work habits (92/153, 60.1%). Reporting OPPE metrics are mandatory for the maintenance of clinical privileges of anesthesia practitioners in the USA. Basing such peer review on work habits can be quantitative, psychometrically reliable, and valid. Copyright © 2017 Elsevier Inc. All rights reserved.

On the validity of measuring change over time in routine clinical assessment: a close examination of item-level response shifts in psychosomatic inpatients.

PubMed

Nolte, S; Mierke, A; Fischer, H F; Rose, M

2016-06-01

Significant life events such as severe health status changes or intensive medical treatment often trigger response shifts in individuals that may hamper the comparison of measurements over time. Drawing from the Oort model, this study aims at detecting response shift at the item level in psychosomatic inpatients and evaluating its impact on the validity of comparing repeated measurements. Complete pretest and posttest data were available from 1188 patients who had filled out the ICD-10 Symptom Rating (ISR) scale at admission and discharge, on average 24 days after intake. Reconceptualization, reprioritization, and recalibration response shifts were explored applying tests of measurement invariance. In the item-level approach, all model parameters were constrained to be equal between pretest and posttest. If non-invariance was detected, these were linked to the different types of response shift. When constraining across-occasion model parameters, model fit worsened as indicated by a significant Satorra-Bentler Chi-square difference test suggesting potential presence of response shifts. A close examination revealed presence of two types of response shift, i.e., (non)uniform recalibration and both higher- and lower-level reconceptualization response shifts leading to four model adjustments. Our analyses suggest that psychosomatic inpatients experienced some response shifts during their hospital stay. According to the hierarchy of measurement invariance, however, only one of the detected non-invariances is critical for unbiased mean comparisons over time, which did not have a substantial impact on estimating change. Hence, the use of the ISR can be recommended for outcomes assessment in clinical routine, as change score estimates do not seem hampered by response shift effects.

Measurement properties of the English and Chinese versions of the Functional Assessment of Cancer Therapy-Breast (FACT-B) in Asian breast cancer patients.

PubMed

Ng, Raymond; Lee, Chun Fan; Wong, Nan Soon; Luo, Nan; Yap, Yoon Sim; Lo, Soo Kien; Chia, Whay Kuang; Yee, Alethea; Krishna, Lalit; Goh, Cynthia; Cheung, Yin Bun

2012-01-01

The objective of the study was to examine the measurement properties of and comparability between the English and Chinese versions of the Functional Assessment of Cancer Therapy-Breast (FACT-B) in breast cancer patients in Singapore. This is an observational study of 271 Singaporean breast cancer patients. The known-group validity of FACT-B total score and Trial Outcome Index (TOI) were assessed in relation to performance status, evidence of disease, and treatment status cross-sectionally; responsiveness to change was assessed in relation to change in performance status longitudinally. Internal consistency and test-retest reliability were evaluated by the Cronbach's alpha and intraclass correlation coefficient (ICC), respectively. Multiple regression analyses were performed to compare the scores on the two language versions, adjusting for covariates. The FACT-B total score and TOI demonstrated known-group validity in differentiating patients with different clinical status. They showed high internal consistency and test-retest reliability, with Cronbach's alpha ranging from 0.87 to 0.91 and ICC ranging from 0.82 to 0.89. The English version was responsive to the change in performance status. The Chinese version was shown to be responsive to decline in performance status but the sample size of Chinese-speaking patients who improved in performance status was too small (N = 6) for conclusive analysis about responsiveness to improvement. Two items concerning sexuality had a high item non-response rate (50.2 and 14.4%). No practically significant difference was found in the total score and TOI between the two language versions despite minor differences in two of the 37 items. The English and Chinese versions of the FACT-B are valid, responsive, and reliable instruments in assessing health-related quality of life in breast cancer patients in Singapore. Data collected from the English and Chinese versions can be pooled and either version could be used for bilingual patients.

The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study.

PubMed

Mokkink, Lidwine B; Terwee, Caroline B; Patrick, Donald L; Alonso, Jordi; Stratford, Paul W; Knol, Dirk L; Bouter, Lex M; de Vet, Henrica C W

2010-05-01

Aim of the COSMIN study (COnsensus-based Standards for the selection of health status Measurement INstruments) was to develop a consensus-based checklist to evaluate the methodological quality of studies on measurement properties. We present the COSMIN checklist and the agreement of the panel on the items of the checklist. A four-round Delphi study was performed with international experts (psychologists, epidemiologists, statisticians and clinicians). Of the 91 invited experts, 57 agreed to participate (63%). Panel members were asked to rate their (dis)agreement with each proposal on a five-point scale. Consensus was considered to be reached when at least 67% of the panel members indicated 'agree' or 'strongly agree'. Consensus was reached on the inclusion of the following measurement properties: internal consistency, reliability, measurement error, content validity (including face validity), construct validity (including structural validity, hypotheses testing and cross-cultural validity), criterion validity, responsiveness, and interpretability. The latter was not considered a measurement property. The panel also reached consensus on how these properties should be assessed. The resulting COSMIN checklist could be useful when selecting a measurement instrument, peer-reviewing a manuscript, designing or reporting a study on measurement properties, or for educational purposes.

Preliminary validation of the Yale Food Addiction Scale.

PubMed

Gearhardt, Ashley N; Corbin, William R; Brownell, Kelly D

2009-04-01

Previous research has found similarities between addiction to psychoactive substances and excessive food consumption. Further exploration is needed to evaluate the concept of "food addiction," as there is currently a lack of psychometrically validated measurement tools in this area. The current study represents a preliminary exploration of the Yale Food Addiction Scale (YFAS), designed to identify those exhibiting signs of addiction towards certain types of foods (e.g., high fat and high sugar). Survey data were collected from 353 respondents from a stratified random sample of young adults. In addition to the YFAS, the survey assessed eating pathology, alcohol consumption and other health behaviors. The YFAS exhibited adequate internal reliability, and showed good convergent validity with measures of similar constructs and good discriminant validity relative to related but dissimilar constructs. Additionally, the YFAS predicted binge-eating behavior above and beyond existing measures of eating pathology, demonstrating incremental validity. The YFAS is a sound tool for identifying eating patterns that are similar to behaviors seen in classic areas of addiction. Further evaluation of the scale is needed, especially due to a low response rate of 24.5% and a non-clinical sample, but confirmation of the reliability and validity of the scale has the potential to facilitate empirical research on the concept of "food addiction".

Comprehension of Japanese oral care-related terms among caregivers and nurses, as assessed using a newly developed instrument.

PubMed

Shibata, Satoko; Stegaroiu, Roxana; Nakazawa, Akari; Ohuchi, Akitsugu

2017-03-01

(i) To assess comprehension of oral care-related terms among caregivers and nurses working at long-term care facilities, using a newly developed test; (ii) to analyse the effect of participant characteristics on their comprehension. Effective mutual communication between dental professionals and caregivers/nurses is essential for providing information on daily oral care for institutionalised elders. A 36-item word-knowledge test in Japanese was developed to assess comprehension of oral care-related terms. The test was administered to a convenience sample of 236 nursing staff (198 caregivers and 38 nurses) at six long-term care facilities in Niigata City, Japan, and its reliability and validity were verified. Associations of participant characteristics with their responses were investigated by multiple regression analysis. Mean percentage of correct responses (accuracy rate) for nursing staff was approximately 62% (highest for oral care products and lowest for prosthodontic terms). Test internal reliability was high (Cronbach's alpha >0.8). Concurrent validity (test ability to distinguish between characteristically different groups) was confirmed. Mean accuracy rate was significantly higher among nurses (78.5 ± 19.3%) than among caregivers (58.7 ± 22.8%), and among respondents with interest in oral care (64.2 ± 21.1%) than among those with no such interest (51.5 ± 28.9%). The word-knowledge test was valid and reliable for nursing staff of six long-term care facilities in Niigata City. Their comprehension was low for perioral and intraoral structures, related symptom and disease names, and prosthodontics terms related to oral care. Understanding of oral care-related terms among the nursing staff was related to their occupation and interest in oral care. © 2016 John Wiley & Sons A/S and The Gerodontology Association. Published by John Wiley & Sons Ltd.

A Measure of Barriers Toward Medical Disclosure Among Health Professionals in the United Arab Emirates.

PubMed

Zaghloul, Ashraf Ahmad; Elsergany, Moetaz; Mosallam, Rasha

2018-03-01

There has been a growing awareness that patients are subject to injuries that can be prevented as a direct consequence of health care. Error disclosure is an effective technique to restore the lost trust with the health care system. The current study aimed to develop a valid and reliable scale to determine the factors facilitating the disclosure of health professionals in health organizations. This study had a cross-sectional design that consisted of 722 responses (response rate of 68.3%) from 1 private and 1 public hospital in Sharjah, United Arab Emirates. The data collection tool included 23 items rated on a Likert scale ranging from 5, strongly agree, to 1, strongly disagree.The internal consistency was established through calculating the split-half reliability for part 1 (12 items), which had a Cronbach coefficient of 0.65, and part 2 (11 items), which had a Cronbach coefficient of 0.62. Scale validity was assessed with the Kaiser-Meyer-Olkin measure of sampling adequacy, which had a value of 0.62, and the Bartlett test of sphericity (approximated χ = 13012.2, P = 0.0001) supported the factorability of the correlation matrix. The varimax rotation revealed 5 components that explained 77.8% of the total variance. The varimax rotation revealed 21 items loaded on the following 5 factors: fear of disclosure and provider image consequences (factor 1), apology (factor 2), organizational culture toward patient safety (factor 3), professional ethics and transparency (factor 4), as well as patient and provider education (factor 5). The disclosure of medical mistakes requires preliminary considerations to effectively and compassionately disclose these events to patients. The validity and reliability of the results support the use of this scale at hospitals as part of the health care providers' disclosure processes.

Comparing UK, USA and Australian values for EQ-5D as a health utility measure of oral health.

PubMed

Brennan, D S; Teusner, D N

2015-09-01

Using generic measures to examine outcomes of oral disorders can add additional information relating to health utility. However, different algorithms are available to generate health states. The aim was to assess UK-, US- and Australian-based algorithms for the EuroQol (EQ-5D) in relation to their discriminative and convergent validity. Methods: Data were collected from adults in Australia aged 30-61 years by mailed survey in 2009-10, including the EQ-5D and a range of self-reported oral health variables, and self-rated oral and general health. Responses were collected from n=1,093 persons (response rate 39.1%). UK-based EQ-5D estimates were lower (0.85) than the USA and Australian estimates (0.91). EQ-5D was associated (p<0.01) with all seven oral health variables, with differences in utility scores ranging from 0.03 to 0.06 for the UK, from 0.04 to 0.07 for the USA, and from 0.05 to 0.08 for the Australian-based estimates. The effect sizes (ESs) of the associations with all seven oral health variables were similar for the UK (ES=0.26 to 0.49), USA (ES=0.31 to 0.48) and Australian-based (ES=0.31 to 0.46) estimates. EQ-5D was correlated with global dental health for the UK (rho=0.29), USA (rho=0.30) and Australian-based estimates (rho=0.30), and correlations with global general health were the same (rho=0.42) for the UK, USA and Australian-based estimates. EQ-5D exhibited equivalent discriminative validity and convergent validity in relation to oral health variables for the UK, USA and Australian-based estimates.

Identification of potential transcriptomic markers in developing pediatric sepsis: a weighted gene co-expression network analysis and a case-control validation study.

PubMed

Li, Yiping; Li, Yanhong; Bai, Zhenjiang; Pan, Jian; Wang, Jian; Fang, Fang

2017-12-13

Sepsis represents a complex disease with the dysregulated inflammatory response and high mortality rate. The goal of this study was to identify potential transcriptomic markers in developing pediatric sepsis by a co-expression module analysis of the transcriptomic dataset. Using the R software and Bioconductor packages, we performed a weighted gene co-expression network analysis to identify co-expression modules significantly associated with pediatric sepsis. Functional interpretation (gene ontology and pathway analysis) and enrichment analysis with known transcription factors and microRNAs of the identified candidate modules were then performed. In modules significantly associated with sepsis, the intramodular analysis was further performed and "hub genes" were identified and validated by quantitative real-time PCR (qPCR) in this study. 15 co-expression modules in total were detected, and four modules ("midnight blue", "cyan", "brown", and "tan") were most significantly associated with pediatric sepsis and suggested as potential sepsis-associated modules. Gene ontology analysis and pathway analysis revealed that these four modules strongly associated with immune response. Three of the four sepsis-associated modules were also enriched with known transcription factors (false discovery rate-adjusted P < 0.05). Hub genes were identified in each of the four modules. Four of the identified hub genes (MYB proto-oncogene like 1, killer cell lectin like receptor G1, stomatin, and membrane spanning 4-domains A4A) were further validated to be differentially expressed between septic children and controls by qPCR. Four pediatric sepsis-associated co-expression modules were identified in this study. qPCR results suggest that hub genes in these modules are potential transcriptomic markers for pediatric sepsis diagnosis. These results provide novel insights into the pathogenesis of pediatric sepsis and promote the generation of diagnostic gene sets.

Dynamically tracking anxious individuals' affective response to valenced information.

PubMed

Fua, Karl C; Teachman, Bethany A

2017-09-01

Past research has shown that an individual's feelings at any given moment reflect currently experienced stimuli as well as internal representations of similar past experiences. However, anxious individuals' affective reactions to streams of interrelated valenced information (vs. reactions to static stimuli that are arguably less ecologically valid) are rarely tracked. The present study provided a first examination of the newly developed Tracking Affect Ratings Over Time (TAROT) task to continuously assess anxious individuals' affective reactions to streams of information that systematically change valence. Undergraduate participants (N = 141) completed the TAROT task in which they listened to narratives containing positive, negative, and neutral physically- or socially-relevant events, and indicated how positive or negative they felt about the information they heard as each narrative unfolded. The present study provided preliminary evidence for the validity and reliability of the task. Within scenarios, participants higher (vs. lower) in anxiety showed many expected negative biases, reporting more negative mean ratings and overall summary ratings, changing their pattern of responding more quickly to negative events, and responding more negatively to neutral events. Furthermore, individuals higher (vs. lower) in anxiety tended to report more negative minimums during and after positive events, and less positive maximums after negative events. Together, findings indicate that positive events were less impactful for anxious individuals, whereas negative experiences had a particularly lasting impact on future affective responses. The TAROT task is able to efficiently capture a number of different cognitive biases, and may help clarify the mechanisms that underlie anxious individuals' biased negative processing. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Effects of a Financial Incentive on Health Researchers’ Response to an Online Survey: a Randomized Controlled Trial

PubMed Central

Petticrew, Mark; Calnan, Mike; Nazareth, Irwin

2010-01-01

Background Nonresponse to questionnaires can affect the validity of surveys and introduce bias. Offering financial incentives can increase response rates to postal questionnaires, but the effect of financial incentives on response rates to online surveys is less clear. Objective As part of a survey, we aimed to test whether knowledge of a financial incentive would increase the response rate to an online questionnaire. Methods A randomized controlled trial of 485 UK-based principal investigators of publicly funded health services and population health research. Participants were contacted by email and invited to complete an online questionnaire via an embedded URL. Participants were randomly allocated to groups with either “knowledge of” or “no knowledge of” a financial incentive (£10 Amazon gift voucher) to be provided on completion of the survey. At the end of the study, gift vouchers were given to all participants who completed the questionnaire regardless of initial randomization status. Four reminder emails (sent from the same email address as the initial invitation) were sent out to nonrespondents at one, two, three, and four weeks; a fifth postal reminder was also undertaken. The primary outcome measure for the trial was the response rate one week after the second reminder. Response rate was also measured at the end of weeks one, two, three, four, and five, and after a postal reminder was sent. Results In total, 243 (50%) questionnaires were returned (232 completed, 11 in which participation was declined). One week after the second reminder, the response rate in the “knowledge” group was 27% (66/244) versus 20% (49/241) in the “no knowledge” group (χ21 = 3.0, P = .08). The odds ratio for responding among those with knowledge of an incentive was 1.45 (95% confidence interval [CI] 0.95 - 2.21). At the third reminder, participants in the “no knowledge” group were informed about the incentive, ending the randomized element of the study. However we continued to follow up all participants, and from reminder three onwards, no significant differences were observed in the response rates of the two groups. Conclusions Knowledge of a financial incentive did not significantly increase the response rate to an online questionnaire. Future surveys should consider including a randomized element to further test the utility of offering incentives of other types and amounts to participate in online questionnaires. Trial Registration ISRCTN59912797; http://www.controlled-trials.com/ISRCTN59912797 (Archived by WebCite at http://www.webcitation.org/5iPPLbT7s) PMID:20457556

First Spanish version of the Memorial Delirium Assessment Scale: psychometric properties, responsiveness, and factor loadings.

PubMed

Noguera, Antonio; Carvajal, Ana; Alonso-Babarro, Alberto; Chisholm, Gary; Bruera, Eduardo; Centeno, Carlos

2014-01-01

The Memorial Delirium Assessment Scale (MDAS) is a reliable and validated instrument with which to assess delirium. However, MDAS responsiveness has only been investigated in an indirect way. Also, neurobehavioral and global cognitive factors seem to be the MDAS main factor loads. The primary objective of this study was to evaluate MDAS responsiveness and analyze individual factors on this scale. The secondary objective was to confirm concurrent validity and reliability of the Spanish version of the MDAS. The translation-back translation method was used to obtain the Spanish version of the MDAS. Delirium diagnosis was determined by the clinical Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision criteria and with the Confusion Assessment Method. Responsiveness and factor loadings were determined with the Delirium Rating Scale-Revised-98, the Mini-Mental State Examination (MMSE), and the MDAS at baseline (0 hours) and at 72 hours. Variation in the scores of the Delirium Rating Scale-Revised-98 shows a correlation of r = 0.93, with variation in MDAS scores at P < 0.001. Variation in MMSE scores shows a correlation of r = -0.84, with variation in MDAS scores at P = 0.015. Factor I, neurobehavioral (reduced awareness, reduced attention, perceptual disturbance, delusions, altered psychomotor activity, and sleep-wake cycle disturbance), correlated moderately with the MMSE at -0.56. Factor II, global cognitive (disorientation, short-term memory impairment, impaired digit span, and disorganized thinking), correlated strongly with the MMSE at -0.81. Factor II was significantly more reliable than Factor I, rho = 0.7, P = 0.01. The high responsiveness confirms the value of the MDAS for ongoing delirium assessment. Two differentiated factor loadings point to a potential future need for MDAS subscales. Copyright © 2014 U.S. Cancer Pain Relief Committee. All rights reserved.

Validity of the Children's Orientation to Book Reading Rating Scale

ERIC Educational Resources Information Center

Kaderavek, Joan N.; Guo, Ying; Justice, Laura M.

2014-01-01

The present study investigates the validity of a 4-point rating scale used to measure the level of preschool children's orientation to literacy during shared book reading. Validity was explored by (a) comparing the children's level of literacy orientation as measured with the "Children's Orientation to Book Reading Rating Scale" (COB)…

A pilot study on the validity of using pictures and videos for individualized symptom provocation in obsessive-compulsive disorder.

PubMed

Simon, Daniela; Kischkel, Eva; Spielberg, Rüdiger; Kathmann, Norbert

2012-06-30

Distressing symptom-related anxiety is difficult to study in obsessive-compulsive disorder (OCD) due to the disorder's heterogeneity. Our aim was to develop and validate a set of pictures and films comprising a variety of prominent OCD triggers that can be used for individually tailored symptom provocation in experimental studies. In a two-staged production procedure a large pool of OCD triggers and neutral contents was produced and preselected by three psychotherapists specialized in OCD. A sample of 13 OCD patients and 13 controls rated their anxiety, aversiveness and arousal during exposure to OCD-relevant, aversive and neutral control stimuli. Our findings demonstrate differences between the responses of patients and controls to OCD triggers only. Symptom-related anxiety was stronger in response to dynamic compared with static OCD-relevant stimuli. Due to the small number of 13 patients included in the study, only tentative conclusions can be drawn and this study merely provides a first step of validation. These standardized sets constitute valuable tools that can be used in experimental studies on the brain correlates of OCD symptoms and for the study of therapeutic interventions in order to contribute to future developments in the field. Copyright © 2012 Elsevier Ltd. All rights reserved.

Validating indicators of treatment response: application to trichotillomania.

PubMed

Nelson, Samuel O; Rogers, Kate; Rusch, Natalie; McDonough, Lauren; Malloy, Elizabeth J; Falkenstein, Martha J; Banis, Maria; Haaga, David A F

2014-09-01

Different studies of the treatment of trichotillomania (TTM) have used varying standards to determine the proportion of patients who obtain clinically meaningful benefits, but there is little information on the similarity of results yielded by these methods or on their comparative validity. Data from a stepped-care (Step 1: Web-based self-help; Step 2: Individual behavior therapy; N = 60) treatment study of TTM were used to evaluate 7 potential standards: complete abstinence, ≥ 25% symptom reduction, recovery of normal functioning, and clinical significance (recovery + statistically reliable change), each of the last 3 being measured by self-report (Massachusetts General Hospital Hairpulling Scale; MGH-HPS) or interview (Psychiatric Institute Trichotillomania Scale). Depending on the metric, response rates ranged from 25 to 68%. All standards were significantly associated with one another, though less strongly for the 25% symptom reduction metrics. Concurrent (with deciding to enter Step 2 treatment) and predictive (with 3-month follow-up treatment satisfaction, TTM-related impairment, quality of life, and diagnosis) validity results were variable but generally strongest for clinical significance as measured via self-report. Routine reporting of the proportion of patients who make clinically significant improvement on the MGH-HPS, supplemented by data on complete abstinence, would bolster the interpretability of TTM treatment outcome findings. PsycINFO Database Record (c) 2014 APA, all rights reserved.

Assessing the limitations of the existing physician directory for measuring electronic health record (EHR) adoption rates among physicians in Connecticut, USA: cross-sectional study.

PubMed

Tikoo, Minakshi

2012-01-01

To assess the limitations of the existing physician directory in measuring electronic health record adoption rates among a cohort of Connecticut physicians. A population-based mailing assessed the number of physicians practising in Connecticut. Information about practice site, practises pertaining to storing of patient information, sources of revenue and preferred method for receiving survey. Practice status in Connecticut, measured by yes and no. Demographic information was collected on gender, year of birth, race and ethnicity. The response rate for the postcard mailing was 19% (3105/16 462). Of the 16 462 unduplicated consumers, 233 (1%) were retired and 5828 (35%) did not practise in Connecticut. Of the 3105 valid postcard responses we received, 2159 were for physicians practising in Connecticut. Nine (0.4%) of these responses did not specify a preferred method for receiving the full physician survey; 91 physicians refused to participate in the survey; 2159 surveys were sent out using each physician's requested method for receiving the survey, that is, web-based, regular mail or telephone. As of August 2012, 898 physicians had returned surveys, resulting in a response rate of 42%. The postcard response rate based on the unduplicated lists adjusted for exclusions, such as death, retired and do not practise in Connecticut, is 30%, which is low. We may be missing physicians' population which could greatly affect the indicators being used to measure change in electronic health record adoption rates. It is difficult to obtain an accurate physician count of practising physicians in Connecticut from the existing lists. States that are participating in the projects funded under various Office of the National Coordinator for Health Information Technology (ONC) initiatives must focus on getting an accurate count of the physicians practising in their state, since their progress is being measured based on this key number.

An Application of Practical Strategies in Assessing the Criterion-Related Validity of Credentialing Examinations.

ERIC Educational Resources Information Center

Fidler, James R.

1993-01-01

Criterion-related validities of 2 laboratory practitioner certification examinations for medical technologists (MTs) and medical laboratory technicians (MLTs) were assessed for 81 MT and 70 MLT examinees. Validity coefficients are presented for both measures. Overall, summative ratings yielded stronger validity coefficients than ratings based on…

Development and Validation of the Physics Anxiety Rating Scale

ERIC Educational Resources Information Center

Sahin, Mehmet; Caliskan, Serap; Dilek, Ufuk

2015-01-01

This study reports the development and validation process for an instrument to measure university students' anxiety in physics courses. The development of the Physics Anxiety Rating Scale (PARS) included the following steps: Generation of scale items, content validation, construct validation, and reliability calculation. The results of construct…

Identifying developmental coordination disorder: MOQ-T validity as a fast screening instrument based on teachers' ratings and its relationship with praxic and visuospatial working memory deficits.

PubMed

Giofrè, David; Cornoldi, Cesare; Schoemaker, Marina M

2014-12-01

The present study was devoted to test the validity of the Italian adaptation of the Motor Observation Questionnaire for Teachers (MOQ-T, Schoemaker, Flapper, Reinders-Messelink, & De Kloet, 2008) as a fast screening instrument, based on teachers' ratings, for detecting developmental coordination disorders symptoms and to study its relationship with praxic and visuospatial working memory deficits. In a first study on a large sample of children, we assessed the reliability and structure of the Italian adaptation of the MOQ-T. Results showed a good reliability of the questionnaire and a hierarchical structure with two first-order factors (reflecting motor and handwriting skills), which are influenced by a second-order factor (general motor function) at the top. In a second study, we looked at the external validity of the MOQ-T and found that children with symptoms of Developmental Coordination Disorder (children with high scores on the MOQ-T) also had difficulty reproducing gestures, either imitating others or in response to verbal prompts. Our results also showed that children with high MOQ-T scores had visuospatial WM impairments. The theoretical and clinical implications of these findings are discussed. Copyright © 2014 Elsevier Ltd. All rights reserved.

Fractional viscoelasticity of soft elastomers and auxetic foams

NASA Astrophysics Data System (ADS)

Solheim, Hannah; Stanisauskis, Eugenia; Miles, Paul; Oates, William

2018-03-01

Dielectric elastomers are commonly implemented in adaptive structures due to their unique capabilities for real time control of a structure's shape, stiffness, and damping. These active polymers are often used in applications where actuator control or dynamic tunability are important, making an accurate understanding of the viscoelastic behavior critical. This challenge is complicated as these elastomers often operate over a broad range of deformation rates. Whereas research has demonstrated success in applying a nonlinear viscoelastic constitutive model to characterize the behavior of Very High Bond (VHB) 4910, robust predictions of the viscoelastic response over the entire range of time scales is still a significant challenge. An alternative formulation for viscoelastic modeling using fractional order calculus has shown significant improvement in predictive capabilities. While fractional calculus has been explored theoretically in the field of linear viscoelasticity, limited experimental validation and statistical evaluation of the underlying phenomena have been considered. In the present study, predictions across several orders of magnitude in deformation rates are validated against data using a single set of model parameters. Moreover, we illustrate the fractional order is material dependent by running complementary experiments and parameter estimation on the elastomer VHB 4949 as well as an auxetic foam. All results are statistically validated using Bayesian uncertainty methods to obtain posterior densities for the fractional order as well as the hyperelastic parameters.

The Role of Psychometric Modeling in Test Validation: An Application of Multidimensional Item Response Theory

ERIC Educational Resources Information Center

Schilling, Stephen G.

2007-01-01

In this paper the author examines the role of item response theory (IRT), particularly multidimensional item response theory (MIRT) in test validation from a validity argument perspective. The author provides justification for several structural assumptions and interpretations, taking care to describe the role he believes they should play in any…

Convergence among Data Sources, Response Bias, and Reliability and Validity of a Structured Job Analysis Questionnaire.

ERIC Educational Resources Information Center

Smith, Jack E.; Hakel, Milton D.

1979-01-01

Examined are questions pertinent to the use of the Position Analysis Questionnaire: Who can use the PAQ reliably and validly? Must one rely on trained job analysts? Can people having no direct contact with the job use the PAQ reliably and validly? Do response biases influence PAQ responses? (Author/KC)

Validating the European Health Literacy Survey Questionnaire in people with type 2 diabetes: Latent trait analyses applying multidimensional Rasch modelling and confirmatory factor analysis.

PubMed

Finbråten, Hanne Søberg; Pettersen, Kjell Sverre; Wilde-Larsson, Bodil; Nordström, Gun; Trollvik, Anne; Guttersrud, Øystein

2017-11-01

To validate the European Health Literacy Survey Questionnaire (HLS-EU-Q47) in people with type 2 diabetes mellitus. The HLS-EU-Q47 latent variable is outlined in a framework with four cognitive domains integrated in three health domains, implying 12 theoretically defined subscales. Valid and reliable health literacy measurers are crucial to effectively adapt health communication and education to individuals and groups of patients. Cross-sectional study applying confirmatory latent trait analyses. Using a paper-and-pencil self-administered approach, 388 adults responded in March 2015. The data were analysed using the Rasch methodology and confirmatory factor analysis. Response violation (response dependency) and trait violation (multidimensionality) of local independence were identified. Fitting the "multidimensional random coefficients multinomial logit" model, 1-, 3- and 12-dimensional Rasch models were applied and compared. Poor model fit and differential item functioning were present in some items, and several subscales suffered from poor targeting and low reliability. Despite multidimensional data, we did not observe any unordered response categories. Interpreting the domains as distinct but related latent dimensions, the data fit a 12-dimensional Rasch model and a 12-factor confirmatory factor model best. Therefore, the analyses did not support the estimation of one overall "health literacy score." To support the plausibility of claims based on the HLS-EU score(s), we suggest: removing the health care aspect to reduce the magnitude of multidimensionality; rejecting redundant items to avoid response dependency; adding "harder" items and applying a six-point rating scale to improve subscale targeting and reliability; and revising items to improve model fit and avoid bias owing to person factors. © 2017 John Wiley & Sons Ltd.

Affective stress responses during leisure time: Validity evaluation of a modified version of the Stress-Energy Questionnaire.

PubMed

Hadžibajramović, Emina; Ahlborg, Gunnar; Håkansson, Carita; Lundgren-Nilsson, Åsa; Grimby-Ekman, Anna

2015-12-01

Psychosocial stress at work is one of the most important factors behind increasing sick-leave rates. In addition to work stressors, it is important to account for non-work-related stressors when assessing stress responses. In this study, a modified version of the Stress-Energy Questionnaire (SEQ), the SEQ during leisure time (SEQ-LT) was introduced for assessing the affective stress response during leisure time. The aim of this study was to investigate the internal construct validity of the SEQ-LT. A second aim was to define the cut-off points for the scales, which could indicate high and low levels of leisure-time stress and energy, respectively. Internal construct validity of the SEQ-LT was evaluated using a Rasch analysis. We examined the unidimensionality and other psychometric properties of the scale by the fit to the Rasch model. A criterion-based approach was used for classification into high and low stress/energy levels. The psychometric properties of the stress and energy scales of the SEQ-LT were satisfactory, having accommodated for local dependency. The cut-off point for low stress was proposed to be in the interval between 2.45 and 3.02 on the Rasch metric score; while for high stress, it was between 3.65 and 3.90. The suggested cut-off points for the low and high energy levels were values between 1.73-1.97 and 2.66-3.08, respectively. The stress and energy scale of the SEQ-LT satisfied the measurement criteria defined by the Rasch analysis and it provided a useful tool for non-work-related assessment of stress responses. We provide guidelines on how to interpret the scale values. © 2015 the Nordic Societies of Public Health.

Measurement properties, feasibility and clinical utility of the Doloplus-2 pain scale in older adults with cognitive impairment: a systematic review.

PubMed

Rostad, Hanne Marie; Utne, Inger; Grov, Ellen Karine; Puts, Martine; Halvorsrud, Liv

2017-11-02

The Doloplus-2 is a pain assessment scale for assessing pain in older adults with cognitive impairment. It is used in clinical practice and research. However, evidence for its measurement properties, feasibility and clinical utility remain incomplete. This systematic review synthesizes previous research on the measurement properties, feasibility and clinical utility of the scale. We conducted a systematic search in three databases (CINAHL, Medline and PsycINFO) for studies published in English, French, German, Dutch/Flemish or a Scandinavian language between 1990 and April 2017. We also reviewed the Doloplus-2 homepage and reference lists of included studies to supplement our search. Two reviewers independently reviewed titles and abstracts and performed the quality assessment and data abstraction. A total of 24 studies were included in this systematic review. The quality of the studies varied, but many lacked sufficient detail about the samples and response rates. The Doloplus-2 has been studied using diverse samples in a variety of settings; most study participants were in long-term care and in people with dementia. Sixteen studies addressed various aspects of the scale's feasibility and clinical utility, but their results are limited and inconsistent across settings and samples. Support for the scale's reliability, validity and responsiveness varied widely across the studies. Generally, the reliability coefficients reached acceptable benchmarks, but the evidence for different aspects of the scale's validity and responsiveness was incomplete. Additional high-quality studies are warranted to determine in which populations of older adults with cognitive impairment the Doloplus-2 is reliable, valid and feasible. The ability of the Doloplus-2 to meaningfully quantify pain, measure treatment response and improve patient outcomes also needs further investigation. PROSPERO reg. no.: CRD42016049697 registered 20. Oct. 2016.

Percent Grammatical Responses as a General Outcome Measure: Initial Validity

ERIC Educational Resources Information Center

Eisenberg, Sarita L.; Guo, Ling-Yu

2018-01-01

Purpose: This report investigated the validity of using percent grammatical responses (PGR) as a measure for assessing grammaticality. To establish construct validity, we computed the correlation of PGR with another measure of grammar skills and with an unrelated skill area. To establish concurrent validity for PGR, we computed the correlation of…

When is best-worst best? A comparison of best-worst scaling, numeric estimation, and rating scales for collection of semantic norms.

PubMed

Hollis, Geoff; Westbury, Chris

2018-02-01

Large-scale semantic norms have become both prevalent and influential in recent psycholinguistic research. However, little attention has been directed towards understanding the methodological best practices of such norm collection efforts. We compared the quality of semantic norms obtained through rating scales, numeric estimation, and a less commonly used judgment format called best-worst scaling. We found that best-worst scaling usually produces norms with higher predictive validities than other response formats, and does so requiring less data to be collected overall. We also found evidence that the various response formats may be producing qualitatively, rather than just quantitatively, different data. This raises the issue of potential response format bias, which has not been addressed by previous efforts to collect semantic norms, likely because of previous reliance on a single type of response format for a single type of semantic judgment. We have made available software for creating best-worst stimuli and scoring best-worst data. We also made available new norms for age of acquisition, valence, arousal, and concreteness collected using best-worst scaling. These norms include entries for 1,040 words, of which 1,034 are also contained in the ANEW norms (Bradley & Lang, Affective norms for English words (ANEW): Instruction manual and affective ratings (pp. 1-45). Technical report C-1, the center for research in psychophysiology, University of Florida, 1999).

Bias in retrospective assessment of perceived dental treatment effects when using the Oral Health Impact Profile.

PubMed

Reissmann, Daniel R; Erler, Antje; Hirsch, Christian; Sierwald, Ira; Machuca, Carolina; Schierz, Oliver

2018-03-01

Aim of this exploratory study was to investigate whether a retrospective assessment of oral health-related quality of life (OHRQoL) using the Oral Health Impact Profile (OHIP) is susceptible to bias such as implicit theory of change and cognitive dissonance. In this prospective clinical study, a sample of 126 adult patients (age 17-83 years, 49% women) requiring prosthodontic treatment was consecutively recruited. The OHRQoL was assessed using the 49-item OHIP at baseline and at follow-up. Additionally, patients were asked at follow-up to retrospectively rate their oral health status at baseline (retrospective pretest or then-test) and the change in oral health status using a global transition question. Furthermore, patients' ratings of overall oral health and general health were used as validity criteria for the OHRQoL assessments. Response shift was calculated as the difference between the initial and retrospective baseline assessments. Baseline and retrospective pretest did not differ substantially in terms of internal consistency and convergent validity. Response shift was more pronounced when patients perceived a large change in OHRQoL during treatment. Retrospective pretests were more highly correlated with the baseline than with the follow-up assessment. Findings suggest that retrospective assessments of OHRQoL using the OHIP-49 are susceptible to bias. Cognitive dissonance is more likely to appear as a source of bias than implicit theory of change.

Prognostic discrimination for early chronic phase chronic myeloid leukemia in imatinib era: comparison of Sokal, Euro, and EUTOS scores in Korean population.

PubMed

Yahng, Seung-Ah; Jang, Eun-Jung; Choi, Soo-Young; Lee, Sung-Eun; Kim, Soo-Hyun; Kim, Dong-Wook

2014-08-01

Beyond the conventional Sokal and Euro scores, a new prognostic risk classification, based on the European Treatment Outcome Study (EUTOS), has been developed to predict the outcome of treatment with tyrosine kinase inhibitors (TKI) in chronic myeloid leukemia (CML). In the present study, each risk score was validated by various endpoints in 206 Korean patients with early chronic-phase CML treated with up-front standard dose imatinib. In our analysis, all three scores were found to be valid. The 5-year event-free survival (EFS) was significantly discriminated using Sokal (P = 0.002), Euro (P = 0.003), and EUTOS (P = 0.029), with the worst probability by Euro high-risk (62 vs. 49 vs. 67 %) and better EFS in Sokal low-risk (89 vs. 86 vs. 82 %). Combining all scores identified 6 % of all patients having homogeneous high-risk with distinctively worse outcomes (5-year EFS of 41 %, cumulative complete cytogenetic response rate of 56 %, and cumulative major molecular response rate of 27 %), whereas the group of discordance in risk scores (60 %) had similar results to those of intermediate-risk groups of Sokal and Euro scores. Combining all risk scores for baseline risk assessment may be useful in clinical practice for identifying groups of patients who may benefit from treatment initiation with a more potent TKI among the currently available first-line TKIs.

A valid model for predicting responsible nerve roots in lumbar degenerative disease with diagnostic doubt.

PubMed

Li, Xiaochuan; Bai, Xuedong; Wu, Yaohong; Ruan, Dike

2016-03-15

To construct and validate a model to predict responsible nerve roots in lumbar degenerative disease with diagnostic doubt (DD). From January 2009-January 2013, 163 patients with DD were assigned to the construction (n = 106) or validation sample (n = 57) according to different admission times to hospital. Outcome was assessed according to the Japanese Orthopedic Association (JOA) recovery rate as excellent, good, fair, and poor. The first two results were considered as effective clinical outcome (ECO). Baseline patient and clinical characteristics were considered as secondary variables. A multivariate logistic regression model was used to construct a model with the ECO as a dependent variable and other factors as explanatory variables. The odds ratios (ORs) of each risk factor were adjusted and transformed into a scoring system. Area under the curve (AUC) was calculated and validated in both internal and external samples. Moreover, calibration plot and predictive ability of this scoring system were also tested for further validation. Patients with DD with ECOs in both construction and validation models were around 76 % (76.4 and 75.5 % respectively). more preoperative visual analog pain scale (VAS) score (OR = 1.56, p < 0.01), stenosis levels of L4/5 or L5/S1 (OR = 1.44, p = 0.04), stenosis locations with neuroforamen (OR = 1.95, p = 0.01), neurological deficit (OR = 1.62, p = 0.01), and more VAS improvement of selective nerve route block (SNRB) (OR = 3.42, p = 0.02). the internal area under the curve (AUC) was 0.85, and the external AUC was 0.72, with a good calibration plot of prediction accuracy. Besides, the predictive ability of ECOs was not different from the actual results (p = 0.532). We have constructed and validated a predictive model for confirming responsible nerve roots in patients with DD. The associated risk factors were preoperative VAS score, stenosis levels of L4/5 or L5/S1, stenosis locations with neuroforamen, neurological deficit, and VAS improvement of SNRB. A tool such as this is beneficial in the preoperative counseling of patients, shared surgical decision making, and ultimately improving safety in spine surgery.

Diffusion model validation and interpretation of stable isotopes in river and lake ice

USGS Publications Warehouse

Ferrick, M.G.; Calkins, D.J.; Perron, N.M.; Cragin, J.H.; Kendall, C.

2002-01-01

The stable isotope stratigraphy of river- and lake-ice archives winter hydroclimatic conditions, and can potentially be used to identify changing water sources or to provide important insights into ice formation processes and growth rates. However, accurate interpretations rely on known isotopic fractionation during ice growth. A one-dimensional diffusion model of the liquid boundary layer adjacent to an advancing solid interface, originally developed to simulate solute rejection by growing crystals, has been used without verification to describe non-equilibrium fractionation during congelation ice growth. Results are not in agreement, suggesting the presence of important uncertainties. In this paper we seek validation of the diffusion model for this application using large-scale laboratory experiments with controlled freezing rates and frequent sampling. We obtained consistent, almost constant, isotopic boundary layer thicknesses over a representative range of ice growth rates on both quiescent and well-mixed water. With the 18O boundary layer thickness from the laboratory, the model successfully quantified reduced river-ice growth rates relative to those of a nearby lake. These results were more representative and easier to obtain than those of a conventional thermal ice-growth model. This diffusion model validation and boundary layer thickness determination provide a powerful tool for interpreting the stable isotope stratigraphy of floating ice. The laboratory experiment also replicated successive fractionation events in response to a freeze-thaw-refreeze cycle, providing a mechanism for apparent ice fractionation that exceeds equilibrium. Analysis of the composition of snow ice and frazil ice in river and lake cores indicated surprising similarities between these ice forms. Published in 2002 by John Wiley & Sons, Ltd.

Description of Mexican Cleft Surgeons' Experience With Foreign Surgical Volunteer Missions in Mexico.

PubMed

Schoenbrunner, Anna R; Kelley, Kristen D; Buckstaff, Taylor; McIntyre, Joyce K; Sigler, Alicia; Gosman, Amanda A

2018-05-01

Mexican cleft surgeons provide multidisciplinary comprehensive cleft lip and palate care to children in Mexico. Many Mexican cleft surgeons have extensive experience with foreign, visiting surgeons. The purpose of this study was to characterize Mexican cleft surgeons' domestic and volunteer practice and to learn more about Mexican cleft surgeons' experience with visiting surgeons. A cross-sectional validated e-mail survey tool was sent to Mexican cleft surgeons through 2 Mexican plastic surgery societies and the Asociación Mexicana de Labio y Paladar Hendido y Anomalías Craneofaciales, the national cleft palate society that includes plastic and maxillofacial surgeons who specialize in cleft surgery. We utilized validated survey methodology, including neutral fact-based questions and repeated e-mails to survey nonresponders to maximize validity of statistical data; response rate was 30.6% (n = 81). Mexican cleft surgeons performed, on average, 37.7 primary palate repairs per year with an overall complication rate of 2.5%; 34.6% (n = 28) of respondents had direct experience with patients operated on by visiting surgeons; 53.6% of these respondents performed corrective surgery because of complications from visiting surgeons. Respondents rated 48% of the functional outcomes of visiting surgeons as "acceptable," whereas 43% rated aesthetic outcomes of visiting surgeons as "poor"; 73.3% of respondents were never paid for the corrective surgeries they performed. Thirty-three percent of Mexican cleft surgeons believe that there is a role for educational collaboration with visiting surgeons. Mexican cleft surgeons have a high volume of primary cleft palate repairs in their domestic practice with good outcomes. Visiting surgeons may play an important role in Mexican cleft care through educational collaborations that complement the strengths of Mexican cleft surgeons.

Development of a clinician-administered National Institutes of Health-Brief Fatigue Inventory: A measure of fatigue in the context of depressive disorders.

PubMed

Saligan, Leorey N; Luckenbaugh, David A; Slonena, Elizabeth E; Machado-Vieira, Rodrigo; Zarate, Carlos A

2015-09-01

Fatigue is a complex, multidimensional condition. Although it is often associated with depression, it is not known whether it has a distinct network from depression or whether it can be clinically evaluated, separately. This study describes preliminary findings in the development of a brief, clinician-administered instrument to measure fatigue in the context of depressive disorders using items from existing clinician-administered depression and mania scales. Based on items from prior fatigue measurements, items were selected from the Hamilton Depression Rating Scale (HDRS), Montgomery-Asberg Depression Rating Scale (MADRS), Young Mania Rating Scale, and Structured Interview Guide for HDRS with Atypical Depression. The final items composed the NIH-Brief Fatigue Inventory (NIH-BFI). Responses from 89 depressed adults collected pre- and post-antidepressant therapy (ADT) determined the reliability and consistency of the NIH-BFI using Cronbach's alpha and principal components analysis (PCA). Correlations of the NIH-BFI and fatigue items from other scales before and after ADT explored validity. The 7-item NIH-BFI had Cronbach alphas ranging from 0.81 to 0.88 and PCA indicating a single dimension. The NIH-BFI score was strongly correlated (r = 0.73, p < 0.001) with fatigue items from Beck Depression Index, with MADRS without fatigue items (r = 0.77, p < 0.001), and HDRS without fatigue items (pre: r = 0.69, p < 0.001). Preliminary findings show support for internal consistency reliability and validity of the NIH-BFI, a clinician-administered measure of fatigue. Further testing in other clinical populations is recommended to obtain additional information on reliability and validity. The NIH-BFI provides a method for clinician-rated fatigue that may be a separate from depression. Published by Elsevier Ltd.

The GRACE checklist for rating the quality of observational studies of comparative effectiveness: a tale of hope and caution.

PubMed

Dreyer, Nancy A; Velentgas, Priscilla; Westrich, Kimberly; Dubois, Robert

2014-03-01

While there is growing demand for information about comparative effectiveness (CE), there is substantial debate about whether and when observational studies have sufficient quality to support decision making. To develop and test an item checklist that can be used to qualify those observational CE studies sufficiently rigorous in design and execution to contribute meaningfully to the evidence base for decision support. An 11-item checklist about data and methods (the GRACE checklist) was developed through literature review and consultation with experts from professional societies, payer groups, the private sector, and academia. Since no single gold standard exists for validation, checklist item responses were compared with 3 different types of external quality ratings (N=88 articles). The articles compared treatment effectiveness and/or safety of drugs, medical devices, and medical procedures. We validated checklist item responses 3 ways against external quality ratings, using published articles of observational CE or safety studies: (a) Systematic Review-quality assessment from a published systematic review; (b) Single Expert Review-quality assessment made according to the solicited "expert opinion" of a senior researcher; and (c) Concordant Expert Review-quality assessments from 2 experts for which there was concordance. Volunteers (N=113) from 5 continents completed 280 article assessments using the checklist. Positive and negative predictive values (PPV, NPV, respectively) of individual items were estimated to compare testers' assessments with those of experts. Taken as a whole, the scale had better NPV than PPV, for both data and methods. The most consistent predictor of quality relates to the validity of the primary outcomes measurement for the study purpose. Other consistent markers of quality relate to using concurrent comparators, minimizing the effects of bias by prudent choice of covariates, and using sensitivity analysis to test robustness of results. Concordance of expert opinion on the quality of the rated articles was 52%; most checklist items performed better. The 11-item GRACE checklist provides guidance to help determine which observational studies of CE have used strong scientific methods and good data that are fit for purpose and merit consideration for decision making. The checklist contains a parsimonious set of elements that can be objectively assessed in published studies, and user testing shows that it can be successfully applied to studies of drugs, medical devices, and clinical and surgical interventions. Although no scoring is provided, study reports that rate relatively well across checklist items merit in-depth examination to understand applicability, effect size, and likelihood of residual bias. The current testing and validation efforts did not achieve clear discrimination between studies fit for purpose and those not, but we have identified a critical, though remediable, limitation in our approach. Not specifying a specific granular decision for evaluation, or not identifying a single study objective in reports that included more than one, left reviewers with too broad an assessment challenge. We believe that future efforts will be more successful if reviewers are asked to focus on a specific objective or question. Despite the challenges encountered in this testing, an agreed upon set of assessment elements, checklists, or score cards is critical for the maturation of this field. Substantial resources will be expended on studies of real-world effectiveness, and if the rigor of these observational assessments cannot be assessed, then the impact of the studies will be suboptimal. Similarly, agreement on key elements of quality will ensure that budgets are appropriately directed toward those elements. Given the importance of this task and the lessons learned from these extensive efforts at validation and user testing, we are optimistic about the potential for improved assessments that can be used for diverse situations by people with a wide range of experience and training. Future testing would benefit by directing reviewers to address a single, granular research question, which would avoid problems that arose by using the checklist to evaluate multiple objectives, by using other types of validation test sets, and by employing further multivariate analysis to see if any combination or sequence of item responses has particularly high predictive validity.

A Finite-Element Method Model of Soft Tissue Response to Impulsive Acoustic Radiation Force

PubMed Central

Palmeri, Mark L.; Sharma, Amy C.; Bouchard, Richard R.; Nightingale, Roger W.; Nightingale, Kathryn R

2010-01-01

Several groups are studying acoustic radiation force and its ability to image the mechanical properties of tissue. Acoustic radiation force impulse (ARFI) imaging is one modality using standard diagnostic ultrasound scanners to generate localized, impulsive, acoustic radiation forces in tissue. The dynamic response of tissue is measured via conventional ultrasonic speckle-tracking methods and provides information about the mechanical properties of tissue. A finite-element method (FEM) model has been developed that simulates the dynamic response of tissues, with and without spherical inclusions, to an impulsive acoustic radiation force excitation from a linear array transducer. These FEM models were validated with calibrated phantoms. Shear wave speed, and therefore elasticity, dictates tissue relaxation following ARFI excitation, but Poisson’s ratio and density do not significantly alter tissue relaxation rates. Increased acoustic attenuation in tissue increases the relative amount of tissue displacement in the near field compared with the focal depth, but relaxation rates are not altered. Applications of this model include improving image quality, and distilling material and structural information from tissue’s dynamic response to ARFI excitation. Future work on these models includes incorporation of viscous material properties and modeling the ultrasonic tracking of displaced scatterers. PMID:16382621

Validation of cross-cultural child mental health and psychosocial research instruments: adapting the Depression Self-Rating Scale and Child PTSD Symptom Scale in Nepal

PubMed Central

2011-01-01

Background The lack of culturally adapted and validated instruments for child mental health and psychosocial support in low and middle-income countries is a barrier to assessing prevalence of mental health problems, evaluating interventions, and determining program cost-effectiveness. Alternative procedures are needed to validate instruments in these settings. Methods Six criteria are proposed to evaluate cross-cultural validity of child mental health instruments: (i) purpose of instrument, (ii) construct measured, (iii) contents of construct, (iv) local idioms employed, (v) structure of response sets, and (vi) comparison with other measurable phenomena. These criteria are applied to transcultural translation and alternative validation for the Depression Self-Rating Scale (DSRS) and Child PTSD Symptom Scale (CPSS) in Nepal, which recently suffered a decade of war including conscription of child soldiers and widespread displacement of youth. Transcultural translation was conducted with Nepali mental health professionals and six focus groups with children (n = 64) aged 11-15 years old. Because of the lack of child mental health professionals in Nepal, a psychosocial counselor performed an alternative validation procedure using psychosocial functioning as a criterion for intervention. The validation sample was 162 children (11-14 years old). The Kiddie-Schedule for Affective Disorders and Schizophrenia (K-SADS) and Global Assessment of Psychosocial Disability (GAPD) were used to derive indication for treatment as the external criterion. Results The instruments displayed moderate to good psychometric properties: DSRS (area under the curve (AUC) = 0.82, sensitivity = 0.71, specificity = 0.81, cutoff score ≥ 14); CPSS (AUC = 0.77, sensitivity = 0.68, specificity = 0.73, cutoff score ≥ 20). The DSRS items with significant discriminant validity were "having energy to complete daily activities" (DSRS.7), "feeling that life is not worth living" (DSRS.10), and "feeling lonely" (DSRS.15). The CPSS items with significant discriminant validity were nightmares (CPSS.2), flashbacks (CPSS.3), traumatic amnesia (CPSS.8), feelings of a foreshortened future (CPSS.12), and easily irritated at small matters (CPSS.14). Conclusions Transcultural translation and alternative validation feasibly can be performed in low clinical resource settings through task-shifting the validation process to trained mental health paraprofessionals using structured interviews. This process is helpful to evaluate cost-effectiveness of psychosocial interventions. PMID:21816045

A Comparison of Validity Rates between Paper-and-Pencil and Computerized Testing with the MMPI-2

ERIC Educational Resources Information Center

Blazek, Nicole L.; Forbey, Johnathan D.

2011-01-01

Although the use of computerized testing in psychopathology assessment has increased in recent years, limited research has examined the impact of this format in terms of potential differences in test validity rates. The current study explores potential differences in the rates of valid and invalid Minnesota Multiphasic Personality Inventory--2…

Core competencies in teaching and training for doctors in Scotland: a review of the literature and stakeholder survey.

PubMed

Ross, Michael T; Macrae, Claire; Scott, Jayne; Renwick, Lynne; Moffat, Mandy; Needham, Gillian; Scott, Hazel; Shippey, Ben; Jackson, Catherine; Edgar, Simon; Aitken, Debbie; Evans, Phillip; Irvine, Stewart

2014-06-01

The UK General Medical Council requires all registered doctors to be competent in all areas of their work, including teaching and training. The current research sought consensus on core competencies for all consultants and GPs involved in teaching and training in Scotland. A draft list of 80 competencies was developed from the literature and made available as a survey to all consultants and GPs with teaching roles and all final year speciality trainees working in Scotland. Respondents rated the importance of each competency and provided free text comments. There were 1026 responses. Eighteen competencies were rated as "high priority", and are recommended as a baseline for all doctors involved in teaching and training; 55 were rated as "medium priority", and are recommended in relation to specific teaching and training roles; and 7 were rated as "low priority". Free text responses suggested the topic was controversial and emotive, and emphasised the importance of further work to engage trainers. The findings appeared to have face validity, and it was felt these could be used as the basis for developing a "Scottish Trainer Framework" for doctors and others involved in teaching and training in Scotland.

Using instant messaging for Internet-based interviews.

PubMed

Stieger, Stefan; Göritz, Anja S

2006-10-01

One method of data collection that has rarely been applied online is the one-on-one interview. Because of its widespread use, the Internet-based service instant messaging (IM) seems to be suitable to conduct scientific online interviews. A unique benefit of IM is the existence of public address books. These can be used both as a sampling frame and as a cross-reference to validate respondents' demographic data. The feasibility of IM interviews was examined in a WWW survey as well as in actual IM interviews that were combined with an experimental manipulation of the request for participation. On the basis of self-reports, respondent behavior, and data in the address books, the studies have demonstrated that the risk of receiving false data in IM interviews is small. Not only is the quality of the obtainable data satisfying but the contact rate, response rate, and retention rate as well. Moreover, the experimental test demonstrated that the response rate is influenced by the information provided in the chat request. On the basis of the study results, recommendations are given as to when and how IM interviews should be used as a data collection method.

The brief negative symptom scale: validation of the German translation and convergent validity with self-rated anhedonia and observer-rated apathy.

PubMed

Bischof, Martin; Obermann, Caitriona; Hartmann, Matthias N; Hager, Oliver M; Kirschner, Matthias; Kluge, Agne; Strauss, Gregory P; Kaiser, Stefan

2016-11-22

Negative symptoms are considered core symptoms of schizophrenia. The Brief Negative Symptom Scale (BNSS) was developed to measure this symptomatic dimension according to a current consensus definition. The present study examined the psychometric properties of the German version of the BNSS. To expand former findings on convergent validity, we employed the Temporal Experience Pleasure Scale (TEPS), a hedonic self-report that distinguishes between consummatory and anticipatory pleasure. Additionally, we addressed convergent validity with observer-rated assessment of apathy with the Apathy Evaluation Scale (AES), which was completed by the patient's primary nurse. Data were collected from 75 in- and outpatients from the Psychiatric Hospital, University Zurich diagnosed with either schizophrenia or schizoaffective disorder. We assessed convergent and discriminant validity, internal consistency and inter-rater reliability. We largely replicated the findings of the original version showing good psychometric properties of the BNSS. In addition, the primary nurses evaluation correlated moderately with interview-based clinician rating. BNSS anhedonia items showed good convergent validity with the TEPS. Overall, the German BNSS shows good psychometric properties comparable to the original English version. Convergent validity extends beyond interview-based assessments of negative symptoms to self-rated anhedonia and observer-rated apathy.

Combined expectancies: electrophysiological evidence for the adjustment of expectancy effects

PubMed Central

Mattler, Uwe; van der Lugt, Arie; Münte, Thomas F

2006-01-01

Background When subjects use cues to prepare for a likely stimulus or a likely response, reaction times are facilitated by valid cues but prolonged by invalid cues. In studies on combined expectancy effects, two cues can independently give information regarding two dimensions of the forthcoming task. In certain situations, cueing effects on one dimension are reduced when the cue on the other dimension is invalid. According to the Adjusted Expectancy Model, cues affect different processing levels and a mechanism is presumed which is sensitive to the validity of early level cues and leads to online adjustment of expectancy effects at later levels. To examine the predictions of this model cueing of stimulus modality was combined with response cueing. Results Behavioral measures showed the interaction of cueing effects. Electrophysiological measures of the lateralized readiness potential (LRP) and the N200 amplitude confirmed the predictions of the model. The LRP showed larger effects of response cues on response activation when modality cues were valid rather than invalid. N200 amplitude was largest with valid modality cues and invalid response cues, medium with invalid modality cues, and smallest with two valid cues. Conclusion Findings support the view that the validity of early level expectancies modulates the effects of late level expectancies, which included response activation and response conflict in the present study. PMID:16674805

Systematic Review of Self-Report Measures of Pain Intensity in 3- and 4-Year-Old Children: Bridging a Period of Rapid Cognitive Development.

PubMed

von Baeyer, Carl L; Jaaniste, Tiina; Vo, Henry L T; Brunsdon, Georgie; Lao, Hsuan-Chih; Champion, G David

2017-09-01

Claims are made for the validity of some self-report pain scales for 3- and 4-year-old children, but little is known about their ability to use such tools. This systematic review identified self-report pain intensity measures used with 3- and/or 4- year-old participants (3-4yo) and considered their reliability and validity within this age span. The search protocol identified research articles that included 3-4yo, reported use of any pain scale, and included self-reported pain intensity ratings. A total of 1,590 articles were screened and 617 articles met inclusion criteria. Of the included studies, 98% aggregated self-report data for 3-4yo with data for older children, leading to overestimates of the reliability and validity of self-report in the younger age group. In the 14 studies that provided nonaggregated data for 3-4yo, there was no evidence for 3-year-old and weak evidence for 4-year-old children being able to use published self-report pain intensity tools in a valid or reliable way. Preschool-age children have been reported to do better with fewer than the 6 response options offered on published faces scales. Simplified tools are being developed for young children; however, more research is needed before these are adopted. Some self-report pain scales have been promoted for use with 3- and 4-year-old children, but this is on the basis of studies that aggregated data for younger and older children, resulting in overestimates of reliability and validity for the preschool-age children. Scales with fewer response options show promise, at least for 4-year-old children. Copyright © 2017 American Pain Society. Published by Elsevier Inc. All rights reserved.

The German version of the Expanded Prostate Cancer Index Composite (EPIC): translation, validation and minimal important difference estimation.

PubMed

Umbehr, Martin H; Bachmann, Lucas M; Poyet, Cedric; Hammerer, Peter; Steurer, Johann; Puhan, Milo A; Frei, Anja

2018-02-20

No official German translation exists for the 50-item Expanded Prostate Cancer Index Composite (EPIC), and no minimal important difference (MID) has been established yet. The aim of the study was to translate and validate a German version of the EPIC with cultural adaptation to the different German speaking countries and to establish the MID. We translated and culturally adapted the EPIC into German. For validation, we included a consecutive subsample of 92 patients with localized prostate cancer undergoing radical prostatectomy who participated the Prostate Cancer Outcomes Cohort. Baseline and follow-up assessments took place before and six weeks after prostatectomy in 2010 and 2011. We assessed the EPIC, EORTC QLQ-PR25, Feeling Thermometer, SF-36 and a global rating of health state change variable. We calculated the internal consistency, test-retest reliability, construct validity, responsiveness and MID. For most EPIC domains and subscales, our a priori defined criteria for reliability were fulfilled (construct reliability: Cronbach's alpha 0.7-0.9; test-retest reliability: intraclass-correlation coefficient ≥ 0.7). Cross-sectional and longitudinal correlations between EPIC and EORTC QLQ-PR25 domains ranged from 0.14-0.79, and 0.06-0.5 and 0.08-0.72 for Feeling Thermometer and SF-36, respectively. We established MID values of 10, 4, 12, and 6 for the urinary, bowel, sexual and hormonal domain. The German version of the EPIC is reliable, responsive and valid to measure HRQL in prostate cancer patients and is now available in German language. With the suggested MID we provide interpretation to what extent changes in HRQL are clinically relevant for patients. Hence, study results are of interest beyond German speaking countries.

Validation of the UNESP-Botucatu unidimensional composite pain scale for assessing postoperative pain in cattle.

PubMed

de Oliveira, Flávia Augusta; Luna, Stelio Pacca Loureiro; do Amaral, Jackson Barros; Rodrigues, Karoline Alves; Sant'Anna, Aline Cristina; Daolio, Milena; Brondani, Juliana Tabarelli

2014-09-06

The recognition and measurement of pain in cattle are important in determining the necessity for and efficacy of analgesic intervention. The aim of this study was to record behaviour and determine the validity and reliability of an instrument to assess acute pain in 40 cattle subjected to orchiectomy after sedation with xylazine and local anaesthesia. The animals were filmed before and after orchiectomy to record behaviour. The pain scale was based on previous studies, on a pilot study and on analysis of the camera footage. Three blinded observers and a local observer assessed the edited films obtained during the preoperative and postoperative periods, before and after rescue analgesia and 24 hours after surgery. Re-evaluation was performed one month after the first analysis. Criterion validity (agreement) and item-total correlation using Spearman's coefficient were employed to refine the scale. Based on factor analysis, a unidimensional scale was adopted. The internal consistency of the data was excellent after refinement (Cronbach's α coefficient = 0.866). There was a high correlation (p < 0.001) between the proposed scale and the visual analogue, simple descriptive and numerical rating scales. The construct validity and responsiveness were confirmed by the increase and decrease in pain scores after surgery and rescue analgesia, respectively (p < 0.001). Inter- and intra-observer reliability ranged from moderate to very good. The optimal cut-off point for rescue analgesia was > 4, and analysis of the area under the curve (AUC = 0.963) showed excellent discriminatory ability. The UNESP-Botucatu unidimensional pain scale for assessing acute postoperative pain in cattle is a valid, reliable and responsive instrument with excellent internal consistency and discriminatory ability. The cut-off point for rescue analgesia provides an additional tool for guiding analgesic therapy.

A Phase II Trial of Neoadjuvant Preoperative Chemoradiotherapy With S-1 Plus Irinotecan and Radiation in Patients With Locally Advanced Rectal Cancer: Clinical Feasibility and Response Rate

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sato, Takeo; Ozawa, Heita; Hatate, Kazuhiko

Purpose: We aimed to validate our hypothesis that a preoperative chemoradiotherapy regimen with S-1 plus irinotecan is feasible, safe, and active for the management of locally advanced rectal cancer in a single-arm Phase II setting. Methods and Materials: Eligible patients had previously untreated, locally advanced rectal adenocarcinoma. Radiotherapy was administered in fractions of 1.8Gy/d for 25 days. S-1 was administered orally in a fixed daily dose of 80mg/m{sup 2} on Days 1 to 5, 8 to 12, 22 to 26, and 29 to 33. Irinotecan (80mg/m{sup 2}) was infused on Days 1, 8, 22, and 29. Four or more weeksmore » after the completion of the treatment, total mesorectal excision with lateral lymph node dissection was performed. The primary endpoint was the rate of completing treatment in terms of feasibility. The secondary endpoints were the response rate and safety. Results: We enrolled 43 men and 24 women in the study. The number of patients who completed treatment was 58 (86.6%). Overall, 46 patients (68.7%) responded to treatment and 24 (34.7%) had a complete histopathologic response. Three patients had Grade 3 leukopenia, and another three patients had Grade 3 neutropenia. Diarrhea was the most common type of nonhematologic toxicity: 3 patients had Grade 3 diarrhea. Conclusions: A preoperative regimen of S-1, irinotecan, and radiotherapy to the rectum was feasible, and it appeared safe and effective in this nonrandomized Phase II setting. It exhibited a low incidence of adverse events, a high rate of completion of treatment, and an extremely high rate of pathologic complete response.« less

Spanish Validation of the Care Evaluation Scale for Measuring the Quality of Structure and Process of Palliative Care From the Family Perspective.

PubMed

Benitez-Rosario, Miguel Angel; Caceres-Miranda, Raquel; Aguirre-Jaime, Armando

2016-03-01

A reliable and valid measure of the structure and process of end-of-life care is important for improving the outcomes of care. This study evaluated the validity and reliability of the Spanish adaptation of a satisfaction tool of the Care Evaluation Scale (CES), which was developed in Japan to evaluate palliative care structure and process from the perspective of family members. Standard forward-backward translation and a pilot test were conducted. A multicenter survey was conducted with the relatives of patients admitted to palliative care units for symptom control. The dimensional structure was assessed using confirmatory factor analyses. Concurrent and discriminant validity were tested by correlation with the SERQVHOS, a Spanish hospital care satisfaction scale and with an 11-point rating scale on satisfaction with care. The reliability of the CES was tested by Cronbach α and by test-retest correlation. A total of 284 primary caregivers completed the CES, with low missing response rates. The results of the factor analysis suggested a six-factor solution explaining 69% of the total variance. The CES moderately correlated with the SERQVHOS and with the overall satisfaction scale (intraclass correlation coefficients of 0.66 and 0.44, respectively; P = 0.001). Cronbach α was 0.90 overall and ranged from 0.85 to 0.89 for subdomains. Intraclass correlation coefficient was 0.88 (P = 0.001) for test-retest analysis. The Spanish CES was found to be a reliable and valid measure of the satisfaction with end-of-life care structure and process from family members' perspectives. Copyright © 2016 American Academy of Hospice and Palliative Medicine. Published by Elsevier Inc. All rights reserved.

Frequency Modulation of Transcriptional Bursting Enables Sensitive and Rapid Gene Regulation.

PubMed

Li, Congxin; Cesbron, François; Oehler, Michael; Brunner, Michael; Höfer, Thomas

2018-04-25

Gene regulation is a complex non-equilibrium process. Here, we show that quantitating the temporal regulation of key gene states (transcriptionally inactive, active, and refractory) provides a parsimonious framework for analyzing gene regulation. Our theory makes two non-intuitive predictions. First, for transcription factors (TFs) that regulate transcription burst frequency, as opposed to amplitude or duration, weak TF binding is sufficient to elicit strong transcriptional responses. Second, refractoriness of a gene after a transcription burst enables rapid responses to stimuli. We validate both predictions experimentally by exploiting the natural, optogenetic-like responsiveness of the Neurospora GATA-type TF White Collar Complex (WCC) to blue light. Further, we demonstrate that differential regulation of WCC target genes is caused by different gene activation rates, not different TF occupancy, and that these rates are tuned by both the core promoter and the distance between TF-binding site and core promoter. In total, our work demonstrates the relevance of a kinetic, non-equilibrium framework for understanding transcriptional regulation. Copyright © 2018 The Authors. Published by Elsevier Inc. All rights reserved.

Beyond student ratings: peer observation of classroom and clinical teaching.

PubMed

Berk, Ronald A; Naumann, Phyllis L; Appling, Susan E

2004-01-01

Peer observation of classroom and clinical teaching has received increased attention over the past decade in schools of nursing to augment student ratings of teaching effectiveness. One essential ingredient is the scale used to evaluate performance. A five-step systematic procedure for adapting, writing, and building any peer observation scale is described. The differences between the development of a classroom observation scale and an appraisal scale to observe clinical instructors are examined. Psychometric issues peculiar to observation scales are discussed in terms of content validity, eight types of response bias, and interobserver reliability. The applications of the scales in one school of nursing as part of the triangulation of methods with student ratings and the teaching portfolio are illustrated. Copies of the scales are also provided.

The level crossing rates and associated statistical properties of a random frequency response function

NASA Astrophysics Data System (ADS)

Langley, Robin S.

2018-03-01

This work is concerned with the statistical properties of the frequency response function of the energy of a random system. Earlier studies have considered the statistical distribution of the function at a single frequency, or alternatively the statistics of a band-average of the function. In contrast the present analysis considers the statistical fluctuations over a frequency band, and results are obtained for the mean rate at which the function crosses a specified level (or equivalently, the average number of times the level is crossed within the band). Results are also obtained for the probability of crossing a specified level at least once, the mean rate of occurrence of peaks, and the mean trough-to-peak height. The analysis is based on the assumption that the natural frequencies and mode shapes of the system have statistical properties that are governed by the Gaussian Orthogonal Ensemble (GOE), and the validity of this assumption is demonstrated by comparison with numerical simulations for a random plate. The work has application to the assessment of the performance of dynamic systems that are sensitive to random imperfections.

Perspectives on population growth.

PubMed

1996-09-01

Assume that everyone has the same information on population growth. There are many different opinions on what that information means and what should be done about it. Some people worry about current rates of growth, especially in the context of growing per capita consumption, and believe that all reasonable steps should be taken to reduce rates and stabilize population size. Others believe that growing populations can be accommodated by reducing consumption in rich countries, that technological progress will supply the new resources needed, that the development needed to support a larger population can be sustained, that large population size fosters prosperity, or that birth rates are falling and current growth is just temporary. These are all valid positions worthy of at least debate. Interest groups commonly acknowledgement population growth as a significant issue, but offer no response to it. Sometimes the issue goes unrecognized because it conflicts with a more highly valued personal agenda item. Finally, some responses come from confusion and anger rather than reasoning or self-interest. The proponents of these latter arguments bring nothing constructive to the debate.

Development and validation of an abbreviated version of the Trust in Oncologist Scale-the Trust in Oncologist Scale-short form (TiOS-SF).

PubMed

Hillen, Marij A; Postma, Rosa-May; Verdam, Mathilde G E; Smets, Ellen M A

2017-03-01

The original 18-item, four-dimensional Trust in Oncologist Scale assesses cancer patients' trust in their oncologist. The current aim was to develop and validate a short form version of the scale to enable more efficient assessment of cancer patients' trust. Existing validation data of the full-length Trust in Oncologist Scale were used to create a short form of the Trust in Oncologist Scale. The resulting short form was validated in a new sample of cancer patients (n = 92). Socio-demographics, medical characteristics, trust in the oncologist, satisfaction with communication, trust in healthcare, willingness to recommend the oncologist to others and to contact the oncologist in case of questions were assessed. Internal consistency, reliability, convergent and structural validity were tested. The five-item Trust in Oncologist Scale Short Form was created by selecting the statistically best performing item from each dimension of the original scale, to ensure content validity. Mean trust in the oncologist was high in the validation sample (response rate 86%, M = 4.30, SD = 0.98). Exploratory factor analyses supported one-dimensionality of the short form. Internal consistency was high, and temporal stability was moderate. Initial convergent validity was suggested by moderate correlations between trust scores with associated constructs. The Trust in Oncologist Scale Short Form appears to efficiently, reliably and validly measures cancer patients' trust in their oncologist. It may be used in research and as a quality indicator in clinical practice. More thorough validation of the scale is recommended to confirm this initial evidence of its validity.

Assessing Biobehavioural Self-Regulation and Coregulation in Early Childhood: The Parent-Child Challenge Task

PubMed Central

Lunkenheimer, Erika; Kemp, Christine J.; Lucas-Thompson, Rachel G.; Cole, Pamela M.; Albrecht, Erin C.

2016-01-01

Researchers have argued for more dynamic and contextually relevant measures of regulatory processes in interpersonal interactions. In response, we introduce and examine the effectiveness of a new task, the Parent-Child Challenge Task, designed to assess the self-regulation and coregulation of affect, goal-directed behavior, and physiology in parents and their preschoolers in response to an experimental perturbation. Concurrent and predictive validity was examined via relations with children’s externalizing behaviors. Mothers used only their words to guide their 3-year-old children to complete increasingly difficult puzzles in order to win a prize (N = 96). A challenge condition was initiated mid-way through the task with a newly introduced time limit. The challenge produced decreases in parental teaching and dyadic behavioral variability and increases in child negative affect and dyadic affective variability, measured by dynamic systems-based methods. Children rated lower on externalizing showed respiratory sinus arrhythmia (RSA) suppression in response to challenge, whereas those rated higher on externalizing showed RSA augmentation. Additionally, select task changes in affect, behavior, and physiology predicted teacher-rated externalizing behaviors four months later. Findings indicate the Parent-Child Challenge Task was effective in producing regulatory changes and suggest its utility in assessing biobehavioral self-regulation and coregulation in parents and their preschoolers. PMID:28458616

Assessing Biobehavioural Self-Regulation and Coregulation in Early Childhood: The Parent-Child Challenge Task.

PubMed

Lunkenheimer, Erika; Kemp, Christine J; Lucas-Thompson, Rachel G; Cole, Pamela M; Albrecht, Erin C

2017-01-01

Researchers have argued for more dynamic and contextually relevant measures of regulatory processes in interpersonal interactions. In response, we introduce and examine the effectiveness of a new task, the Parent-Child Challenge Task, designed to assess the self-regulation and coregulation of affect, goal-directed behavior, and physiology in parents and their preschoolers in response to an experimental perturbation. Concurrent and predictive validity was examined via relations with children's externalizing behaviors. Mothers used only their words to guide their 3-year-old children to complete increasingly difficult puzzles in order to win a prize ( N = 96). A challenge condition was initiated mid-way through the task with a newly introduced time limit. The challenge produced decreases in parental teaching and dyadic behavioral variability and increases in child negative affect and dyadic affective variability, measured by dynamic systems-based methods. Children rated lower on externalizing showed respiratory sinus arrhythmia (RSA) suppression in response to challenge, whereas those rated higher on externalizing showed RSA augmentation. Additionally, select task changes in affect, behavior, and physiology predicted teacher-rated externalizing behaviors four months later. Findings indicate the Parent-Child Challenge Task was effective in producing regulatory changes and suggest its utility in assessing biobehavioral self-regulation and coregulation in parents and their preschoolers.

Three-dimensional finite element models of the human pubic symphysis with viscohyperelastic soft tissues.

PubMed

Li, Zuoping; Alonso, Jorge E; Kim, Jong-Eun; Davidson, James S; Etheridge, Brandon S; Eberhardt, Alan W

2006-09-01

Three-dimensional finite element (FE) models of human pubic symphyses were constructed from computed tomography image data of one male and one female cadaver pelvis. The pubic bones, interpubic fibrocartilaginous disc and four pubic ligaments were segmented semi-automatically and meshed with hexahedral elements using automatic mesh generation schemes. A two-term viscoelastic Prony series, determined by curve fitting results of compressive creep experiments, was used to model the rate-dependent effects of the interpubic disc and the pubic ligaments. Three-parameter Mooney-Rivlin material coefficients were calculated for the discs using a heuristic FE approach based on average experimental joint compression data. Similarly, a transversely isotropic hyperelastic material model was applied to the ligaments to capture average tensile responses. Linear elastic isotropic properties were assigned to bone. The applicability of the resulting models was tested in bending simulations in four directions and in tensile tests of varying load rates. The model-predicted results correlated reasonably with the joint bending stiffnesses and rate-dependent tensile responses measured in experiments, supporting the validity of the estimated material coefficients and overall modeling approach. This study represents an important and necessary step in the eventual development of biofidelic pelvis models to investigate symphysis response under high-energy impact conditions, such as motor vehicle collisions.

Quantifying condition-dependent intracellular protein levels enables high-precision fitness estimates.

PubMed

Geiler-Samerotte, Kerry A; Hashimoto, Tatsunori; Dion, Michael F; Budnik, Bogdan A; Airoldi, Edoardo M; Drummond, D Allan

2013-01-01

Countless studies monitor the growth rate of microbial populations as a measure of fitness. However, an enormous gap separates growth-rate differences measurable in the laboratory from those that natural selection can distinguish efficiently. Taking advantage of the recent discovery that transcript and protein levels in budding yeast closely track growth rate, we explore the possibility that growth rate can be more sensitively inferred by monitoring the proteomic response to growth, rather than growth itself. We find a set of proteins whose levels, in aggregate, enable prediction of growth rate to a higher precision than direct measurements. However, we find little overlap between these proteins and those that closely track growth rate in other studies. These results suggest that, in yeast, the pathways that set the pace of cell division can differ depending on the growth-altering stimulus. Still, with proper validation, protein measurements can provide high-precision growth estimates that allow extension of phenotypic growth-based assays closer to the limits of evolutionary selection.

Multidimensional analysis of the frequencies and rates of cytokine secretion from single cells by quantitative microengraving.

PubMed

Han, Qing; Bradshaw, Elizabeth M; Nilsson, Björn; Hafler, David A; Love, J Christopher

2010-06-07

The large diversity of cells that comprise the human immune system requires methods that can resolve the individual contributions of specific subsets to an immunological response. Microengraving is process that uses a dense, elastomeric array of microwells to generate microarrays of proteins secreted from large numbers of individual live cells (approximately 10(4)-10(5) cells/assay). In this paper, we describe an approach based on this technology to quantify the rates of secretion from single immune cells. Numerical simulations of the microengraving process indicated an operating regime between 30 min-4 h that permits quantitative analysis of the rates of secretion. Through experimental validation, we demonstrate that microengraving can provide quantitative measurements of both the frequencies and the distribution in rates of secretion for up to four cytokines simultaneously released from individual viable primary immune cells. The experimental limits of detection ranged from 0.5 to 4 molecules/s for IL-6, IL-17, IFNgamma, IL-2, and TNFalpha. These multidimensional measures resolve the number and intensities of responses by cells exposed to stimuli with greater sensitivity than single-parameter assays for cytokine release. We show that cells from different donors exhibit distinct responses based on both the frequency and magnitude of cytokine secretion when stimulated under different activating conditions. Primary T cells with specific profiles of secretion can also be recovered after microengraving for subsequent expansion in vitro. These examples demonstrate the utility of quantitative, multidimensional profiles of single cells for analyzing the diversity and dynamics of immune responses in vitro and for identifying rare cells from clinical samples.

Evaluating Tablet Computers as a Survey Tool in Rural Communities

PubMed Central

Newell, Steve M.; Logan, Henrietta L.; Guo, Yi; Marks, John G.; Shepperd, James A.

2015-01-01

Purpose Although tablet computers offer advantages in data collection over traditional paper-and-pencil methods, little research has examined whether the 2 formats yield similar responses, especially with underserved populations. We compared the 2 survey formats and tested whether participants’ responses to common health questionnaires or perceptions of usability differed by survey format. We also tested whether we could replicate established paper-and-pencil findings via tablet computer. Methods We recruited a sample of low-income community members living in the rural southern United States. Participants were 170 residents (black = 49%; white = 36%; other races and missing data = 15%) drawn from 2 counties meeting Florida’s state statutory definition of rural with 100 persons or fewer per square mile. We randomly assigned participants to complete scales (Center for Epidemiologic Studies Depression Inventory and Regulatory Focus Questionnaire) along with survey format usability ratings via paper-and-pencil or tablet computer. All participants rated a series of previously validated posters using a tablet computer. Finally, participants completed comparisons of the survey formats and reported survey format preferences. Findings Participants preferred using the tablet computer and showed no significant differences between formats in mean responses, scale reliabilities, or in participants’ usability ratings. Conclusions Overall, participants reported similar scales responses and usability ratings between formats. However, participants reported both preferring and enjoying responding via tablet computer more. Collectively, these findings are among the first data to show that tablet computers represent a suitable substitute among an underrepresented rural sample for paper-and-pencil methodology in survey research. PMID:25243953

Evaluating tablet computers as a survey tool in rural communities.

PubMed

Newell, Steve M; Logan, Henrietta L; Guo, Yi; Marks, John G; Shepperd, James A

2015-01-01

Although tablet computers offer advantages in data collection over traditional paper-and-pencil methods, little research has examined whether the 2 formats yield similar responses, especially with underserved populations. We compared the 2 survey formats and tested whether participants' responses to common health questionnaires or perceptions of usability differed by survey format. We also tested whether we could replicate established paper-and-pencil findings via tablet computer. We recruited a sample of low-income community members living in the rural southern United States. Participants were 170 residents (black = 49%; white = 36%; other races and missing data = 15%) drawn from 2 counties meeting Florida's state statutory definition of rural with 100 persons or fewer per square mile. We randomly assigned participants to complete scales (Center for Epidemiologic Studies Depression Inventory and Regulatory Focus Questionnaire) along with survey format usability ratings via paper-and-pencil or tablet computer. All participants rated a series of previously validated posters using a tablet computer. Finally, participants completed comparisons of the survey formats and reported survey format preferences. Participants preferred using the tablet computer and showed no significant differences between formats in mean responses, scale reliabilities, or in participants' usability ratings. Overall, participants reported similar scales responses and usability ratings between formats. However, participants reported both preferring and enjoying responding via tablet computer more. Collectively, these findings are among the first data to show that tablet computers represent a suitable substitute among an underrepresented rural sample for paper-and-pencil methodology in survey research. Published 2014. This article is a U.S. Government work and is in the public domain in the USA.

Statistical methods for clinical verification of dose response parameters related to esophageal stricture and AVM obliteration from radiotherapy

NASA Astrophysics Data System (ADS)

Mavroidis, Panayiotis; Lind, Bengt K.; Theodorou, Kyriaki; Laurell, Göran; Fernberg, Jan-Olof; Lefkopoulos, Dimitrios; Kappas, Constantin; Brahme, Anders

2004-08-01

The purpose of this work is to provide some statistical methods for evaluating the predictive strength of radiobiological models and the validity of dose-response parameters for tumour control and normal tissue complications. This is accomplished by associating the expected complication rates, which are calculated using different models, with the clinical follow-up records. These methods are applied to 77 patients who received radiation treatment for head and neck cancer and 85 patients who were treated for arteriovenous malformation (AVM). The three-dimensional dose distribution delivered to esophagus and AVM nidus and the clinical follow-up results were available for each patient. Dose-response parameters derived by a maximum likelihood fitting were used as a reference to evaluate their compatibility with the examined treatment methodologies. The impact of the parameter uncertainties on the dose-response curves is demonstrated. The clinical utilization of the radiobiological parameters is illustrated. The radiobiological models (relative seriality and linear Poisson) and the reference parameters are validated to prove their suitability in reproducing the treatment outcome pattern of the patient material studied (through the probability of finding a worse fit, area under the ROC curve and khgr2 test). The analysis was carried out for the upper 5 cm of the esophagus (proximal esophagus) where all the strictures are formed, and the total volume of AVM. The estimated confidence intervals of the dose-response curves appear to have a significant supporting role on their clinical implementation and use.

Simultaneous Determination of Potassium Sorbate, Sodium Benzoate, Quinoline Yellow and Sunset Yellow in Lemonades and Lemon Sauces by HPLC Using Experimental Design.

PubMed

Dinç Zor, Şule; Aşçı, Bürge; Aksu Dönmez, Özlem; Yıldırım Küçükkaraca, Dilek

2016-07-01

In this study, development and validation of a HPLC method was described for simultaneous determination of potassium sorbate, sodium benzoate, quinoline yellow and sunset yellow. A Box-Behnken design using three variables at three levels was employed to determine the optimum conditions of chromatographic separation: pH of mobile phase, 6.0-7.0; flow rate, 0.8-1.2 mL min(-1) and the ratio of mobile phase composed of a 0.025 M sodium acetate/acetic acid buffer, 80-90%. Resolution was chosen as a response. The optimized method was validated for linearity, the limits of detection and quantification, accuracy, precision and stability. All the validation parameters were within the acceptance range. The applicability of the developed method to the determination of these food additives in commercial lemonade and lemon sauce samples was successfully demonstrated. © The Author 2016. Published by Oxford University Press. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Validation of the Comprehensive Assessment of Defense Style (CADS): mothers' and children's responses to the stresses of missile attacks.

PubMed

Wolmer, L; Laor, N; Cicchetti, D V

2001-06-01

This study furthers the validation of the Comprehensive Assessment of Defense Style (CADS) as a measure of children's defensive behavior. Participants were 81 mothers who assessed the defense style (CADS) of their 8- to 10-year-old children, as well as their own defense style and level of object relations. Five years earlier, the mothers had rated their children's symptom level and personality after the missile attacks during the Gulf War. The original factor structure of the CADS was replicated for the most part. Self-oriented and other-oriented defenses were related to the children's early personality and symptomatic reaction, as well as to their mother's defense style and level of object relations. The CADS factors correlated with the defenses of the Defense Mechanisms Manual. The results provide further validation of the CADS and suggest possible areas of implementation, such as longitudinal examination of defenses, psychopathology screening, and therapeutic improvement.

Analysis of delamination related fracture processes in composites

NASA Technical Reports Server (NTRS)

Armanios, Erian A.

1992-01-01

This is a final report that summarizes the results achieved under this grant. The first major accomplishment is the development of the sublaminate modeling approach and shear deformation theory. The sublaminate approach allows the flexibility of considering one ply or groups of plies as a single laminated unit with effective properties. This approach is valid when the characteristic length of the response is small compared to the sublaminate thickness. The sublaminate approach was validated comparing its predictions with a finite element solution. A shear deformation theory represents an optimum compromise between accuracy and computational effort in delamination analysis of laminated composites. This conclusion was reached by applying several theories with increasing level of complexity to the prediction of interlaminar stresses and strain energy release rate in a double cracked-lap-shear configuration.

Effects of soil dry-wet cycles and nitrogen fertilization on soil nitrous oxide emission: Simulation using the DNDC model

NASA Astrophysics Data System (ADS)

Hui, D.; Chen, H.; Deng, Q.; Wang, G.; Schadt, C. W.

2017-12-01

The major source of atmospheric nitrous oxide (N2O) is from croplands. A rapid pulse response of soil N2O emission to precipitation (PPT) is often reported, especially after a drought period. However, how precipitation pattern (i.e. frequency) and intensity, and nitrogen (N) fertilization would interactively influence soil N2O emission has not been well investigated. In this modeling study, we took advantage of a validated biogeochemical model (DNDC) in a cornfield and simulated soil N2O emission under manipulated precipitation treatments and three levels (Low, medium and high) of N application rate. The PPT treatments included precipitation pattern (from very frequent, to medium, and rare dry-wet cycles without changes in total annual precipitation) and intensity (from ambient, to -50%, +50%, and +100% ambient precipitation without changes in precipitation pattern). Results showed that both precipitation pattern and intensity, as well as nitrogen application rate had significant influences on the pulse responses and annual soil N2O emission. Very frequent dry-wet cycles tended to increase soil N2O emission while long drought-wet cycles had lower soil N2O emission, but the timing of N fertilization and precipitation also played an important role in the magnitude of pulse response and annual budget of N2O emission. As expected, soil N2O emission was higher under the high N application and lower under the low N application rate. Double precipitation (+100%) had the highest soil N2O emission, but showed no significant differences with +50% and ambient precipitation. The drought (-50%) treatment significantly reduced soil N2O emission. Annual soil N2O emission could be described as N2O=-6.7436+0.1098N+0.0049PPT, R2=0.86. Our results demonstrate that not only the intensity and pattern of precipitation greatly influence soil N2O emission, but also the timing of rainfall and N fertilization may play an important role in soil N2O pulse responses and annual N2O emission in cornfields. These modeling approaches inform our future work to deploy automated gas flux systems to validate and monitor these rapid N2O responses in the field.

Comparison of response patterns in different survey designs: a longitudinal panel with mixed-mode and online-only design.

PubMed

Rübsamen, Nicole; Akmatov, Manas K; Castell, Stefanie; Karch, André; Mikolajczyk, Rafael T

2017-01-01

Increasing availability of the Internet allows using only online data collection for more epidemiological studies. We compare response patterns in a population-based health survey using two survey designs: mixed-mode (choice between paper-and-pencil and online questionnaires) and online-only design (without choice). We used data from a longitudinal panel, the Hygiene and Behaviour Infectious Diseases Study (HaBIDS), conducted in 2014/2015 in four regions in Lower Saxony, Germany. Individuals were recruited using address-based probability sampling. In two regions, individuals could choose between paper-and-pencil and online questionnaires. In the other two regions, individuals were offered online-only participation. We compared sociodemographic characteristics of respondents who filled in all panel questionnaires between the mixed-mode group (n = 1110) and the online-only group (n = 482). Using 134 items, we performed multinomial logistic regression to compare responses between survey designs in terms of type (missing, "do not know" or valid response) and ordinal regression to compare responses in terms of content. We applied the false discovery rates (FDR) to control for multiple testing and investigated effects of adjusting for sociodemographic characteristic. For validation of the differential response patterns between mixed-mode and online-only, we compared the response patterns between paper and online mode among the respondents in the mixed-mode group in one region (n = 786). Respondents in the online-only group were older than those in the mixed-mode group, but both groups did not differ regarding sex or education. Type of response did not differ between the online-only and the mixed-mode group. Survey design was associated with different content of response in 18 of the 134 investigated items; which decreased to 11 after adjusting for sociodemographic variables. In the validation within the mixed-mode, only two of those were among the 11 significantly different items. The probability of observing by chance the same two or more significant differences in this setting was 22%. We found similar response patterns in both survey designs with only few items being answered differently, likely attributable to chance. Our study supports the equivalence of the compared survey designs and suggests that, in the studied setting, using online-only design does not cause strong distortion of the results.

Assessing students' communication skills: validation of a global rating.

PubMed

Scheffer, Simone; Muehlinghaus, Isabel; Froehmel, Annette; Ortwein, Heiderose

2008-12-01

Communication skills training is an accepted part of undergraduate medical programs nowadays. In addition to learning experiences its importance should be emphasised by performance-based assessment. As detailed checklists have been shown to be not well suited for the assessment of communication skills for different reasons, this study aimed to validate a global rating scale. A Canadian instrument was translated to German and adapted to assess students' communication skills during an end-of-semester-OSCE. Subjects were second and third year medical students at the reformed track of the Charité-Universitaetsmedizin Berlin. Different groups of raters were trained to assess students' communication skills using the global rating scale. Validity testing included concurrent validity and construct validity: Judgements of different groups of raters were compared to expert ratings as a defined gold standard. Furthermore, the amount of agreement between scores obtained with this global rating scale and a different instrument for assessing communication skills was determined. Results show that communication skills can be validly assessed by trained non-expert raters as well as standardised patients using this instrument.

Why care about linear hair growth rates (LHGR)? a study using in vivo imaging and computer assisted image analysis after manual processing (CAIAMP) in unaffected male controls and men with male pattern hair loss (MPHL).

PubMed

Van Neste, Dominique

2014-01-01

The words "hair growth" frequently encompass many aspects other than just growth. Report on a validation method for precise non-invasive measurement of thickness together with linear hair growth rates of individual hair fibres. To verify the possible correlation between thickness and linear growth rate of scalp hair in male pattern hair loss as compared with healthy male controls. To document the process of validation of hair growth measurement from in vivo image capturing and manual processing, followed by computer assisted image analysis. We analysed 179 paired images obtained with the contrast-enhanced-phototrichogram method with exogen collection (CE-PTG-EC) in 13 healthy male controls and in 87 men with male pattern hair loss (MPHL). There was a global positive correlation between thickness and growth rate (ANOVA; p<0.0001) and a statistically significantly (ANOVA; p<0.0005) slower growth rate in MPHL as compared with equally thick hairs from controls. Finally, the growth rate recorded in the more severe patterns was significantly (ANOVA; P ≤ 0.001) reduced compared with equally thick hair from less severely affected MPHL or controls subjects. Reduced growth rate, together with thinning and shortening of the anagen phase duration in MPHL might contribute together to the global impression of decreased hair volume on the top of the head. Amongst other structural and functional parameters characterizing hair follicle regression, linear hair growth rate warrants further investigation, as it may be relevant in terms of self-perception of hair coverage, quantitative diagnosis and prognostic factor of the therapeutic response.

Incremental validity of the MMPI-2-RF over-reporting scales and RBS in assessing the veracity of memory complaints.

PubMed

Gervais, Roger O; Ben-Porath, Yossef S; Wygant, Dustin B; Sellbom, Martin

2010-06-01

The Response Bias Scale (RBS) has been found to be a better predictor of over-reported memory complaints than Minnesota Multiphasic Personality Inventory-2 (MMPI-2) F, Back Infrequency (Fb), Infrequency-Psychopathology (Fp), and FBS scales. The MMPI-2-Restructured Form (RF) validity scales were designed to meet or exceed the sensitivity of their MMPI-2 counterparts to symptom over-reporting. This study examined the incremental validity of MMPI-2-RF validity scales and RBS in assessing memory complaints. The MMPI-2-RF over-reporting validity scales were more strongly associated with mean Memory Complaints Inventory scores than their MMPI-2 counterparts (d = 0.22 to 0.49). RBS showed the strongest relationship with memory complaints. Regression analyses demonstrated the incremental validity of the MMPI-2-RF Infrequent Responses, Infrequent Psychopathology Responses, Infrequent Somatic Responses, and FBS-r scales relative to MMPI-2 F, Fp, and FBS in predicting memory complaints. This is consistent with the development objectives of the MMPI-2-RF validity scales as more efficient and sensitive measures of symptom over-reporting.