Toward DSM-V: mapping the alcohol use disorder continuum in college students.

PubMed

Hagman, Brett T; Cohn, Amy M

2011-11-01

The present study examined the dimensionality of DSM-IV Alcohol Use Disorder (AUD) criteria using Item Response Theory (IRT) methods and tested the validity of the proposed DSM-V AUD guidelines in a sample of college students. Participants were 396 college students who reported any alcohol use in the past 90 days and were aged 18 years or older. We conducted factor analyses to determine whether a one- or two-factor model provided a better fit to the AUD criteria. IRT analyses estimated item severity and discrimination parameters for each criterion. Multivariate analyses examined differences among the DSM-V diagnostic cut-off (AUD vs. No AUD) and severity qualifiers (no diagnosis, moderate, severe) across several validating measures of alcohol use. A dominant single-factor model provided the best fit to the AUD criteria. IRT analyses indicated that abuse and dependence criteria were intermixed along the latent continuum. The "legal problems" criterion had the highest severity parameter and the tolerance criterion had the lowest severity parameter. The abuse criterion "social/interpersonal problems" and dependence criterion "activities to obtain alcohol" had the highest discrimination parameter estimates. Multivariate analysis indicated that the DSM-V cut-off point, and severity qualifier groups were distinguishable on several measures of alcohol consumption, drinking consequences, and drinking restraint. Findings suggest that the AUD criteria reflect a latent variable that represents a primary disorder and provide support for the proposed DSM-V AUD criteria in a sample of college students. Continued research in other high-risk samples of college students is needed. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

The SNAQ(RC), an easy traffic light system as a first step in the recognition of undernutrition in residential care.

PubMed

Kruizenga, H M; de Vet, H C W; Van Marissing, C M E; Stassen, E E P M; Strijk, J E; Van Bokhorst-de Van der Schueren, M A E; Horman, J C H; Schols, J M G A; Van Binsbergen, J J; Eliens, A; Knol, D L; Visser, M

2010-02-01

Development and validation of a quick and easy screening tool for the early detection of undernourished residents in nursing homes and residential homes. Multi-center, cross sectional observational study. Nursing homes and residential homes. The screening tool was developed in a total of 308 residents (development sample; sample A) and cross validated in a new sample of 720 residents (validation sample) consisting of 476 nursing home residents (Sample B1) and 244 residential home residents (sample B2). Patients were defined severely undernourished when they met at least one of the following criteria: BMI or= 5% unintentional weight loss in the past month and/or >or= 10% unintentional weight loss in the past 6 months. Patients were defined as moderately undernourished if they met the following criteria: BMI 20.1-22 kg/m2 and/or 5-10% unintentional weight loss in the past six months. The most predictive questions (originally derived from previously developed screening instruments) of undernourishment were selected in sample A and cross validated in sample B. In a second stage BMI was added to the SNAQRC in sample B. The diagnostic accuracy of the screening tool in the development and validation samples was expressed in sensitivity, specificity, and the negative and positive predictive value. The four most predictive questions for undernutrition related to: unintentional weight loss more than 6 kg during the past 6 months and more than 3 kg in the past month, capability of eating and drinking with help, and decreased appetite during the past month. The diagnostic accuracy of these questions alone was insufficient (Se=45%, Sp=87%, PPV=50% and NPV=84%). However, combining the questions with measured BMI sufficiently improved the diagnostic accuracy (Se=87%, Sp=82%, PPV=59% and NPV=95%). Early detection of undernourished nursing- and residential home residents is possible using four screening questions and measured BMI.

The importance of having a flexible scope ISO 15189 accreditation and quality specifications based on biological variation--the case of validation of the biochemistry analyzer Dimension Vista.

PubMed

Fernandez-Calle, Pilar; Pelaz, Sandra; Oliver, Paloma; Alcaide, Maria Jose; Gomez-Rioja, Ruben; Buno, Antonio; Iturzaeta, Jose Manuel

2013-01-01

Technological innovation requires the laboratories to ensure that modifications or incorporations of new techniques do not alter the quality of their results. In an ISO 15189 accredited laboratory, flexible scope accreditation facilitates the inclusion of these changes prior to accreditation body evaluation. A strategy to perform the validation of a biochemistry analyzer in an accredited laboratory having a flexible scope is shown. A validation procedure including the evaluation of imprecision and bias of two Dimension Vista analysers 1500 was conducted. Comparability of patient results between one of them and the lately replaced Dimension RxL Max was evaluated. All studies followed the respective Clinical and Laboratory Standards Institute (CLSI) protocols. 30 chemistry assays were studied. Coefficients of variation, percent bias and total error were calculated for all tests and biological variation was considered as acceptance criteria. Quality control material and patient samples were used as test materials. Interchangeability of the results was established by processing forty patients' samples in both devices. 27 of the 30 studied parameters met allowable performance criteria. Sodium, chloride and magnesium did not fulfil acceptance criteria. Evidence of interchangeability of patient results was obtained for all parameters except magnesium, NT-proBNP, cTroponin I and C-reactive protein. A laboratory having a well structured and documented validation procedure can opt to get a flexible scope of accreditation. In addition, performing these activities prior to use on patient samples may evidence technical issues which must be corrected to minimize their impact on patient results.

Validation of the Yale Food Addiction Scale among a weight-loss surgery population.

PubMed

Clark, Shannon M; Saules, Karen K

2013-04-01

The Yale Food Addiction Scale (YFAS), recently validated in college students and binge eaters, is a means to assess "food addiction" in accordance with DSM-IV criteria for substance dependence. Using online survey methodology, we aimed to validate the use of the YFAS among weight loss surgery (WLS) patients. Participants completed measures about pre-WLS food addiction (YFAS), emotional and binge eating, behavioral activation and inhibition, and pre- and post-WLS substance use. A sample of 67 WLS patients (59.7% Roux-en-Y) was recruited; participants were 62.7% female, 86.6% Caucasian, had a mean age of 42.7; and 53.7% met the criteria for pre-WLS food addiction. Convergent validity was found between the YFAS and measures of emotional eating (r=.368, p<.05) and binge eating (r=.469, p<.05). Discriminant validity was supported in that problematic substance use, behavioral activation, and behavioral inhibition were not associated with YFAS scores. Incremental validity was supported in that the YFAS explained a significant proportion of additional variance in binge eating scores, beyond that predicted by emotional eating (EES) and disordered eating behavior (EAT-26). Those meeting the food addiction criteria had poorer percent total weight loss outcomes (32% vs. 27%). There was a nonsignificant trend towards those with higher food addiction being more likely to admit to post-WLS problematic substance use (i.e., potential "addiction transfer"; 53% vs. 39%). Results support the use of the YFAS as a valid measure of food addiction among WLS patients. Future research with a larger sample may shed light on potentially important relationships between pre-surgical food addiction and both weight and substance use outcomes. Copyright © 2013 Elsevier Ltd. All rights reserved.

Validation of Geriatric Depression Scale--5 Scores among Sedentary Older Adults

ERIC Educational Resources Information Center

Marquez, David X.; McAuley, Edward; Motl, Robert W.; Elavsky, Steriani; Konopack, James F.; Jerome, Gerald J.; Kramer, Arthur F.

2006-01-01

This study examined the validity of Geriatric Depression Scale--5 (GDS-5) scores among older sedentary adults based on its structural properties and relationship with external criteria. Participants from two samples (Ns = 185 and 93; M ages = 66 and 67 years) completed baseline assessments as part of randomized controlled exercise trials.…

Insomnia and hypnotic medications are associated with suicidal ideation in a community population.

PubMed

Pigeon, Wilfred R; Woosley, Julie A; Lichstein, Kenneth L

2014-01-01

Suicidal ideation (SI), a significant predictor of suicide, is associated with sleep disturbance, which is seldom assessed using stringent diagnostic criteria and validated sleep instruments in community samples. Cross-sectional data, including sleep diaries and validated instruments, from 767 community adults were used to identify variables associated with SI and subsequently entered into a regression model to predict SI. Suicidal ideation was endorsed by 9.3% of the sample. This group differed from non-ideators on several variables, but only insomnia diagnosis, depression severity, and hypnotic medication use predicted SI. Findings confirm an association of insomnia with SI using stringent criteria and controlling for depression. If treating insomnia is a conceivable pathway to reduce SI, the apparent risk posed by hypnotics may limit treatment options.

Are posttraumatic stress disorder (PTSD) and complex-PTSD distinguishable within a treatment-seeking sample of Syrian refugees living in Lebanon?

PubMed

Hyland, P; Ceannt, R; Daccache, F; Abou Daher, R; Sleiman, J; Gilmore, B; Byrne, S; Shevlin, M; Murphy, J; Vallières, F

2018-01-01

The World Health Organization will publish its 11 th revision of the International Classification of Diseases (ICD-11) in 2018. The ICD-11 will include a refined model of posttraumatic stress disorder (PTSD) and a new diagnosis of complex PTSD (CPTSD). Whereas emerging data supports the validity of these proposals, the discriminant validity of PTSD and CPTSD have yet to be tested amongst a sample of refugees. Treatment-seeking Syrian refugees ( N  = 110) living in Lebanon completed an Arabic version of the International Trauma Questionnaire ; a measure specifically designed to capture the symptom content of ICD-11 PTSD and CPTSD. In total, 62.6% of the sample met the diagnostic criteria for PTSD or CPTSD. More refugees met the criteria for CPTSD (36.1%) than PTSD (25.2%) and no gender differences were observed. Latent class analysis results identified three distinct groups: (1) a PTSD class, (2) a CPTSD class and (3) a low symptom class. Class membership was significantly predicted by levels of functional impairment. Support for the discriminant validity of ICD-11 PTSD and CPTSD was observed for the first time within a sample of refugees. In support of the cross-cultural validity of the ICD-11 proposals, the prevalence of PTSD and CPTSD were similar to those observed in culturally distinct contexts.

Cross-Validation of Survival Bump Hunting by Recursive Peeling Methods.

PubMed

Dazard, Jean-Eudes; Choe, Michael; LeBlanc, Michael; Rao, J Sunil

2014-08-01

We introduce a survival/risk bump hunting framework to build a bump hunting model with a possibly censored time-to-event type of response and to validate model estimates. First, we describe the use of adequate survival peeling criteria to build a survival/risk bump hunting model based on recursive peeling methods. Our method called "Patient Recursive Survival Peeling" is a rule-induction method that makes use of specific peeling criteria such as hazard ratio or log-rank statistics. Second, to validate our model estimates and improve survival prediction accuracy, we describe a resampling-based validation technique specifically designed for the joint task of decision rule making by recursive peeling (i.e. decision-box) and survival estimation. This alternative technique, called "combined" cross-validation is done by combining test samples over the cross-validation loops, a design allowing for bump hunting by recursive peeling in a survival setting. We provide empirical results showing the importance of cross-validation and replication.

Cross-Validation of Survival Bump Hunting by Recursive Peeling Methods

PubMed Central

Dazard, Jean-Eudes; Choe, Michael; LeBlanc, Michael; Rao, J. Sunil

2015-01-01

We introduce a survival/risk bump hunting framework to build a bump hunting model with a possibly censored time-to-event type of response and to validate model estimates. First, we describe the use of adequate survival peeling criteria to build a survival/risk bump hunting model based on recursive peeling methods. Our method called “Patient Recursive Survival Peeling” is a rule-induction method that makes use of specific peeling criteria such as hazard ratio or log-rank statistics. Second, to validate our model estimates and improve survival prediction accuracy, we describe a resampling-based validation technique specifically designed for the joint task of decision rule making by recursive peeling (i.e. decision-box) and survival estimation. This alternative technique, called “combined” cross-validation is done by combining test samples over the cross-validation loops, a design allowing for bump hunting by recursive peeling in a survival setting. We provide empirical results showing the importance of cross-validation and replication. PMID:26997922

A multidimensional assessment of the validity and utility of alcohol use disorder severity as determined by item response theory models.

PubMed

Dawson, Deborah A; Saha, Tulshi D; Grant, Bridget F

2010-02-01

The relative severity of the 11 DSM-IV alcohol use disorder (AUD) criteria are represented by their severity threshold scores, an item response theory (IRT) model parameter inversely proportional to their prevalence. These scores can be used to create a continuous severity measure comprising the total number of criteria endorsed, each weighted by its relative severity. This paper assesses the validity of the severity ranking of the 11 criteria and the overall severity score with respect to known AUD correlates, including alcohol consumption, psychological functioning, family history, antisociality, and early initiation of drinking, in a representative population sample of U.S. past-year drinkers (n=26,946). The unadjusted mean values for all validating measures increased steadily with the severity threshold score, except that legal problems, the criterion with the highest score, was associated with lower values than expected. After adjusting for the total number of criteria endorsed, this direct relationship was no longer evident. The overall severity score was no more highly correlated with the validating measures than a simple count of criteria endorsed, nor did the two measures yield different risk curves. This reflects both within-criterion variation in severity and the fact that the number of criteria endorsed and their severity are so highly correlated that severity is essentially redundant. Attempts to formulate a scalar measure of AUD will do as well by relying on simple counts of criteria or symptom items as by using scales weighted by IRT measures of severity. Published by Elsevier Ireland Ltd.

Design and validation of standardized clinical and functional remission criteria in schizophrenia

PubMed Central

Mosolov, Sergey N; Potapov, Andrey V; Ushakov, Uriy V; Shafarenko, Aleksey A; Kostyukova, Anastasiya B

2014-01-01

Background International Remission Criteria (IRC) for schizophrenia were developed recently by a group of internationally known experts. The IRC detect only 10%–30% of cases and do not cover the diversity of forms and social functioning. Our aim was to design a more applicable tool and validate its use – the Standardized Clinical and Functional Remission Criteria (SCFRC). Methods We used a 6-month follow-up study of 203 outpatients from two Moscow centers and another further sample of stable patients from a 1-year controlled trial of atypical versus typical medication. Diagnosis was confirmed by International Classification of Diseases Version 10 (ICD10) criteria and the Mini-International Neuropsychiatric Interview (MINI). Patients were assessed by the Positive and Negative Syndrome Scale, including intensity threshold, and further classified using the Russian domestic remission criteria and the level of social and personal functioning, according to the Personal and Social Performance Scale (PSP). The SCFRC were formulated and were validated by a data reanalysis on the first population sample and on a second independent sample (104 patients) and in an open-label prospective randomized 12-month comparative study of risperidone long-acting injectable (RLAI) versus olanzapine. Results Only 64 of the 203 outpatients (31.5%) initially met the IRC, and 53 patients (26.1%) met the IRC after 6 months, without a change in treatment. Patients who were in remission had episodic and progressive deficit (39.6%), or remittent (15%) paranoid schizophrenia, or schizoaffective disorder (17%). In addition, 105 patients of 139 (51.7%), who did not meet symptomatic IRC, remained stable within the period. Reanalysis of data revealed that 65.5% of the patients met the SCFRC. In the controlled trial, 70% of patients in the RLAI group met the SCFRC and only 19% the IRC. In the routine treatment group, 55.9% met the SCFRC and only 5.7% the IRC. Results of the further independent sample demonstrated that 35% met the IRC, 65% the SCFRC, and 56% of patients met both the symptomatic and functional criteria. In the controlled trial of RLAI and olanzapine, 40% and 35% of patients, respectively, met the IRC, while 70% and 55%, respectively, met the SCFRC. Conclusion In schizophrenia outpatients, a greater proportion of stable cases is detected in remission by SCFRC in comparison with IRC. The SCFRC were more sensitive to the full spectrum of schizophrenia. The SCFRC appear to be valid as a tool and clinically useful as they produce a comprehensive assessment of treatment effectiveness for a wide range of patients. PMID:24511232

Evaluation of the MMPI-2-RF for Detecting Over-reported Symptoms in a Civil Forensic and Disability Setting.

PubMed

Nguyen, Constance T; Green, Debbie; Barr, William B

2015-01-01

This study investigated the classification accuracy of the Minnesota Multiphasic Personality Inventory-2-Restructured Form validity scales in a sample of disability claimants and civil forensic litigants. A criterion-groups design was used, classifying examinees as "Failed Slick Criteria" through low performance on at least two performance validity indices (stand-alone or embedded) and "Passed Slick Criteria." The stand-alone measures included the Test of Memory Malingering and the Dot Counting Test. The embedded indices were extracted from the Wechsler Adult Intelligence Scales Digit Span and Vocabulary subtests, the California Verbal Learning Test-II, and the Wisconsin Card Sorting Test. Among groups classified by primary complaints at the time of evaluation, those alleging neurological conditions were more frequently classified as Failed Slick Criteria than those alleging psychiatric or medical conditions. Among those with neurological or psychiatric complaints, the F-r, FBS-r, and RBS scales differentiated between those who Passed Slick Criteria from those who Failed Slick Criteria. The Fs scale was also significantly higher in the Failed Slick Criteria compared to Passed Slick Criteria examinees within the psychiatric complaints group. Results indicated that interpretation of scale scores should take into account the examinees' presenting illness. While this study has limitations, it highlights the possibility of different cutoffs depending on the presenting complaints and the need for further studies to cross-validate the results.

How valid are current diagnostic criteria for dental erosion?

PubMed Central

2008-01-01

In principle, there is agreement about the clinical diagnostic criteria for dental erosion, basically defined as cupping and grooving of the occlusal/incisal surfaces, shallow defects on smooth surfaces located coronal from the enamel–cementum junction with an intact cervical enamel rim and restorations rising above the adjacent tooth surface. This lesion characteristic was established from clinical experience and from observations in a small group of subjects with known exposure to acids rather than from systematic research. Their prevalence is higher in risk groups for dental erosion compared to subjects not particularly exposed to acids, but analytical epidemiological studies on random or cluster samples often fail to find a relation between occurrence or severity of lesions and any aetiological factor. Besides other aspects, this finding might be due to lack of validity with respect to diagnostic criteria. In particular, cupping and grooving might be an effect of abrasion as well as of erosion and their value for the specific diagnosis of erosion must be doubted. Knowledge about the validity of current diagnostic criteria of different forms of tooth wear is incomplete, therefore further research is needed. PMID:18228062

Field validation of the dnph method for aldehydes and ketones. Final report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Workman, G.S.; Steger, J.L.

1996-04-01

A stationary source emission test method for selected aldehydes and ketones has been validated. The method employs a sampling train with impingers containing 2,4-dinitrophenylhydrazine (DNPH) to derivatize the analytes. The resulting hydrazones are recovered and analyzed by high performance liquid chromatography. Nine analytes were studied; the method was validated for formaldehyde, acetaldehyde, propionaldehyde, acetophenone and isophorone. Acrolein, menthyl ethyl ketone, menthyl isobutyl ketone, and quinone did not meet the validation criteria. The study employed the validation techniques described in EPA method 301, which uses train spiking to determine bias, and collocated sampling trains to determine precision. The studies were carriedmore » out at a plywood veneer dryer and a polyester manufacturing plant.« less

Technical note: Instantaneous sampling intervals validated from continuous video observation for behavioral recording of feedlot lambs.

PubMed

Pullin, A N; Pairis-Garcia, M D; Campbell, B J; Campler, M R; Proudfoot, K L

2017-11-01

When considering methodologies for collecting behavioral data, continuous sampling provides the most complete and accurate data set whereas instantaneous sampling can provide similar results and also increase the efficiency of data collection. However, instantaneous time intervals require validation to ensure accurate estimation of the data. Therefore, the objective of this study was to validate scan sampling intervals for lambs housed in a feedlot environment. Feeding, lying, standing, drinking, locomotion, and oral manipulation were measured on 18 crossbred lambs housed in an indoor feedlot facility for 14 h (0600-2000 h). Data from continuous sampling were compared with data from instantaneous scan sampling intervals of 5, 10, 15, and 20 min using a linear regression analysis. Three criteria determined if a time interval accurately estimated behaviors: 1) ≥ 0.90, 2) slope not statistically different from 1 ( > 0.05), and 3) intercept not statistically different from 0 ( > 0.05). Estimations for lying behavior were accurate up to 20-min intervals, whereas feeding and standing behaviors were accurate only at 5-min intervals (i.e., met all 3 regression criteria). Drinking, locomotion, and oral manipulation demonstrated poor associations () for all tested intervals. The results from this study suggest that a 5-min instantaneous sampling interval will accurately estimate lying, feeding, and standing behaviors for lambs housed in a feedlot, whereas continuous sampling is recommended for the remaining behaviors. This methodology will contribute toward the efficiency, accuracy, and transparency of future behavioral data collection in lamb behavior research.

Resolving Contradictions of Predictive Validity of University Matriculation Examinations in Nigeria: A Meta-Analysis Approach

ERIC Educational Resources Information Center

Modupe, Ale Veronica; Babafemi, Kolawole Emmanuel

2015-01-01

The study examined the various means of solving contradictions of predictive studies of University Matriculation Examination in Nigeria. The study used a sample size of 35 studies on predictive validity of University Matriculation Examination in Nigeria, which was purposively selected to have met the criteria for meta-analysis. Two null hypotheses…

Reference Proteome Extracts for Mass Spec Instrument Performance Validation and Method Development

PubMed Central

Rosenblatt, Mike; Urh, Marjeta; Saveliev, Sergei

2014-01-01

Biological samples of high complexity are required to test protein mass spec sample preparation procedures and validate mass spec instrument performance. Total cell protein extracts provide the needed sample complexity. However, to be compatible with mass spec applications, such extracts should meet a number of design requirements: compatibility with LC/MS (free of detergents, etc.)high protein integrity (minimal level of protein degradation and non-biological PTMs)compatibility with common sample preparation methods such as proteolysis, PTM enrichment and mass-tag labelingLot-to-lot reproducibility Here we describe total protein extracts from yeast and human cells that meet the above criteria. Two extract formats have been developed: Intact protein extracts with primary use for sample preparation method development and optimizationPre-digested extracts (peptides) with primary use for instrument validation and performance monitoring

A meta-analysis of an implicit measure of personality functioning: the Mutuality of Autonomy Scale.

PubMed

Graceffo, Robert A; Mihura, Joni L; Meyer, Gregory J

2014-01-01

The Mutuality of Autonomy scale (MA) is a Rorschach variable designed to capture the degree to which individuals mentally represent self and other as mutually autonomous versus pathologically destructive (Urist, 1977). Discussions of the MA's validity found in articles and chapters usually claim good support, which we evaluated by a systematic review and meta-analysis of its construct validity. Overall, in a random effects analysis across 24 samples (N = 1,801) and 91 effect sizes, the MA scale was found to maintain a relationship of r =.20, 95% CI [.16,.25], with relevant validity criteria. We hypothesized that MA summary scores that aggregate more MA response-level data would maintain the strongest relationship with relevant validity criteria. Results supported this hypothesis (aggregated scoring method: r =.24, k = 57, S = 24; nonaggregated scoring methods: r =.15, k = 34, S = 10; p =.039, 2-tailed). Across 7 exploratory moderator analyses, only 1 (criterion method) produced significant results. Criteria derived from the Thematic Apperception Test produced smaller effects than clinician ratings, diagnostic differentiation, and self-attributed characteristics; criteria derived from observer reports produced smaller effects than clinician ratings and self-attributed characteristics. Implications of the study's findings are discussed in terms of both research and clinical work.

The importance of having a flexible scope ISO 15189 accreditation and quality specifications based on biological variation – the case of validation of the biochemistry analyzer Dimension Vista

PubMed Central

Fernandez-Calle, Pilar; Pelaz, Sandra; Oliver, Paloma; Alcaide, Maria Jose; Gomez-Rioja, Ruben; Buno, Antonio; Iturzaeta, Jose Manuel

2013-01-01

Introduction Technological innovation requires the laboratories to ensure that modifications or incorporations of new techniques do not alter the quality of their results. In an ISO 15189 accredited laboratory, flexible scope accreditation facilitates the inclusion of these changes prior to accreditation body evaluation. A strategy to perform the validation of a biochemistry analyzer in an accredited laboratory having a flexible scope is shown. Materials and methods: A validation procedure including the evaluation of imprecision and bias of two Dimension Vista analysers 1500 was conducted. Comparability of patient results between one of them and the lately replaced Dimension RxL Max was evaluated. All studies followed the respective Clinical and Laboratory Standards Institute (CLSI) protocols. 30 chemistry assays were studied. Coefficients of variation, percent bias and total error were calculated for all tests and biological variation was considered as acceptance criteria. Quality control material and patient samples were used as test materials. Interchangeability of the results was established by processing forty patients’ samples in both devices. Results: 27 of the 30 studied parameters met allowable performance criteria. Sodium, chloride and magnesium did not fulfil acceptance criteria. Evidence of interchangeability of patient results was obtained for all parameters except magnesium, NT-proBNP, cTroponin I and C-reactive protein. Conclusions: A laboratory having a well structured and documented validation procedure can opt to get a flexible scope of accreditation. In addition, performing these activities prior to use on patient samples may evidence technical issues which must be corrected to minimize their impact on patient results. PMID:23457769

40 CFR 86.1912 - How do I determine whether an engine meets the vehicle-pass criteria?

Code of Federal Regulations, 2011 CFR

2011-07-01

... region, will not be added together to make a 30 second or longer event. Exclude any portion of a sampling... section for at least 90 percent of the valid NTE sampling events, as defined in paragraph (b) of this section. For 2007 through 2009 model year engines, the average emissions from every NTE sampling event...

External validity of post-stroke interventional gait rehabilitation studies.

PubMed

Kafri, Michal; Dickstein, Ruth

2017-01-01

Gait rehabilitation is a major component of stroke rehabilitation, and is supported by extensive research. The objective of this review was to examine the external validity of intervention studies aimed at improving gait in individuals post-stroke. To that end, two aspects of these studies were assessed: subjects' exclusion criteria and the ecological validity of the intervention, as manifested by the intervention's technological complexity and delivery setting. Additionally, we examined whether the target population as inferred from the titles/abstracts is broader than the population actually represented by the reported samples. We systematically researched PubMed for intervention studies to improve gait post-stroke, working backwards from the beginning of 2014. Exclusion criteria, the technological complexity of the intervention (defined as either elaborate or simple), setting, and description of the target population in the titles/abstracts were recorded. Fifty-two studies were reviewed. The samples were exclusive, with recurrent stroke, co-morbidities, cognitive status, walking level, and residency being major reasons for exclusion. In one half of the studies, the intervention was elaborate. Descriptions of participants in the title/abstract in almost one half of the studies included only the diagnosis (stroke or comparable terms) and its stage (acute, subacute, and chronic). The external validity of a substantial number of intervention studies about rehabilitation of gait post-stroke appears to be limited by exclusivity of the samples as well as by deficiencies in ecological validity of the interventions. These limitations are not accurately reflected in the titles or abstracts of the studies.

Analysis of internal and external validity criteria for a computerized visual search task: A pilot study.

PubMed

Richard's, María M; Introzzi, Isabel; Zamora, Eliana; Vernucci, Santiago

2017-01-01

Inhibition is one of the main executive functions, because of its fundamental role in cognitive and social development. Given the importance of reliable and computerized measurements to assessment inhibitory performance, this research intends to analyze the internal and external criteria of validity of a computerized conjunction search task, to evaluate the role of perceptual inhibition. A sample of 41 children (21 females and 20 males), aged between 6 and 11 years old (M = 8.49, SD = 1.47), intentionally selected from a private management school of Mar del Plata (Argentina), middle socio-economic level were assessed. The Conjunction Search Task from the TAC Battery, Coding and Symbol Search tasks from Wechsler Intelligence Scale for Children were used. Overall, results allow us to confirm that the perceptual inhibition task form TAC presents solid rates of internal and external validity that make a valid measurement instrument of this process.

Exploring DSM-5 ADHD criteria beyond young adulthood: phenomenology, psychometric properties and prevalence in a large three-decade birth cohort.

PubMed

Vitola, E S; Bau, C H D; Salum, G A; Horta, B L; Quevedo, L; Barros, F C; Pinheiro, R T; Kieling, C; Rohde, L A; Grevet, E H

2017-03-01

There are still uncertainties on the psychometric validity of the DSM-5 attention deficit hyperactivity disorder (ADHD) criteria for its use in the adult population. We aim to describe the adult ADHD phenotype, to test the psychometric properties of the DSM-5 ADHD criteria, and to calculate the resulting prevalence in a population-based sample in their thirties. A cross-sectional evaluation using the DSM-5 ADHD criteria was carried out in 3574 individuals from the 1982 Pelotas Birth Cohort. Through receiver operator curve, latent and regression analyses, we obtained parameters on construct and discriminant validity. Still, prevalence rates were calculated for different sets of criteria. The latent analysis suggested that the adult ADHD phenotype is constituted mainly by inattentive symptoms. Also, inattention symptoms were the symptoms most associated with impairment. The best cut-off for diagnosis was four symptoms, but sensitivity and specificity for this cut-off was low. ADHD prevalence rates were 2.1% for DSM-5 ADHD criteria and 5.8% for ADHD disregarding age-of-onset criterion. The bi-dimensional ADHD structure proposed by the DSM demonstrated both construct and discriminant validity problems when used in the adult population, since inattention is a much more relevant feature in the adult phenotype. The use of the DSM-5 criteria results in a higher prevalence of ADHD when compared to those obtained by DSM-IV, and prevalence would increase almost threefold when considering current ADHD syndrome. These findings suggest a need for further refinement of the criteria for its use in the adult population.

Testing the validity and acceptability of the diagnostic criteria for Hoarding Disorder: a DSM-5 survey.

PubMed

Mataix-Cols, D; Fernández de la Cruz, L; Nakao, T; Pertusa, A

2011-12-01

The DSM-5 Obsessive-Compulsive Spectrum Sub-Workgroup is recommending the creation of a new diagnostic category named Hoarding Disorder (HD). The validity and acceptability of the proposed diagnostic criteria have yet to be formally tested. Obsessive-compulsive disorder/hoarding experts and random members of the American Psychiatric Association (APA) were shown eight brief clinical vignettes (four cases meeting criteria for HD, three with hoarding behaviour secondary to other mental disorders, and one with subclinical hoarding behaviour) and asked to decide the most appropriate diagnosis in each case. Participants were also asked about the perceived acceptability of the criteria and whether they supported the inclusion of HD in the main manual. Altogether, 211 experts and 48 APA members completed the survey (30% and 10% response rates, respectively). The sensitivity and specificity of the HD diagnosis and the individual criteria were high (80-90%) across various types of professionals, irrespective of their experience with hoarding cases. About 90% of participants in both samples thought the criteria would be very/somewhat acceptable for professionals and sufferers. Most experts (70%) supported the inclusion of HD in the main manual, whereas only 50% of the APA members did. The proposed criteria for HD have high sensitivity and specificity. The criteria are also deemed acceptable for professionals and sufferers alike. Training of professionals and the development and validation of semi-structured diagnostic instruments should improve diagnostic accuracy even further. A field trial is now needed to confirm these encouraging findings with real patients in real clinical settings.

Cross-cultural validity of standardized motor development screening and assessment tools: a systematic review.

PubMed

Mendonça, Bianca; Sargent, Barbara; Fetters, Linda

2016-12-01

To investigate whether standardized motor development screening and assessment tools that are used to evaluate motor abilities of children aged 0 to 2 years are valid in cultures other than those in which the normative sample was established. This was a systematic review in which six databases were searched. Studies were selected based on inclusion/exclusion criteria and appraised for evidence level and quality. Study variables were extracted. Twenty-three studies representing six motor development screening and assessment tools in 16 cultural contexts met the inclusion criteria: Alberta Infant Motor Scale (n=7), Ages and Stages Questionnaire, 3rd edition (n=2), Bayley Scales of Infant and Toddler Development, 3rd edition (n=8), Denver Developmental Screening Test, 2nd edition (n=4), Harris Infant Neuromotor Test (n=1), and Peabody Developmental Motor Scales, 2nd edition (n=1). Thirteen studies found significant differences between the cultural context and normative sample. Two studies established reliability and/or validity of standardized motor development assessments in high-risk infants from different cultural contexts. Five studies established new population norms. Eight studies described the cross-cultural adaptation of a standardized motor development assessment. Standardized motor development assessments have limited validity in cultures other than that in which the normative sample was established. Their use can result in under- or over-referral for services. © 2016 Mac Keith Press.

Exploring the Validity of the Affect Balance Scale With a Sample of Family Caregivers

PubMed Central

Perkinson, Margaret A.; Albert, Steven M.; Luborsky, Mark; Moss, Miriam; Glicksman, Allen

2014-01-01

Open-ended responses of caregiving daughters and daughters-in-law were generated by a modified random probe technique to investigate the construct validity of the two subscales of the Affect Balance Scale (ABS), i.e., the 5-item Positive Affect Scale (PAS) and the 5-item Negative Affect Scale (NAS). A set of criteria were developed to distinguish between responses that did and did not correspond to Bradburn’s assumptions concerning affect. While most responses met at least one of the criteria, very few met all. In exploring the nature of affect, we found that positive affect was based to a large extent on personal accomplishments and the recognition of others. The assessment of negative affect was a more interior, or self-focused process. For a significant subset of the sample, a negative response to a closed-ended PAS or NAS item implied disagreement or discontent with the wording or the implications of the item itself, rather than an absence of affect. Not all of the ABS items were equally valid measures of affect. PMID:8056955

Development and Validation of the Minnesota Borderline Personality Disorder Scale (MBPD)

PubMed Central

Bornovalova, Marina A.; Hicks, Brian M.; Patrick, Christopher J.; Iacono, William G.; McGue, Matt

2011-01-01

While large epidemiological datasets can inform research on the etiology and development of borderline personality disorder (BPD), they rarely include BPD measures. In some cases, however, proxy measures can be constructed using instruments already in these datasets. In this study we developed and validated a self-report measure of BPD from the Multidimensional Personality Questionnaire (MPQ). Items for the new instrument—the Minnesota BPD scale (MBPD)—were identified and refined using three large samples: undergraduates, community adolescent twins, and urban substance users. We determined the construct validity of the MBPD by examining its association with (1) diagnosed BPD, (2) questionnaire reported BPD symptoms, and (3) clinical variables associated with BPD: suicidality, trauma, disinhibition, internalizing distress, and substance use. We also tested the MBPD in two prison inmate samples. Across samples, the MBPD correlated with BPD indices and external criteria, and showed incremental validity above measures of negative affect, thus supporting its construct validity as a measure of BPD. PMID:21467094

40 CFR 1065.514 - Cycle-validation criteria for operation over specified duty cycles.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 40 Protection of Environment 34 2012-07-01 2012-07-01 false Cycle-validation criteria for... Over Specified Duty Cycles § 1065.514 Cycle-validation criteria for operation over specified duty...-validation criteria. You must compare the original reference duty cycle points generated as described in...

40 CFR 1065.514 - Cycle-validation criteria for operation over specified duty cycles.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 40 Protection of Environment 34 2013-07-01 2013-07-01 false Cycle-validation criteria for... Over Specified Duty Cycles § 1065.514 Cycle-validation criteria for operation over specified duty...-validation criteria. You must compare the original reference duty cycle points generated as described in...

40 CFR 1065.514 - Cycle-validation criteria for operation over specified duty cycles.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 40 Protection of Environment 33 2011-07-01 2011-07-01 false Cycle-validation criteria for... Over Specified Duty Cycles § 1065.514 Cycle-validation criteria for operation over specified duty...-validation criteria. You must compare the original reference duty cycle points generated as described in...

40 CFR 1065.514 - Cycle-validation criteria for operation over specified duty cycles.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 40 Protection of Environment 33 2014-07-01 2014-07-01 false Cycle-validation criteria for... Over Specified Duty Cycles § 1065.514 Cycle-validation criteria for operation over specified duty...-validation criteria. You must compare the original reference duty cycle points generated as described in...

Establishing diagnostic cut-off criteria for the COBAS AmpliPrep/COBAS TaqMan HIV-1 Qualitative test through validation against the Amplicor DNA test v1.5 for infant diagnosis using dried blood spots.

PubMed

Maritz, Jean; Preiser, Wolfgang; van Zyl, Gert U

2012-02-01

As antibody testing cannot confirm HIV-1 infection in children less than 18 months of age, diagnosis in these children depends on nucleic acid testing. The COBAS(®) AmpliPrep/COBAS(®) TaqMan(®) (CAP/CTM, Roche(®) Molecular Systems, Inc., Branchburg, NJ) HIV-1 Qualitative test is a total nucleic acid real-time PCR assay utilising whole EDTA blood or dried blood spots (DBS), which recently replaced the Roche(®) AMPLICOR(®) DNA test v1.5 (Amplicor) as the diagnostic HIV PCR assay in many South African laboratories. For the Amplicor assay, stringent diagnostic criteria were previously formulated for the local population, and a comparison reported the CAP/CTM's sensitivity at 99.7% and specificity at 100% for both sample types compared to these Amplicor criteria. To validate the assay prior to introduction in our laboratory and to define stringent diagnostic cut-off criteria. Whole EDTA blood samples from patients younger than 18 months sent for routine HIV-1 diagnosis were tested by Amplicor, and positive results were confirmed from DBS. CAP/CTM assays were subsequently performed from DBS. The CAP/CTM had a sensitivity of 98.8% and a specificity of 97.1%, but a positive predictive value (PPV) of only 78.7% compared to the Amplicor assay. Samples positive by CAP/CTM but negative by Amplicor displayed poor amplification curves compared to concordant positive samples. Upon re-testing those with sufficient material available by CAP/CTM, all showed negative results. The decreased PPV may either be due to false positive CAP/CTM results, or increased sensitivity compared to the Amplicor assay. Criteria were formulated for defining presumed false-positive results. Copyright © 2011 Elsevier B.V. All rights reserved.

Psycho-oncology assessment in Chinese populations: a systematic review of quality of life and psychosocial measures.

PubMed

Hyde, M K; Chambers, S K; Shum, D; Ip, D; Dunn, J

2016-09-01

This systematic review describes psychosocial and quality of life (QOL) measures used in psycho-oncology research with cancer patients and caregivers in China. Medline and PsycINFO databases were searched (1980-2014). Studies reviewed met the following criteria: English language; peer-reviewed; sampled Chinese cancer patients/caregivers; developed, validated or assessed psychometric properties of psychosocial or QOL outcome measures; and reported validation data. The review examined characteristics of measures and participants, translation and cultural adaptation processes and psychometric properties of the measures. Ninety five studies met review criteria. Common characteristics of studies reviewed were they: assessed primarily QOL measures, sampled patients with breast, colorectal, or head and neck cancer, and validated existing measures (>80%) originating in North America or Europe. Few studies reported difficulties translating measures. Regarding psychometric properties of the measures >50% of studies reported subscale reliabilities <α = 0.70, <50% reported test-retest reliability, and <30% reported divergent validity. Few reported sensitivity, specificity or responsiveness. Improved accuracy and transparency of reporting for translation, cultural adaptation and psychometric testing of psychosocial measures is needed. Developing support structures for translating and validating psychosocial measures would enable this and ensure Chinese psycho-oncology clinical practice and research keeps pace with international focus on patient reported outcome measures and data management. © 2015 John Wiley & Sons Ltd.

40 CFR 86.1912 - How do I determine whether an engine meets the vehicle-pass criteria?

Code of Federal Regulations, 2010 CFR

2010-07-01

... deficiency area or limited testing region, will not be added together to make a 30 second or longer event... section for at least 90 percent of the valid NTE sampling events, as defined in paragraph (b) of this section. For 2007 through 2009 model year engines, the average emissions from every NTE sampling event...

Validation of the criteria for initiating the cleaning of heating, ventilation, and air-conditioning (HVAC) ductwork under real conditions.

PubMed

Lavoie, Jacques; Marchand, Geneviève; Cloutier, Yves; Lavoué, Jérôme

2011-08-01

Dust accumulation in the components of heating, ventilation, and air-conditioning (HVAC) systems is a potential source of contaminants. To date, very little information is available on recognized methods for assessing dust buildup in these systems. The few existing methods are either objective in nature, involving numerical values, or subjective in nature, based on experts' judgments. An earlier project aimed at assessing different methods of sampling dust in ducts was carried out in the laboratories of the Institut de recherche Robert-Sauvé en santé et en sécurité du travail (IRSST). This laboratory study showed that all the sampling methods were practicable, provided that a specific surface-dust cleaning initiation criterion was used for each method. However, these conclusions were reached on the basis of ideal conditions in a laboratory using a reference dust. The objective of this present study was to validate these laboratory results in the field. To this end, the laboratory sampling templates were replicated in real ducts and the three sampling methods (the IRSST method, the method of the U.S. organization National Air Duct Cleaner Association [NADCA] and that of the French organization Association pour la Prévention et l'Étude de la Contamination [ASPEC]) were used simultaneously in a statistically representative number of systems. The air return and supply ducts were also compared. Cleaning initiation criteria under real conditions were found to be 6.0 mg/100 cm(2) using the IRSST method, 2.0 mg/100 cm(2) using the NADCA method, and 23 mg/100 cm(2) using the ASPEC method. In the laboratory study, the criteria using the same methods were 6.0 for the IRSST method, 2.0 for the NADCA method, and 3.0 for the ASPEC method. The laboratory criteria for the IRSST and NADCA methods were therefore validated in the field. The ASPEC criterion was the only one to change. The ASPEC method therefore allows for the most accurate evaluation of dust accumulation in HVAC ductwork. We therefore recommend using the latter method to objectively assess dust accumulation levels in HVAC ductwork.

Optimized probability sampling of study sites to improve generalizability in a multisite intervention trial.

PubMed

Kraschnewski, Jennifer L; Keyserling, Thomas C; Bangdiwala, Shrikant I; Gizlice, Ziya; Garcia, Beverly A; Johnston, Larry F; Gustafson, Alison; Petrovic, Lindsay; Glasgow, Russell E; Samuel-Hodge, Carmen D

2010-01-01

Studies of type 2 translation, the adaption of evidence-based interventions to real-world settings, should include representative study sites and staff to improve external validity. Sites for such studies are, however, often selected by convenience sampling, which limits generalizability. We used an optimized probability sampling protocol to select an unbiased, representative sample of study sites to prepare for a randomized trial of a weight loss intervention. We invited North Carolina health departments within 200 miles of the research center to participate (N = 81). Of the 43 health departments that were eligible, 30 were interested in participating. To select a representative and feasible sample of 6 health departments that met inclusion criteria, we generated all combinations of 6 from the 30 health departments that were eligible and interested. From the subset of combinations that met inclusion criteria, we selected 1 at random. Of 593,775 possible combinations of 6 counties, 15,177 (3%) met inclusion criteria. Sites in the selected subset were similar to all eligible sites in terms of health department characteristics and county demographics. Optimized probability sampling improved generalizability by ensuring an unbiased and representative sample of study sites.

[Rosenberg self-esteem scale: validation in a representative sample of Chilean adults].

PubMed

Rojas-Barahona, Cristian A; Zegers, Beatriz; Förster, Carla E

2009-06-01

Self-esteem is positively associated to the well being of people and could be a good mental health indicator. To determine the reliability and validity of the Rosenberg Self-esteem Scale in a Chilean adult sample. The instrument was applied to 473 subjects living in the Metropolitan Region of Santiago, evenly distributed according to gender, age, educational level and income. The Neugarten Life Satisfaction index (LSI-A) was also applied to the sample. Cronbach's alpha for reliability of the scale was 0.754. There was no gender bias and factor analysis grouped items into two factors (5 positive and 5 negative). The instrument had a correlation of 0.455 with the LSI-A. The Rosenberg Self-esteem Scale meets the criteria for validity and reliability of a quality instrument to measure self-esteem in Chile.

Reliability and validity of the Edinburgh Postnatal Depression Scale (EPDS) for detecting perinatal common mental disorders (PCMDs) among women in low-and lower-middle-income countries: a systematic review.

PubMed

Shrestha, Sumitra Devi; Pradhan, Rina; Tran, Thach D; Gualano, Rosa C; Fisher, Jane R W

2016-04-04

The Edinburgh Postnatal Depression Scale (EPDS), originally developed in Britain, is one of the most widely used screening instruments for assessing symptoms of the Perinatal Common Mental Disorders (PCMDs) of depression and anxiety. However, its potential to detect PCMDs in culturally diverse low- and lower-middle income countries (LALMICs) is unclear. This systematic review aimed to appraise formally validated local language versions of the EPDS from these resource-constrained settings. Following the PRISMA protocol, we searched MEDLINE-OVID, CINAHL-Plus and PUBMED to identify studies reporting translation, cultural adaptation and formal validation of the EPDS to detect PCMDs among women in LALMICs. The quality of the studies meeting inclusion criteria was assessed using standard criteria and a new process-based criteria; which was developed specifically for this study. We identified 1281 records among which 16 met inclusion criteria; three further papers were identified by hand-searching reference lists. The publications reported findings from 12 LALMICs in 14 native languages. Most of these local language versions of the EPDS (LLV-EPDS) had lower precision for identifying true cases of PCMDs among women in the general perinatal population compared to the original English version. Only one study met all criteria for culturally sensitive translation, the others had not established the comprehensibility of the local version amongst representative groups of women in pre-testing. Many studies tested the LLV-EPDS only amongst convenience samples recruited at single health facilities. Diagnostic interviews for confirmation of mental disorders could have been influenced by the mental health professionals' lack of blinding to the initial screening results. Additionally, even when diagnostic-interviews were carried out in the local language, questions might not have been understood as most studies followed standard diagnostic protocol which had not been culturally adapted. Most of the LLV-EPDS from non-English speaking low- and middle-income-countries did not meet all criteria for formal validation of a screening instrument. Psychometric properties of LLV-EPDS could be enhanced by adopting the new process-based criteria for translation, adaptation and validation.

Convergent validity of alternative MMPI-2 personality disorder scales.

PubMed

Hicklin, J; Widiger, T A

2000-12-01

The Morey, Waugh, and Blashfield (1985) MMPI (Hathaway et al., 1989) personality disorder scales provided a significant contribution to personality disorder research and assessment. However, the subsequent revisions to the MMPI and the multiple revisions to the diagnostic criteria sets that have since occurred may have justified comparable revisions to these scales. Somwaru and Ben-Porath (1995) selected a substantially different set of items from the MMPI-2 (Butcher, Dahlstrom, Graham, Tellegen, & Kaemmer, 1989) to assess Diagnostic and Statistical Manual of Mental Disorders (4th ed.; American Psychiatric Association, 1994) personality disorder diagnostic criteria. In our study, we compared the convergent validity of these alternative MMPI-2 personality disorder scales with respect to 3 self-report measures of personality disorder symptomatology in a sample of 82 psychiatric outpatients. The results suggested that Somwaru and Ben-Porath's scales are as valid as the original Morey et al. scales and might be even more valid for the assessment of borderline, antisocial, and schizoid personality disorder symptomatology.

Criterion and incremental validity of the emotion regulation questionnaire

PubMed Central

Ioannidis, Christos A.; Siegling, A. B.

2015-01-01

Although research on emotion regulation (ER) is developing, little attention has been paid to the predictive power of ER strategies beyond established constructs. The present study examined the incremental validity of the Emotion Regulation Questionnaire (ERQ; Gross and John, 2003), which measures cognitive reappraisal and expressive suppression, over and above the Big Five personality factors. It also extended the evidence for the measure's criterion validity to yet unexamined criteria. A university student sample (N = 203) completed the ERQ, a measure of the Big Five, and relevant cognitive and emotion-laden criteria. Cognitive reappraisal predicted positive affect beyond personality, as well as experiential flexibility and constructive self-assertion beyond personality and affect. Expressive suppression explained incremental variance in negative affect beyond personality and in experiential flexibility beyond personality and general affect. No incremental effects were found for worry, social anxiety, rumination, reflection, and preventing negative emotions. Implications for the construct validity and utility of the ERQ are discussed. PMID:25814967

Assessment of bachelor's theses in a nursing degree with a rubrics system: Development and validation study.

PubMed

González-Chordá, Víctor M; Mena-Tudela, Desirée; Salas-Medina, Pablo; Cervera-Gasch, Agueda; Orts-Cortés, Isabel; Maciá-Soler, Loreto

2016-02-01

Writing a bachelor thesis (BT) is the last step to obtain a nursing degree. In order to perform an effective assessment of a nursing BT, certain reliable and valid tools are required. To develop and validate a 3-rubric system (drafting process, dissertation, and viva) to assess final year nursing students' BT. A multi-disciplinary study of content validity and psychometric properties. The study was carried out between December 2014 and July 2015. Nursing Degree at Universitat Jaume I. Spain. Eleven experts (9 nursing professors and 2 education professors from 6 different universities) took part in the development and content validity stages. Fifty-two theses presented during the 2014-2015 academic year were included by consecutive sampling of cases in order to study the psychometric properties. First, a group of experts was created to validate the content of the assessment system based on three rubrics (drafting process, dissertation, and viva). Subsequently, a reliability and validity study of the rubrics was carried out on the 52 theses presented during the 2014-2015 academic year. The BT drafting process rubric has 8 criteria (S-CVI=0.93; α=0.837; ICC=0.614), the dissertation rubric has 7 criteria (S-CVI=0.9; α=0.893; ICC=0.74), and the viva rubric has 4 criteria (S-CVI=0.86; α=8.16; ICC=0.895). A nursing BT assessment system based on three rubrics (drafting process, dissertation, and viva) has been validated. This system may be transferred to other nursing degrees or degrees from other academic areas. It is necessary to continue with the validation process taking into account factors that may affect the results obtained. Copyright © 2015 Elsevier Ltd. All rights reserved.

Clinical validation of the C-VAT 2.0 assessment tool for gaming disorder: A sensitivity analysis of the proposed DSM-5 criteria and the clinical characteristics of young patients with 'video game addiction'.

PubMed

van Rooij, Antonius J; Schoenmakers, Tim M; van de Mheen, Dike

2017-01-01

Clinicians struggle with the identification of video gaming problems. To address this issue, a clinical assessment tool (C-VAT 2.0) was developed and tested in a clinical setting. The instrument allows exploration of the validity of the DSM-5 proposal for 'internet gaming disorder'. Using C-VAT 2.0, the current study provides a sensitivity analysis of the proposed DSM-5 criteria in a clinical youth sample (13-23years old) in treatment for video gaming disorder (N=32). The study also explores the clinical characteristics of these patients. The patients were all male and reported spending extensive amounts of time on video games. At least half of the patients reported playing online games (n=15). Comorbid problems were common (n=22) and included (social) anxiety disorders, PDD NOS, ADHD/ADD, Parent-Child relationship problem, and various types of depressive mood problems. The sensitivity of the test was good: results further show that the C-VAT correctly identified 91% of the sample at the proposed cut-off score of at least 5 out of 9 of the criteria. As our study did not include healthy, extreme gamers, we could not assess the specificity of the tool: future research should make this a priority. Using the proposed DSM-5 cut-off score, the C-VAT 2.0 shows preliminary validity in a sample of gamers in treatment for gaming disorder, but the discriminating value of the instrument should be studied further. In the meantime, it is crucial that therapists try to avoid false positives by using expert judgment of functional impairment in each case. Copyright © 2015 Elsevier Ltd. All rights reserved.

Assessment of Semi-Structured Clinical Interview for Mobile Phone Addiction Disorder.

PubMed

Alavi, Seyyed Salman; Mohammadi, Mohammad Reza; Jannatifard, Fereshteh; Mohammadi Kalhori, Soroush; Sepahbodi, Ghazal; BabaReisi, Mohammad; Sajedi, Sahar; Farshchi, Mojtaba; KhodaKarami, Rasul; Hatami Kasvaee, Vahid

2016-04-01

The Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision (DSM-IV-TR) classified mobile phone addiction disorder under "impulse control disorder not elsewhere classified". This study surveyed the diagnostic criteria of DSM-IV-TR for the diagnosis of mobile phone addiction in correspondence with Iranian society and culture. Two hundred fifty students of Tehran universities were entered into this descriptive-analytical and cross-sectional study. Quota sampling method was used. At first, semi- structured clinical interview (based on DSM-IV-TR) was performed for all the cases, and another specialist reevaluated the interviews. Data were analyzed using content validity, inter-scorer reliability (Kappa coefficient) and test-retest via SPSS18 software. The content validity of the semi- structured clinical interview matched the DSM-IV-TR criteria for behavioral addiction. Moreover, their content was appropriate, and two items, including "SMS pathological use" and "High monthly cost of using the mobile phone" were added to promote its validity. Internal reliability (Kappa) and test-retest reliability were 0.55 and r = 0.4 (p<0. 01) respectively. The results of this study revealed that semi- structured diagnostic criteria of DSM-IV-TR are valid and reliable for diagnosing mobile phone addiction, and this instrument is an effective tool to diagnose this disorder.

An Integrative Review of Self-Efficacy Measurement Instruments in Youth with Type 1 Diabetes (T1DM)

PubMed Central

Rasbach, Lisa; Jenkins, Carolyn; Laffel, Lori

2014-01-01

Purpose The purpose of this study is to assess the extant literature on instruments used to measure self-efficacy in youth with type 1 diabetes (T1DM) and their caregivers and to critically evaluate these measurements. Methods An integrative review (2003–2013) was conducted searching PsycINFO, Cumulative Index to Nursing and Allied Health Literature (CINAHL), and U.S. National Library of Medicine PubMed service (PubMed) databases using key words diabetes, type 1 diabetes, and self-efficacy. The authors reviewed the resulting294 references for inclusion criteria of (a) sample of youth with T1DM or sample of caregivers of youth with T1DM, (b) description of the self-efficacy instrument as primary research, and (c) the instrument measured self-efficacy specifically related to diabetes management. Forty-five articles out of the initial 294 met criteria. Results Of the 45 articles, 10 different self-efficacy instruments were identified. The primary theoretical framework used was Bandura’s social cognitive theory and model of self-efficacy. Most participants were white middle class T1DM youth. Evaluations to assess validity often were not reported; however, a majority of studies reported high internal consistency of the instruments. Conclusions Sample homogeneity could limit the applicability of results to certain patient populations. Further psychometric analysis, including validity assessments, should be conducted in more diverse samples. Development of valid and reliable instruments for measuring self-efficacy that are sensitive to change across a wider caregiver base over time is necessary. While this review examined reliable and valid instruments used in research, future opportunities include evaluation of measuring self-efficacy in T1DM youth exposed to recent advances in diabetes management technologies. PMID:25216655

Methodological Issues in the Classification of Attention-Related Disorders.

ERIC Educational Resources Information Center

Fletcher, Jack M.; And Others

1991-01-01

For successful classification of children with attention deficit-hyperactivity disorder, major issues include (1) the need for explicit studies of identification criteria; (2) the need for systematic sampling strategies; (3) development of hypothetical classifications; and (4) systematic assessment of reliability and validity of hypothetical…

Synchronization of generalized reaction-diffusion neural networks with time-varying delays based on general integral inequalities and sampled-data control approach.

PubMed

Dharani, S; Rakkiyappan, R; Cao, Jinde; Alsaedi, Ahmed

2017-08-01

This paper explores the problem of synchronization of a class of generalized reaction-diffusion neural networks with mixed time-varying delays. The mixed time-varying delays under consideration comprise of both discrete and distributed delays. Due to the development and merits of digital controllers, sampled-data control is a natural choice to establish synchronization in continuous-time systems. Using a newly introduced integral inequality, less conservative synchronization criteria that assure the global asymptotic synchronization of the considered generalized reaction-diffusion neural network and mixed delays are established in terms of linear matrix inequalities (LMIs). The obtained easy-to-test LMI-based synchronization criteria depends on the delay bounds in addition to the reaction-diffusion terms, which is more practicable. Upon solving these LMIs by using Matlab LMI control toolbox, a desired sampled-data controller gain can be acuqired without any difficulty. Finally, numerical examples are exploited to express the validity of the derived LMI-based synchronization criteria.

Assessment of the LV-C2 Stack Sampling Probe Location for Compliance with ANSI/HPS N13.1-1999

DOE Office of Scientific and Technical Information (OSTI.GOV)

Glissmeyer, John A.; Antonio, Ernest J.; Flaherty, Julia E.

2015-09-01

This document reports on a series of tests conducted to assess the proposed air sampling location for the Hanford Tank Waste Treatment and Immobilization Plant (WTP) Low-Activity Waste (LAW) C2V (LV-C2) exhaust stack with respect to the applicable criteria regarding the placement of an air sampling probe. Federal regulations require that a sampling probe be located in the exhaust stack according to the criteria established by the American National Standards Institute/Health Physics Society (ANSI/HPS) N13.1-1999, Sampling and Monitoring Releases of Airborne Radioactive Substances from the Stack and Ducts of Nuclear Facilities. These criteria address the capability of the sampling probemore » to extract a sample that represents the effluent stream. The tests were conducted on the LV-C2 scale model system. Based on the scale model tests, the location proposed for the air sampling probe in the scale model stack meets the requirements of the ANSI/HPS N13.1-1999 standard for velocity uniformity, flow angle, gas tracer and particle tracer uniformity. Additional velocity uniformity and flow angle tests on the actual stack will be necessary during cold startup to confirm the validity of the scale model results in representing the actual stack.« less

Validation of the process criteria for assessment of a hospital nursing service.

PubMed

Feldman, Liliane Bauer; Cunha, Isabel Cristina Kowal Olm; D'Innocenzo, Maria

2013-01-01

to validate an instrument containing process criteria for assessment of a hospital nursing service based on the National Accreditation Organization program. a descriptive, quantitative methodological study performed in stages. An instrument constructed with 69 process criteria was assessed by 49 nurses from accredited hospitals in 2009, according to a Likert scale, and validated by 16 judges through Delphi rounds in 2010. the original instrument assessed by nurses with 69 process criteria was judged by the degree of importance, and changed to 39 criteria. In the first Delphi round, the 39 criteria reached consensus among the 19 judges, with a medium reliability by Cronbach's alpha. In the second round, 40 converging criteria were validated by 16 judges, with high reliability. The criteria addressed management, costs, teaching, education, indicators, protocols, human resources, communication, among others. the 40 process criteria formed a validated instrument to assess the hospital nursing service which, when measured, can better direct interventions by nurses in reaching and strengthening outcomes.

Validation of a French version of the Sleep Condition Indicator: a clinical screening tool for insomnia disorder according to DSM-5 criteria.

PubMed

Bayard, Sophie; Lebrun, Cindy; Maudarbocus, Khaalid Hassan; Schellaert, Vanessa; Joffre, Alicia; Ferrante, Esther; Le Louedec, Marie; Cournoulat, Alice; Gely-Nargeot, Marie-Christine; Luik, Annemarie I

2017-12-01

Insomnia disorder is frequent in the population, yet there is no French screening instrument available that is based on the updated DSM-5 criteria. We evaluated the validity and reliability of the French version of an insomnia screening instrument based on DSM-5 criteria, the Sleep Condition Indicator, in a population-based sample of adults. A total of 366 community-dwelling participants completed a face-to-face clinical interview to determine insomnia disorder against DSM-5 criteria and several questionnaires including the French Sleep Condition Indicator version. Three-hundred and twenty-nine participants completed the Sleep Condition Indicator again after 1 month. Statistical analyses were performed to determine the reliability, construct validity, divergent validity and temporal stability of the French translation of the Sleep Condition Indicator. In addition, an explanatory factor analysis was performed to assess the underlying structure. The internal consistency (α = 0.87) and temporal stability (r = 0.86, P < 0.001) of the French Sleep Condition Indicator were high. When using the previously defined cut-off value of ≤ 16, the area under the receiver operating characteristic curve was 0.93 with a sensitivity of 95% and a specificity of 75%. Additionally, good construct and divergent validity were demonstrated. The factor analyses showed a two-factor structure with a focus on sleep and daytime effects. The French version of the Sleep Condition Indicator demonstrates satisfactory psychometric properties while being a useful instrument in detecting cases of insomnia disorder, consistent with features of DSM-5, in the general population. © 2017 European Sleep Research Society.

The validated sun exposure questionnaire: association of objective and subjective measures of sun exposure in a Danish population-based sample.

PubMed

Køster, B; Søndergaard, J; Nielsen, J B; Allen, M; Olsen, A; Bentzen, J

2017-02-01

Few questionnaires used in monitoring sun-related behaviour have been tested for validity. We established the criteria validity of a questionnaire developed for monitoring population sun-related behaviour. During May-August 2013, 664 Danes wore a personal electronic ultraviolet radiation (UVR) dosimeter for 1 week that measured their outdoor time and dose of erythemal UVR exposure. In the following week, they answered a questionnaire on their sun-related behaviour in the measurement week. Outdoor time measured by dosimetry correlated strongly with both outdoor time and the developed exposure scale measured in the questionnaire. Exposure measured in standard erythema dose (SED) by dosimetry correlated strongly with the exposure scale. In a linear regression model of UVR (SED) received, 41% of the variation was explained by skin type, age, week of participation and exposure scale, with exposure scale as the main contributor. The weekly sunburn fraction correlated strongly with the number of ambient sun hours (r = 0·73, P < 0·001). This criteria-validated questionnaire provides evidence of the exposure that the questionnaire aimed to measure. The evidence provided showed a strong link between the objectively measured behaviour and the behaviour measured by this survey construct. The questionnaire is the first validated tool to measure the UVR exposure in a national population-based sample. © 2016 The Authors. British Journal of Dermatology published by John Wiley & Sons Ltd on behalf of British Association of Dermatologists.

40 CFR 86.1341-90 - Test cycle validation criteria.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 40 Protection of Environment 19 2011-07-01 2011-07-01 false Test cycle validation criteria. 86... Procedures § 86.1341-90 Test cycle validation criteria. (a) To minimize the biasing effect of the time lag... brake horsepower-hour. (c) Regression line analysis to calculate validation statistics. (1) Linear...

40 CFR 86.1341-90 - Test cycle validation criteria.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 40 Protection of Environment 20 2013-07-01 2013-07-01 false Test cycle validation criteria. 86... Procedures § 86.1341-90 Test cycle validation criteria. (a) To minimize the biasing effect of the time lag... brake horsepower-hour. (c) Regression line analysis to calculate validation statistics. (1) Linear...

40 CFR 86.1341-90 - Test cycle validation criteria.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 40 Protection of Environment 20 2012-07-01 2012-07-01 false Test cycle validation criteria. 86... Procedures § 86.1341-90 Test cycle validation criteria. (a) To minimize the biasing effect of the time lag... brake horsepower-hour. (c) Regression line analysis to calculate validation statistics. (1) Linear...

A new responder criterion (relative effect per patient (REPP) > 0.2) externally validated in a large total hip replacement multicenter cohort (EUROHIP).

PubMed

Huber, J; Hüsler, J; Dieppe, P; Günther, K P; Dreinhöfer, K; Judge, A

2016-03-01

To validate a new method to identify responders (relative effect per patient (REPP) >0.2) using the OMERACT-OARSI criteria as gold standard in a large multicentre sample. The REPP ([score before - after treatment]/score before treatment) was calculated for 845 patients of a large multicenter European cohort study for THR. The patients with a REPP >0.2 were defined as responders. The responder rate was compared to the gold standard (OMERACT-OARSI criteria) using receiver operator characteristic (ROC) curve analysis for sensitivity, specificity and percentage of appropriately classified patients. With the criterion REPP>0.2 85.4% of the patients were classified as responders, applying the OARSI-OMERACT criteria 85.7%. The new method had 98.8% sensitivity, 94.2% specificity and 98.1% of the patients were correctly classified compared to the gold standard. The external validation showed a high sensitivity and also specificity of a new criterion to identify a responder compared to the gold standard method. It is simple and has no uncertainties due to a single classification criterion. Copyright © 2015 The Authors. Published by Elsevier Ltd.. All rights reserved.

Validation of the Arabic Version of the Internet Gaming Disorder-20 Test.

PubMed

Hawi, Nazir S; Samaha, Maya

2017-04-01

In recent years, researchers have been trying to shed light on gaming addiction and its association with different psychiatric disorders and psychological determinants. The latest edition version of the American Psychiatric Association's Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5) included in its Section 3 Internet Gaming Disorder (IGD) as a condition for further empirical study and proposed nine criteria for the diagnosis of IGD. The 20-item Internet Gaming Disorder (IGD-20) Test was developed as a valid and reliable tool to assess gaming addiction based on the nine criteria set by the DSM-5. The aim of this study is to validate an Arabic version of the IGD-20 Test. The Arabic version of IGD-20 will not only help in identifying Arabic-speaking pathological gamers but also stimulate cross-cultural studies that could contribute to an area in need of more research for insight and treatment. After a process of translation and back-translation and with the participation of a sizable sample of Arabic-speaking adolescents, the present study conducted a psychometric validation of the IGD-20 Test. Our confirmatory factor analysis showed the validity of the Arabic version of the IGD-20 Test. The one-factor model of the Arabic IGD-20 Test had very good psychometric properties, and it fitted the sample data extremely well. In addition, correlation analysis between the IGD-20 Test and the daily duration on weekdays and weekends gameplay revealed significant positive relationships that warranted a criterion-related validation. Thus, the Arabic version of the IGD-20 Test is a valid and reliable measure of IGD among Arabic-speaking populations.

Incremental validity of the Minnesota Multiphasic Personality Inventory-2 and symptom checklist-90-revised with mental health inpatients.

PubMed

Simonds, Elise C; Handel, Richard W; Archer, Robert P

2008-03-01

This study evaluated the incremental validity of scores from the Minnesota Multiphasic Personality Inventory-2 (MMPI-2) and the Symptom Checklist-90-Revised (SCL-90-R) in a sample of mental health inpatients originally published by Archer, Griffin, and Aiduk (1995). The incremental validity of scores from the SCL-90-R primary symptom dimensions and MMPI-2 Clinical, Content, and Restructured Clinical scales was assessed in a sample of 544 mental health inpatients using conceptually related items from the Brief Psychiatric Rating Scale (BPRS) as criteria. A series of hierarchical multiple regressions indicated that scores from the SCL-90-R primary symptom dimensions exhibited limited incremental validity (Mdn DeltaR(2) = .01, range = 0-.01), whereas scores from MMPI-2 scales contributed additional information in the prediction of ratings on all but one BPRS item (Mdn DeltaR( 2) = .08, range = .04-.12).

Validity of Factors of the Psychopathy Checklist–Revised in Female Prisoners

PubMed Central

Kennealy, Patrick J.; Hicks, Brian M.; Patrick, Christopher J.

2008-01-01

The validity of the Psychopathy Checklist–Revised (PCL-R) has been examined extensively in men, but its validity for women remains understudied. Specifically, the correlates of the general construct of psychopathy and its components as assessed by PCL-R total, factor, and facet scores have yet to be examined in depth. Based on previous research conducted with male offenders, a large female inmate sample was used to examine the patterns of relations between total, factor, and facet scores on the PCL-R and various criterion variables. These variables include ratings of psychopathy based on Cleckley’s criteria, symptoms of antisocial personality disorder, and measures of substance use and abuse, criminal behavior, institutional misconduct, interpersonal aggression, normal range personality, intellectual functioning, and social background variables. Results were highly consistent with past findings in male samples and provide further evidence for the construct validity of the PCL-R two-factor and four-facet models across genders. PMID:17986651

40 CFR 86.1341-98 - Test cycle validation criteria.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 40 Protection of Environment 20 2012-07-01 2012-07-01 false Test cycle validation criteria. 86... Procedures § 86.1341-98 Test cycle validation criteria. Section 86.1341-98 includes text that specifies...-90 (d)(4), shall be excluded from both cycle validation and the integrated work used for emissions...

40 CFR 86.1341-98 - Test cycle validation criteria.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 40 Protection of Environment 20 2013-07-01 2013-07-01 false Test cycle validation criteria. 86... Procedures § 86.1341-98 Test cycle validation criteria. Section 86.1341-98 includes text that specifies...-90 (d)(4), shall be excluded from both cycle validation and the integrated work used for emissions...

40 CFR 86.1341-98 - Test cycle validation criteria.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 40 Protection of Environment 19 2011-07-01 2011-07-01 false Test cycle validation criteria. 86... Procedures § 86.1341-98 Test cycle validation criteria. Section 86.1341-98 includes text that specifies...-90 (d)(4), shall be excluded from both cycle validation and the integrated work used for emissions...

Validation of Proposed DSM-5 Criteria for Autism Spectrum Disorder

PubMed Central

Frazier, Thomas W.; Youngstrom, Eric A.; Speer, Leslie; Embacher, Rebecca; Law, Paul; Constantino, John; Findling, Robert L.; Hardan, Antonio Y.; Eng, Charis

2011-01-01

Objective The primary aim of the present study was to evaluate the validity of proposed DSM-5 criteria for Autism Spectrum Disorder (ASD). Method We analyzed symptoms from 14,744 siblings (8,911 ASD; 5,863 non-ASD) included in a national registry, the Interactive Autism Network. Youth aged 2–18 were included if at least one child in the family was diagnosed with ASD. Caregivers reported symptoms using the Social Responsiveness Scale and the Social Communication Questionnaire. The structure of autism symptoms was examined using latent variable models that included categories, dimensions, or hybrid models specifying categories and sub-dimensions. Diagnostic efficiency statistics evaluated the proposed DSM-5 algorithm in identifying ASD. Results A hybrid model that included both a category (ASD vs. non-ASD) and two symptom dimensions (social communication/interaction and restricted/repetitive behaviors) was more parsimonious than all other models and replicated across measures and sub-samples. Empirical classifications from this hybrid model closely mirrored clinical ASD diagnoses (90% overlap), implying a broad ASD category distinct from non-ASD. DSM-5 criteria had superior specificity relative to DSM-IV-TR criteria (.97 vs. .86), however sensitivity was lower (.81 vs. .95). Relaxing DSM-5 criteria by requiring one less symptom criterion increased sensitivity (.93 vs. .81), with minimal reduction in specificity (.95 vs. .97). Conclusions Results supported the validity of proposed DSM-5 criteria for ASD as provided in Phase I field trials criteria. Increased specificity of DSM-5 relative to DSM-IV-TR may reduce false positive diagnoses, a particularly relevant consideration for low base rate clinical settings. Phase II testing of DSM-5 should consider a relaxed algorithm, without which as many as 12% of ASD-affected individuals, particularly females, will be missed. Relaxed DSM-5 criteria may improve identification of ASD, decreasing societal costs through appropriate early diagnosis and maximizing intervention resources. PMID:22176937

Validation of the PTSD Checklist-Civilian Version in survivors of bone marrow transplantation.

PubMed

Smith, M Y; Redd, W; DuHamel, K; Vickberg, S J; Ricketts, P

1999-07-01

Life-threatening illness now qualifies as a precipitating stessor for posttraumatic stress disorder (PTSD). We examined the validity of the PTSD Checklist-Civilian Version (PCL-C; Weathers, Litz, Herman, Juska, & Keane, 1993), a brief 17-item inventory of PTSD-like symptoms, in a sample of 111 adults who had undergone bone marrow transplantation an average of 4.04 years previously. Exploratory factor analysis of the PCL-C identified four distinct patterns of symptom responses: Numbing-Hyperarousal, Dreams-Memories of the Cancer Treatment, General Hyperarousal, Responses to Cancer-Related Reminders and Avoidance-Numbing. Respondents meeting PTSD symptom criteria on the PCL-C had significantly lower physical, role, and social functioning, greater distress and anxiety, and significantly more intrusive and avoidant responses than individuals who did not meet PTSD symptom criteria.

Working towards accreditation by the International Standards Organization 15189 Standard: how to validate an in-house developed method an example of lead determination in whole blood by electrothermal atomic absorption spectrometry.

PubMed

Garcia Hejl, Carine; Ramirez, Jose Manuel; Vest, Philippe; Chianea, Denis; Renard, Christophe

2014-09-01

Laboratories working towards accreditation by the International Standards Organization (ISO) 15189 standard are required to demonstrate the validity of their analytical methods. The different guidelines set by various accreditation organizations make it difficult to provide objective evidence that an in-house method is fit for the intended purpose. Besides, the required performance characteristics tests and acceptance criteria are not always detailed. The laboratory must choose the most suitable validation protocol and set the acceptance criteria. Therefore, we propose a validation protocol to evaluate the performance of an in-house method. As an example, we validated the process for the detection and quantification of lead in whole blood by electrothermal absorption spectrometry. The fundamental parameters tested were, selectivity, calibration model, precision, accuracy (and uncertainty of measurement), contamination, stability of the sample, reference interval, and analytical interference. We have developed a protocol that has been applied successfully to quantify lead in whole blood by electrothermal atomic absorption spectrometry (ETAAS). In particular, our method is selective, linear, accurate, and precise, making it suitable for use in routine diagnostics.

Assessment of Semi-Structured Clinical Interview for Mobile Phone Addiction Disorder

PubMed Central

Alavi, Seyyed Salman; Jannatifard, Fereshteh; Mohammadi Kalhori, Soroush; Sepahbodi, Ghazal; BabaReisi, Mohammad; Sajedi, Sahar; Farshchi, Mojtaba; KhodaKarami, Rasul; Hatami Kasvaee, Vahid

2016-01-01

Objective: The Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision (DSM-IV-TR) classified mobile phone addiction disorder under “impulse control disorder not elsewhere classified”. This study surveyed the diagnostic criteria of DSM-IV-TR for the diagnosis of mobile phone addiction in correspondence with Iranian society and culture. Method: Two hundred fifty students of Tehran universities were entered into this descriptive-analytical and cross-sectional study. Quota sampling method was used. At first, semi- structured clinical interview (based on DSM-IV-TR) was performed for all the cases, and another specialist reevaluated the interviews. Data were analyzed using content validity, inter-scorer reliability (Kappa coefficient) and test-retest via SPSS18 software. Results: The content validity of the semi- structured clinical interview matched the DSM–IV-TR criteria for behavioral addiction. Moreover, their content was appropriate, and two items, including “SMS pathological use” and “High monthly cost of using the mobile phone” were added to promote its validity. Internal reliability (Kappa) and test–retest reliability were 0.55 and r = 0.4 (p<0. 01) respectively. Conclusion: The results of this study revealed that semi- structured diagnostic criteria of DSM-IV-TR are valid and reliable for diagnosing mobile phone addiction, and this instrument is an effective tool to diagnose this disorder. PMID:27437008

Development and Psychometric Evaluation of the Brief Adolescent Gambling Screen (BAGS)

PubMed Central

Stinchfield, Randy; Wynne, Harold; Wiebe, Jamie; Tremblay, Joel

2017-01-01

The purpose of this study was to develop and evaluate the initial reliability, validity and classification accuracy of a new brief screen for adolescent problem gambling. The three-item Brief Adolescent Gambling Screen (BAGS) was derived from the nine-item Gambling Problem Severity Subscale (GPSS) of the Canadian Adolescent Gambling Inventory (CAGI) using a secondary analysis of existing CAGI data. The sample of 105 adolescents included 49 females and 56 males from Canada who completed the CAGI, a self-administered measure of DSM-IV diagnostic criteria for Pathological Gambling, and a clinician-administered diagnostic interview including the DSM-IV diagnostic criteria for Pathological Gambling (both of which were adapted to yield DSM-5 Gambling Disorder diagnosis). A stepwise multivariate discriminant function analysis selected three GPSS items as the best predictors of a diagnosis of Gambling Disorder. The BAGS demonstrated satisfactory estimates of reliability, validity and classification accuracy and was equivalent to the nine-item GPSS of the CAGI and the BAGS was more accurate than the SOGS-RA. The BAGS estimates of classification accuracy include hit rate = 0.95, sensitivity = 0.88, specificity = 0.98, false positive rate = 0.02, and false negative rate = 0.12. Since these classification estimates are preliminary, derived from a relatively small sample size, and based upon the same sample from which the items were selected, it will be important to cross-validate the BAGS with larger and more diverse samples. The BAGS should be evaluated for use as a screening tool in both clinical and school settings as well as epidemiological surveys. PMID:29312064

Psychometric Testing of the Personal Internet Gaming Disorder Evaluation-9: A New Measure Designed to Assess Internet Gaming Disorder.

PubMed

Pearcy, Benjamin T D; Roberts, Lynne D; McEvoy, Peter M

2016-05-01

Internet Gaming Disorder (IGD) is in the early stages of recognition as a disorder, following its inclusion in the Diagnostic and Statistical Manual for Mental Disorders (DSM-5; American Psychiatric Association(1)) as a condition for further study. Existing measures of Internet gaming pathology are limited in their ability to measure IGD as defined in the DSM-5. We present the initial development and validation of a new measure derived from the proposed DSM-5 criteria for IGD, the Personal Internet Gaming Disorder Evaluation-9 (PIE-9). A student sample (n = 119) and a community sample (n = 285), sourced through a variety of online gaming forums, completed an online survey comprising the new measure, existing measures of IGD, and a range of health and demographic questions. Exploratory and confirmatory factor analysis supported a single factor structure for the 9-item PIE-9. Internal consistency (α = 0.89) and test-retest reliability (intraclass correlation [ICC] = 0.77) were high. Convergent validity was demonstrated with similar gaming addiction measures. Predictive validity was established through significant differences in distress and disability between those who met the criteria for IGD and those who did not. The distress and disability associated with meeting IGD criteria fell within the range of other common DSM-5 disorders. Preliminary testing of the PIE-9 has demonstrated that it is an efficient and straightforward measure for use in further research of IGD, and as a potential screening measure in clinical practice.

The Epidemiology of Substance Use Disorders in US Veterans: A Systematic Review and Analysis of Assessment Methods

PubMed Central

Lan, Chiao-Wen; Fiellin, David A.; Barry, Declan T.; Bryant, Kendall J.; Gordon, Adam J.; Edelman, E. Jennifer; Gaither, Julie R.; Maisto, Stephen A.; Marshall, Brandon D.L.

2016-01-01

Background Substance use disorders (SUDs), which encompass alcohol and drug use disorders (AUDs, DUDs), constitute a major public health challenge among US veterans. SUDs are among the most common and costly of all health conditions among veterans. Objectives This study sought to examine the epidemiology of SUDs among US veterans, compare the prevalence of SUDs in studies using diagnostic and administrative criteria assessment methods, and summarize trends in the prevalence of SUDs reported in studies sampling US veterans over time. Methods Comprehensive electronic database searches were conducted. A total of 3,490 studies were identified. We analyzed studies sampling US veterans and reporting prevalence, distribution, and examining AUDs and DUDs. Results Of the studies identified, 72 met inclusion criteria. The studies were published between 1995 and 2013. Studies using diagnostic criteria reported higher prevalence of AUDs (32% vs. 10%) and DUDs (20% vs. 5%) than administrative criteria, respectively. Regardless of assessment method, both the lifetime and past year prevalence of AUDs in studies sampling US veterans has declined gradually over time. Conclusion The prevalence of SUDs reported in studies sampling US veterans are affected by assessment method. Given the significant public health problems of SUDs among US veterans, improved guidelines for clinical screening using validated diagnostic criteria to assess AUDs and DUDs in US veteran populations are needed. Scientific Significance These findings may inform VA and other healthcare systems in prevention, diagnosis, and intervention for SUDs among US veterans. PMID:26693830

Variable criteria sequential stopping rule: Validity and power with repeated measures ANOVA, multiple correlation, MANOVA and relation to Chi-square distribution.

PubMed

Fitts, Douglas A

2017-09-21

The variable criteria sequential stopping rule (vcSSR) is an efficient way to add sample size to planned ANOVA tests while holding the observed rate of Type I errors, α o , constant. The only difference from regular null hypothesis testing is that criteria for stopping the experiment are obtained from a table based on the desired power, rate of Type I errors, and beginning sample size. The vcSSR was developed using between-subjects ANOVAs, but it should work with p values from any type of F test. In the present study, the α o remained constant at the nominal level when using the previously published table of criteria with repeated measures designs with various numbers of treatments per subject, Type I error rates, values of ρ, and four different sample size models. New power curves allow researchers to select the optimal sample size model for a repeated measures experiment. The criteria held α o constant either when used with a multiple correlation that varied the sample size model and the number of predictor variables, or when used with MANOVA with multiple groups and two levels of a within-subject variable at various levels of ρ. Although not recommended for use with χ 2 tests such as the Friedman rank ANOVA test, the vcSSR produces predictable results based on the relation between F and χ 2 . Together, the data confirm the view that the vcSSR can be used to control Type I errors during sequential sampling with any t- or F-statistic rather than being restricted to certain ANOVA designs.

The validation of AORN recommended practices in Finnish perioperative nursing documentation.

PubMed

Tiusanen, Teija Susanna; Junttila, Kristiina; Leinonen, Tuija; Salanterä, Sanna

2010-02-01

In Finland, there are no common guidelines or recommended practices for perioperative documentation. Thus, perioperative nursing documentation varies from one operating department to another. To create minimum criteria for nursing documentation in Finland, we conducted an investigation in a university hospital district in 2006. Purposive sampling was used to invite experts in perioperative nursing documentation (N = 42) to serve as a Delphi panel. The final criteria are 120 items, 71% of which are based on the AORN standards and recommended practices. These criteria may be used to educate students and new perioperative personnel and to enhance the quality of nursing practice. To ensure relevance and usability, the criteria should be tested in various perioperative settings with a variety of surgical patients. Copyright 2010 AORN, Inc. Published by Elsevier Inc. All rights reserved.

High-throughput method for macrolides and lincosamides antibiotics residues analysis in milk and muscle using a simple liquid-liquid extraction technique and liquid chromatography-electrospray-tandem mass spectrometry analysis (LC-MS/MS).

PubMed

Jank, Louise; Martins, Magda Targa; Arsand, Juliana Bazzan; Campos Motta, Tanara Magalhães; Hoff, Rodrigo Barcellos; Barreto, Fabiano; Pizzolato, Tânia Mara

2015-11-01

A fast and simple method for residue analysis of the antibiotics classes of macrolides (erythromycin, azithromycin, tylosin, tilmicosin and spiramycin) and lincosamides (lincomycin and clindamycin) was developed and validated for cattle, swine and chicken muscle and for bovine milk. Sample preparation consists in a liquid-liquid extraction (LLE) with acetonitrile, followed by liquid chromatography-electrospray-tandem mass spectrometry analysis (LC-ESI-MS/MS), without the need of any additional clean-up steps. Chromatographic separation was achieved using a C18 column and a mobile phase composed by acidified acetonitrile and water. The method was fully validated according the criteria of the Commission Decision 2002/657/EC. Validation parameters such as limit of detection, limit of quantification, linearity, accuracy, repeatability, specificity, reproducibility, decision limit (CCα) and detection capability (CCβ) were evaluated. All calculated values met the established criteria. Reproducibility values, expressed as coefficient of variation, were all lower than 19.1%. Recoveries range from 60% to 107%. Limits of detection were from 5 to 25 µg kg(-1).The present method is able to be applied in routine analysis, with adequate time of analysis, low cost and a simple sample preparation protocol. Copyright © 2015. Published by Elsevier B.V.

Empirical correlates for the Minnesota Multiphasic Personality Inventory-2-Restructured Form in a German inpatient sample.

PubMed

Moultrie, Josefine K; Engel, Rolf R

2017-10-01

We identified empirical correlates for the 42 substantive scales of the German language version of the Minnesota Multiphasic Personality Inventory (MMPI)-2-Restructured Form (MMPI-2-RF): Higher Order, Restructured Clinical, Specific Problem, Interest, and revised Personality Psychopathology Five scales. We collected external validity data by means of a 177-item chart review form in a sample of 488 psychiatric inpatients of a German university hospital. We structured our findings along the interpretational guidelines for the MMPI-2-RF and compared them with the validity data published in the tables of the MMPI-2-RF Technical Manual. Our results show significant correlations between MMPI-2-RF scales and conceptually relevant criteria. Most of the results were in line with U.S. validation studies. Some of the differences could be attributed to sample compositions. For most of the scales, construct validity coefficients were acceptable. Taken together, this study amplifies the enlarging body of research on empirical correlates of the MMPI-2-RF scales in a new sample. The study suggests that the interpretations given in the MMPI-2-RF manual may be generalizable to the German language MMPI-2-RF. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

2016 Revisions to the 2010/2011 fibromyalgia diagnostic criteria.

PubMed

Wolfe, Frederick; Clauw, Daniel J; Fitzcharles, Mary-Ann; Goldenberg, Don L; Häuser, Winfried; Katz, Robert L; Mease, Philip J; Russell, Anthony S; Russell, Irwin Jon; Walitt, Brian

2016-12-01

The provisional criteria of the American College of Rheumatology (ACR) 2010 and the 2011 self-report modification for survey and clinical research are widely used for fibromyalgia diagnosis. To determine the validity, usefulness, potential problems, and modifications required for the criteria, we assessed multiple research reports published in 2010-2016 in order to provide a 2016 update to the criteria. We reviewed 14 validation studies that compared 2010/2011 criteria with ACR 1990 classification and clinical criteria, as well as epidemiology, clinical, and databank studies that addressed important criteria-level variables. Based on definitional differences between 1990 and 2010/2011 criteria, we interpreted 85% sensitivity and 90% specificity as excellent agreement. Against 1990 and clinical criteria, the median sensitivity and specificity of the 2010/2011 criteria were 86% and 90%, respectively. The 2010/2011 criteria led to misclassification when applied to regional pain syndromes, but when a modified widespread pain criterion (the "generalized pain criterion") was added misclassification was eliminated. Based on the above data and clinic usage data, we developed a (2016) revision to the 2010/2011 fibromyalgia criteria. Fibromyalgia may now be diagnosed in adults when all of the following criteria are met: CONCLUSIONS: The fibromyalgia criteria have good sensitivity and specificity. This revision combines physician and questionnaire criteria, minimizes misclassification of regional pain disorders, and eliminates the previously confusing recommendation regarding diagnostic exclusions. The physician-based criteria are valid for individual patient diagnosis. The self-report version of the criteria is not valid for clinical diagnosis in individual patients but is valid for research studies. These changes allow the criteria to function as diagnostic criteria, while still being useful for classification. Copyright © 2016 Elsevier Inc. All rights reserved.

A content validated questionnaire for assessment of self reported venous blood sampling practices

PubMed Central

2012-01-01

Background Venous blood sampling is a common procedure in health care. It is strictly regulated by national and international guidelines. Deviations from guidelines due to human mistakes can cause patient harm. Validated questionnaires for health care personnel can be used to assess preventable "near misses"--i.e. potential errors and nonconformities during venous blood sampling practices that could transform into adverse events. However, no validated questionnaire that assesses nonconformities in venous blood sampling has previously been presented. The aim was to test a recently developed questionnaire in self reported venous blood sampling practices for validity and reliability. Findings We developed a questionnaire to assess deviations from best practices during venous blood sampling. The questionnaire contained questions about patient identification, test request management, test tube labeling, test tube handling, information search procedures and frequencies of error reporting. For content validity, the questionnaire was confirmed by experts on questionnaires and venous blood sampling. For reliability, test-retest statistics were used on the questionnaire answered twice. The final venous blood sampling questionnaire included 19 questions out of which 9 had in total 34 underlying items. It was found to have content validity. The test-retest analysis demonstrated that the items were generally stable. In total, 82% of the items fulfilled the reliability acceptance criteria. Conclusions The questionnaire could be used for assessment of "near miss" practices that could jeopardize patient safety and gives several benefits instead of assessing rare adverse events only. The higher frequencies of "near miss" practices allows for quantitative analysis of the effect of corrective interventions and to benchmark preanalytical quality not only at the laboratory/hospital level but also at the health care unit/hospital ward. PMID:22260505

A content validated questionnaire for assessment of self reported venous blood sampling practices.

PubMed

Bölenius, Karin; Brulin, Christine; Grankvist, Kjell; Lindkvist, Marie; Söderberg, Johan

2012-01-19

Venous blood sampling is a common procedure in health care. It is strictly regulated by national and international guidelines. Deviations from guidelines due to human mistakes can cause patient harm. Validated questionnaires for health care personnel can be used to assess preventable "near misses"--i.e. potential errors and nonconformities during venous blood sampling practices that could transform into adverse events. However, no validated questionnaire that assesses nonconformities in venous blood sampling has previously been presented. The aim was to test a recently developed questionnaire in self reported venous blood sampling practices for validity and reliability. We developed a questionnaire to assess deviations from best practices during venous blood sampling. The questionnaire contained questions about patient identification, test request management, test tube labeling, test tube handling, information search procedures and frequencies of error reporting. For content validity, the questionnaire was confirmed by experts on questionnaires and venous blood sampling. For reliability, test-retest statistics were used on the questionnaire answered twice. The final venous blood sampling questionnaire included 19 questions out of which 9 had in total 34 underlying items. It was found to have content validity. The test-retest analysis demonstrated that the items were generally stable. In total, 82% of the items fulfilled the reliability acceptance criteria. The questionnaire could be used for assessment of "near miss" practices that could jeopardize patient safety and gives several benefits instead of assessing rare adverse events only. The higher frequencies of "near miss" practices allows for quantitative analysis of the effect of corrective interventions and to benchmark preanalytical quality not only at the laboratory/hospital level but also at the health care unit/hospital ward.

[Methodological quality of an article on the treatment of gastric cancer adopted as protocol by some Chilean hospitals].

PubMed

Manterola, Carlos; Torres, Rodrigo; Burgos, Luis; Vial, Manuel; Pineda, Viviana

2006-07-01

Surgery is a curative treatment for gastric cancer (GC). As relapse is frequent, adjuvant therapies such as postoperative chemo radiotherapy have been tried. In Chile, some hospitals adopted Macdonald's study as a protocol for the treatment of GC. To determine methodological quality and internal and external validity of the Macdonald study. Three instruments were applied that assess methodological quality. A critical appraisal was done and the internal and external validity of the methodological quality was analyzed with two scales: MINCIR (Methodology and Research in Surgery), valid for therapy studies and CONSORT (Consolidated Standards of Reporting Trials), valid for randomized controlled trials (RCT). Guides and scales were applied by 5 researchers with training in clinical epidemiology. The reader's guide verified that the Macdonald study was not directed to answer a clearly defined question. There was random assignment, but the method used is not described and the patients were not considered until the end of the study (36% of the group with surgery plus chemo radiotherapy did not complete treatment). MINCIR scale confirmed a multicentric RCT, not blinded, with an unclear randomized sequence, erroneous sample size estimation, vague objectives and no exclusion criteria. CONSORT system proved the lack of working hypothesis and specific objectives as well as an absence of exclusion criteria and identification of the primary variable, an imprecise estimation of sample size, ambiguities in the randomization process, no blinding, an absence of statistical adjustment and the omission of a subgroup analysis. The instruments applied demonstrated methodological shortcomings that compromise the internal and external validity of the.

Elucidating the Construct Validity of the Psychopathic Personality Inventory Triarchic Scales.

PubMed

Sellbom, Martin; Wygant, Dustin B; Drislane, Laura E

2015-01-01

This study sought to replicate and extend Hall and colleagues' (2014) work on developing and validating scales from the Psychopathic Personality Inventory (PPI) to index the triarchic psychopathy constructs of boldness, meanness, and disinhibition. This study also extended Hall et al.'s initial findings by including the PPI Revised (PPI-R). A community sample (n = 240) weighted toward subclinical psychopathy traits and a male prison sample (n = 160) were used for this study. Results indicated that PPI-Boldness, PPI-Meanness, and PPI-Disinhibition converged with other psychopathy, personality, and behavioral criteria in ways conceptually expected from the perspective of the triarchic psychopathy model, including showing very strong convergent and discriminant validity with their Triarchic Psychopathy Measure counterparts. These findings further enhance the utility of the PPI and PPI-R in measuring these constructs.

How much is enough? Examining frequency criteria for NSSI disorder in adolescent inpatients.

PubMed

Muehlenkamp, Jennifer J; Brausch, Amy M; Washburn, Jason J

2017-06-01

To empirically evaluate the diagnostic relevance of the proposed Diagnostic and Statistical Manual of Mental Disorders (5th ed.; DSM-5 ; APA, 2013) Criterion-A frequency threshold for nonsuicidal self-injury (NSSI) disorder. Archival, de-identified, self-reported clinical assessment data from 746 adolescent psychiatric patients (Mage = 14.97; 88% female; 76% White) were used. The sample was randomly split into 2 unique samples for data analyses. Measures included assessments of NSSI, proposed DSM-5 NSSI-disorder criteria, psychopathology, dysfunction, distress, functional impairment, and suicidality. Discriminant-function analyses run with Sample A identified a significant differentiation of groups based on a frequency of NSSI at 25 or more days in the past year, Λ = .814, χ2(54) = 72.59, p < .05, canonical R2 = .36. This cutoff was replicated in the second sample. All patients were coded into 1 of 3 empirically derived NSSI-frequency cutoff groups: high (>25 days), moderate (5-24 days), and low (1-4 days) and compared. The high-NSSI group scored higher on most NSSI features, including DSM-5 -proposed Criterion-B and -C symptoms, depression, psychotic symptoms, substance abuse, borderline personality-disorder features, suicidal ideation, and suicide plans, than the moderate- and low-NSSI groups, who did not differ from each other on many of the variables. The currently proposed DSM-5 Criterion-A frequency threshold for NSSI disorder lacks validity and clinical utility. The field needs to consider raising the frequency threshold to ensure that a meaningful and valid set of diagnostic criteria are established, and to avoid overpathologizing individuals who infrequently engage in NSSI. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

A Psychometric Review of Norm-Referenced Tests Used to Assess Phonological Error Patterns

ERIC Educational Resources Information Center

Kirk, Celia; Vigeland, Laura

2014-01-01

Purpose: The authors provide a review of the psychometric properties of 6 norm-referenced tests designed to measure children's phonological error patterns. Three aspects of the tests' psychometric adequacy were evaluated: the normative sample, reliability, and validity. Method: The specific criteria used for determining the psychometric…

40 CFR 86.1341-98 - Test cycle validation criteria.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 40 Protection of Environment 19 2010-07-01 2010-07-01 false Test cycle validation criteria. 86...) Emission Regulations for New Otto-Cycle and Diesel Heavy-Duty Engines; Gaseous and Particulate Exhaust Test Procedures § 86.1341-98 Test cycle validation criteria. Section 86.1341-98 includes text that specifies...

40 CFR 1065.514 - Cycle-validation criteria for operation over specified duty cycles.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 40 Protection of Environment 32 2010-07-01 2010-07-01 false Cycle-validation criteria for operation over specified duty cycles. 1065.514 Section 1065.514 Protection of Environment ENVIRONMENTAL... Over Specified Duty Cycles § 1065.514 Cycle-validation criteria for operation over specified duty...

Analysis of expert validation on developing integrated science worksheet to improve problem solving skills of natural science prospective teachers

NASA Astrophysics Data System (ADS)

Widodo, W.; Sudibyo, E.; Sari, D. A. P.

2018-04-01

This study aims to develop student worksheets for higher education that apply integrated science learning in discussing issues about motion in humans. These worksheets will guide students to solve the problem about human movement. They must integrate their knowledge about biology, physics, and chemistry to solve the problem. The worksheet was validated by three experts in Natural Science Integrated Science, especially in Human Movement topic. The aspects of the validation were feasibility of the content, the construction, and the language. This research used the Likert scale to measure the validity of each aspect, which is 4.00 for very good validity criteria, 3.00 for good validity criteria, 2.00 for more or less validity criteria, and 1.00 for not good validity criteria. Data showed that the validity for each aspect were in the range of good validity and very good validity criteria (3.33 to 3.67 for the content aspect, 2.33 to 4.00 for the construction aspect, and 3.33 to 4.00 for language aspect). However, there was a part of construction aspect that needed to improve. Overall, this students’ worksheet can be applied in classroom after some revisions based on suggestions from the validators.

Development of the Modified Yale Food Addiction Scale Version 2.0.

PubMed

Schulte, Erica M; Gearhardt, Ashley N

2017-07-01

The Yale Food Addiction Scale (YFAS) operationalizes indicators of addictive-like eating, originally based on the Diagnostic and Statistical Manual of Mental Disorders 4th edition Text Revision (DSM-IV-TR) criteria for substance-use disorders. The YFAS has multiple adaptations, including a briefer scale (mYFAS). Recently, the YFAS 2.0 was developed to reflect changes to diagnostic criteria in the DSM-5. The current study developed a briefer version of the YFAS 2.0 (mYFAS 2.0) using the participant sample from the YFAS 2.0 validation paper (n = 536). Then, in an independent sample recruited from Mechanical Turk, 213 participants completed the mYFAS 2.0, YFAS 2.0, and measures of eating-related constructs in order to evaluate the psychometric properties of the mYFAS 2.0, relative to the YFAS 2.0. The mYFAS 2.0 and YFAS 2.0 performed similarly on indexes of reliability, convergent validity with related constructs (e.g. weight cycling), discriminant validity with distinct measures (e.g. dietary restraint) and incremental validity evidenced by associations with frequency of binge eating beyond a measure of disinhibited eating. The mYFAS 2.0 may be an appropriate choice for studies prioritizing specificity when assessing for addictive-like eating or when a briefer measurement of food addiction is needed. Copyright © 2017 John Wiley & Sons, Ltd and Eating Disorders Association. Copyright © 2017 John Wiley & Sons, Ltd and Eating Disorders Association.

Validity of the ATP III diagnostic criteria for the metabolic syndrome in an elderly Italian Caucasian population: the Italian Longitudinal Study on Aging.

PubMed

Maggi, Stefania; Noale, Marianna; Zambon, Alberto; Limongi, Federica; Romanato, Giovanna; Crepaldi, Gaetano

2008-04-01

The metabolic syndrome (MetS) is represented by the co-occurrence of multiple metabolic and physiologic risk factors for both type 2 diabetes mellitus and atherosclerotic cardiovascular diseases. In spite of its high frequency and association with morbidity and mortality in the adult population, very little is known about its magnitude in the elderly and about the validity of the diagnostic criteria commonly used. The objective of this paper is to assess the prevalence rate of MetS and the validity of the Adult Treatment Panel III (ATP III) diagnostic criteria in an elderly Caucasian cohort, considering data from the Italian Longitudinal Study on Aging (ILSA), a population-based study with a sample of 5632 individuals aged 65-84 years at baseline (1992). Logistic regression models and ROC curve were used to test the validity of the cut off levels proposed. The prevalence of MetS was 31.5% in men, and 59.8% in women. The cut off levels suggested for both men and women by the ATP III panel indicated a significant association with the MetS for all components. Actually, the ROC analysis would suggest lower levels for glycaemia (106 mg/dl) in men, and higher levels for blood pressure in both men and women (145/95 and 135/90, respectively). Concluding, MetS is very common in the aged Caucasians and the diagnostic criteria proposed by the ATP III panel seem to be appropriate in older individuals. Small adjustments in the cut off levels could be suggested for glycaemia (men) and in blood pressure (men and women).

Community-Based Validation of the Social Phobia Screener (SOPHS).

PubMed

Batterham, Philip J; Mackinnon, Andrew J; Christensen, Helen

2017-10-01

There is a need for brief, accurate screening scales for social anxiety disorder to enable better identification of the disorder in research and clinical settings. A five-item social anxiety screener, the Social Phobia Screener (SOPHS), was developed to address this need. The screener was validated in two samples: (a) 12,292 Australian young adults screened for a clinical trial, including 1,687 participants who completed a phone-based clinical interview and (b) 4,214 population-based Australian adults recruited online. The SOPHS (78% sensitivity, 72% specificity) was found to have comparable screening performance to the Social Phobia Inventory (77% sensitivity, 71% specificity) and Mini-Social Phobia Inventory (74% sensitivity, 73% specificity) relative to clinical criteria in the trial sample. In the population-based sample, the SOPHS was also accurate (95% sensitivity, 73% specificity) in identifying Diagnostic and Statistical Manual of Mental Disorders-Fifth edition social anxiety disorder. The SOPHS is a valid and reliable screener for social anxiety that is freely available for use in research and clinical settings.

Methodological review of the quality of reach out and read: does it "work"?

PubMed

Yeager Pelatti, Christina; Pentimonti, Jill M; Justice, Laura M

2014-04-01

A considerable percentage of American children and adults fail to learn adequate literacy skills and read below a third grade level. Shared book reading is perhaps the single most important activity to prepare young children for success in reading. The primary objective of this manuscript was to critically review the methodological quality of Read Out and Read (ROR), a clinically based literacy program/intervention that teaches parents strategies to incorporate while sharing books with children as a method of preventing reading difficulties and academic struggles. A PubMed search was conducted. Articles that met three criteria were considered. First, the study must be clinically based and include parent contact with a pediatrician. Second, parental counseling ("anticipatory guidance") about the importance of parent-child book reading must be included. Third, only experimental or quasi-experimental studies were included; no additional criteria were used. Published articles from any year and peer-reviewed journal were considered. Study quality was determined using a modified version of the Downs and Black (1998) checklist assessing four categories: (1) Reporting, (2) External Validity, (3) Internal Validity-Bias, and (4) Internal Validity-Confounding. We were also interested in whether quality differed based on study design, children's age, sample size, and study outcome. Eleven studies met the inclusion criteria. The overall quality of evidence was variable across all studies; Reporting and External Validity categories were relatively strong while methodological concerns were found in the area of internal validity. Quality scores differed on the four study characteristics. Implications related to clinical practice and future studies are discussed.

[Validation of the Montgomery-Åsberg Depression Rating Scale (MADRS) in Colombia].

PubMed

Cano, Juan Fernando; Gomez Restrepo, Carlos; Rondón, Martín

2016-01-01

To adapt and to validate the Montgomery-Åsberg Depression Rating Scale (MADRS) in Colombia. Observational study for scale validation. Validity criteria were used to determine the severity cut-off points of the tool. Taking into account sensitivity and specificity values, those cut points were contrasted with ICD-10 criteria for depression severity. A a factor analysis was performed. The internal consistencY was determined with the same sample of patients used for the validity criteria. Inter-rater reliability was assessed by evaluating the 22 records of the patients that consented to a video interview. Sensitivity to change was established through a second application of the scale in 28 subjects after a lapse of 14 to 28 days. The study was performed in Bogotá, the tool was applied in 150 patients suffering from major depressive disorder. The cut-off point for moderate depression was 20 (sensitivity, 98%; specificity, 96%), and the cut-off point for severe depression was 34 (sensitivity, 98%; specificity, 92%). The tool appears as a unidimensional scale, which possesses a good internal consistency with (α=.9168). The findings of inter-rater reliability evaluation showed the scale as highly reliable (intraclass correlation coefficient=.9833). The instrument has a good sensitivity to change. The Colombian version of the Montgomery-Åsberg Depression Rating Scale has good psychometric properties and can be used in clinical practice and in clinical research in the field of depressive disorder. Copyright © 2015 Asociación Colombiana de Psiquiatría. Publicado por Elsevier España. All rights reserved.

The influence of validity criteria on Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) test-retest reliability among high school athletes.

PubMed

Brett, Benjamin L; Solomon, Gary S

2017-04-01

Research findings to date on the stability of Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) Composite scores have been inconsistent, requiring further investigation. The use of test validity criteria across these studies also has been inconsistent. Using multiple measures of stability, we examined test-retest reliability of repeated ImPACT baseline assessments in high school athletes across various validity criteria reported in previous studies. A total of 1146 high school athletes completed baseline cognitive testing using the online ImPACT test battery at two time periods of approximately two-year intervals. No participant sustained a concussion between assessments. Five forms of validity criteria used in previous test-retest studies were applied to the data, and differences in reliability were compared. Intraclass correlation coefficients (ICCs) ranged in composite scores from .47 (95% confidence interval, CI [.38, .54]) to .83 (95% CI [.81, .85]) and showed little change across a two-year interval for all five sets of validity criteria. Regression based methods (RBMs) examining the test-retest stability demonstrated a lack of significant change in composite scores across the two-year interval for all forms of validity criteria, with no cases falling outside the expected range of 90% confidence intervals. The application of more stringent validity criteria does not alter test-retest reliability, nor does it account for some of the variation observed across previously performed studies. As such, use of the ImPACT manual validity criteria should be utilized in the determination of test validity and in the individualized approach to concussion management. Potential future efforts to improve test-retest reliability are discussed.

Validity of a PCR assay in CSF for the diagnosis of neurocysticercosis.

PubMed

Carpio, Arturo; Campoverde, Alfredo; Romo, Matthew L; García, Lorena; Piedra, Luis M; Pacurucu, Mónica; López, Nelson; Aguilar, Jenner; López, Sebastian; Vintimilla, Luis C; Toral, Ana M; Peña-Tapia, Pablo

2017-03-01

To prospectively evaluate the validity of a PCR assay in CSF for the diagnosis of neurocysticercosis (NC). We conducted a multicenter, prospective case-control study, recruiting participants from 5 hospitals in Cuenca, Ecuador, from January 2015 to February 2016. Cases fulfilled validated diagnostic criteria for NC. For each case, a neurosurgical patient who did not fulfill the diagnostic criteria for NC was selected as a control. CT and MRI, as well as a CSF sample, were collected from both cases and controls. The diagnostic criteria to identify cases were used as a reference standard. Overall, 36 case and 36 control participants were enrolled. PCR had a sensitivity of 72.2% (95% confidence interval [CI] 54.8%-85.8%) and a specificity of 100.0% (95% CI 90.3%-100.0%). For parenchymal NC, PCR had a sensitivity of 42.9% (95% CI 17.7%-71.1%), and for extraparenchymal NC, PCR had a sensitivity of 90.9% (95% CI 70.8%-98.9%). This study demonstrated the usefulness of this PCR assay in CSF for the diagnosis of NC. PCR may be particularly helpful for diagnosing extraparenchymal NC when neuroimaging techniques have failed. This study provides Class III evidence that CSF PCR can accurately identify patients with extraparenchymal NC.

40 CFR 86.1341-90 - Test cycle validation criteria.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 40 Protection of Environment 19 2010-07-01 2010-07-01 false Test cycle validation criteria. 86...) Emission Regulations for New Otto-Cycle and Diesel Heavy-Duty Engines; Gaseous and Particulate Exhaust Test Procedures § 86.1341-90 Test cycle validation criteria. (a) To minimize the biasing effect of the time lag...

Validation of a short cognitive tool for the screening of dementia in elderly people with low educational level.

PubMed

De Yébenes, María Jesús García; Otero, Angel; Zunzunegui, María Victoria; Rodríguez-Laso, Angel; Sánchez-Sánchez, Fernando; Del Ser, Teodoro

2003-10-01

To validate the 'Prueba Cognitiva de Leganés' (PCL) as a screening tool for cognitive impairment in elderly people with little formal education. The PCL is a simple cognitive test with 32 items that includes two scores of orientation and memory and a global score of 0-32 points. It was applied to a population sample of 527 elderly people over 70 with low educational level, who were independently diagnosed by consensus between two neurologists as having normal cognitive function, age associated cognitive decline (AACD, IPA-OMS criteria) or dementia (DSM-IV criteria). Individuals with severe visual or hearing defects and those who rejected the exam were excluded from the study. The PCL was validated in a sample of 375 individuals: 300 normal, 42 with AACD and 33 with dementia. The sensitivity, specificity, accuracy and likelihood ratios, as well as the ROC curves for dementia and for AACD-dementia, were calculated. The confounding effect of sociodemographic variables was assessed by logistic regression analysis and convergent validity by partial correlations of the PCL with other cognitive tests. Inter-rater reliability was evaluated with the intraclass correlation coefficient. The PCL identified dementia (cut-off < or =22) and AACD-dementia (cut-off < or =26), with the following diagnostic parameters, respectively: sensitivity 93.9%-80%, specificity 94.7%-84.3%, positive likelihood ratio 17.8-5.1, negative likelihood ratio 0.06-0.24, and accuracy 94.6%-83.4%. The areas under the ROC curve were 0.985 (95% Confidence Intervals (CI) 0.967-0.995) and 0.904 (95% CI: 0.870-0.932) respectively. The intraclass correlation coefficient was 0.79 (0.74-0.83). The PCL is a simple instrument, which is both valid and reliable, for the screening of dementia in population samples of individuals with low educational level. This instrument could be useful in primary health care. Copyright 2003 John Wiley & Sons, Ltd.

Validation of the Ten-Item Internet Gaming Disorder Test (IGDT-10) and evaluation of the nine DSM-5 Internet Gaming Disorder criteria.

PubMed

Király, Orsolya; Sleczka, Pawel; Pontes, Halley M; Urbán, Róbert; Griffiths, Mark D; Demetrovics, Zsolt

2017-01-01

The inclusion of Internet Gaming Disorder (IGD) in the DSM-5 (Section 3) has given rise to much scholarly debate regarding the proposed criteria and their operationalization. The present study's aim was threefold: to (i) develop and validate a brief psychometric instrument (Ten-Item Internet Gaming Disorder Test; IGDT-10) to assess IGD using definitions suggested in DSM-5, (ii) contribute to ongoing debate regards the usefulness and validity of each of the nine IGD criteria (using Item Response Theory [IRT]), and (iii) investigate the cut-off threshold suggested in the DSM-5. An online gamer sample of 4887 gamers (age range 14-64years, mean age 22.2years [SD=6.4], 92.5% male) was collected through Facebook and a gaming-related website with the cooperation of a popular Hungarian gaming magazine. A shopping voucher of approx. 300 Euros was drawn between participants to boost participation (i.e., lottery incentive). Confirmatory factor analysis and a structural regression model were used to test the psychometric properties of the IGDT-10 and IRT analysis was conducted to test the measurement performance of the nine IGD criteria. Finally, Latent Class Analysis along with sensitivity and specificity analysis were used to investigate the cut-off threshold proposed in the DSM-5. Analysis supported IGDT-10's validity, reliability, and suitability to be used in future research. Findings of the IRT analysis suggest IGD is manifested through a different set of symptoms depending on the level of severity of the disorder. More specifically, "continuation", "preoccupation", "negative consequences" and "escape" were associated with lower severity of IGD, while "tolerance", "loss of control", "giving up other activities" and "deception" criteria were associated with more severe levels. "Preoccupation" and "escape" provided very little information to the estimation IGD severity. Finally, the DSM-5 suggested threshold appeared to be supported by our statistical analyses. IGDT-10 is a valid and reliable instrument to assess IGD as proposed in the DSM-5. Apparently the nine criteria do not explain IGD in the same way, suggesting that additional studies are needed to assess the characteristics and intricacies of each criterion and how they account to explain IGD. Copyright © 2015 Elsevier Ltd. All rights reserved.

Limited-sampling strategies for anti-infective agents: systematic review.

PubMed

Sprague, Denise A; Ensom, Mary H H

2009-09-01

Area under the concentration-time curve (AUC) is a pharmacokinetic parameter that represents overall exposure to a drug. For selected anti-infective agents, pharmacokinetic-pharmacodynamic parameters, such as AUC/MIC (where MIC is the minimal inhibitory concentration), have been correlated with outcome in a few studies. A limited-sampling strategy may be used to estimate pharmacokinetic parameters such as AUC, without the frequent, costly, and inconvenient blood sampling that would be required to directly calculate the AUC. To discuss, by means of a systematic review, the strengths, limitations, and clinical implications of published studies involving a limited-sampling strategy for anti-infective agents and to propose improvements in methodology for future studies. The PubMed and EMBASE databases were searched using the terms "anti-infective agents", "limited sampling", "optimal sampling", "sparse sampling", "AUC monitoring", "abbreviated AUC", "abbreviated sampling", and "Bayesian". The reference lists of retrieved articles were searched manually. Included studies were classified according to modified criteria from the US Preventive Services Task Force. Twenty studies met the inclusion criteria. Six of the studies (involving didanosine, zidovudine, nevirapine, ciprofloxacin, efavirenz, and nelfinavir) were classified as providing level I evidence, 4 studies (involving vancomycin, didanosine, lamivudine, and lopinavir-ritonavir) provided level II-1 evidence, 2 studies (involving saquinavir and ceftazidime) provided level II-2 evidence, and 8 studies (involving ciprofloxacin, nelfinavir, vancomycin, ceftazidime, ganciclovir, pyrazinamide, meropenem, and alpha interferon) provided level III evidence. All of the studies providing level I evidence used prospectively collected data and proper validation procedures with separate, randomly selected index and validation groups. However, most of the included studies did not provide an adequate description of the methods or the characteristics of included patients, which limited their generalizability. Many limited-sampling strategies have been developed for anti-infective agents that do not have a clearly established link between AUC and clinical outcomes in humans. Future studies should first determine if there is an association between AUC monitoring and clinical outcomes. Thereafter, it may be worthwhile to prospectively develop and validate a limited-sampling strategy for the particular anti-infective agent in a similar population.

Prototypicality ratings of DSM-III criteria for personality disorders.

PubMed

Livesley, W J; Reiffer, L I; Sheldon, A E; West, M

1987-07-01

Although DSM-III personality disorder criteria have demonstrated acceptable reliability, the question of validity has not been adequately addressed. A first step in establishing the validity of diagnoses is to establish the validity of the criteria used to assess each diagnosis. The content validity of diagnostic criteria was investigated in relation to the larger set of potential criteria culled from the psychiatric literature. For each DSM-III axis II diagnosis, a panel of clinicians rated how prototypical each potential criterion was of the diagnosis in question. The results reveal problems with the organization and content of the criteria for most diagnoses. Many DSM-III criteria are composed of several statements linked by conjunctions or disjunctions. These component statements often received markedly different ratings, suggesting that criteria should be single statements. For most diagnoses, traits not included in DSM-III received higher ratings than did some DSM-III criteria. Suggestions are made to improve the distinctiveness and content validity of paranoid, schizoid, antisocial, borderline, avoidant, dependent, and compulsive personality disorders. The results for schizotypal personality disorder suggest that many clinicians are uncertain about this diagnosis. These findings provide a systematic way to modify definitions that contrasts with the more arbitrary ways in which diagnoses have previously been defined and redefined.

Factor Structure and Convergent Validity of the Stress Index for Parents of Adolescents (SIPA) in Adolescents With ADHD.

PubMed

Eadeh, Hana-May; Langberg, Joshua M; Molitor, Stephen J; Behrhorst, Katie; Smith, Zoe R; Evans, Steven W

2018-02-01

Parenting stress is common in families with an adolescent with attention-deficit/hyperactivity disorder (ADHD). The Stress Index for Parents of Adolescents (SIPA) was developed to assess parenting stress but has not been validated outside of the original development work. This study examined the factor structure and sources of convergent validity of the SIPA in a sample of adolescents diagnosed with ADHD ( M age = 12.3, N = 327) and their caregivers. Three first-order models, two bifactor models, and one higher order model were evaluated; none met overall model fit criteria but the first-order nine-factor model displayed the best fit. Convergent validity was also assessed and the SIPA adolescent domain was moderately correlated with measures of family impairment and conflict after accounting for ADHD symptom severity. Implications of these findings for use of the SIPA in ADHD samples are discussed along with directions for future research focused on parent stress and ADHD.

Analytical validation of BRAF mutation testing from circulating free DNA using the amplification refractory mutation testing system.

PubMed

Aung, Kyaw L; Donald, Emma; Ellison, Gillian; Bujac, Sarah; Fletcher, Lynn; Cantarini, Mireille; Brady, Ged; Orr, Maria; Clack, Glen; Ranson, Malcolm; Dive, Caroline; Hughes, Andrew

2014-05-01

BRAF mutation testing from circulating free DNA (cfDNA) using the amplification refractory mutation testing system (ARMS) holds potential as a surrogate for tumor mutation testing. Robust assay validation is needed to establish the optimal clinical matrix for measurement and cfDNA-specific mutation calling criteria. Plasma- and serum-derived cfDNA samples from 221 advanced melanoma patients were analyzed for BRAF c.1799T>A (p.V600E) mutation using ARMS in two stages in a blinded fashion. cfDNA-specific mutation calling criteria were defined in stage 1 and validated in stage 2. cfDNA concentrations in serum and plasma, and the sensitivities and specificities of BRAF mutation detection in these two clinical matrices were compared. Sensitivity of BRAF c.1799T>A (p.V600E) mutation detection in cfDNA was increased by using mutation calling criteria optimized for cfDNA (these criteria were adjusted from those used for archival tumor biopsies) without compromising specificity. Sensitivity of BRAF mutation detection in serum was 44% (95% CI, 35% to 53%) and in plasma 52% (95% CI, 43% to 61%). Specificity was 96% (95% CI, 90% to 99%) in both matrices. Serum contains significantly higher total cfDNA than plasma, whereas the proportion of tumor-derived mutant DNA was significantly higher in plasma. Using mutation calling criteria optimized for cfDNA improves sensitivity of BRAF c.1799T>A (p.V600E) mutation detection. The proportion of tumor-derived cfDNA in plasma was significantly higher than in serum. Copyright © 2014 American Society for Investigative Pathology and the Association for Molecular Pathology. Published by Elsevier Inc. All rights reserved.

Detection methods and performance criteria for genetically modified organisms.

PubMed

Bertheau, Yves; Diolez, Annick; Kobilinsky, André; Magin, Kimberly

2002-01-01

Detection methods for genetically modified organisms (GMOs) are necessary for many applications, from seed purity assessment to compliance of food labeling in several countries. Numerous analytical methods are currently used or under development to support these needs. The currently used methods are bioassays and protein- and DNA-based detection protocols. To avoid discrepancy of results between such largely different methods and, for instance, the potential resulting legal actions, compatibility of the methods is urgently needed. Performance criteria of methods allow evaluation against a common standard. The more-common performance criteria for detection methods are precision, accuracy, sensitivity, and specificity, which together specifically address other terms used to describe the performance of a method, such as applicability, selectivity, calibration, trueness, precision, recovery, operating range, limit of quantitation, limit of detection, and ruggedness. Performance criteria should provide objective tools to accept or reject specific methods, to validate them, to ensure compatibility between validated methods, and be used on a routine basis to reject data outside an acceptable range of variability. When selecting a method of detection, it is also important to consider its applicability, its field of applications, and its limitations, by including factors such as its ability to detect the target analyte in a given matrix, the duration of the analyses, its cost effectiveness, and the necessary sample sizes for testing. Thus, the current GMO detection methods should be evaluated against a common set of performance criteria.

Evaluation of physical activity interventions in children via the reach, efficacy/effectiveness, adoption, implementation, and maintenance (RE-AIM) framework: A systematic review of randomized and non-randomized trials.

PubMed

McGoey, Tara; Root, Zach; Bruner, Mark W; Law, Barbi

2016-01-01

Existing reviews of physical activity (PA) interventions designed to increase PA behavior exclusively in children (ages 5 to 11years) focus primarily on the efficacy (e.g., internal validity) of the interventions without addressing the applicability of the results in terms of generalizability and translatability (e.g., external validity). This review used the RE-AIM (Reach, Efficacy/Effectiveness, Adoption, Implementation, Maintenance) framework to measure the degree to which randomized and non-randomized PA interventions in children report on internal and external validity factors. A systematic search for controlled interventions conducted within the past 12years identified 78 studies that met the inclusion criteria. Based on the RE-AIM criteria, most of the studies focused on elements of internal validity (e.g., sample size, intervention location and efficacy/effectiveness) with minimal reporting of external validity indicators (e.g., representativeness of participants, start-up costs, protocol fidelity and sustainability). Results of this RE-AIM review emphasize the need for future PA interventions in children to report on real-world challenges and limitations, and to highlight considerations for translating evidence-based results into health promotion practice. Copyright © 2015 Elsevier Inc. All rights reserved.

Development and validation of an HPLC–MS/MS method to determine clopidogrel in human plasma

PubMed Central

Liu, Gangyi; Dong, Chunxia; Shen, Weiwei; Lu, Xiaopei; Zhang, Mengqi; Gui, Yuzhou; Zhou, Qinyi; Yu, Chen

2015-01-01

A quantitative method for clopidogrel using online-SPE tandem LC–MS/MS was developed and fully validated according to the well-established FDA guidelines. The method achieves adequate sensitivity for pharmacokinetic studies, with lower limit of quantifications (LLOQs) as low as 10 pg/mL. Chromatographic separations were performed on reversed phase columns Kromasil Eternity-2.5-C18-UHPLC for both methods. Positive electrospray ionization in multiple reaction monitoring (MRM) mode was employed for signal detection and a deuterated analogue (clopidogrel-d4) was used as internal standard (IS). Adjustments in sample preparation, including introduction of an online-SPE system proved to be the most effective method to solve the analyte back-conversion in clinical samples. Pooled clinical samples (two levels) were prepared and successfully used as real-sample quality control (QC) in the validation of back-conversion testing under different conditions. The result showed that the real samples were stable in room temperature for 24 h. Linearity, precision, extraction recovery, matrix effect on spiked QC samples and stability tests on both spiked QCs and real sample QCs stored in different conditions met the acceptance criteria. This online-SPE method was successfully applied to a bioequivalence study of 75 mg single dose clopidogrel tablets in 48 healthy male subjects. PMID:26904399

Use of Bayesian Methods to Analyze and Visualize Content Uniformity Capability Versus United States Pharmacopeia and ASTM Standards.

PubMed

Hofer, Jeffrey D; Rauk, Adam P

2017-02-01

The purpose of this work was to develop a straightforward and robust approach to analyze and summarize the ability of content uniformity data to meet different criteria. A robust Bayesian statistical analysis methodology is presented which provides a concise and easily interpretable visual summary of the content uniformity analysis results. The visualization displays individual batch analysis results and shows whether there is high confidence that different content uniformity criteria could be met a high percentage of the time in the future. The 3 tests assessed are as follows: (a) United States Pharmacopeia Uniformity of Dosage Units <905>, (b) a specific ASTM E2810 Sampling Plan 1 criterion to potentially be used for routine release testing, and (c) another specific ASTM E2810 Sampling Plan 2 criterion to potentially be used for process validation. The approach shown here could readily be used to create similar result summaries for other potential criteria. Copyright © 2017 American Pharmacists Association®. Published by Elsevier Inc. All rights reserved.

Validating the Multidimensional Measure of Cultural Identity Scales for Latinos Among Latina Mothers and Daughters

PubMed Central

Dillon, Frank R.; Félix-Ortiz, Maria; Rice, Christopher; De La Rosa, Mario; Rojas, Patria; Duan, Rui

2009-01-01

The psychometric properties of the Multidimensional Measure of Cultural Identity Scales for Latinos (MMCISL; Félix-Ortiz, Newcomb, & Myers, 1994) have never been examined in an adult Latina sample representing various levels of nativity and nationality. The rationale for the study was to confirm the factor structure and psychometric properties of the MMCISL with a predominantly immigrant sample of Latina mothers and daughters (n = 316). Adequate reliability estimates were found for 6 of the original 10 scales. Confirmatory factor analyses provided evidence of construct validity for the reliable scales. The Preferred Latino Affiliation scale was the only scale to meet strict measurement invariance criteria across mothers and daughters. Criterion validity was evidenced by relations between the Familiarity with Latino Culture scale and all criterion variables. Implications for acculturation and cultural identity research involving the MMCISL are discussed. PMID:19364206

Subtyping attention-deficit/hyperactivity disorder using temperament dimensions: toward biologically based nosologic criteria.

PubMed

Karalunas, Sarah L; Fair, Damien; Musser, Erica D; Aykes, Kamari; Iyer, Swathi P; Nigg, Joel T

2014-09-01

Psychiatric nosology is limited by behavioral and biological heterogeneity within existing disorder categories. The imprecise nature of current nosologic distinctions limits both mechanistic understanding and clinical prediction. We demonstrate an approach consistent with the National Institute of Mental Health Research Domain Criteria initiative to identify superior, neurobiologically valid subgroups with better predictive capacity than existing psychiatric categories for childhood attention-deficit/hyperactivity disorder (ADHD). To refine subtyping of childhood ADHD by using biologically based behavioral dimensions (i.e., temperament), novel classification algorithms, and multiple external validators. A total of 437 clinically well-characterized, community-recruited children, with and without ADHD, participated in an ongoing longitudinal study. Baseline data were used to classify children into subgroups based on temperament dimensions and examine external validators including physiological and magnetic resonance imaging measures. One-year longitudinal follow-up data are reported for a subgroup of the ADHD sample to address stability and clinical prediction. Parent/guardian ratings of children on a measure of temperament were used as input features in novel community detection analyses to identify subgroups within the sample. Groups were validated using 3 widely accepted external validators: peripheral physiological characteristics (cardiac measures of respiratory sinus arrhythmia and pre-ejection period), central nervous system functioning (via resting-state functional connectivity magnetic resonance imaging), and clinical outcomes (at 1-year longitudinal follow-up). The community detection algorithm suggested 3 novel types of ADHD, labeled as mild (normative emotion regulation), surgent (extreme levels of positive approach-motivation), and irritable (extreme levels of negative emotionality, anger, and poor soothability). Types were independent of existing clinical demarcations including DSM-5 presentations or symptom severity. These types showed stability over time and were distinguished by unique patterns of cardiac physiological response, resting-state functional brain connectivity, and clinical outcomes 1 year later. Results suggest that a biologically informed temperament-based typology, developed with a discovery-based community detection algorithm, provides a superior description of heterogeneity in the ADHD population than does any current clinical nosologic criteria. This demonstration sets the stage for more aggressive attempts at a tractable, biologically based nosology.

Criteria for the validity of clinical trials of treatments of cohorts of cancer patients based on the Hardin Jones principle.

PubMed Central

Pauling, L; Herman, Z S

1989-01-01

With the assumption of the validity of the Hardin Jones principle that the death rate of members of a homogeneous cohort of cancer patients is constant, three criteria for the validity of clinical trials of cancer treatments are formulated. These criteria are satisfied by most published clinical trials, but one trial was found to violate all three, rendering the validity of its reported results uncertain. PMID:2780542

Predictive ability of positive clinical culture results and International Classification of Diseases, Ninth Revision, to identify and classify noninvasive Staphylococcus aureus infections: a validation study.

PubMed

Tracy, LaRee A; Furuno, Jon P; Harris, Anthony D; Singer, Mary; Langenberg, Patricia; Roghmann, Mary-Claire

2010-07-01

To develop and validate an algorithm to identify and classify noninvasive infections due to Staphylococcus aureus by using positive clinical culture results and administrative data. Retrospective cohort study. Veterans Affairs Maryland Health Care System. Data were collected retrospectively on all S. aureus clinical culture results from samples obtained from nonsterile body sites during October 1998 through September 2008 and associated administrative claims records. An algorithm was developed to identify noninvasive infections on the basis of a unique S. aureus-positive culture result from a nonsterile site sample with a matching International Classification of Diseases, Ninth Revision (ICD-9-CM), code for infection at time of sampling. Medical records of a subset of cases were reviewed to find the proportion of true noninvasive infections (cases that met the Centers for Disease Control and Prevention National Healthcare Safety Network [NHSN] definition of infection). Positive predictive value (PPV) and negative predictive value (NPV) were calculated for all infections and according to body site of infection. We identified 4,621 unique S. aureus-positive culture results, of which 2,816 (60.9%) results met our algorithm definition of noninvasive S. aureus infection and 1,805 (39.1%) results lacked a matching ICD-9-CM code. Among 96 cases that met our algorithm criteria for noninvasive S. aureus infection, 76 also met the NHSN criteria (PPV, 79.2% [95% confidence interval, 70.0%-86.1%]). Among 98 cases that failed to meet the algorithm criteria, 80 did not meet the NHSN criteria (NPV, 81.6% [95% confidence interval, 72.8%-88.0%]). The PPV of all culture results was 55.4%. The algorithm was most predictive for skin and soft-tissue infections and bone and joint infections. When culture-based surveillance methods are used, the addition of administrative ICD-9-CM codes for infection can increase the PPV of true noninvasive S. aureus infection over the use of positive culture results alone.

Criterion for evaluating the predictive ability of nonlinear regression models without cross-validation.

PubMed

Kaneko, Hiromasa; Funatsu, Kimito

2013-09-23

We propose predictive performance criteria for nonlinear regression models without cross-validation. The proposed criteria are the determination coefficient and the root-mean-square error for the midpoints between k-nearest-neighbor data points. These criteria can be used to evaluate predictive ability after the regression models are updated, whereas cross-validation cannot be performed in such a situation. The proposed method is effective and helpful in handling big data when cross-validation cannot be applied. By analyzing data from numerical simulations and quantitative structural relationships, we confirm that the proposed criteria enable the predictive ability of the nonlinear regression models to be appropriately quantified.

Assessment of the Validity of the Research Diagnostic Criteria for Temporomandibular Disorders: Overview and Methodology

PubMed Central

Schiffman, Eric L.; Truelove, Edmond L.; Ohrbach, Richard; Anderson, Gary C.; John, Mike T.; List, Thomas; Look, John O.

2011-01-01

AIMS The purpose of the Research Diagnostic Criteria for Temporomandibular Disorders (RDC/TMD) Validation Project was to assess the diagnostic validity of this examination protocol. An overview is presented, including Axis I and II methodology and descriptive statistics for the study participant sample. This paper details the development of reliable methods to establish the reference standards for assessing criterion validity of the Axis I RDC/TMD diagnoses. Validity testing for the Axis II biobehavioral instruments was based on previously validated reference standards. METHODS The Axis I reference standards were based on the consensus of 2 criterion examiners independently performing a comprehensive history, clinical examination, and evaluation of imaging. Intersite reliability was assessed annually for criterion examiners and radiologists. Criterion exam reliability was also assessed within study sites. RESULTS Study participant demographics were comparable to those of participants in previous studies using the RDC/TMD. Diagnostic agreement of the criterion examiners with each other and with the consensus-based reference standards was excellent with all kappas ≥ 0.81, except for osteoarthrosis (moderate agreement, k = 0.53). Intrasite criterion exam agreement with reference standards was excellent (k ≥ 0.95). Intersite reliability of the radiologists for detecting computed tomography-disclosed osteoarthrosis and magnetic resonance imaging-disclosed disc displacement was good to excellent (k = 0.71 and 0.84, respectively). CONCLUSION The Validation Project study population was appropriate for assessing the reliability and validity of the RDC/TMD Axis I and II. The reference standards used to assess the validity of Axis I TMD were based on reliable and clinically credible methods. PMID:20213028

STOPP/START Medication Criteria Modified for US Nursing Home Setting

PubMed Central

Khodyakov, Dmitry; Ochoa, Aileen; Olivieri-Mui, Brianne L.; Bouwmeester, Carla; Zarowitz, Barbara J.; Patel, Meenakshi; Ching, Diana; Briesacher, Becky

2016-01-01

STRUCTURED ABSTRACT BACKGROUND/OBJECTIVES A barrier to assessing the quality of prescribing in nursing homes (NH) is the lack of explicit criteria for this setting. Our objective was to develop a set of prescribing indicators measurable with available data from electronic nursing home databases by adapting the European-based 2014 STOPP/START criteria of potentially inappropriate and underused medications for the US setting. DESIGN A two-stage expert panel process. In first stage, investigator team reviewed 114 criteria for compatibility and measurability. In second stage, we convened an online modified e-Delphi (OMD) panel to rate the validity of criteria and two webinars to identify criteria with highest relevance to US NHs. PARTICIPANTS Seventeen experts with recognized reputations in NH care participated in the e-Delphi panel and 12 in the webinar. MEASUREMENTS Compatibility and measurability were assessed by comparing criteria to US terminology/setting standards and data elements in NH databases. Validity was rated with a 9-point Likert-type scale (1=not valid at all, 9=highly valid). Mean, median, interpercentile ranges, and agreement were determined for each criterion score. Relevance was determined by ranking the mean panel ratings on criteria that reached agreement; half of the criteria with the highest mean values were reviewed and approved by the webinar participants. RESULTS Fifty-three STOPP/START criteria were deemed as compatible with US setting and measurable using data from electronic NH databases. E-Delphi panelists rated 48 criteria as valid for US NHs. Twenty-four criteria were deemed as most relevant, consisting of 22 measures of potentially inappropriate medications and 2 measures of underused medications. CONCLUSION This study created the first explicit criteria for assessing the quality of prescribing in US NHs. PMID:28008599

Reliability and validity of the DSM-IV-TR and proposed DSM-5 criteria for pedophilia: Implications for the ICD-11 and the next DSM.

PubMed

Seto, Michael C; Fedoroff, J Paul; Bradford, John M; Knack, Natasha; Rodrigues, Nicole C; Curry, Susan; Booth, Brad; Gray, Jonathan; Cameron, Colin; Bourget, Dominique; Messina, Sarina; James, Elizabeth; Watson, Diane; Gulati, Sanjiv; Balmaceda, Rufino; Ahmed, Adekunle G

We tested the inter-rater reliability and criterion-related validity of the DSM-IV-TR pedophilia diagnosis and proposed DSM-5 pedohebephilia diagnosis in a sample of 79 men who had committed child pornography offenses, contact sexual offenses against children, or who were referred because of concerns about whether they had a sexual interest in children. Participants were evaluated by two independent psychiatrists with an interview and questionnaire regarding demographic characteristics, sexual history, and self-reported sexual interests; they also completed phallometric and visual reaction time testing. Kappa was .59 for ever meeting DSM-IV-TR criteria for pedophilia and .52 for ever meeting the proposed DSM-5 criteria for pedohebephilia. Ever meeting DSM-IV-TR diagnosis was significantly related to self-reported index of sexual interest in children (highest AUC=.81, 95% CI=.70-.91, p<.001) and to indices of sexual interest in children from phallometric testing (AUC=.70; 95% CI=.52-.89; p<.05) or a computerized assessment based on visual reaction time and self-report (AUC=.75; 95% CI=.62-.88; p<.005). Ever meeting the proposed DSM-5 "diagnosis" was similarly related to self-report (AUC=.84, 95% CI=.74-.94, p<.001) and to the two objective indices, with AUCs of .69 (95% CI=.53-.85; p<.05) and .77 (95% CI=.64-.89; p<.001), respectively. Because the pDSM-5 criteria did not produce significantly better reliability or validity results and users are more familiar with the current DSM-5 criteria, we believe these results suggest the revision of DSM-5 and development of ICD-11 could benefit from drawing on the current DSM-5 criteria, which are essentially the same as DSM-IV-TR except for a distinction between having a paraphilia (the interest) and a paraphilic disorder (the paraphilia plus clinically significant distress or impairment). Copyright © 2016. Published by Elsevier Ltd.

A comparison of the psychometric properties of the psychopathic personality inventory full-length and short-form versions.

PubMed

Kastner, Rebecca M; Sellbom, Martin; Lilienfeld, Scott O

2012-03-01

The Psychopathic Personality Inventory (PPI) has shown promising construct validity as a measure of psychopathy. Because of its relative efficiency, a short-form version of the PPI (PPI-SF) was developed and has proven useful in many psychopathy studies. The validity of the PPI-SF, however, has not been thoroughly examined, and no studies have directly compared the validity of the short form with that of the full-length version. The current study was designed to compare the psychometric properties of both PPI versions, with an emphasis on convergent and discriminant validity in predicting external criteria conceptually relevant to psychopathy. We used both prison (n = 558) and college samples (n = 322) for this investigation. PPI scale scores were more reliable and more strongly correlated with the conceptually relevant criterion measures compared with the PPI-SF, particularly in the prison sample. There were no differences in relative discriminant validity. Thus, overall, the PPI full-length version showed more evidence of construct validity than did the short form, and the consequences of this psychometric difference should be considered when evaluating the clinical utility of each measure.

The Research Diagnostic Criteria for Temporomandibular Disorders. I: overview and methodology for assessment of validity.

PubMed

Schiffman, Eric L; Truelove, Edmond L; Ohrbach, Richard; Anderson, Gary C; John, Mike T; List, Thomas; Look, John O

2010-01-01

The purpose of the Research Diagnostic Criteria for Temporomandibular Disorders (RDC/TMD) Validation Project was to assess the diagnostic validity of this examination protocol. The aim of this article is to provide an overview of the project's methodology, descriptive statistics, and data for the study participant sample. This article also details the development of reliable methods to establish the reference standards for assessing criterion validity of the Axis I RDC/TMD diagnoses. The Axis I reference standards were based on the consensus of two criterion examiners independently performing a comprehensive history, clinical examination, and evaluation of imaging. Intersite reliability was assessed annually for criterion examiners and radiologists. Criterion examination reliability was also assessed within study sites. Study participant demographics were comparable to those of participants in previous studies using the RDC/TMD. Diagnostic agreement of the criterion examiners with each other and with the consensus-based reference standards was excellent with all kappas > or = 0.81, except for osteoarthrosis (moderate agreement, k = 0.53). Intrasite criterion examiner agreement with reference standards was excellent (k > or = 0.95). Intersite reliability of the radiologists for detecting computed tomography-disclosed osteoarthrosis and magnetic resonance imaging-disclosed disc displacement was good to excellent (k = 0.71 and 0.84, respectively). The Validation Project study population was appropriate for assessing the reliability and validity of the RDC/TMD Axis I and II. The reference standards used to assess the validity of Axis I TMD were based on reliable and clinically credible methods.

Design, testing and validation of an innovative web-based instrument to evaluate school meal quality.

PubMed

Patterson, Emma; Quetel, Anna-Karin; Lilja, Karin; Simma, Marit; Olsson, Linnea; Elinder, Liselotte Schäfer

2013-06-01

To develop a feasible, valid, reliable web-based instrument to objectively evaluate school meal quality in Swedish primary schools. The construct 'school meal quality' was operationalized by an expert panel into six domains, one of which was nutritional quality. An instrument was drafted and pilot-tested. Face validity was evaluated by the panel. Feasibility was established via a large national study. Food-based criteria to predict the nutritional adequacy of school meals in terms of fat quality, iron, vitamin D and fibre content were developed. Predictive validity was evaluated by comparing the nutritional adequacy of school menus based on these criteria with the results from a nutritional analysis. Inter-rater reliability was also assessed. The instrument was developed between 2010 and 2012. It is designed for use in all primary schools by school catering and/or management representatives. A pilot-test of eighty schools in Stockholm (autumn 2010) and a further test of feasibility in 191 schools nationally (spring 2011). The four nutrient-specific food-based criteria predicted nutritional adequacy with sensitivity ranging from 0.85 to 1.0, specificity from 0.45 to 1.0 and accuracy from 0.67 to 1.0. The sample in the national study was statistically representative and the majority of users rated the questionnaire positively, suggesting the instrument is feasible. The inter-rater reliability was fair to almost perfect for continuous variables and agreement was ≥ 67 % for categorical variables. An innovative web-based system to comprehensively monitor school meal quality across several domains, with validated questions in the nutritional domain, is available in Sweden for the first time.

Use of the Panic Attack Questionnaire-IV to assess non-clinical panic attacks and limited symptom panic attacks in student and community samples.

PubMed

Norton, Peter J; Zvolensky, Michael J; Bonn-Miller, Marcel O; Cox, Brian J; Norton, G Ron

2008-10-01

Since its development in the mid-1980s, the Panic Attack Questionnaire (PAQ) has been one of the more, if not the most, commonly used self-report tools for assessing panic attacks. The usage of the instrument, however, has come amid potential concerns that instructions and descriptions may lead to an over-estimate of the prevalence of panic attacks. Furthermore, the instrument has not been revised since 1992, despite changes in DSM-IV criteria and more recent developments in the understanding of panic attacks. As a result, this paper describes a revision of the PAQ to improve the instruction and descriptive set, and to fully assess features of panic derived from recent conceptualizations. Students meeting DSM-IV panic attack criteria and those endorsing panic attacks, but not meeting criteria, showed few differences with the exception that those not meeting DSM-IV criteria typically reported a longer onset-to-peak intensity time than did Panickers. Results were cross-validated and extended using an independent Community Sample. A full descriptive phenomenology of panic attacks is described, and future directions for studying panic attacks using the PAQ are presented.

Sensitivity of revised diagnostic criteria for the behavioural variant of frontotemporal dementia

PubMed Central

Hodges, John R.; Knopman, David; Mendez, Mario F.; Kramer, Joel H.; Neuhaus, John; van Swieten, John C.; Seelaar, Harro; Dopper, Elise G. P.; Onyike, Chiadi U.; Hillis, Argye E.; Josephs, Keith A.; Boeve, Bradley F.; Kertesz, Andrew; Seeley, William W.; Rankin, Katherine P.; Johnson, Julene K.; Gorno-Tempini, Maria-Luisa; Rosen, Howard; Prioleau-Latham, Caroline E.; Lee, Albert; Kipps, Christopher M.; Lillo, Patricia; Piguet, Olivier; Rohrer, Jonathan D.; Rossor, Martin N.; Warren, Jason D.; Fox, Nick C.; Galasko, Douglas; Salmon, David P.; Black, Sandra E.; Mesulam, Marsel; Weintraub, Sandra; Dickerson, Brad C.; Diehl-Schmid, Janine; Pasquier, Florence; Deramecourt, Vincent; Lebert, Florence; Pijnenburg, Yolande; Chow, Tiffany W.; Manes, Facundo; Grafman, Jordan; Cappa, Stefano F.; Freedman, Morris; Grossman, Murray; Miller, Bruce L.

2011-01-01

Based on the recent literature and collective experience, an international consortium developed revised guidelines for the diagnosis of behavioural variant frontotemporal dementia. The validation process retrospectively reviewed clinical records and compared the sensitivity of proposed and earlier criteria in a multi-site sample of patients with pathologically verified frontotemporal lobar degeneration. According to the revised criteria, ‘possible’ behavioural variant frontotemporal dementia requires three of six clinically discriminating features (disinhibition, apathy/inertia, loss of sympathy/empathy, perseverative/compulsive behaviours, hyperorality and dysexecutive neuropsychological profile). ‘Probable’ behavioural variant frontotemporal dementia adds functional disability and characteristic neuroimaging, while behavioural variant frontotemporal dementia ‘with definite frontotemporal lobar degeneration’ requires histopathological confirmation or a pathogenic mutation. Sixteen brain banks contributed cases meeting histopathological criteria for frontotemporal lobar degeneration and a clinical diagnosis of behavioural variant frontotemporal dementia, Alzheimer’s disease, dementia with Lewy bodies or vascular dementia at presentation. Cases with predominant primary progressive aphasia or extra-pyramidal syndromes were excluded. In these autopsy-confirmed cases, an experienced neurologist or psychiatrist ascertained clinical features necessary for making a diagnosis according to previous and proposed criteria at presentation. Of 137 cases where features were available for both proposed and previously established criteria, 118 (86%) met ‘possible’ criteria, and 104 (76%) met criteria for ‘probable’ behavioural variant frontotemporal dementia. In contrast, 72 cases (53%) met previously established criteria for the syndrome (P < 0.001 for comparison with ‘possible’ and ‘probable’ criteria). Patients who failed to meet revised criteria were significantly older and most had atypical presentations with marked memory impairment. In conclusion, the revised criteria for behavioural variant frontotemporal dementia improve diagnostic accuracy compared with previously established criteria in a sample with known frontotemporal lobar degeneration. Greater sensitivity of the proposed criteria may reflect the optimized diagnostic features, less restrictive exclusion features and a flexible structure that accommodates different initial clinical presentations. Future studies will be needed to establish the reliability and specificity of these revised diagnostic guidelines. PMID:21810890

The Role of Sensory Modulation Deficits and Behavioral Symptoms in a Diagnosis for Early Childhood

ERIC Educational Resources Information Center

Perez-Robles, Ruth; Doval, Eduardo; Jane, Ma Claustre; da Silva, Pedro Caldeira; Papoila, Ana Luisa; Virella, Daniel

2013-01-01

To contribute to the validation of the sensory and behavioral criteria for Regulation Disorders of Sensory Processing (RDSP) (DC:0-3R, 2005), this study examined a sample of toddlers in a clinical setting to analyze: (1) the severity of sensory modulation deficits and the behavioral symptoms of RDSP; (2) the associations between sensory and…

Evaluating the Utility of Sluggish Cognitive Tempo in Discriminating among "DSM-IV" ADHD Subtypes

ERIC Educational Resources Information Center

Harrington, Kelly M.; Waldman, Irwin D.

2010-01-01

The objective of the current study was to evaluate how the inclusion of 3 Sluggish Cognitive Tempo (SCT) symptoms in Attention-Deficit/Hyperactivity Disorder (ADHD) diagnostic criteria influences the external validity of the ADHD subtypes. The sample comprised 228 children (166 boys, 62 girls) ranging in age from 5-18 years who were referred to…

Validation of the Italian version of the Clinical Outcomes in Routine Evaluation Outcome Measure (CORE-OM).

PubMed

Palmieri, Gaspare; Evans, Chris; Hansen, Vidje; Brancaleoni, Greta; Ferrari, Silvia; Porcelli, Piero; Reitano, Francesco; Rigatelli, Marco

2009-01-01

The Clinical Outcomes in Routine Evaluation--Outcome Measure (CORE-OM) was translated into Italian and tested in non-clinical (n = 263) and clinical (n = 647) samples. The translation showed good acceptability, internal consistency and convergent validity in both samples. There were large and statistically significant differences between clinical and non-clinical datasets on all scores. The reliable change criteria were similar to those for the UK referential data. Some of the clinically significant change criteria, particularly for the men, were moderately different from the UK cutting points. The Italian version of the CORE-OM showed respectable psychometric parameters. However, it seemed plausible that non-clinical and clinical distributions of self-report scores on psychopathology and functioning measures may differ by language and culture. *A good quality Italian translation of the CORE-OM, and hence the GP-CORE, CORE-10 and CORE-5 measures also, is now available for use by practitioners and anyone surveying or exploring general psychological state. The measures can be obtained from CORE-IMS or yourself and practitioners are encouraged to share anonymised data so that good clinical and non-clinical referential databases can be established for Italy.

Validity of a PCR assay in CSF for the diagnosis of neurocysticercosis

PubMed Central

Campoverde, Alfredo; Romo, Matthew L.; García, Lorena; Piedra, Luis M.; Pacurucu, Mónica; López, Nelson; Aguilar, Jenner; López, Sebastian; Vintimilla, Luis C.; Toral, Ana M.; Peña-Tapia, Pablo

2017-01-01

Objective: To prospectively evaluate the validity of a PCR assay in CSF for the diagnosis of neurocysticercosis (NC). Methods: We conducted a multicenter, prospective case-control study, recruiting participants from 5 hospitals in Cuenca, Ecuador, from January 2015 to February 2016. Cases fulfilled validated diagnostic criteria for NC. For each case, a neurosurgical patient who did not fulfill the diagnostic criteria for NC was selected as a control. CT and MRI, as well as a CSF sample, were collected from both cases and controls. The diagnostic criteria to identify cases were used as a reference standard. Results: Overall, 36 case and 36 control participants were enrolled. PCR had a sensitivity of 72.2% (95% confidence interval [CI] 54.8%–85.8%) and a specificity of 100.0% (95% CI 90.3%–100.0%). For parenchymal NC, PCR had a sensitivity of 42.9% (95% CI 17.7%–71.1%), and for extraparenchymal NC, PCR had a sensitivity of 90.9% (95% CI 70.8%–98.9%). Conclusions: This study demonstrated the usefulness of this PCR assay in CSF for the diagnosis of NC. PCR may be particularly helpful for diagnosing extraparenchymal NC when neuroimaging techniques have failed. Classification of evidence: This study provides Class III evidence that CSF PCR can accurately identify patients with extraparenchymal NC. PMID:28105460

Established risk factors for addiction fail to discriminate between healthy gamers and gamers endorsing DSM-5 Internet gaming disorder.

PubMed

Deleuze, Jory; Nuyens, Filip; Rochat, Lucien; Rothen, Stéphane; Maurage, Pierre; Billieux, Joël

2017-12-01

Background and aims The DSM-5 includes criteria for diagnosing Internet gaming disorder (IGD) that are adapted from substance abuse and widely used in research and clinical contexts, although evidence supporting their validity remains scarce. This study compared online gamers who do or do not endorse IGD criteria regarding self-control-related abilities (impulsivity, inhibitory control, and decision-making), considered the hallmarks of addictive behaviors. Method A double approach was adopted to distinguish pathological from recreational gamers: The first is the classic DSM-5 approach (≥5 criteria required to endorse the IGD diagnosis), and the second consists in using latent class analysis (LCA) for IGD criteria to distinguish gamers' subgroups. We computed comparisons separately for each approach. Ninety-seven volunteer gamers from the community were recruited. Self-reported questionnaires were used to measure demographic- and game-related characteristics, problematic online gaming (with the Problematic Online Gaming Questionnaire), impulsivity (with the UPPS-P Impulsive Behavior Scale), and depression (with the Beck Depression Inventory-II). Experimental tasks were used to measure inhibitory control (Hybrid-Stop Task) and decision-making abilities (Game of Dice Task). Results Thirty-two participants met IGD criteria (33% of the sample), whereas LCA identified two groups of gamers [pathological (35%) and recreational]. Comparisons that used both approaches (DSM-5 and LCA) failed to identify significant differences regarding all constructs except for variables related to actual or problematic gaming behaviors. Discussion The validity of IGD criteria is questioned, mostly with respect to their relevance in distinguishing high engagement from pathological involvement in video games.

Data mining: comparing the empiric CFS to the Canadian ME/CFS case definition.

PubMed

Jason, Leonard A; Skendrovic, Beth; Furst, Jacob; Brown, Abigail; Weng, Angela; Bronikowski, Christine

2012-01-01

This article contrasts two case definitions for myalgic encephalomyelitis/chronic fatigue syndrome (ME/CFS). We compared the empiric CFS case definition (Reeves et al., 2005) and the Canadian ME/CFS clinical case definition (Carruthers et al., 2003) with a sample of individuals with CFS versus those without. Data mining with decision trees was used to identify the best items to identify patients with CFS. Data mining is a statistical technique that was used to help determine which of the survey questions were most effective for accurately classifying cases. The empiric criteria identified about 79% of patients with CFS and the Canadian criteria identified 87% of patients. Items identified by the Canadian criteria had more construct validity. The implications of these findings are discussed. © 2011 Wiley Periodicals, Inc.

[Usefulness of a screening questionnaire for post traumatic stress in a Colombian population].

PubMed

Pineda, D A; Guerrero, O L; Pinilla, M L; Estupiñán, M

Rating scales for post traumatic stress disorder (PTSD) should be consistents with DSM IV criteria, and should be validate for each culture. To validate a PTSD checklist in a Colombian little town population, which was semi destructed by a guerrilla attack. A stratified, representative and randomized sample of 202 adult participants, aged over 15 year old, was selected from San Joaquin (Santander Colombia) two year after an guerrilla attack. A structured interview (SCID I), based on DSM IV criteria, was developed with each member of the sample. 76 participants (37.6%) met criteria for PTSD, and 126 (62.4%) were classified as non PTSD. A rating checklist with 24 symptoms of PTSD was applied by self report. Each item of the scale was scored 1 to 4. PTSD checklist had a reliability Cronbach s alpha coefficient of 0.97. PTSD group scored 70.4 22.9, and non PTSD 37.2 13.7 (p< 0.0001) on the PTSD checklist. A discriminant analysis found that the scale had a correctly classification capability of 88.6% (p< 0.0001). Sensibility was found between 76.3% for a cut off point of 51 and 81.6% for cut off point of 45. Specificity changed between 71.4% for a cut off point of 45 and 84.4% for a cut off point of 51. Checklist for PTSD had a high reliability, good discriminant capability, and good sensibility and specificity.

High-throughput method for the determination of residues of β-lactam antibiotics in bovine milk by LC-MS/MS.

PubMed

Jank, Louise; Martins, Magda Targa; Arsand, Juliana Bazzan; Hoff, Rodrigo Barcellos; Barreto, Fabiano; Pizzolato, Tânia Mara

2015-01-01

This study describes the development and validation procedures for scope extension of a method for the determination of β-lactam antibiotic residues (ampicillin, amoxicillin, penicillin G, penicillin V, oxacillin, cloxacillin, dicloxacillin, nafcillin, ceftiofur, cefquinome, cefoperazone, cephapirine, cefalexin and cephalonium) in bovine milk. Sample preparation was performed by liquid-liquid extraction (LLE) followed by two clean-up steps, including low temperature purification (LTP) and a solid phase dispersion clean-up. Extracts were analysed using a liquid chromatography-electrospray-tandem mass spectrometry system (LC-ESI-MS/MS). Chromatographic separation was performed in a C18 column, using methanol and water (both with 0.1% of formic acid) as mobile phase. Method validation was performed according to the criteria of Commission Decision 2002/657/EC. Main validation parameters such as linearity, limit of detection, decision limit (CCα), detection capability (CCβ), accuracy, and repeatability were determined and were shown to be adequate. The method was applied to real samples (more than 250) and two milk samples had levels above maximum residues limits (MRLs) for cloxacillin - CLX and cefapirin - CFAP.

Development and Analytical Validation of an Immunoassay for Quantifying Serum Anti-Pertussis Toxin Antibodies Resulting from Bordetella pertussis Infection ▿

PubMed Central

Menzies, Sandra L.; Kadwad, Vijay; Pawloski, Lucia C.; Lin, Tsai-Lien; Baughman, Andrew L.; Martin, Monte; Tondella, Maria Lucia C.; Meade, Bruce D.

2009-01-01

Adequately sensitive and specific methods to diagnose pertussis in adolescents and adults are not widely available. Currently, no Food and Drug Administration-approved diagnostic assays are available for the serodiagnosis of Bordetella pertussis. Since concentrations of B. pertussis-specific antibodies tend to be high during the later phases of disease, a simple, rapid, easily transferable serodiagnostic test was developed. This article describes test development, initial evaluation of a prototype kit enzyme-linked immunosorbent assay (ELISA) in an interlaboratory collaborative study, and analytical validation. The data presented here demonstrate that the kit met all prespecified criteria for precision, linearity, and accuracy for samples with anti-pertussis toxin (PT) immunoglobulin G (IgG) antibody concentrations in the range of 50 to 150 ELISA units (EU)/ml, the range believed to be most relevant for serodiagnosis. The assay met the precision and linearity criteria for a wider range, namely, from 50 to 200 EU/ml; however, the accuracy criterion was not met at 200 EU/ml. When the newly adopted World Health Organization International Standard for pertussis antiserum (human) reference reagent was used to evaluate accuracy, the accuracy criteria were met from 50 to 200 international units/ml. In conclusion, the IgG anti-PT ELISA met all assay validation parameters within the range considered most relevant for serodiagnosis. This ELISA was developed and analytically validated as a user-friendly kit that can be used in both qualitative and quantitative formats. The technology for producing the kit is transferable to public health laboratories. PMID:19864485

A Generalized Pivotal Quantity Approach to Analytical Method Validation Based on Total Error.

PubMed

Yang, Harry; Zhang, Jianchun

2015-01-01

The primary purpose of method validation is to demonstrate that the method is fit for its intended use. Traditionally, an analytical method is deemed valid if its performance characteristics such as accuracy and precision are shown to meet prespecified acceptance criteria. However, these acceptance criteria are not directly related to the method's intended purpose, which is usually a gurantee that a high percentage of the test results of future samples will be close to their true values. Alternate "fit for purpose" acceptance criteria based on the concept of total error have been increasingly used. Such criteria allow for assessing method validity, taking into account the relationship between accuracy and precision. Although several statistical test methods have been proposed in literature to test the "fit for purpose" hypothesis, the majority of the methods are not designed to protect the risk of accepting unsuitable methods, thus having the potential to cause uncontrolled consumer's risk. In this paper, we propose a test method based on generalized pivotal quantity inference. Through simulation studies, the performance of the method is compared to five existing approaches. The results show that both the new method and the method based on β-content tolerance interval with a confidence level of 90%, hereafter referred to as the β-content (0.9) method, control Type I error and thus consumer's risk, while the other existing methods do not. It is further demonstrated that the generalized pivotal quantity method is less conservative than the β-content (0.9) method when the analytical methods are biased, whereas it is more conservative when the analytical methods are unbiased. Therefore, selection of either the generalized pivotal quantity or β-content (0.9) method for an analytical method validation depends on the accuracy of the analytical method. It is also shown that the generalized pivotal quantity method has better asymptotic properties than all of the current methods. Analytical methods are often used to ensure safety, efficacy, and quality of medicinal products. According to government regulations and regulatory guidelines, these methods need to be validated through well-designed studies to minimize the risk of accepting unsuitable methods. This article describes a novel statistical test for analytical method validation, which provides better protection for the risk of accepting unsuitable analytical methods. © PDA, Inc. 2015.

Validation of prescribing appropriateness criteria for older Australians using the RAND/UCLA appropriateness method

PubMed Central

Basger, Benjamin Joseph; Chen, Timothy Frank; Moles, Rebekah Jane

2012-01-01

Objective To further develop and validate previously published national prescribing appropriateness criteria to assist in identifying drug-related problems (DRPs) for commonly occurring medications and medical conditions in older (≥65 years old) Australians. Design RAND/UCLA appropriateness method. Participants A panel of medication management experts were identified consisting of geriatricians/pharmacologists, clinical pharmacists and disease management advisors to organisations that produce Australian evidence-based therapeutic publications. This resulted in a round-one panel of 15 members, and a round-two panel of 12 members. Main outcome measure Agreement on all criteria. Results Forty-eight prescribing criteria were rated. In the first rating round via email, there was disagreement regarding 17 of the criteria according to median panel ratings. During a face-to-face second round meeting, discussion resulted in retention of 25 criteria after amendments, agreement for 14 criteria with no changes required and deletion of 9 criteria. Two new criteria were added, resulting in a final validated list of 41 prescribing appropriateness criteria. Agreement after round two was reached for all 41 criteria, measured by median panel ratings and the amount of dispersion of panel ratings, based on the interpercentile range. Conclusions A set of 41 Australian prescribing appropriateness criteria were validated by an expert panel. Use of these criteria, together with clinical judgement and other medication review processes such as patient interview, is intended to assist in improving patient care by efficiently detecting potential DRPs related to commonly occurring medicines and medical conditions in older Australians. These criteria may also contribute to the medication management education of healthcare professionals. PMID:22983875

Concordance between DSM-5 and DSM-IV nicotine, alcohol, and cannabis use disorder diagnoses among pediatric patients.

PubMed

Kelly, Sharon M; Gryczynski, Jan; Mitchell, Shannon Gwin; Kirk, Arethusa; O'Grady, Kevin E; Schwartz, Robert P

2014-07-01

The recently published Diagnostic and Statistical Manual of Mental Disorders-5 (DSM-5) includes several major revisions to substance use diagnoses. Studies have evaluated the impact of these changes among adult samples but research with adolescent samples is lacking. 525 adolescents (93% African American) awaiting primary care appointments in Baltimore, Maryland were recruited for a study evaluating a substance use screening instrument. Participants were assessed for DSM-5 nicotine, alcohol, and cannabis use disorder, DSM-IV alcohol and cannabis abuse, and DSM-IV dependence for all three substances during the past year using the modified Composite International Diagnostic Interview-2, Substance Abuse Module. Contingency tables examining DSM-5 vs. DSM-IV joint frequency distributions were examined for each substance. Diagnoses were more prevalent using DSM-5 criteria compared with DSM-IV for nicotine (4.0% vs. 2.7%), alcohol (4.6% vs. 3.8%), and cannabis (10.7% vs. 8.2%). Cohen's κ, Somers' d, and Cramer's V ranged from 0.70 to 0.99 for all three substances. Of the adolescents categorized as "diagnostic orphans" under DSM-IV, 7/16 (43.8%), 9/29 (31.0%), and 13/36 (36.1%) met criteria for DSM-5 disorder for nicotine, alcohol, and cannabis, respectively. Additionally, 5/17 (29.4%) and 1/21 (4.8%) adolescents who met criteria for DSM-IV abuse did not meet criteria for a DSM-5 diagnosis for alcohol and cannabis, respectively. Categorizing adolescents using DSM-5 criteria may result in diagnostic net widening-particularly for cannabis use disorders-by capturing adolescents who were considered diagnostic orphans using DSM-IV criteria. Future research examining the validity of DSM-5 substance use disorders with larger and more diverse adolescent samples is needed. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Concordance between DSM-5 and DSM-IV nicotine, alcohol, and cannabis use disorder diagnoses among pediatric patients

PubMed Central

Kelly, Sharon M.; Gryczynski, Jan; Mitchell, Shannon Gwin; Kirk, Arethusa; O’Grady, Kevin E.; Schwartz, Robert P.

2014-01-01

Background The recently published Diagnostic and Statistical Manual of Mental Disorders-5 (DSM-5) includes several major revisions to substance use diagnoses. Studies have evaluated the impact of these changes among adult samples but research with adolescent samples is lacking. Methods 525 adolescents (93% African American) awaiting primary care appointments in Baltimore, Maryland were recruited for a study evaluating a substance use screening instrument. Participants were assessed for DSM-5 nicotine, alcohol, and cannabis use disorder, DSM-IV alcohol and cannabis abuse, and DSM-IV dependence for all three substances during the past year using the modified Composite International Diagnostic Interview-2, Substance Abuse Module. Contingency tables examining DSM-5 vs. DSM-IV joint frequency distributions were examined for each substance. Results Diagnoses were more prevalent using DSM-5 criteria compared with DSM-IV for nicotine (4.0% vs. 2.7%), alcohol (4.6% vs. 3.8%), and cannabis (10.7% vs. 8.2%). Cohen's κ, Somers' d, and Cramer's V ranged from 0.70-0.99 for all three substances. Of the adolescents categorized as “diagnostic orphans” under DSM-IV, 7/16 (43.8%), 9/29 (31.0%), and 13/36 (36.1%) met criteria for DSM-5 disorder for nicotine, alcohol, and cannabis, respectively. Additionally, 5/17 (29.4%) and 1/21 (4.8%) adolescents who met criteria for DSM-IV abuse did not meet criteria for a DSM-5 diagnosis for alcohol and cannabis, respectively. Conclusions Categorizing adolescents using DSM-5 criteria may result in diagnostic net widening-particularly for cannabis use disorders-by capturing adolescents who were considered diagnostic orphans using DSM-IV criteria. Future research examining the validity of DSM-5 substance use disorders with larger and more diverse adolescent samples is needed. PMID:24793367

Performance of a Cartridge-Based Assay for Detection of Clinically Significant Human Papillomavirus (HPV) Infection: Lessons from VALGENT (Validation of HPV Genotyping Tests)

PubMed Central

Geraets, Daan; Cuzick, Jack; Cadman, Louise; Moore, Catherine; Vanden Broeck, Davy; Padalko, Elisaveta; Quint, Wim; Arbyn, Marc

2016-01-01

The Validation of Human Papillomavirus (HPV) Genotyping Tests (VALGENT) studies offer an opportunity to clinically validate HPV assays for use in primary screening for cervical cancer and also provide a framework for the comparison of analytical and type-specific performance. Through VALGENT, we assessed the performance of the cartridge-based Xpert HPV assay (Xpert HPV), which detects 14 high-risk (HR) types and resolves HPV16 and HPV18/45. Samples from women attending the United Kingdom cervical screening program enriched with cytologically abnormal samples were collated. All had been previously tested by a clinically validated standard comparator test (SCT), the GP5+/6+ enzyme immunoassay (EIA). The clinical sensitivity and specificity of the Xpert HPV for the detection of cervical intraepithelial neoplasia grade 2 or higher (CIN2+) and CIN3+ relative to those of the SCT were assessed as were the inter- and intralaboratory reproducibilities according to international criteria for test validation. Type concordance for HPV16 and HPV18/45 between the Xpert HPV and the SCT was also analyzed. The Xpert HPV detected 94% of CIN2+ and 98% of CIN3+ lesions among all screened women and 90% of CIN2+ and 96% of CIN3+ lesions in women 30 years and older. The specificity for CIN1 or less (≤CIN1) was 83% (95% confidence interval [CI], 80 to 85%) in all women and 88% (95% CI, 86 to 91%) in women 30 years and older. Inter- and intralaboratory agreements for the Xpert HPV were 98% and 97%, respectively. The kappa agreements for HPV16 and HPV18/45 between the clinically validated reference test (GP5+/6+ LMNX) and the Xpert HPV were 0.92 and 0.91, respectively. The clinical performance and reproducibility of the Xpert HPV are comparable to those of well-established HPV assays and fulfill the criteria for use in primary cervical cancer screening. PMID:27385707

Criteria of validity for animal models of psychiatric disorders: focus on anxiety disorders and depression

PubMed Central

2011-01-01

Animal models of psychiatric disorders are usually discussed with regard to three criteria first elaborated by Willner; face, predictive and construct validity. Here, we draw the history of these concepts and then try to redraw and refine these criteria, using the framework of the diathesis model of depression that has been proposed by several authors. We thus propose a set of five major criteria (with sub-categories for some of them); homological validity (including species validity and strain validity), pathogenic validity (including ontopathogenic validity and triggering validity), mechanistic validity, face validity (including ethological and biomarker validity) and predictive validity (including induction and remission validity). Homological validity requires that an adequate species and strain be chosen: considering species validity, primates will be considered to have a higher score than drosophila, and considering strains, a high stress reactivity in a strain scores higher than a low stress reactivity in another strain. Pathological validity corresponds to the fact that, in order to shape pathological characteristics, the organism has been manipulated both during the developmental period (for example, maternal separation: ontopathogenic validity) and during adulthood (for example, stress: triggering validity). Mechanistic validity corresponds to the fact that the cognitive (for example, cognitive bias) or biological mechanisms (such as dysfunction of the hormonal stress axis regulation) underlying the disorder are identical in both humans and animals. Face validity corresponds to the observable behavioral (ethological validity) or biological (biomarker validity) outcomes: for example anhedonic behavior (ethological validity) or elevated corticosterone (biomarker validity). Finally, predictive validity corresponds to the identity of the relationship between the triggering factor and the outcome (induction validity) and between the effects of the treatments on the two organisms (remission validity). The relevance of this framework is then discussed regarding various animal models of depression. PMID:22738250

Predictive and concurrent validity of the Braden scale in long-term care: a meta-analysis.

PubMed

Wilchesky, Machelle; Lungu, Ovidiu

2015-01-01

Pressure ulcer prevention is an important long-term care (LTC) quality indicator. While the Braden Scale is a recommended risk assessment tool, there is a paucity of information specifically pertaining to its validity within the LTC setting. We, therefore, undertook a systematic review and meta-analysis comparing Braden Scale predictive and concurrent validity within this context. We searched the Medline, EMBASE, PsychINFO and PubMed databases from 1985-2014 for studies containing the requisite information to analyze tool validity. Our initial search yielded 3,773 articles. Eleven datasets emanating from nine published studies describing 40,361 residents met all meta-analysis inclusion criteria and were analyzed using random effects models. Pooled sensitivity, specificity, positive predictive value (PPV), and negative predictive values were 86%, 38%, 28%, and 93%, respectively. Specificity was poorer in concurrent samples as compared with predictive samples (38% vs. 72%), while PPV was low in both sample types (25 and 37%). Though random effects model results showed that the Scale had good overall predictive ability [RR, 4.33; 95% CI, 3.28-5.72], none of the concurrent samples were found to have "optimal" sensitivity and specificity. In conclusion, the appropriateness of the Braden Scale in LTC is questionable given its low specificity and PPV, in particular in concurrent validity studies. Future studies should further explore the extent to which the apparent low validity of the Scale in LTC is due to the choice of cutoff point and/or preventive strategies implemented by LTC staff as a matter of course. © 2015 by the Wound Healing Society.

Internet cognitive testing of large samples needed in genetic research.

PubMed

Haworth, Claire M A; Harlaar, Nicole; Kovas, Yulia; Davis, Oliver S P; Oliver, Bonamy R; Hayiou-Thomas, Marianna E; Frances, Jane; Busfield, Patricia; McMillan, Andrew; Dale, Philip S; Plomin, Robert

2007-08-01

Quantitative and molecular genetic research requires large samples to provide adequate statistical power, but it is expensive to test large samples in person, especially when the participants are widely distributed geographically. Increasing access to inexpensive and fast Internet connections makes it possible to test large samples efficiently and economically online. Reliability and validity of Internet testing for cognitive ability have not been previously reported; these issues are especially pertinent for testing children. We developed Internet versions of reading, language, mathematics and general cognitive ability tests and investigated their reliability and validity for 10- and 12-year-old children. We tested online more than 2500 pairs of 10-year-old twins and compared their scores to similar internet-based measures administered online to a subsample of the children when they were 12 years old (> 759 pairs). Within 3 months of the online testing at 12 years, we administered standard paper and pencil versions of the reading and mathematics tests in person to 30 children (15 pairs of twins). Scores on Internet-based measures at 10 and 12 years correlated .63 on average across the two years, suggesting substantial stability and high reliability. Correlations of about .80 between Internet measures and in-person testing suggest excellent validity. In addition, the comparison of the internet-based measures to ratings from teachers based on criteria from the UK National Curriculum suggests good concurrent validity for these tests. We conclude that Internet testing can be reliable and valid for collecting cognitive test data on large samples even for children as young as 10 years.

Pathological video-game use among youth ages 8 to 18: a national study.

PubMed

Gentile, Douglas

2009-05-01

Researchers have studied whether some youth are "addicted" to video games, but previous studies have been based on regional convenience samples. Using a national sample, this study gathered information about video-gaming habits and parental involvement in gaming, to determine the percentage of youth who meet clinical-style criteria for pathological gaming. A Harris poll surveyed a randomly selected sample of 1,178 American youth ages 8 to 18. About 8% of video-game players in this sample exhibited pathological patterns of play. Several indicators documented convergent and divergent validity of the results: Pathological gamers spent twice as much time playing as nonpathological gamers and received poorer grades in school; pathological gaming also showed comorbidity with attention problems. Pathological status significantly predicted poorer school performance even after controlling for sex, age, and weekly amount of video-game play. These results confirm that pathological gaming can be measured reliably, that the construct demonstrates validity, and that it is not simply isomorphic with a high amount of play.

Evaluation of the reported association of obsessive-compulsive symptoms or disorder with Tourette's disorder.

PubMed

Shapiro, A K; Shapiro, E

1992-01-01

This review evaluates the evidence reporting an association of obsessive-compulsive symptoms (OCS) and obsessive-compulsive disorder (OCD) with Tourette's syndrome or disorder (TS). Published reports in the literature describing a relationship between OCS-OCD and TS provided the data for the review. The methodological adequacy of the studies are discussed and rated on five criteria: adequacy of the experimental sample, presence and adequacy of the control sample, whether tics are defined as OCS-OCD, whether blind procedures are used to diagnose OCS-OCD in subjects and controls, and evidence for the reliability and validity of OCS-OCD measures. Although there are considerable clinical indications suggesting an association of OCS-OCD with TS and chronic motor tic disorder (CMT), and a possible overlap between OSC-OCD and TS, our evaluation of the evidence does not provide adequate support for an association between these disorders. To meaningfully evaluate the possible relationship between OCS-OCD and TS requires development of specific criteria for classification of OCS-OCD-TS symptoms, use of adequate experimental and control samples, blind evaluation, reliable and valid measures of OCS-OCD-TS, and appropriate statistical analysis. If such studies are performed, it is possible that the strong relationship reported between OCS-OCD and TS is more likely to be artifact than fact, and recent bandwagon effect rather than the latest breakthrough.

Instruments for Assessing Risk of Bias and Other Methodological Criteria of Published Animal Studies: A Systematic Review

PubMed Central

Krauth, David; Woodruff, Tracey J.

2013-01-01

Background: Results from animal toxicology studies are critical to evaluating the potential harm from exposure to environmental chemicals or the safety of drugs prior to human testing. However, there is significant debate about how to evaluate the methodology and potential biases of the animal studies. There is no agreed-upon approach, and a systematic evaluation of current best practices is lacking. Objective: We performed a systematic review to identify and evaluate instruments for assessing the risk of bias and/or other methodological criteria of animal studies. Method: We searched Medline (January 1966–November 2011) to identify all relevant articles. We extracted data on risk of bias criteria (e.g., randomization, blinding, allocation concealment) and other study design features included in each assessment instrument. Discussion: Thirty distinct instruments were identified, with the total number of assessed risk of bias, methodological, and/or reporting criteria ranging from 2 to 25. The most common criteria assessed were randomization (25/30, 83%), investigator blinding (23/30, 77%), and sample size calculation (18/30, 60%). In general, authors failed to empirically justify why these or other criteria were included. Nearly all (28/30, 93%) of the instruments have not been rigorously tested for validity or reliability. Conclusion: Our review highlights a number of risk of bias assessment criteria that have been empirically tested for animal research, including randomization, concealment of allocation, blinding, and accounting for all animals. In addition, there is a need for empirically testing additional methodological criteria and assessing the validity and reliability of a standard risk of bias assessment instrument. Citation: Krauth D, Woodruff TJ, Bero L. 2013. Instruments for assessing risk of bias and other methodological criteria of published animal studies: a systematic review. Environ Health Perspect 121:985–992 (2013); http://dx.doi.org/10.1289/ehp.1206389 PMID:23771496

Validation of high throughput sequencing and microbial forensics applications

PubMed Central

2014-01-01

High throughput sequencing (HTS) generates large amounts of high quality sequence data for microbial genomics. The value of HTS for microbial forensics is the speed at which evidence can be collected and the power to characterize microbial-related evidence to solve biocrimes and bioterrorist events. As HTS technologies continue to improve, they provide increasingly powerful sets of tools to support the entire field of microbial forensics. Accurate, credible results allow analysis and interpretation, significantly influencing the course and/or focus of an investigation, and can impact the response of the government to an attack having individual, political, economic or military consequences. Interpretation of the results of microbial forensic analyses relies on understanding the performance and limitations of HTS methods, including analytical processes, assays and data interpretation. The utility of HTS must be defined carefully within established operating conditions and tolerances. Validation is essential in the development and implementation of microbial forensics methods used for formulating investigative leads attribution. HTS strategies vary, requiring guiding principles for HTS system validation. Three initial aspects of HTS, irrespective of chemistry, instrumentation or software are: 1) sample preparation, 2) sequencing, and 3) data analysis. Criteria that should be considered for HTS validation for microbial forensics are presented here. Validation should be defined in terms of specific application and the criteria described here comprise a foundation for investigators to establish, validate and implement HTS as a tool in microbial forensics, enhancing public safety and national security. PMID:25101166

Validation of high throughput sequencing and microbial forensics applications.

PubMed

Budowle, Bruce; Connell, Nancy D; Bielecka-Oder, Anna; Colwell, Rita R; Corbett, Cindi R; Fletcher, Jacqueline; Forsman, Mats; Kadavy, Dana R; Markotic, Alemka; Morse, Stephen A; Murch, Randall S; Sajantila, Antti; Schmedes, Sarah E; Ternus, Krista L; Turner, Stephen D; Minot, Samuel

2014-01-01

High throughput sequencing (HTS) generates large amounts of high quality sequence data for microbial genomics. The value of HTS for microbial forensics is the speed at which evidence can be collected and the power to characterize microbial-related evidence to solve biocrimes and bioterrorist events. As HTS technologies continue to improve, they provide increasingly powerful sets of tools to support the entire field of microbial forensics. Accurate, credible results allow analysis and interpretation, significantly influencing the course and/or focus of an investigation, and can impact the response of the government to an attack having individual, political, economic or military consequences. Interpretation of the results of microbial forensic analyses relies on understanding the performance and limitations of HTS methods, including analytical processes, assays and data interpretation. The utility of HTS must be defined carefully within established operating conditions and tolerances. Validation is essential in the development and implementation of microbial forensics methods used for formulating investigative leads attribution. HTS strategies vary, requiring guiding principles for HTS system validation. Three initial aspects of HTS, irrespective of chemistry, instrumentation or software are: 1) sample preparation, 2) sequencing, and 3) data analysis. Criteria that should be considered for HTS validation for microbial forensics are presented here. Validation should be defined in terms of specific application and the criteria described here comprise a foundation for investigators to establish, validate and implement HTS as a tool in microbial forensics, enhancing public safety and national security.

[The Family Questionnaire (FB-K) - A Short Version of the General Family Questionnaire and its Reliability and Validity].

PubMed

Sidor, Anna; Cierpka, Manfred

2016-01-01

A standardized assessment of a family system plays a crucial role in family therapy research and diagnostic, as well as in a family therapy itself. A 14-item short version of the General Family Questionnaire (FB-K) was designed to get a tool for assessing family functionality that is low time-consuming. The short version was developed by factor analysis from the long version FA-A. The quality criteria of the family questionnaire were verified in a control sample of 208 high-risk families four months after the birth of their child. The new family questionnaire demonstrates a very good reliability and a satisfactory 8-months-stability. The concurrent validity with the FACES scale "cohesion" is assured. Regarding the construct validity a positive correlation to the feeling of coherence was found. The family questionnaire shows a negative correlation to the maternal postnatal depressive symptoms, the degree of maternal stress burden, the dysfunctionality of the mother-child-relationship and impaired bonding. The values taken from a norm sample with infants are higher by trend and in the sample with children under 18 do not deviate from the values of the risk sample. FB-K covers two aspects of family functioning, the bond between family members and their willingness to communicate. The internal consistency of FB-K is excellent, the criterion and the construct validity are good.

Clinical diagnosis of ventilator associated pneumonia revisited: comparative validation using immediate post-mortem lung biopsies.

PubMed

Fàbregas, N; Ewig, S; Torres, A; El-Ebiary, M; Ramirez, J; de La Bellacasa, J P; Bauer, T; Cabello, H

1999-10-01

A study was undertaken to assess the diagnostic value of different clinical criteria and the impact of microbiological testing on the accuracy of clinical diagnosis of suspected ventilator associated pneumonia (VAP). Twenty five deceased mechanically ventilated patients were studied prospectively. Immediately after death, multiple bilateral lung biopsy specimens (16 specimens/patient) were obtained for histological examination and quantitative lung cultures. The presence of both histological pneumonia and positive lung cultures was used as a reference test. The presence of infiltrates on the chest radiograph and two of three clinical criteria (leucocytosis, purulent secretions, fever) had a sensitivity of 69% and a specificity of 75%; the corresponding numbers for the clinical pulmonary infection score (CPIS) were 77% and 42%. Non-invasive as well as invasive sampling techniques had comparable values. The combination of all techniques achieved a sensitivity of 85% and a specificity of 50%, and these values remained virtually unchanged despite the presence of previous treatment with antibiotics. When microbiological results were added to clinical criteria, adequate diagnoses originating from microbiological results which might have corrected false positive and false negative clinical judgements (n = 5) were countered by a similar proportion of inadequate diagnoses (n = 6). Clinical criteria had reasonable diagnostic values. CPIS was not superior to conventional clinical criteria. Non-invasive and invasive sampling techniques had diagnostic values comparable to clinical criteria. An algorithm guiding antibiotic treatment exclusively by microbiological results does not increase the overall diagnostic accuracy and carries the risk of undertreatment.

Development and Validation of Culture-Specific Variable Response Inconsistency and True Response Inconsistency Scales for Use with the Korean MMPI-2

ERIC Educational Resources Information Center

Ketterer, Holly L.; Han, Kyunghee; Hur, Jaehong; Moon, Kyungjoo

2010-01-01

In response to the concern that Minnesota Multiphasic Personality Inventory-2 (MMPI-2; J. N. Butcher, W. Dahlstrom, J. R. Graham, A. Tellegen, & B. Kaemmer, 1989; J. N. Butcher et al., 2001) Variable Response Inconsistency (VRIN) and True Response Inconsistency (TRIN) score invalidity criteria recommended for use with American samples results…

Assessment of Clinical Criteria for Sepsis

PubMed Central

Seymour, Christopher W.; Liu, Vincent X.; Iwashyna, Theodore J.; Brunkhorst, Frank M.; Rea, Thomas D.; Scherag, André; Rubenfeld, Gordon; Kahn, Jeremy M.; Shankar-Hari, Manu; Singer, Mervyn; Deutschman, Clifford S.; Escobar, Gabriel J.; Angus, Derek C.

2016-01-01

IMPORTANCE The Third International Consensus Definitions Task Force defined sepsis as “life-threatening organ dysfunction due to a dysregulated host response to infection.” The performance of clinical criteria for this sepsis definition is unknown. OBJECTIVE To evaluate the validity of clinical criteria to identify patients with suspected infection who are at risk of sepsis. DESIGN, SETTINGS, AND POPULATION Among 1.3 million electronic health record encounters from January 1, 2010, to December 31, 2012, at 12 hospitals in southwestern Pennsylvania, we identified those with suspected infection in whom to compare criteria. Confirmatory analyses were performed in 4 data sets of 706 399 out-of-hospital and hospital encounters at 165 US and non-US hospitals ranging from January 1, 2008, until December 31, 2013. EXPOSURES Sequential [Sepsis-related] Organ Failure Assessment (SOFA) score, systemic inflammatory response syndrome (SIRS) criteria, Logistic Organ Dysfunction System (LODS) score, and a new model derived using multivariable logistic regression in a split sample, the quick Sequential [Sepsis-related] Organ Failure Assessment (qSOFA) score (range, 0–3 points, with 1 point each for systolic hypotension [≤100 mm Hg], tachypnea [≥22/min], or altered mentation). MAIN OUTCOMES AND MEASURES For construct validity, pairwise agreement was assessed. For predictive validity, the discrimination for outcomes (primary: in-hospital mortality; secondary: in-hospital mortality or intensive care unit [ICU] length of stay ≥3 days) more common in sepsis than uncomplicated infection was determined. Results were expressed as the fold change in outcome over deciles of baseline risk of death and area under the receiver operating characteristic curve (AUROC). RESULTS In the primary cohort, 148 907 encounters had suspected infection (n = 74 453 derivation; n = 74 454 validation), of whom 6347 (4%) died. Among ICU encounters in the validation cohort (n = 7932 with suspected infection, of whom 1289 [16%] died), the predictive validity for in-hospital mortality was lower for SIRS (AUROC = 0.64; 95% CI, 0.62–0.66) and qSOFA (AUROC = 0.66; 95% CI, 0.64–0.68) vs SOFA (AUROC = 0.74; 95% CI, 0.73–0.76; P < .001 for both) or LODS (AUROC = 0.75; 95% CI, 0.73–0.76; P < .001 for both). Among non-ICU encounters in the validation cohort (n = 66 522 with suspected infection, of whom 1886 [3%] died), qSOFA had predictive validity (AUROC = 0.81; 95% CI, 0.80–0.82) that was greater than SOFA (AUROC = 0.79; 95% CI, 0.78–0.80; P < .001) and SIRS (AUROC = 0.76; 95% CI, 0.75–0.77; P < .001). Relative to qSOFA scores lower than 2, encounters with qSOFA scores of 2 or higher had a 3- to 14-fold increase in hospital mortality across baseline risk deciles. Findings were similar in external data sets and for the secondary outcome. CONCLUSIONS AND RELEVANCE Among ICU encounters with suspected infection, the predictive validity for in-hospital mortality of SOFA was not significantly different than the more complex LODS but was statistically greater than SIRS and qSOFA, supporting its use in clinical criteria for sepsis. Among encounters with suspected infection outside of the ICU, the predictive validity for in-hospital mortality of qSOFA was statistically greater than SOFA and SIRS, supporting its use as a prompt to consider possible sepsis. PMID:26903335

A systematic review of the Diagnostic and Statistical Manual diagnostic criteria for nicotine dependence.

PubMed

DiFranza, Joseph; Ursprung, W W Sanouri; Lauzon, Béatrice; Bancej, Christina; Wellman, Robert J; Ziedonis, Douglas; Kim, Sun S; Gervais, André; Meltzer, Bruce; McKay, Colleen E; O'Loughlin, Jennifer; Okoli, Chizimuzo T C; Fortuna, Lisa R; Tremblay, Michèle

2010-05-01

The Diagnostic and Statistical Manual diagnostic criteria for nicotine dependence (DSM-ND) are based on the proposition that dependence is a syndrome that can be diagnosed only when a minimum of 3 of the 7 proscribed features are present. The DSM-ND criteria are an accepted research measure, but the validity of these criteria has not been subjected to a systematic evaluation. To systematically review evidence of validity and reliability for the DSM-ND criteria, a literature search was conducted of 16 national and international databases. Each article with original data was independently reviewed by two or more reviewers. In total, 380 potentially relevant articles were examined and 169 were reviewed in depth. The DSM-ND criteria have seen wide use in research settings, but sensitivity and specificity are well below the accepted standards for clinical applications. Predictive validity is generally poor. The 7 DSM-ND criteria are regarded as having face validity, but no data support a 3-symptom ND diagnostic threshold, or a 4-symptom withdrawal syndrome threshold. The DSM incorrectly states that daily smoking is a prerequisite for withdrawal symptoms. The DSM shows poor to modest concurrence with all other measures of nicotine dependence, smoking behaviors and biological measures of tobacco use. The data support the DSM-ND criteria as a valid measure of nicotine dependence severity for research applications. However, the data do not support the central premise of a 3-symptom diagnostic threshold, and no data establish that the DSM-ND criteria provide an accurate diagnosis of nicotine dependence. Copyright (c) 2009 Elsevier Ltd. All rights reserved.

The Geochemical Databases GEOROC and GeoReM - What's New?

NASA Astrophysics Data System (ADS)

Sarbas, B.; Jochum, K. P.; Nohl, U.; Weis, U.

2017-12-01

The geochemical databases GEOROC (http: georoc.mpch-mainz.gwdg.de) and GeoReM (http: georem.mpch-mainz.gwdg.de) are maintained by the Max Planck Institute for Chemistry in Mainz, Germany. Both online databases became crucial tools for geoscientists from different research areas. They are regularly upgraded by new tools and new data from recent publications obtained from a wide range of international journals. GEOROC is a collection of published analyses of volcanic rocks and mantle xenoliths. Since recently, data for plutonic rocks are added. The analyses include major and trace element concentrations, radiogenic and non-radiogenic isotope ratios as well as analytical ages for whole rocks, glasses, minerals and inclusions. Samples come from eleven geological settings and span the whole geological age scale from Archean to Recent. Metadata include, among others, geographic location, rock class and rock type, geological age, degree of alteration, analytical method, laboratory, and reference. The GEOROC web page allows selection of samples by geological setting, geography, chemical criteria, rock or sample name, and bibliographic criteria. In addition, it provides a large number of precompiled files for individual locations, minerals and rock classes. GeoReM is a database collecting information about reference materials of geological and environmental interest, such as rock powders, synthetic and natural glasses as well as mineral, isotopic, biological, river water and seawater reference materials. It contains published data and compilation values (major and trace element concentrations and mass fractions, radiogenic and stable isotope ratios). Metadata comprise, among others, uncertainty, analytical method and laboratory. Reference materials are important for calibration, method validation, quality control and to establish metrological traceability. GeoReM offers six different search strategies: samples or materials (published values), samples (GeoReM preferred values), chemical criteria, chemical criteria based on bibliography, bibliography, as well as methods and institutions.

Determination of calcium, copper, iron, magnesium, manganese, potassium, phosphorus, sodium, and zinc in fortified food products by microwave digestion and inductively coupled plasma-optical emission spectrometry: single-laboratory validation and ring trial.

PubMed

Poitevin, Eric

2012-01-01

A single-laboratory validation (SLV) and a ring trial (RT) were undertaken to determine nine nutritional elements in food products by inductively coupled plasma-optical emission spectrometry in order to modernize AOAC Official Method 984.27. The improvements involved extension of the scope to all food matrixes (including infant formula), optimized microwave digestion, selected analytical lines, internal standardization, and ion buffering. Simultaneous determination of nine elements (calcium, copper, iron, potassium, magnesium, manganese, sodium, phosphorus, and zinc) was made in food products. Sample digestion was performed through wet digestion of food samples by microwave technology with either closed- or open-vessel systems. Validation was performed to characterize the method for selectivity, sensitivity, linearity, accuracy, precision, recovery, ruggedness, and uncertainty. The robustness and efficiency of this method was proven through a successful RT using experienced independent food industry laboratories. Performance characteristics are reported for 13 certified and in-house reference materials, populating the AOAC triangle food sectors, which fulfilled AOAC criteria and recommendations for accuracy (trueness, recovery, and z-scores) and precision (repeatability and reproducibility RSD, and HorRat values) regarding SLVs and RTs. This multielemental method is cost-efficient, time-saving, accurate, and fit-for-purpose according to ISO 17025 Norm and AOAC acceptability criteria, and is proposed as an extended updated version of AOAC Official Method 984.27 for fortified food products, including infant formula.

Improvement of AOAC Official Method 984.27 for the determination of nine nutritional elements in food products by Inductively coupled plasma-atomic emission spectroscopy after microwave digestion: single-laboratory validation and ring trial.

PubMed

Poitevin, Eric; Nicolas, Marine; Graveleau, Laetitia; Richoz, Janique; Andrey, Daniel; Monard, Florence

2009-01-01

A single-laboratory validation (SLV) and a ring trial (RT) were undertaken to determine nine nutritional elements in food products by inductively coupled plasma-atomic emission spectroscopy in order to improve and update AOAC Official Method 984.27. The improvements involved optimized microwave digestion, selected analytical lines, internal standardization, and ion buffering. Simultaneous determination of nine elements (calcium, copper, iron, potassium, magnesium, manganese, sodium, phosphorus, and zinc) was made in food products. Sample digestion was performed through wet digestion of food samples by microwave technology with either closed or open vessel systems. Validation was performed to characterize the method for selectivity, sensitivity, linearity, accuracy, precision, recovery, ruggedness, and uncertainty. The robustness and efficiency of this method was proved through a successful internal RT using experienced food industry laboratories. Performance characteristics are reported for 13 certified and in-house reference materials, populating the AOAC triangle food sectors, which fulfilled AOAC criteria and recommendations for accuracy (trueness, recovery, and z-scores) and precision (repeatability and reproducibility RSD and HorRat values) regarding SLV and RT. This multielemental method is cost-efficient, time-saving, accurate, and fit-for-purpose according to ISO 17025 Norm and AOAC acceptability criteria, and is proposed as an improved version of AOAC Official Method 984.27 for fortified food products, including infant formula.

The Structure of Diagnostic and Statistical Manual of Mental Disorders (4th Edition, Text Revision) Personality Disorder Symptoms in a Large National Sample

PubMed Central

Trull, Timothy J.; Vergés, Alvaro; Wood, Phillip K.; Jahng, Seungmin; Sher, Kenneth J.

2013-01-01

We examined the latent structure underlying the criteria for DSM–IV–TR (American Psychiatric Association, 2000, Diagnostic and statistical manual of mental disorders (4th ed., text revision). Washington, DC: Author.) personality disorders in a large nationally representative sample of U.S. adults. Personality disorder symptom data were collected using a structured diagnostic interview from approximately 35,000 adults assessed over two waves of data collection in the National Epidemiologic Survey on Alcohol and Related Conditions. Our analyses suggested that a seven-factor solution provided the best fit for the data, and these factors were marked primarily by one or at most two personality disorder criteria sets. A series of regression analyses that used external validators tapping Axis I psychopathology, treatment for mental health problems, functioning scores, interpersonal conflict, and suicidal ideation and behavior provided support for the seven-factor solution. We discuss these findings in the context of previous studies that have examined the structure underlying the personality disorder criteria as well as the current proposals for DSM-5 personality disorders. PMID:22506626

Measuring safety climate in health care.

PubMed

Flin, R; Burns, C; Mearns, K; Yule, S; Robertson, E M

2006-04-01

To review quantitative studies of safety climate in health care to examine the psychometric properties of the questionnaires designed to measure this construct. A systematic literature review was undertaken to study sample and questionnaire design characteristics (source, no of items, scale type), construct validity (content validity, factor structure and internal reliability, concurrent validity), within group agreement, and level of analysis. Twelve studies were examined. There was a lack of explicit theoretical underpinning for most questionnaires and some instruments did not report standard psychometric criteria. Where this information was available, several questionnaires appeared to have limitations. More consideration should be given to psychometric factors in the design of healthcare safety climate instruments, especially as these are beginning to be used in large scale surveys across healthcare organisations.

Infant polysomnography: reliability and validity of infant arousal assessment.

PubMed

Crowell, David H; Kulp, Thomas D; Kapuniai, Linda E; Hunt, Carl E; Brooks, Lee J; Weese-Mayer, Debra E; Silvestri, Jean; Ward, Sally Davidson; Corwin, Michael; Tinsley, Larry; Peucker, Mark

2002-10-01

Infant arousal scoring based on the Atlas Task Force definition of transient EEG arousal was evaluated to determine (1). whether transient arousals can be identified and assessed reliably in infants and (2). whether arousal and no-arousal epochs scored previously by trained raters can be validated reliably by independent sleep experts. Phase I for inter- and intrarater reliability scoring was based on two datasets of sleep epochs selected randomly from nocturnal polysomnograms of healthy full-term, preterm, idiopathic apparent life-threatening event cases, and siblings of Sudden Infant Death Syndrome infants of 35 to 64 weeks postconceptional age. After training, test set 1 reliability was assessed and discrepancies identified. After retraining, test set 2 was scored by the same raters to determine interrater reliability. Later, three raters from the trained group rescored test set 2 to assess inter- and intrarater reliabilities. Interrater and intrarater reliability kappa's, with 95% confidence intervals, ranged from substantial to almost perfect levels of agreement. Interrater reliabilities for spontaneous arousals were initially moderate and then substantial. During the validation phase, 315 previously scored epochs were presented to four sleep experts to rate as containing arousal or no-arousal events. Interrater expert agreements were diverse and considered as noninterpretable. Concordance in sleep experts' agreements, based on identification of the previously sampled arousal and no-arousal epochs, was used as a secondary evaluative technique. Results showed agreement by two or more experts on 86% of the Collaborative Home Infant Monitoring Evaluation Study arousal scored events. Conversely, only 1% of the Collaborative Home Infant Monitoring Evaluation Study-scored no-arousal epochs were rated as an arousal. In summary, this study presents an empirically tested model with procedures and criteria for attaining improved reliability in transient EEG arousal assessments in infants using the modified Atlas Task Force standards. With training based on specific criteria, substantial inter- and intrarater agreement in identifying infant arousals was demonstrated. Corroborative validation results were too disparate for meaningful interpretation. Alternate evaluation based on concordance agreements supports reliance on infant EEG criteria for assessment. Results mandate additional confirmatory validation studies with specific training on infant EEG arousal assessment criteria.

Introducing a short version of the physical self description questionnaire: new strategies, short-form evaluative criteria, and applications of factor analyses.

PubMed

Marsh, Herbert W; Martin, Andrew J; Jackson, Susan

2010-08-01

Based on the Physical Self Description Questionnaire (PSDQ) normative archive (n = 1,607 Australian adolescents), 40 of 70 items were selected to construct a new short form (PSDQ-S). The PSDQ-S was evaluated in a new cross-validation sample of 708 Australian adolescents and four additional samples: 349 Australian elite-athlete adolescents, 986 Spanish adolescents, 395 Israeli university students, 760 Australian older adults. Across these six groups, the 11 PSDQ-S factors had consistently high reliabilities and invariant factor structures. Study 1, using a missing-by-design variation of multigroup invariance tests, showed invariance across 40 PSDQ-S items and 70 PSDQ items. Study 2 demonstrated factorial invariance over a 1-year interval (test-retest correlations .57-.90; Mdn = .77), and good convergent and discriminant validity in relation to time. Study 3 showed good and nearly identical support for convergent and discriminant validity of PSDQ and PSDQ-S responses in relation to two other physical self-concept instruments.

Validation of the World Health Organization's Quality of Life Questionnaire with parents of children with autistic disorder.

PubMed

Dardas, Latefa A; Ahmad, Muayyad M

2014-09-01

The World Health Organization's Quality of Life Questionnaire-BREF (WHOQOL-BREF) has been used in many studies that target parents of children with Autistic Disorder. However, the measure has yet to be validated and adapted to this sample group whose daily experiences are considered substantially different from those of parents of children with typical development and parents of children with other disabilities. Therefore, this study was designed to examine the psychometric properties and the theoretical structure of the WHOQOL-BREF with a sample of 184 parents of children with Autistic Disorder. The factor structure for the WHOQOL-BREF was examined using exploratory and confirmatory factor analyses. Our analyses provided no evidence of a better model than the original 4-domain model. Nevertheless, some items in the measure were re-distributed to different domains based on theoretical meanings and/or clean loading criteria. The new model structure gained the measure's required validity with parents of children with Autistic Disorder.

Further development and validation of the Unhelpful Thoughts and Beliefs About Stuttering (UTBAS) scales: relationship to anxiety and social phobia among adults who stutter.

PubMed

Iverach, Lisa; Menzies, Ross; Jones, Mark; O'Brian, Sue; Packman, Ann; Onslow, Mark

2011-01-01

In an initial validation study, the Unhelpful Thoughts and Beliefs About Stuttering (UTBAS I) scale, demonstrated excellent psychometric properties as a self-report measure of the frequency of unhelpful cognitions associated with social anxiety for adults who stutter. The aim was to further validate the original UTBAS I scale, and to develop two additional scales to assess beliefs (UTBAS II) and anxiety (UTBAS III) associated with negative thoughts. A total of 140 adults seeking speech-restructuring treatment for stuttering completed the original UTBAS I scale, the newly developed UTBAS II and III scales, and self-report measures of psychological functioning. Participants also completed a first-stage screener for the presence of anxious personality disorder, and a diagnostic assessment to evaluate the presence of social phobia, according to criteria of the Diagnostic and Statistical Manual of Mental Disorders (DSM-IV) and the International Classification of Diseases (ICD-10). The mean UTBAS I score for the present sample did not differ significantly from the mean score reported in the original UTBAS I validation study. Convergent validity was confirmed by significant correlations between the UTBAS Total score and all anxiety-related measures. Discriminant validity was established by the absence of strong correlations between the UTBAS Total score and some of the self-report measures of unrelated constructs, although it was found to tap into the negative cognitions associated with depression and life problems. Approximately one-quarter of participants met criteria for a diagnosis of DSM-IV or ICD-10 social phobia (23.5% and 27.2% respectively), and nearly one-third met first-stage screening criteria for anxious personality disorder (30%). The mean UTBAS scores for participants who met criteria for these disorders were significantly higher than scores for participants who did not, confirming known-groups validity. The present study demonstrates the validity and utility of the UTBAS scales in assessing negative cognitions associated with speech-related anxiety among adults who stutter. Results also confirm previous evidence of a high rate of social phobia among adults who stutter, and reveal that the UTBAS discriminates between adults with and without social phobia. In terms of clinical applications, the UTBAS scales could be used to screen for indicators of social phobia among adults who stutter, and may prove useful in identifying negative cognitions which have the potential to impact treatment outcomes. © 2011 Royal College of Speech & Language Therapists.

Assessment of performance validity in the Stroop Color and Word Test in mild traumatic brain injury patients: a criterion-groups validation design.

PubMed

Guise, Brian J; Thompson, Matthew D; Greve, Kevin W; Bianchini, Kevin J; West, Laura

2014-03-01

The current study assessed performance validity on the Stroop Color and Word Test (Stroop) in mild traumatic brain injury (TBI) using criterion-groups validation. The sample consisted of 77 patients with a reported history of mild TBI. Data from 42 moderate-severe TBI and 75 non-head-injured patients with other clinical diagnoses were also examined. TBI patients were categorized on the basis of Slick, Sherman, and Iverson (1999) criteria for malingered neurocognitive dysfunction (MND). Classification accuracy is reported for three indicators (Word, Color, and Color-Word residual raw scores) from the Stroop across a range of injury severities. With false-positive rates set at approximately 5%, sensitivity was as high as 29%. The clinical implications of these findings are discussed. © 2012 The British Psychological Society.

Evidence on existing caries risk assessment systems: are they predictive of future caries?

PubMed

Tellez, M; Gomez, J; Pretty, I; Ellwood, R; Ismail, A I

2013-02-01

To critically appraise evidence for the prediction of caries using four caries risk assessment (CRA) systems/guidelines (Cariogram, Caries Management by Risk Assessment (CAMBRA), American Dental Association (ADA), and American Academy of Pediatric Dentistry (AAPD)). This review focused on prospective cohort studies or randomized controlled trials. A systematic search strategy was developed to locate papers published in Medline Ovid and Cochrane databases. The search identified 539 scientific reports, and after title and abstract review, 137 were selected for full review and 14 met the following inclusion criteria: (i) used as validating criterion caries incidence/increment, (ii) involved human subjects and natural carious lesions, and (iii) published in peer-reviewed journals. In addition, papers were excluded if they met one or more of the following criteria: (i) incomplete description of sample selection, outcomes, or small sample size and (ii) not meeting the criteria for best evidence under the prognosis category of the Oxford Centre for Evidence-Based Medicine. There are wide variations among the systems in terms of definitions of caries risk categories, type and number of risk factors/markers, and disease indicators. The Cariogram combined sensitivity and specificity for predicting caries in permanent dentition ranges from 110 to 139 and is the only system for which prospective studies have been conducted to assess its validity. The Cariogram had limited prediction utility in preschool children, and a moderate to good performance for sorting out elderly individuals into caries risk groups. One retrospective analysis on CAMBRA's CRA reported higher incidence of cavitated lesions among those assessed as extreme-risk patients when compared with those at low risk. The evidence on the validity for existing systems for CRA is limited. It is unknown if the identification of high-risk individuals can lead to more effective long-term patient management that prevents caries initiation and arrests or reverses the progression of lesions. There is an urgent need to develop valid and reliable methods for caries risk assessment that are based on best evidence for prediction and disease management rather than opinions of experts.

Tylosin content in meat and honey samples over a two-year period in Croatia.

PubMed

Kolanović, Božica S; Bilandžić, Nina; Varenina, Ivana; Božić, Durđica

2014-01-01

A total of 646 meat and 96 honey samples were examined over a 2-year period for the presence of tylosin residues. ELISA method used was validated according to the criteria of Commission Decision 2002/657/EC established for qualitative screening methods. The CCβ values were 32.1 µg kg⁻¹ in muscle and 24.4 µg kg⁻¹ in honey. The recoveries from spiked samples ranged from 66.4-118.6%, with a coefficient of variation between 12.6% and 18.6%. All the investigated samples showed no presence of tylosin. Calculated estimated daily intakes show exposure levels lower than the acceptable daily intakes set by World Health Organization.

Symptom and performance validity with veterans assessed for attention-deficit/hyperactivity disorder (ADHD).

PubMed

Shura, Robert D; Denning, John H; Miskey, Holly M; Rowland, Jared A

2017-12-01

Little is known about attention-deficit/hyperactivity disorder (ADHD) in veterans. Practice standards recommend the use of both symptom and performance validity measures in any assessment, and there are salient external incentives associated with ADHD evaluation (stimulant medication access and academic accommodations). The purpose of this study was to evaluate symptom and performance validity measures in a clinical sample of veterans presenting for specialty ADHD evaluation. Patients without a history of a neurocognitive disorder and for whom data were available on all measures (n = 114) completed a clinical interview structured on DSM-5 ADHD symptoms, the Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF), and the Test of Memory Malingering Trial 1 (TOMM1) as part of a standardized ADHD diagnostic evaluation. Veterans meeting criteria for ADHD were not more likely to overreport symptoms on the MMPI-2-RF nor to fail TOMM1 (score ≤ 41) compared with those who did not meet criteria. Those who overreported symptoms did not endorse significantly more ADHD symptoms; however, those who failed TOMM1 did report significantly more ADHD symptoms (g = 0.90). In the total sample, 19.3% failed TOMM1, 44.7% overreported on the MMPI-2-RF, and 8.8% produced both an overreported MMPI-2-RF and invalid TOMM1. F-r had the highest correlation to TOMM1 scores (r = -.30). These results underscore the importance of assessing both symptom and performance validity in a clinical ADHD evaluation with veterans. In contrast to certain other conditions (e.g., mild traumatic brain injury), ADHD as a diagnosis is not related to higher rates of invalid report/performance in veterans. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Resource Conservation and Recovery Act, Part B Permit Application [for the Waste Isolation Pilot Plant (WIPP)]. Volume 5, Chapter D, Appendix D1 (conclusion), Revision 3

DOE Office of Scientific and Technical Information (OSTI.GOV)

Cook, Neville G.W.; Heuze, Francois E.; Miller, Hamish D.S.

1993-03-01

The reference design for the underground facilities at the Waste Isolation Pilot Plant was developed using the best criteria available at initiation of the detailed design effort. These design criteria are contained in the US Department of Energy document titled Design Criteria, Waste Isolation Pilot Plant (WIPP). Revised Mission Concept-IIA (RMC-IIA), Rev. 4, dated February 1984. The validation process described in the Design Validation Final Report has resulted in validation of the reference design of the underground openings based on these criteria. Future changes may necessitate modification of the Design Criteria document and/or the reference design. Validation of the referencemore » design as presented in this report permits the consideration of future design or design criteria modifications necessitated by these changes or by experience gained at the WIPP. Any future modifications to the design criteria and/or the reference design will be governed by a DOE Standard Operation Procedure (SOP) covering underground design changes. This procedure will explain the process to be followed in describing, evaluating and approving the change.« less

Exploratory factor analysis of borderline personality disorder criteria in monolingual Hispanic outpatients with substance use disorders†

PubMed Central

Becker, Daniel F.; Añez, Luis Miguel; Paris, Manuel; Grilo, Carlos M.

2009-01-01

This study examined the factor structure of the DSM-IV criteria for borderline personality disorder (BPD) in Hispanic patients. Subjects were 130 monolingual Hispanic adults who had been admitted to a specialty outpatient clinic that provides psychiatric and substance abuse services to Spanish-speaking individuals. All were reliably assessed with the Spanish-Language Version of the Diagnostic Interview for DSM-IV Personality Disorders. After evaluating internal consistency of the BPD criterion set, an exploratory factor analysis was performed using principal axis factoring. Results suggested a unidimensional structure, and were consistent with similar studies of the DSM-IV criteria for BPD in non-Hispanic samples. These findings have implications for understanding borderline psychopathology in this population, and for the overall validity of the DSM-IV BPD construct. PMID:20472296

Assessment of the accuracy of a new tool for the screening of smartphone addiction.

PubMed

Khoury, Julia Machado; de Freitas, André Augusto Corrêa; Roque, Marco Antônio Valente; Albuquerque, Maicon Rodrigues; das Neves, Maila de Castro Lourenço; Garcia, Frederico Duarte

2017-01-01

To translate, adapt and validate the Smartphone Addiction Inventory (SPAI) in a Brazilian population of young adults. We employed the translation and back-translation method for the adaptation of the Brazilian version SPAI (SPAI-BR). The sample consisted of 415 university students. Data was collected through an electronic questionnaire, which consisted of the SPAI-BR and the Goodman Criteria (gold standard). The retests were carried out 10-15 days after the initial tests with 130 individuals. The SPAI-BR maintained semantic, idiomatic and conceptual equivalences from the original scale. The Confirmatory Factor Analysis confirmed the One-factor model of the SPAI with good fit indexes (x2 = 767.861, CFI = 0.913, TLI = 0.905, RMSE = 0.061, WRMR = 1.465). The Kuder-Richardson Coefficient showed good internal consistency. The analysis of the ROC curve established an area under the curve of 86.38%. The Intraclass-Correlation Coefficient of 0.926 between the test and the retest demonstrated an excellent temporal stability. The high correlation between SPAI-BR and the Goodman Criteria (rs = 0.750) established the convergent validity. The SPAI-BR is a valid and reliable tool for the detection of Smartphone Addiction in Brazilian university students.

The pancreatic surgery registry (StuDoQ|Pancreas) of the German Society for General and Visceral Surgery (DGAV) - presentation and systematic quality evaluation.

PubMed

Wellner, Ulrich F; Klinger, Carsten; Lehmann, Kai; Buhr, Heinz; Neugebauer, Edmund; Keck, Tobias

2017-04-05

Pancreatic resections are among the most complex procedures in visceral surgery. While mortality has decreased substantially over the past decades, morbidity remains high. The volume-outcome correlation in pancreatic surgery is among the strongest in the field of surgery. The German Society for General and Visceral Surgery (DGAV) established a national registry for quality control, risk assessment and outcomes research in pancreatic surgery in Germany (DGAV SuDoQ|Pancreas). Here, we present the aims and scope of the DGAV StuDoQ|Pancreas Registry. A systematic assessment of registry quality is performed based on the recommendations of the German network for outcomes research (DNVF). The registry quality was assessed by consensus criteria of the DNVF in regard to the domains Systematics and Appropriateness, Standardization, Validity of the sampling procedure, Validity of data collection, Validity of statistical analysis and reports, and General demands for registry quality. In summary, DGAV StuDoQ|Pancreas meets most of the criteria of a high-quality clinical registry. The DGAV StuDoQ|Pancreas provides a valuable platform for quality assessment, outcomes research as well as randomized registry trials in pancreatic surgery.

Predicting Performance in Higher Education Using Proximal Predictors.

PubMed

Niessen, A Susan M; Meijer, Rob R; Tendeiro, Jorge N

2016-01-01

We studied the validity of two methods for predicting academic performance and student-program fit that were proximal to important study criteria. Applicants to an undergraduate psychology program participated in a selection procedure containing a trial-studying test based on a work sample approach, and specific skills tests in English and math. Test scores were used to predict academic achievement and progress after the first year, achievement in specific course types, enrollment, and dropout after the first year. All tests showed positive significant correlations with the criteria. The trial-studying test was consistently the best predictor in the admission procedure. We found no significant differences between the predictive validity of the trial-studying test and prior educational performance, and substantial shared explained variance between the two predictors. Only applicants with lower trial-studying scores were significantly less likely to enroll in the program. In conclusion, the trial-studying test yielded predictive validities similar to that of prior educational performance and possibly enabled self-selection. In admissions aimed at student-program fit, or in admissions in which past educational performance is difficult to use, a trial-studying test is a good instrument to predict academic performance.

Examining the diagnostic criteria for Internet addiction: Expert validation.

PubMed

Hsu, Wen-Yu; Lin, Sunny S J; Chang, Shan-Mei; Tseng, Yin-Hsing; Chiu, Nan-Ying

2015-06-01

Internet addiction is the coming problem around the world. The diagnostic criteria for Internet addiction among adolescents (DC-IA-A) has become a widely used measure for assessing the presence of Internet addiction in Taiwan. This study examined the diagnosis criteria for Internet addiction in adolescents by expert evaluation. Twenty psychiatrists rated the adequacy of each criterion in DC-IA-A. The content validity and homogeneity reliability proposed by Aiken were calculated. The coefficients content validity and homogeneity reliability showed twenty psychiatrists agreed on each of DC-IA-A as relevant to the diagnosis of Internet addiction, though several criteria need improvements. Two criteria "excessive time spent on Internet activities and leaving the Internet" and "excessive effort spent on activities necessary to obtain access to the Internet" should be omitted, and the criteria of "tolerance" should be modified. The diagnostic criteria for Internet addiction among adolescents should be revised to meet the real condition of this population. Copyright © 2014. Published by Elsevier B.V.

Visual reproduction subtest of the Wechsler Memory Scale-Revised: analysis of construct validity.

PubMed

Williams, M A; Rich, M A; Reed, L K; Jackson, W T; LaMarche, J A; Boll, T J

1998-11-01

This study assessed the construct validity of Visual Reproduction (VR) Cards A (Flags) and B (Boxes) from the original Wechsler Memory Scale (WMS) compared to Flags and Boxes from the revised edition of the WMS (WMS-R). Independent raters scored Flags and Boxes using both the original and revised scoring criteria and correlations were obtained with age, education, IQ, and four separate criterion memory measures. Results show that for Flags, there is a tendency for the revised scoring criteria to produce improved construct validity. For Boxes, however, there was a trend in the opposite direction, with the revised scoring criteria demonstrating worse construct validity. Factor analysis suggests that Flags are a more distinct measure of visual memory, whereas Boxes are more complex and significantly associated with conceptual reasoning abilities. Using the revised scoring criteria, Boxes were found to be more strongly related to IQ than Flags. This difference was not found using the original scoring criteria.

Development and evaluation of short forms of the Pain Catastrophizing Scale and the Pain Self-efficacy Questionnaire.

PubMed

McWilliams, L A; Kowal, J; Wilson, K G

2015-10-01

To facilitate efficient screening and reduce the length of comprehensive self-report batteries, a four-item short form of the Pain Catastrophizing Scale (PCS) and a two-item short form of the Pain Self-Efficacy Questionnaire (PSEQ) have been developed and evaluated in samples of patients with arm and upper extremity pain. The first aim of this study was to evaluate these short forms in a heterogeneous sample of patients seeking treatment for chronic musculoskeletal pain, using a priori criteria for determining adequate internal consistency, construct validity and sensitivity to change. In addition, the findings of past studies were used to identify items suitable for new and potentially stronger short forms of these measures. Data were provided by 280 patients who completed the original PCS and PSEQ as part of an interdisciplinary rehabilitation programme. The previously developed four-item PCS and the newly developed six-item short form of the PCS both met the internal consistency and construct validity criteria. They did not meet the criterion regarding sensitivity to change. However, similar to what was obtained using the original PCS, large effect sizes were found when using these short forms to examine pre-treatment to post-treatment changes in catastrophizing. For the PSEQ, the new four-item short form was clearly superior to the other alternatives and met all three criteria. The strongest short forms of the PCS and PSEQ could facilitate the assessment of pain catastrophizing and self-efficacy in situations in which the use of the longer original measures is not feasible. © 2015 European Pain Federation - EFIC®

[Systematic umbilical cord blood analysis at birth: feasibility and reliability in a French labour ward].

PubMed

Ernst, D; Clerc, J; Decullier, E; Gavanier, G; Dupuis, O

2012-10-01

At birth, evaluation of neonatal well-being is crucial. It is though important to perform umbilical cord blood gas analysis, and then to analyze the samples. We wanted to establish the feasibility and reliability of systematic umbilical cord blood sampling in a French labour ward. Study of systematic umbilical cord blood gas analysis was realized retrospectively from 1000 consecutive deliveries. We first established the feasibility of the samples. Feasibility was defined by the ratio of complete cord acid-base data on the number of deliveries from alive newborns. Afterwards, we established the reliability on the remaining cord samples. Reliability was the ratio of samples that fulfilled quality criteria defined by Westgate et al. and revised by Kro et al., on the number of complete samples from alive newborns. At last, we looked for factors that would influence these results. The systematic umbilical cord blood sample feasibility reached 91.6%, and the reliability reached 80.7%. About the delivery mode, 38.6% of emergency caesarians (IC 95% [30.8-46.3]; P<0.0001) led to non-valid samples, when only 11.3% of programmed caesarians (IC 95% [4.3-18.2]; P<0.0001) led to non-valid samples. Umbilical cord blood analysis were significantly less validated during emergency caesarians. Realization of systematic cord blood gas analysis was followed by 8.4% of incomplete samples, and by 19.3% that were uninterpretable. Training sessions should be organized to improve the feasibility and reliability, especially during emergency caesarians. Copyright © 2012 Elsevier Masson SAS. All rights reserved.

Content validity of the DSM-IV borderline and narcissistic personality disorder criteria sets.

PubMed

Blais, M A; Hilsenroth, M J; Castlebury, F D

1997-01-01

This study sought to empirically evaluate the content validity of the newly revised DSM-IV narcissistic personality disorder (NPD) and borderline personality disorder (BPD) criteria sets. Using the essential features of each disorder as construct definitions, factor analysis was used to determine how adequately the criteria sets covered the constructs. In addition, this empirical investigation sought to: 1) help define the dimensions underlying these polythetic disorders; 2) identify core features of each diagnosis; and 3) highlight the characteristics that may be most useful in diagnosing these two disorders. Ninety-one outpatients meeting DSM-IV criteria for a personality disorder (PD) were identified through a retrospective analysis of chart information. Records of these 91 patients were independently rated on all of the BPD and NPD symptom criteria for the DSM-IV. Acceptable interrater reliability (kappa estimates) was obtained for both presence or absence of a PD and symptom criteria for BPD and NPD. The factor analysis, performed separately for each disorder, identified a three-factor solution for both the DSM-IV BPD and NPD criteria sets. The results of this study provide strong support for the content validity of the NPD criteria set and moderate support for the content validly of the BPD criteria set. Three domains were found to comprise the BPD criteria set, with the essential features of interpersonal and identity instability forming one domain, and impulsivity and affective instability each identified as separate domains. Factor analysis of the NPD criteria set found three factors basically corresponding to the essential features of grandiosity, lack of empathy, and need for admiration. Therefore, the NPD criteria set adequately covers the essential or defining features of the disorder.

The Bulimia Test--Revised: Validation with "DSM-IV" Criteria for Bulimia Nervosa.

ERIC Educational Resources Information Center

Thelen, Mark H.; And Others

1996-01-01

The Bulimia Test--Revised (BULIT-R) was given to 23 female subjects who met the criteria for bulimia in the "Diagnostic and Statistical Manual of Mental Disorders" (DSM-IV) and 124 female controls. The BULIT-R appears to be a valid instruction for identifying individuals who meet DSM-IV criteria for bulimia. (SLD)

JacketSE: An Offshore Wind Turbine Jacket Sizing Tool; Theory Manual and Sample Usage with Preliminary Validation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Damiani, Rick

This manual summarizes the theory and preliminary verifications of the JacketSE module, which is an offshore jacket sizing tool that is part of the Wind-Plant Integrated System Design & Engineering Model toolbox. JacketSE is based on a finite-element formulation and on user-prescribed inputs and design standards' criteria (constraints). The physics are highly simplified, with a primary focus on satisfying ultimate limit states and modal performance requirements. Preliminary validation work included comparing industry data and verification against ANSYS, a commercial finite-element analysis package. The results are encouraging, and future improvements to the code are recommended in this manual.

A rapid and sensitive LC-MS/MS method for the determination of Pulsatilla saponin D in rat plasma and its application in a rat pharmacokinetic and bioavailability study.

PubMed

Ouyang, Hui; Guo, Yicheng; He, Mingzhen; Zhang, Jinlian; Huang, Xiaofang; Zhou, Xin; Jiang, Hongliang; Feng, Yulin; Yang, Shilin

2015-03-01

A simple, sensitive and specific liquid chromatography-tandem mass spectrometry method was developed and validated for the determination of Pulsatilla saponin D, a potential antitumor constituent isolated from Pulsatilla chinensis in rat plasma. Rat plasma samples were pretreated by protein precipitation with methanol. The method validation was performed in accordance with US Food and Drug Administration guidelines and the results met the acceptance criteria. The method was successfully applied to assess the pharmacokinetics and oral bioavailability of Pulsatilla saponin D in rats. Copyright © 2014 John Wiley & Sons, Ltd.

Hybrid Optimal Design of the Eco-Hydrological Wireless Sensor Network in the Middle Reach of the Heihe River Basin, China

PubMed Central

Kang, Jian; Li, Xin; Jin, Rui; Ge, Yong; Wang, Jinfeng; Wang, Jianghao

2014-01-01

The eco-hydrological wireless sensor network (EHWSN) in the middle reaches of the Heihe River Basin in China is designed to capture the spatial and temporal variability and to estimate the ground truth for validating the remote sensing productions. However, there is no available prior information about a target variable. To meet both requirements, a hybrid model-based sampling method without any spatial autocorrelation assumptions is developed to optimize the distribution of EHWSN nodes based on geostatistics. This hybrid model incorporates two sub-criteria: one for the variogram modeling to represent the variability, another for improving the spatial prediction to evaluate remote sensing productions. The reasonability of the optimized EHWSN is validated from representativeness, the variogram modeling and the spatial accuracy through using 15 types of simulation fields generated with the unconditional geostatistical stochastic simulation. The sampling design shows good representativeness; variograms estimated by samples have less than 3% mean error relative to true variograms. Then, fields at multiple scales are predicted. As the scale increases, estimated fields have higher similarities to simulation fields at block sizes exceeding 240 m. The validations prove that this hybrid sampling method is effective for both objectives when we do not know the characteristics of an optimized variables. PMID:25317762

Hybrid optimal design of the eco-hydrological wireless sensor network in the middle reach of the Heihe River Basin, China.

PubMed

Kang, Jian; Li, Xin; Jin, Rui; Ge, Yong; Wang, Jinfeng; Wang, Jianghao

2014-10-14

The eco-hydrological wireless sensor network (EHWSN) in the middle reaches of the Heihe River Basin in China is designed to capture the spatial and temporal variability and to estimate the ground truth for validating the remote sensing productions. However, there is no available prior information about a target variable. To meet both requirements, a hybrid model-based sampling method without any spatial autocorrelation assumptions is developed to optimize the distribution of EHWSN nodes based on geostatistics. This hybrid model incorporates two sub-criteria: one for the variogram modeling to represent the variability, another for improving the spatial prediction to evaluate remote sensing productions. The reasonability of the optimized EHWSN is validated from representativeness, the variogram modeling and the spatial accuracy through using 15 types of simulation fields generated with the unconditional geostatistical stochastic simulation. The sampling design shows good representativeness; variograms estimated by samples have less than 3% mean error relative to true variograms. Then, fields at multiple scales are predicted. As the scale increases, estimated fields have higher similarities to simulation fields at block sizes exceeding 240 m. The validations prove that this hybrid sampling method is effective for both objectives when we do not know the characteristics of an optimized variables.

Empirical testing of criteria for dissociative schizophrenia.

PubMed

Laferrière-Simard, Marie-Christine; Lecomte, Tania; Ahoundova, Lola

2014-01-01

This study examined the validity of dissociative schizophrenia diagnostic criteria. In the first phase, 50 participants with a psychotic disorder were administered the Dissociative Experiences Scale and the Childhood Trauma Questionnaire to identify those with dissociative characteristics. In the second phase, we selected those who had a score of 15 or above on the Dissociative Experiences Scale. Fifteen of these participants were evaluated thoroughly with the Structured Clinical Interview for DSM-IV Axis I, Structured Clinical Interview for DSM-IV Axis II, and Structured Clinical Interview for DSM-IV Dissociative Disorders to determine whether they met the criteria for dissociative schizophrenia and to generate a clinical description. Our results indicated that 24% of the individuals we tested met these criteria. We propose making mandatory 1 of the 3 dissociative symptoms of the criteria to eliminate people with only nonspecific symptoms (e.g., extensive comorbidity). According to this modified criterion, 14% of our sample would receive a diagnosis of dissociative schizophrenia. However, a more comprehensive look at the clinical picture begs the question of whether dissociative schizophrenia is truly present in every person meeting the criteria. We discuss the relevance of creating a new schizophrenia subtype and offer recommendations for clinicians.

Selecting the optimum number of partial least squares components for the calibration of attenuated total reflectance-mid-infrared spectra of undesigned kerosene samples.

PubMed

Gómez-Carracedo, M P; Andrade, J M; Rutledge, D N; Faber, N M

2007-03-07

Selecting the correct dimensionality is critical for obtaining partial least squares (PLS) regression models with good predictive ability. Although calibration and validation sets are best established using experimental designs, industrial laboratories cannot afford such an approach. Typically, samples are collected in an (formally) undesigned way, spread over time and their measurements are included in routine measurement processes. This makes it hard to evaluate PLS model dimensionality. In this paper, classical criteria (leave-one-out cross-validation and adjusted Wold's criterion) are compared to recently proposed alternatives (smoothed PLS-PoLiSh and a randomization test) to seek out the optimum dimensionality of PLS models. Kerosene (jet fuel) samples were measured by attenuated total reflectance-mid-IR spectrometry and their spectra where used to predict eight important properties determined using reference methods that are time-consuming and prone to analytical errors. The alternative methods were shown to give reliable dimensionality predictions when compared to external validation. By contrast, the simpler methods seemed to be largely affected by the largest changes in the modeling capabilities of the first components.

Matrix Effect Evaluation and Method Validation of Azoxystrobin and Difenoconazole Residues in Red Flesh Dragon Fruit (Hylocereus polyrhizus) Matrices Using QuEChERS Sample Preparation Methods Followed by LC-MS/MS Determination.

PubMed

Noegrohati, Sri; Hernadi, Elan; Asviastuti, Syanti

2018-06-01

Production of red flesh dragon fruit (Hylocereus polyrhizus) was hampered by Colletotrichum sp. Pre-harvest application of azoxystrobin and difenoconazole mixture is recommended, therefore, a selective and sensitive multi residues analytical method is required in monitoring and evaluating the commodity's safety. LC-MS/MS is a well-established analytical technique for qualitative and quantitative determination in complex matrices. However, this method is hurdled by co-eluted coextractives interferences. This work evaluated the pH effect of acetate buffered and citrate buffered QuEChERS sample preparation in their effectiveness of matrix effect reduction. Citrate buffered QuEChERS proved to produce clean final extract with relative matrix effect 0.4%-0.7%. Method validation of the selected sample preparation followed by LC-MS/MS for whole dragon fruit, flesh and peel matrices fortified at 0.005, 0.01, 0.1 and 1 g/g showed recoveries 75%-119%, intermediate repeatability 2%-14%. The expanded uncertainties were 7%-48%. Based on the international acceptance criteria, this method is valid.

Development, validation and accreditation of a method for the determination of Pb, Cd, Cu and As in seafood and fish feed samples.

PubMed

Psoma, A K; Pasias, I N; Rousis, N I; Barkonikos, K A; Thomaidis, N S

2014-05-15

A rapid, sensitive, accurate and precise method for the determination of Pb, Cd, As and Cu in seafood and fish feed samples by Simultaneous Electrothermal Atomic Absorption Spectrometry was developed in regard to Council Directive 333/2007EC and ISO/IEC 17025 (2005). Different approaches were investigated in order to shorten the analysis time, always taking into account the sensitivity. For method validation, precision (repeatability and reproducibility) and accuracy by addition recovery tests have been assessed as performance criteria. The expanded uncertainties based on the Eurachem/Citac Guidelines were calculated. The method was accredited by the Hellenic Accreditation System and it was applied for an 8 years study in seafood (n=202) and fish feeds (n=275) from the Greek market. The annual and seasonal variation of the elemental content and correlation among the elemental content in fish feeds and the respective fish samples were also accomplished. Copyright © 2013 Elsevier Ltd. All rights reserved.

Reliability, validity, and utility of the Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF) in assessments of bariatric surgery candidates.

PubMed

Tarescavage, Anthony M; Wygant, Dustin B; Boutacoff, Lana I; Ben-Porath, Yossef S

2013-12-01

In the current study, we examined the reliability, validity, and clinical utility of Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF; Ben-Porath & Tellegen, 2011) scores in a sample of 759 bariatric surgery candidates. We provide descriptives for all scales, internal consistency and standard error of measurement estimates for all substantive scales, external correlates of substantive scales using chart review and self-report criteria, and relative risk ratios to assess the clinical utility of the instrument. Results generally support the reliability, validity, and clinical utility of MMPI-2-RF scale scores in the psychological evaluation of bariatric surgery candidates. Limitations, future directions, and practical application of these results are discussed. (c) 2013 APA, all rights reserved.

Creation and validation of the self-efficacy instrument for physical education teacher education majors toward inclusion.

PubMed

Block, Martin E; Hutzler, Yeshayahu; Barak, Sharon; Klavina, Aija

2013-04-01

The purpose was to validate a self-efficacy (SE) instrument toward including students with disability in physical education (PE). Three scales referring to intellectual disabilities (ID), physical disabilities (PD), or visual impairments (VI) were administered to 486 physical education teacher education (PETE) majors. The sample was randomly split, and exploratory and confirmatory factor analyses (EFA and CFA, respectively) were conducted. After deleting items that did not meet inclusion criteria, EFA item loadings ranged from 0.53 to 0.91, and Cronbach's alpha reliability was high (for ID = .86, PD = .90, and VI = .92). CFA showed that the ID scale demonstrated good goodness-of-fit, whereas in the PD and in the VI scales demonstrated moderate fit. Thus, the content and construct validity of the instrument was supported.

Data Validation Package December 2015 Groundwater Sampling at the Ambrosia Lake, New Mexico, Disposal Site March 2016

DOE Office of Scientific and Technical Information (OSTI.GOV)

Tsosie, Bernadette; Johnson, Dick

The Long-Term Surveillance Plan for the Ambrosia Lake, New Mexico, Disposal Site does not require groundwater monitoring because groundwater in the uppermost aquifer is of limited use, and supplemental standards have been applied to the aquifer. However, at the request of the New Mexico Environment Department, the U.S. Department of Energy conducts annual monitoring at three locations: monitoring wells 0409, 0675, and 0678. Sampling and analyses were conducted as specified in the Sampling and Analysis Plan for US. Department of Energy Office of Legacy Management Sites (LMS/PRO/S04351, continually updated). Monitoring Well 0409 was not sampled during this event because itmore » was dry. Water levels were measured at each sampled well. One duplicate sample was collected from location 0675. Groundwater samples from the two sampled wells were analyzed for the constituents listed in Table 1. Time-concentration graphs for selected analytes are included in this report. At well 0675, the duplicate results for total dissolved solids and for most metals (magnesium, molybdenum, potassium, selenium, sodium, and uranium) were outside acceptance criteria, which may indicate non-homogeneous conditions at this location. November 2014 results for molybdenum and uranium at well 0675 also were outside acceptance criteria. The well condition will be evaluated prior to the next sampling event.« less

Clinical diagnosis of ventilator associated pneumonia revisited: comparative validation using immediate post-mortem lung biopsies

PubMed Central

Fabregas, N.; Ewig, S.; Torres, A.; El-Ebiary, M.; Ramirez, J.; de la Bellacasa, J. P.; Bauer, T.; Cabello, H.

1999-01-01

BACKGROUND—A study was undertaken to assess the diagnostic value of different clinical criteria and the impact of microbiological testing on the accuracy of clinical diagnosis of suspected ventilator associated pneumonia (VAP).
METHODS—Twenty five deceased mechanically ventilated patients were studied prospectively. Immediately after death, multiple bilateral lung biopsy specimens (16 specimens/patient) were obtained for histological examination and quantitative lung cultures. The presence of both histological pneumonia and positive lung cultures was used as a reference test.
RESULTS—The presence of infiltrates on the chest radiograph and two of three clinical criteria (leucocytosis, purulent secretions, fever) had a sensitivity of 69% and a specificity of 75%; the corresponding numbers for the clinical pulmonary infection score (CPIS) were 77% and 42%. Non-invasive as well as invasive sampling techniques had comparable values. The combination of all techniques achieved a sensitivity of 85% and a specificity of 50%, and these values remained virtually unchanged despite the presence of previous treatment with antibiotics. When microbiological results were added to clinical criteria, adequate diagnoses originating from microbiological results which might have corrected false positive and false negative clinical judgements (n = 5) were countered by a similar proportion of inadequate diagnoses (n =6).
CONCLUSIONS—Clinical criteria had reasonable diagnostic values. CPIS was not superior to conventional clinical criteria. Non-invasive and invasive sampling techniques had diagnostic values comparable to clinical criteria. An algorithm guiding antibiotic treatment exclusively by microbiological results does not increase the overall diagnostic accuracy and carries the risk of undertreatment.

 PMID:10491448

Development of a quantitative validation method for forensic investigation of human spermatozoa using a commercial fluorescence staining kit (SPERM HY-LITER™ Express).

PubMed

Takamura, Ayari; Watanabe, Ken; Akutsu, Tomoko

2016-11-01

In investigations of sexual assaults, as well as in identifying a suspect, the detection of human sperm is important. Recently, a kit for fluorescent staining of human spermatozoa, SPERM HY-LITER™, has become available. This kit allows for microscopic observation of the heads of human sperm using an antibody tagged with a fluorescent dye. This kit is specific to human sperm and provides easy detection by luminescence. However, criteria need to be established to objectively evaluate the fluorescent signals and to evaluate the staining efficiency of this kit. These criteria will be indispensable for investigation of forensic samples. In the present study, the SPERM HY-LITER™ Express kit, which is an improved version of SPERM HY-LITER™, was evaluated using an image analysis procedure using Laplacian and Gaussian methods. This method could be used to automatically select important regions of fluorescence produced by sperm. The fluorescence staining performance was evaluated and compared under various experimental conditions, such as for aged traces and in combination with other chemical staining methods. The morphological characteristics of human sperm were incorporated into the criteria for objective identification of sperm, based on quantified features of the fluorescent spots. Using the criteria, non-specific or insignificant fluorescent spots were excluded, and the specificity of the kit for human sperm was confirmed. The image analysis method and criteria established in this study are universal and could be applied under any experimental conditions. These criteria will increase the reliability of operator judgment in the analysis of human sperm samples in forensics.

The Biographical Personality Interview (BPI)--a new approach to the assessment of premorbid personality in psychiatric research. Part II: Psychometric properties.

PubMed

von Zerssen, D; Barthelmes, H; Pössl, J; Black, C; Garzynski, E; Wessel, E; Hecht, H

1998-01-01

The Biographical Personality Interview (BPI) was applied to 179 subjects (158 psychiatric patients and 21 probands from the general population); 100 patients and 20 healthy controls served as a validation sample; the others had been interviewed during the training period or did not meet the inclusion criteria for the validation of the BPI. The acceptance of the interview was high, the inter-rater reliability of the ratings of premorbid personality structures ("types") varied between 0.81 and 0.88 per type. Concurrent validity of the typological constructs as assessed by means of the BPI was inferred from the intercorrelations of type scores and correlations of these scores with questionnaire data and proved to be adequate. Clinical validity of the assessment was indicated by statistically significant differences between diagnostic groups. Problems and further developments of the instrument and its application are discussed.

Validation of the REA bioassay to detect estrogenic activity in the water cycle.

PubMed

Nguyen, Mai Thao; van der Oost, Ron; Bovee, Toine F H

2011-12-01

Endocrine disrupting compounds (EDCs) with estrogenic potency contaminate water and might eventually cause adverse effects to the aquatic environment. Many estrogenic compounds are not completely removed by wastewater treatment systems and, together with the run-off from agricultural areas, they enter surface waters. Chemical analytical methods to determine these compounds are usually expensive and laborious. Therefore, screening bioassays which are able to detect compounds based on their effects offer a solution for prior selection of samples that need to be chemically analyzed. In this study, the REA (RIKILT yeast Estrogen bioAssay), which has been developed to detect estrogenic compounds in calf urine and animal feed at RIKILT, is validated at the Water Board Laboratory of Waterproef for water samples. According to EC Decision 2002/657, detection capability CCβ, specificity and stability have to be determined for the internal validation of a qualitative screening test. In addition, surface water and effluent samples were analyzed to further demonstrate the applicability of the validated test procedure. Results demonstrate that the REA assay is reproducible and specific for estrogenic compounds in water and meets the criteria as prescribed in EC Decision 2002/657. The assay was sensitive enough to detect estrogenic activity of pollutants in water with a limit of quantification (LOQ) below 1 ng EEQ/L. This means that samples can be compared with preliminary threshold levels for drinking water and surface waters (7 and 1 ng EEQ/L, respectively). The stability of estrogenic activity in water samples is at least 4 weeks, when stored at 4 °C. Copyright © 2011 Elsevier Ltd. All rights reserved.

Improved military air traffic controller selection methods as measured by subsequent training performance.

PubMed

Carretta, Thomas R; King, Raymond E

2008-01-01

Over the past decade, the U.S. military has conducted several studies to evaluate determinants of enlisted air traffic controller (ATC) performance. Research has focused on validation of the Armed Services Vocational Aptitude Battery (ASVAB) and has shown it to be a good predictor of training performance. Despite this, enlisted ATC training and post-training attrition is higher than desirable, prompting interest in alternate selection methods to augment current procedures. The current study examined the utility of the FAA Air Traffic Selection and Training (AT-SAT) battery for incrementing the predictiveness of the ASVAB versus several enlisted ATC training criteria. Subjects were 448 USAF enlisted ATC students who were administered the ASVAB and FAA AT-SAT subtests and subsequently graduated or were eliminated from apprentice-level training. Training criteria were a dichotomous graduation/elimination training score, average ATC fundamentals course score, and FAA certified tower operator test score. Results confirmed the predictive validity of the ASVAB and showed that one of the AT-SAT subtests resembling a low-fidelity ATC work sample significantly improved prediction of training performance beyond the ASVAB alone. Results suggested training attrition could be reduced by raising the current ASVAB minimum qualifying score. However, this approach may make it difficult to identify sufficient numbers of trainees and lead to adverse impact. Although the AT-SAT ATC work sample subtest showed incremental validity to the ASVAB, its length (95 min) may be problematic in operational testing. Recommendations are made for additional studies to address issues affecting operational implementation.

Design, objectives, execution and reporting of published open-label extension studies.

PubMed

Megan, Bowers; Pickering, Ruth M; Weatherall, Mark

2012-04-01

Open-label extension (OLE) studies following blinded randomized controlled trials (RCTs) of pharmaceuticals are increasingly being carried out but do not conform to regulatory standards and questions surround the validity of their evidence. OLE studies are usually discussed as a homogenous group, yet substantial differences in study design still meet the definition of an OLE. We describe published papers reporting OLE studies focussing on stated objectives, design, conduct and reporting. A search of Embase and Medline databases for 1996 to July 2008 revealed 268 papers reporting OLE studies that met our eligibility criteria. A random sample of 50 was selected for detailed review. Over 80% of the studies had efficacy stated as an objective. The most common methods of allocation at the start of the OLE were for all RCT participants to switch to one active treatment or for only participants on the new drug to continue, but in three studies all participants were re-randomized at the start of the OLE. Eligibility criteria and other selection factors resulted in on average of 74% of participants in the preceding RCT(s) enrolling in the OLE and only 57% completed it. Published OLE studies do not form a homogenous group with respect to design or retention of participants, and thus the validity of evidence from an OLE should be judged on an individual basis. The term 'open label' suggests bias through lack of blinding, but slippage in relation to the sample randomized in the preceding RCT may be the more important threat to validity. © 2010 Blackwell Publishing Ltd.

A concise, content valid, gender invariant measure of workplace incivility.

PubMed

Matthews, Russell A; Ritter, Kelsey-Jo

2016-07-01

The authors present a short, valid, gender invariant measure of workplace incivility that should have a high degree of utility in a variety of research designs, especially those concerned with reducing participant burden such as experience sampling and multiwave longitudinal designs. Given ongoing concerns about the psychometric properties of workplace mistreatment constructs, they validated a 4-item measure of experienced incivility based on series of 3 independent field studies (N = 2,636). In addition to retaining items on the basis of employee rated conceptual alignment (i.e., judgmental criteria) with a standard incivility definition (i.e., ambiguous intent to harm), items were also chosen based on external criteria in terms of their ability to explain incremental variance in outcomes of interest (e.g., role overload, interpersonal deviance). Items with large systematic relationships with other mistreatment constructs (i.e., abusive supervision, supervisor undermining) were excluded. In turn, the authors demonstrated that the 4-item measure is gender invariant, a critical issue that has received limited attention in the literature to date. They also experimentally investigated the effect of recall window (2 weeks, 1 month, 1 year) and found a differential pattern of effect sizes for various outcomes of interest. A fourth independent field study was conducted as a practical application of the measure within a longitudinal framework. An autoregressive model examining experienced incivility and counterproductive work behaviors was tested. Data was collected from a sample of 278 respondents at 3 time points with 1 month between assessments. Implications of these findings are discussed. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

English Placement Testing, Multiple Measures, and Disproportionate Impact: An Analysis of the Criterion- and Content-Related Validity Evidence for the Reading & Writing Placement Tests in the San Diego Community College District.

ERIC Educational Resources Information Center

Armstrong, William B.

As part of an effort to statistically validate the placement tests used in California's San Diego Community College District (SDCCD) a study was undertaken to review the criteria- and content-related validity of the Assessment and Placement Services (APS) reading and writing tests. Evidence of criteria and content validity was gathered from…

Reliability and validity of the DSM-IV diagnostic category of schizoaffective disorder: preliminary data.

PubMed

Maj, M; Pirozzi, R; Formicola, A M; Bartoli, L; Bucci, P

2000-01-01

Concerns have been expressed about the reliability and validity of the DSM-IV criteria for schizoaffective disorder, but no systematic study has been published up to now. The Cohen's kappa for the individual items of the DSM-IV definition of schizoaffective disorder, manic episode and major depressive episode was evaluated in 150 patients independently interviewed by two psychiatrists using the Composite International Diagnostic Interview. The two-year outcome of patients with a consensus DSM-IV diagnosis of schizoaffective disorder was compared to that of patients with DSM-IV schizophrenia and schizophreniform disorder, using the Strauss-Carpenter Outcome Scale. The Cohen's kappa was 0.22 for the diagnosis of schizoaffective disorder, 0.71 for that of manic episode, and 0.82 for that of major depressive episode. Schizoaffective patients had a significantly better outcome than those with schizophrenia but a worse outcome than those with schizophreniform disorder. The inter-rater reliability of the DSM-IV criteria for schizoaffective disorder is not satisfactory. The better outcome of DSM-IV schizoaffective disorder compared with schizophrenia seems to depend more on the inclusion, in the definition of schizophrenia but not in that of schizoaffective disorder, of the six-month duration and functional impairment criteria than on the different symptomatological patterns of the two conditions. The size of the sample of patients fulfilling DSM-IV criteria for schizoaffective disorder was small. The study suggests that the clinical implications of the currently problematic diagnosis of schizoaffective disorder may be modest.

Liquid chromatography tandem-mass spectrometry (LC-MS/MS) and dried blood spot sampling applied to pharmacokinetics studies in animals: Correlation of classic and block design.

PubMed

Baldo, Matías N; Angeli, Emmanuel; Gareis, Natalia C; Hunzicker, Gabriel A; Murguía, Marcelo C; Ortega, Hugo H; Hein, Gustavo J

2018-04-01

A relative bioavailability study (RBA) of two phenytoin (PHT) formulations was conducted in rabbits, in order to compare the results obtained from different matrices (plasma and blood from dried blood spot (DBS) sampling) and different experimental designs (classic and block). The method was developed by liquid chromatography tandem-mass spectrometry (LC-MS/MS) in plasma and blood samples. The different sample preparation techniques, plasma protein precipitation and DBS, were validated according to international requirements. The analytical method was validated with ranges 0.20-50.80 and 0.12-20.32 µg ml -1 , r > 0.999 for plasma and blood, respectively. Accuracy and precision were within acceptance criteria for bioanalytical assay validation (< 15 for bias and CV% and < 20 for limit of quantification (LOQ)). PHT showed long-term stability, both for plasma and blood, and under refrigerated and room temperature conditions. Haematocrit values were measured during the validation process and RBA study. Finally, the pharmacokinetic parameters (C max , T max and AUC 0-t ) obtained from the RBA study were tested. Results were highly comparable for matrices and experimental designs. A matrix correlation higher than 0.975 and a ratio of (PHT blood) = 1.158 (PHT plasma) were obtained. The results obtained herein show that the use of classic experimental design and DBS sampling for animal pharmacokinetic studies should be encouraged as they could help to prevent the use of a large number of animals and also animal euthanasia. Finally, the combination of DBS sampling with LC-MS/MS technology showed to be an excellent tool not only for therapeutic drug monitoring but also for RBA studies.

FT-midIR determination of fatty acid profiles, including trans fatty acids, in bakery products after focused microwave-assisted Soxhlet extraction.

PubMed

Ruiz-Jiménez, J; Priego-Capote, F; Luque de Castro, M D

2006-08-01

A study of the feasibility of Fourier transform medium infrared spectroscopy (FT-midIR) for analytical determination of fatty acid profiles, including trans fatty acids, is presented. The training and validation sets-75% (102 samples) and 25% (36 samples) of the samples once the spectral outliers have been removed-to develop FT-midIR general equations, were built with samples from 140 commercial and home-made bakery products. The concentration of the analytes in the samples used for this study is within the typical range found in these kinds of products. Both sets were independent; thus, the validation set was only used for testing the equations. The criterion used for the selection of the validation set was samples with the highest number of neighbours and the most separation between them (H<0.6). Partial least squares regression and cross validation were used for multivariate calibration. The FT-midIR method does not require post-extraction manipulation and gives information about the fatty acid profile in two min. The 14:0, 16:0, 18:0, 18:1 and 18:2 fatty acids can be determined with excellent precision and other fatty acids with good precision according to the Shenk criteria, R (2)>/=0.90, SEP=1-1.5 SEL and R (2)=0.70-0.89, SEP=2-3 SEL, respectively. The results obtained with the proposed method were compared with those provided by the conventional method based on GC-MS. At 95% significance level, the differences between the values obtained for the different fatty acids were within the experimental error.

Infrared properties of serendipitous X-ray quasars

NASA Technical Reports Server (NTRS)

Neugebauer, G.; Soifer, B. T.; Matthews, K.; Margon, B.; Chanan, G. A.

1982-01-01

Near infrared measurements were obtained of 30 quasars originally found serendipitously as X-ray sources in fields of other objects. The observations show that the infrared characteristics of these quasars do not differ significantly from those of quasars selected by other criteria. Because this X-ray selected sample is subject to different selection biases than previous radio and optical surveys, this conclusion is useful in validating previous inferences regarding the infrared colors of 'typical' quasars.

Instrumental and statistical methods for the comparison of class evidence

NASA Astrophysics Data System (ADS)

Liszewski, Elisa Anne

Trace evidence is a major field within forensic science. Association of trace evidence samples can be problematic due to sample heterogeneity and a lack of quantitative criteria for comparing spectra or chromatograms. The aim of this study is to evaluate different types of instrumentation for their ability to discriminate among samples of various types of trace evidence. Chemometric analysis, including techniques such as Agglomerative Hierarchical Clustering, Principal Components Analysis, and Discriminant Analysis, was employed to evaluate instrumental data. First, automotive clear coats were analyzed by using microspectrophotometry to collect UV absorption data. In total, 71 samples were analyzed with classification accuracy of 91.61%. An external validation was performed, resulting in a prediction accuracy of 81.11%. Next, fiber dyes were analyzed using UV-Visible microspectrophotometry. While several physical characteristics of cotton fiber can be identified and compared, fiber color is considered to be an excellent source of variation, and thus was examined in this study. Twelve dyes were employed, some being visually indistinguishable. Several different analyses and comparisons were done, including an inter-laboratory comparison and external validations. Lastly, common plastic samples and other polymers were analyzed using pyrolysis-gas chromatography/mass spectrometry, and their pyrolysis products were then analyzed using multivariate statistics. The classification accuracy varied dependent upon the number of classes chosen, but the plastics were grouped based on composition. The polymers were used as an external validation and misclassifications occurred with chlorinated samples all being placed into the category containing PVC.

A new measure of home care patients' dignity at the end of life: The Palliative Patients' Dignity Scale (PPDS).

PubMed

Rudilla, David; Oliver, Amparo; Galiana, Laura; Barreto, Pilar

2016-04-01

This study aimed to develop a new and brief instrument to be employed in dignity measurement, one based on the perceptions of patients, relatives, and professionals about dignity. Surveys of patients receiving palliative care, family caregivers, and palliative care professionals were first carried out (sample 1). In the second step, palliative care patients were surveyed with a pilot questionnaire (sample 2). Finally, a survey design was used to assess patients admitted into a home care unit (sample 3). Sample 1 included 78 subjects, including patients, family caregivers, and professionals. Some 20 additional palliative patients participated in sample 2. Finally, 70 more patients admitted to a home care unit participated were surveyed (sample 3). Together with the Palliative Patients' Dignity Scale (PPDS), our survey included other measures of dignity, anxiety, depression, resilient coping, quality of life, spirituality, and social support. After analyzing data from steps 1 and 2, an eight-item questionnaire was presented for validation. The new scale showed appropriate factorial validity (χ2(19) = 21.43, p = 0.31, CFI = 0.99, GFI = 0.92, SRMR = 0.07, and RMSEA = 0.04), reliability (internal consistency estimations of 0.75 and higher), criterial validity (significant correlations with the hypothesized related variables), and a cutoff criteria of 50 on the overall scale. The new PPDS has appropriate psychometric properties that, together with its briefness, encourages its applicability for dignity assessment at the end of life.

A comparison of four embedded validity indices for the RBANS in a memory disorders clinic.

PubMed

Paulson, Daniel; Horner, Michael David; Bachman, David

2015-05-01

This examination of four embedded validity indices for the Repeated Battery for the Assessment of Neuropsychological Status (RBANS) explores the potential utility of integrating cognitive and self-reported depressive measures. Examined indices include the proposed RBANS Performance Validity Index (RBANS PVI) and the Charleston Revised Index of Effort for the RBANS (CRIER). The CRIER represented the novel integration of cognitive test performance and depression self-report information. The sample included 234 patients without dementia who could be identified as having demonstrated either valid or invalid responding, based on standardized criteria. Sensitivity and specificity for invalid responding varied widely, with the CRIER emerging as the best all-around index (sensitivity = 0.84, specificity = 0.90, AUC = 0.94). Findings support the use of embedded response validity indices, and suggest that the integration of cognitive and self-report depression data may optimize detection of invalid responding among older Veterans. © The Author 2015. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Development and validation of a rapid multi-class method for the confirmation of fourteen prohibited medicinal additives in pig and poultry compound feed by liquid chromatography-tandem mass spectrometry.

PubMed

Cronly, Mark; Behan, P; Foley, B; Malone, E; Earley, S; Gallagher, M; Shearan, P; Regan, L

2010-12-01

A confirmatory method has been developed to allow for the analysis of fourteen prohibited medicinal additives in pig and poultry compound feed. These compounds are prohibited for use as feed additives although some are still authorised for use in medicated feed. Feed samples are extracted by acetonitrile with addition of sodium sulfate. The extracts undergo a hexane wash to aid with sample purification. The extracts are then evaporated to dryness and reconstituted in initial mobile phase. The samples undergo an ultracentrifugation step prior to injection onto the LC-MS/MS system and are analysed in a run time of 26 min. The LC-MS/MS system is run in MRM mode with both positive and negative electrospray ionisation. The method was validated over three days and is capable of quantitatively analysing for metronidazole, dimetridazole, ronidazole, ipronidazole, chloramphenicol, sulfamethazine, dinitolimide, ethopabate, carbadox and clopidol. The method is also capable of qualitatively analysing for sulfadiazine, tylosin, virginiamycin and avilamycin. A level of 100 microg kg(-1) was used for validation purposes and the method is capable of analysing to this level for all the compounds. Validation criteria of trueness, precision, repeatability and reproducibility along with measurement uncertainty are calculated for all analytes. Copyright (c) 2010 Elsevier B.V. All rights reserved.

Crossing the North Sea seems to make DCD disappear: cross-validation of Movement Assessment Battery for Children-2 norms.

PubMed

Niemeijer, Anuschka S; van Waelvelde, Hilde; Smits-Engelsman, Bouwien C M

2015-02-01

The Movement Assessment Battery for Children has been revised as the Movement ABC-2 (Henderson, Sugden, & Barnett, 2007). In Europe, the 15th percentile score on this test is recommended for one of the DSM-IV diagnostic criteria for Developmental Coordination Disorder (DCD). A representative sample of Dutch and Flemish children was tested to cross-validate the UK standard scores, including the 15th percentile score. First, the mean, SD and percentile scores of Dutch children were compared to those of UK normative samples. Item standard scores of Dutch speaking children deviated from the UK reference values suggesting necessary adjustments. Except for very young children, the Dutch-speaking samples performed better. Second, based on the mean and SD and clinical relevant cut-off scores (5th and 15th percentile), norms were adjusted for the Dutch population. For diagnostic use, researchers and clinicians should use the reference norms that are valid for the group of children they are testing. The results indicate that there possibly is an effect of testing procedure in other countries that validated the UK norms and/or cultural influence on the age norms of the Movement ABC-2. It is suggested to formulate criterion-based norms for age groups in addition to statistical norms. Copyright © 2014 Elsevier B.V. All rights reserved.

Ink dating using thermal desorption and gas chromatography/mass spectrometry: comparison of results obtained in two laboratories.

PubMed

Koenig, Agnès; Bügler, Jürgen; Kirsch, Dieter; Köhler, Fritz; Weyermann, Céline

2015-01-01

An ink dating method based on solvent analysis was recently developed using thermal desorption followed by gas chromatography/mass spectrometry (GC/MS) and is currently implemented in several forensic laboratories. The main aims of this work were to implement this method in a new laboratory to evaluate whether results were comparable at three levels: (i) validation criteria, (ii) aging curves, and (iii) results interpretation. While the results were indeed comparable in terms of validation, the method proved to be very sensitive to maintenances. Moreover, the aging curves were influenced by ink composition, as well as storage conditions (particularly when the samples were not stored in "normal" room conditions). Finally, as current interpretation models showed limitations, an alternative model based on slope calculation was proposed. However, in the future, a probabilistic approach may represent a better solution to deal with ink sample inhomogeneity. © 2014 American Academy of Forensic Science.

Validity of the Family Asthma Management System Scale with an urban African-American sample.

PubMed

Celano, Marianne; Klinnert, Mary D; Holsey, Chanda Nicole; McQuaid, Elizabeth L

2011-06-01

To examine the reliability and validity of the Family Asthma Management System Scale for low-income African-American children with poor asthma control and caregivers under stress. The FAMSS assesses eight aspects of asthma management from a family systems perspective. Forty-three children, ages 8-13, and caregivers were interviewed with the FAMSS; caregivers completed measures of primary care quality, family functioning, parenting stress, and psychological distress. Children rated their relatedness with the caregiver, and demonstrated inhaler technique. Medical records were reviewed for dates of outpatient visits for asthma. The FAMSS demonstrated good internal consistency. Higher scores were associated with adequate inhaler technique, recent outpatient care, less parenting stress and better family functioning. Higher scores on the Collaborative Relationship with Provider subscale were associated with greater perceived primary care quality. The FAMSS demonstrated relevant associations with asthma management criteria and family functioning for a low-income, African-American sample.

A client-treatment matching protocol for therapeutic communities: first report.

PubMed

Melnick, G; De Leon, G; Thomas, G; Kressel, D

2001-10-01

The present study is the first report on a client-treatment matching protocol (CMP) to guide admissions to residential and outpatient substance abuse treatment settings. Two cohorts, a field test sample (n = 318) and cross-validation (n = 407) sample were drawn from consecutive admissions to nine geographically distributed multisetting therapeutic communities (TCs). A passive matching design was employed. Clients received the CMP on admission, but agencies were "blind" to the CMP treatment recommendation (i.e., match) and assigned clients to treatment by the usual intake procedures. Bivariate and logistical regression analyses show that positive treatment dispositions (treatment completion or longer retention in treatment)) were significantly higher among the CMP-matched clients. The present findings provide the empirical basis for studies assessing the validity and utility of the CMP with controlled designs. Though limited to TC-oriented agencies, the present research supports the use of objective matching criteria to improve treatment.

Relationship status: Scales for assessing the vitality of late adolescents' relationships with their parents.

PubMed

Klos, D S; Paddock, J R

1978-12-01

Three criteria for assessing relationship status were proposed: self-disclosure despite the risk of parental disapproval; openness to critical feedback from parents; constructive confrontation when angry with parents. These concepts were operationalized as narratives of nine interpersonal dilemmas, to which late adolescents responded by indicating "What would you do if you were in this situation?" Reliable example-anchored scales were constructed from the responses of one sample of college students and then cross-validated with two other samples. Social class had a significant but small effect on the relationship status scores; but age and sex of adolescent and sex of parent did not. The patterns of correlations of the Relationship Status Scales among themselves and with the Parent-Child Relations Questionnaire, the College Self-Expression Scale, the Fear of Negative Evaluation Scale, and Hogan's Empathy Scale were interpreted as evidence of construct validity.

Audit of an emergency biochemistry service.

PubMed Central

Smellie, W S; Murphy, M J; Galloway, P J; Hinnie, J; McIlroy, J; Dryburgh, F J

1995-01-01

AIM--To examine a model for the evaluation of appropriateness of testing in an emergency biochemistry laboratory. METHODS--A model was devised in which incoming emergency test requests were categorised as appropriate or inappropriate. Explicit criteria were used to define eight minor categories, which were chosen to reflect accurately current working practice within the hospital and laboratory. Five junior medical staff each undertook a prospective 24 hour assessment, during which time all incoming requests were monitored and categorised according to these criteria. Concordance between monitors was evaluated before and during assessments. RESULTS--Of 509 requests, 384 (75%) were appropriate and 125 (25%) were inappropriate according to the criteria used to define categories. Inappropriate requests fell into three main groups: preoperative samples (43.2% (54/125) of all inappropriate requests), missed routine samples (33.6% (42/125)) and accelerated (priority) analyses (16% (20/125)). Various other reasons accounted for the remaining 7.2% (9/125). CONCLUSION--This model may be used to obtain valid information about current clinical and laboratory practice. Strategies to reduce the number of inappropriate requests have been identified in order to reserve the emergency service for situations of true need. PMID:8568000

The structure of Diagnostic and Statistical Manual of Mental Disorders (4th edition, text revision) personality disorder symptoms in a large national sample.

PubMed

Trull, Timothy J; Vergés, Alvaro; Wood, Phillip K; Jahng, Seungmin; Sher, Kenneth J

2012-10-01

We examined the latent structure underlying the criteria for DSM-IV-TR (American Psychiatric Association, 2000, Diagnostic and statistical manual of mental disorders (4th ed., text revision). Washington, DC: Author.) personality disorders in a large nationally representative sample of U.S. adults. Personality disorder symptom data were collected using a structured diagnostic interview from approximately 35,000 adults assessed over two waves of data collection in the National Epidemiologic Survey on Alcohol and Related Conditions. Our analyses suggested that a seven-factor solution provided the best fit for the data, and these factors were marked primarily by one or at most two personality disorder criteria sets. A series of regression analyses that used external validators tapping Axis I psychopathology, treatment for mental health problems, functioning scores, interpersonal conflict, and suicidal ideation and behavior provided support for the seven-factor solution. We discuss these findings in the context of previous studies that have examined the structure underlying the personality disorder criteria as well as the current proposals for DSM-5 personality disorders. (PsycINFO Database Record (c) 2012 APA, all rights reserved).

QUADAS and STARD: evaluating the quality of diagnostic accuracy studies.

PubMed

Oliveira, Maria Regina Fernandes de; Gomes, Almério de Castro; Toscano, Cristiana Maria

2011-04-01

To compare the performance of two approaches, one based on the Quality Assessment of Diagnostic Accuracy Studies (QUADAS) and another on the Standards for Reporting Studies of Diagnostic Accuracy (STARD), in evaluating the quality of studies validating the OptiMal® rapid malaria diagnostic test. Articles validating the rapid test published until 2007 were searched in the Medline/PubMed database. This search retrieved 13 articles. A combination of 12 QUADAS criteria and three STARD criteria were compared with the 12 QUADAS criteria alone. Articles that fulfilled at least 50% of QUADAS criteria were considered as regular to good quality. Of the 13 articles retrieved, 12 fulfilled at least 50% of QUADAS criteria, and only two fulfilled the STARD/QUADAS criteria combined. Considering the two criteria combination (> 6 QUADAS and > 3 STARD), two studies (15.4%) showed good methodological quality. The articles selection using the proposed combination resulted in two to eight articles, depending on the number of items assumed as cutoff point. The STARD/QUADAS combination has the potential to provide greater rigor when evaluating the quality of studies validating malaria diagnostic tests, given that it incorporates relevant information not contemplated in the QUADAS criteria alone.

Symptomatic remission in psychosis and real-life functioning.

PubMed

Oorschot, M; Lataster, T; Thewissen, V; Lardinois, M; van Os, J; Delespaul, P A E G; Myin-Germeys, I

2012-09-01

In 2005 Andreasen proposed criteria for remission in schizophrenia. It is unclear whether these criteria reflect symptom reduction and improved social functioning in daily life. To investigate whether criteria for symptomatic remission reflect symptom reduction and improved functioning in real life, comparing patients meeting remission criteria, patients not meeting these criteria and healthy controls. The Experience Sampling Method (ESM), a structured diary technique, was used to explore real-life symptoms and functioning in 177 patients with (remitted and non-remitted) schizophrenia spectrum disorders and 148 controls. Of 177 patients, 70 met criteria for symptomatic remission. These patients reported significantly fewer positive and negative symptoms and better mood states compared with patients not in remission. Furthermore, patients in remission spent more time in goal-directed activities and had less preference for being alone when they were with others. However, the patient groups did not differ on time spent in social company and doing nothing, and both the remission and non-remission groups had lower scores on functional outcome measures compared with the control group. The study provides an ecological validation for the symptomatic remission criteria, showing that patients who met the criteria reported fewer positive symptoms, better mood states and partial recovery of reward experience compared with those not in remission. However, remission status was not related to functional recovery, suggesting that the current focus on symptomatic remission may reflect an overly restricted goal.

Measuring progress in maternal and newborn health care in Mexico: validating indicators of health system contact and quality of care.

PubMed

Blanc, Ann K; Diaz, Claudia; McCarthy, Katharine J; Berdichevsky, Karla

2016-08-30

The majority of births in Mexico take place in a health facility and are attended by a skilled birth attendant, yet maternal mortality has not declined to anticipated levels. Coverage estimates of skilled attendance and other maternal and newborn interventions often rely on women's self-report through a population-based survey, the accuracy of which is not well established. We used a facility-based design to validate women's report of skilled birth attendance, as well as other key elements of maternal, newborn intrapartum, and immediate postnatal care. Women's reports of labor and delivery care were collected by exit interview prior to hospital discharge and were compared against direct observation by a trained third party in a Mexican public hospital (n = 597). For each indicator, validity was assessed at the individual level using the area under the receiver operating curve (AUC) and at the population level using the inflation factor (IF). Five of 47 indicators met both validation criteria (AUC > 0.60 and 0.75 < IF < 1.25): urine sample screen, injection or IV medication received during labor, before the birth of the baby (i.e., uterotonic for either induction or augmentation of labor), episiotomy, excessive bleeding, and receipt of blood products. An additional 9 indicators met criteria for the AUC and 18 met criteria for the IF. A skilled attendant indicator had high sensitivity (90.1 %: 95 % CI: 87.1-92.5 %), low specificity (14.0 %: 95 % CI: 5.8-26.7 %) and was suitable for population-level estimation only. Women are able to give valid reports on some aspects of the content of care, although questions regarding the indication for interventions are less likely to be known. Questions that include technical terms or refer to specific time periods tended to have lower response levels. A key aspect of efforts to improve maternal and newborn health requires valid measurement of women's access to maternal and newborn health interventions and the quality of such services. Additional work on improving measurement of population coverage indicators is warranted.

Ride qualities criteria validation/pilot performance study: Flight test results

NASA Technical Reports Server (NTRS)

Nardi, L. U.; Kawana, H. Y.; Greek, D. C.

1979-01-01

Pilot performance during a terrain following flight was studied for ride quality criteria validation. Data from manual and automatic terrain following operations conducted during low level penetrations were analyzed to determine the effect of ride qualities on crew performance. The conditions analyzed included varying levels of turbulence, terrain roughness, and mission duration with a ride smoothing system on and off. Limited validation of the B-1 ride quality criteria and some of the first order interactions between ride qualities and pilot/vehicle performance are highlighted. An earlier B-1 flight simulation program correlated well with the flight test results.

Critical-Inquiry-Based-Learning: Model of Learning to Promote Critical Thinking Ability of Pre-service Teachers

NASA Astrophysics Data System (ADS)

Prayogi, S.; Yuanita, L.; Wasis

2018-01-01

This study aimed to develop Critical-Inquiry-Based-Learning (CIBL) learning model to promote critical thinking (CT) ability of preservice teachers. The CIBL learning model was developed by meeting the criteria of validity, practicality, and effectiveness. Validation of the model involves 4 expert validators through the mechanism of the focus group discussion (FGD). CIBL learning model declared valid to promote CT ability, with the validity level (Va) of 4.20 and reliability (r) of 90,1% (very reliable). The practicality of the model was evaluated when it was implemented that involving 17 of preservice teachers. The CIBL learning model had been declared practice, its measuring from learning feasibility (LF) with very good criteria (LF-score = 4.75). The effectiveness of the model was evaluated from the improvement CT ability after the implementation of the model. CT ability were evaluated using the scoring technique adapted from Ennis-Weir Critical Thinking Essay Test. The average score of CT ability on pretest is - 1.53 (uncritical criteria), whereas on posttest is 8.76 (critical criteria), with N-gain score of 0.76 (high criteria). Based on the results of this study, it can be concluded that developed CIBL learning model is feasible to promote CT ability of preservice teachers.

Method validation using weighted linear regression models for quantification of UV filters in water samples.

PubMed

da Silva, Claudia Pereira; Emídio, Elissandro Soares; de Marchi, Mary Rosa Rodrigues

2015-01-01

This paper describes the validation of a method consisting of solid-phase extraction followed by gas chromatography-tandem mass spectrometry for the analysis of the ultraviolet (UV) filters benzophenone-3, ethylhexyl salicylate, ethylhexyl methoxycinnamate and octocrylene. The method validation criteria included evaluation of selectivity, analytical curve, trueness, precision, limits of detection and limits of quantification. The non-weighted linear regression model has traditionally been used for calibration, but it is not necessarily the optimal model in all cases. Because the assumption of homoscedasticity was not met for the analytical data in this work, a weighted least squares linear regression was used for the calibration method. The evaluated analytical parameters were satisfactory for the analytes and showed recoveries at four fortification levels between 62% and 107%, with relative standard deviations less than 14%. The detection limits ranged from 7.6 to 24.1 ng L(-1). The proposed method was used to determine the amount of UV filters in water samples from water treatment plants in Araraquara and Jau in São Paulo, Brazil. Copyright © 2014 Elsevier B.V. All rights reserved.

Development of an on-site screening system for amphetamine-type stimulant tablets with a portable attenuated total reflection Fourier transform infrared spectrometer.

PubMed

Tsujikawa, Kenji; Kuwayama, Kenji; Miyaguchi, Hajime; Kanamori, Tatsuyuki; Iwata, Yuko T; Yoshida, Takemi; Inoue, Hiroyuki

2008-02-04

We tried to develop a library search system using a portable, attenuated total reflection Fourier transform infrared (ATR-FT-IR) spectrometer for on-site identification of 3,4-methylenedioxymethamphetamine (MDMA) and 3,4-methylenedioxyamphetamine (MDA) tablets. The library consisted of the spectra from mixtures of controlled drugs (e.g. MDMA and ketamine), adulterants (e.g. caffeine), and diluents (e.g. lactose). In the seven library search algorithms, the derivative correlation coefficient showed the best discriminant capability. This was enhanced by segmentation of the search area. The optimized search algorithm was validated by the positive (n=154, e.g. the standard mixtures containing the controlled drug, and the MDMA/MDA tablets confiscated) and negative samples (n=56, e.g. medicinal tablets). All validation samples except for four were judged truly. Final criteria for positive identification were decided on the basis of the results of the validation. In conclusion, a portable ATR-FT-IR spectrometer with our library search system would be a useful tool for on-site identification of amphetamine-type stimulant tablets.

Psychometric Validation of the Academic Motivation Scale in a Dental Student Sample.

PubMed

Orsini, Cesar; Binnie, Vivian; Evans, Phillip; Ledezma, Priscilla; Fuentes, Fernando; Villegas, Maria J

2015-08-01

The Academic Motivation Scale is one of the most frequently used instruments to assess academic motivation. It relies on the self-determination theory of human motivation. However, motivation has been understudied in dental education. Therefore, to address the lack of valid instruments to assess academic motivation in dental education and contribute to future research in the field, the aim of this study was to analyze the psychometric properties of this instrument in a sample of dental students. Participants were 989 Chilean undergraduate dental students (86% response rate) who completed a survey containing a Chilean face-valid version of the Spanish Academic Motivation Scale and three other motivation-related instruments to assess the survey's construct and criterion validity. Later, 76 of the students (out of 100 invited) took the survey again to assess its test-retest stability. The instrument's construct validity was supported by the superior goodness of fit of the seven-subscale Academic Motivation Scale over competing models through confirmatory factor analysis and by the expected correlations among its subscales. The concurrent criterion validity was supported by the confirmation of correlations between its subscales and external criteria. Adequate internal consistency and test-retest correlations were also found. The evidence from this study suggests that the Academic Motivation Scale is a preliminarily valid and reliable instrument to assess motivation in the predoctoral dental context. Future research in this area is needed to confirm or refute these results.

Validation of scores of use of inhalation devices: valoration of errors *

PubMed Central

Zambelli-Simões, Letícia; Martins, Maria Cleusa; Possari, Juliana Carneiro da Cunha; Carvalho, Greice Borges; Coelho, Ana Carla Carvalho; Cipriano, Sonia Lucena; de Carvalho-Pinto, Regina Maria; Cukier, Alberto; Stelmach, Rafael

2015-01-01

Abstract Objective: To validate two scores quantifying the ability of patients to use metered dose inhalers (MDIs) or dry powder inhalers (DPIs); to identify the most common errors made during their use; and to identify the patients in need of an educational program for the use of these devices. Methods: This study was conducted in three phases: validation of the reliability of the inhaler technique scores; validation of the contents of the two scores using a convenience sample; and testing for criterion validation and discriminant validation of these instruments in patients who met the inclusion criteria. Results: The convenience sample comprised 16 patients. Interobserver disagreement was found in 19% and 25% of the DPI and MDI scores, respectively. After expert analysis on the subject, the scores were modified and were applied in 72 patients. The most relevant difficulty encountered during the use of both types of devices was the maintenance of total lung capacity after a deep inhalation. The degree of correlation of the scores by observer was 0.97 (p < 0.0001). There was good interobserver agreement in the classification of patients as able/not able to use a DPI (50%/50% and 52%/58%; p < 0.01) and an MDI (49%/51% and 54%/46%; p < 0.05). Conclusions: The validated scores allow the identification and correction of inhaler technique errors during consultations and, as a result, improvement in the management of inhalation devices. PMID:26398751

Validity criteria for Fermi's golden rule scattering rates applied to metallic nanowires.

PubMed

Moors, Kristof; Sorée, Bart; Magnus, Wim

2016-09-14

Fermi's golden rule underpins the investigation of mobile carriers propagating through various solids, being a standard tool to calculate their scattering rates. As such, it provides a perturbative estimate under the implicit assumption that the effect of the interaction Hamiltonian which causes the scattering events is sufficiently small. To check the validity of this assumption, we present a general framework to derive simple validity criteria in order to assess whether the scattering rates can be trusted for the system under consideration, given its statistical properties such as average size, electron density, impurity density et cetera. We derive concrete validity criteria for metallic nanowires with conduction electrons populating a single parabolic band subjected to different elastic scattering mechanisms: impurities, grain boundaries and surface roughness.

DSM-5 Gambling Disorder: Prevalence and Characteristics in a Substance Use Disorder Sample

PubMed Central

Rennert, Lior; Denis, Cécile; Peer, Kyle; Lynch, Kevin G.; Gelernter, Joel; Kranzler, Henry R.

2014-01-01

Background The fifth edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-5) replaced the DSM-IV diagnosis of Pathological Gambling (PG) with Gambling Disorder (GD). GD requires four rather than five criteria for the diagnosis and excludes the “Illegal Acts” criterion. We examined the prevalence of GD and its characteristics and validity in a substance use disorder (SUD) sample. Methods Participants (N=6,613) in genetic studies of substance dependence underwent a semi-structured psychiatric interview. Individuals who reported ever having gambled $10 at least monthly (n = 1,507) were the focus of the analyses. Results Approximately one-third of acknowledged gamblers (n = 563; 8.5% of the total sample) received both PG (DSM-IV) and GD (DSM-5) diagnoses and 678 (10.3% of the total) received a DSM-5 diagnosis, representing an increase of 20.4% relative to DSM-IV. Although the three groups were comparable demographically, the DSM-5-Only group was intermediate between the other two groups on the prevalence of comorbid substance use disorders, the distribution of DSM-IV PG criteria endorsed, and the types of gambling reported. Multinomial logistic regression analysis showed that the DSM-5-Only group was more likely than the No-Diagnosis group and less likely than the Both-Diagnoses group to acknowledge a gambling problem. Conclusion There was a high prevalence of PG in this SUD sample. Analysis of non-DSM variables suggested that the increased sensitivity of the DSM-5 GD diagnosis successfully identifies a broader set of individuals with clinically significant gambling-related problems. Prospective studies of individuals with GD are needed to validate this finding. PMID:24490711

[Estuary health assessment using a benthic-index of biotic integrity in Yangtze Estuary and its adjacent waters].

PubMed

Zhou, Xiao-wei; Wang, Li-ping; Zheng, Bing-hui; Liu, Lu-san; Fu, Qing

2009-01-01

A benthic index of biotic integrity (B-IBI) was developed for application in estuaries health assessment of the Yangtze Estuary and its adjacent waters. Benthic macro-invertebrate samples were collected from 41 stream sites (13 non-degraded stations and 28 degraded stations) in the Yangtze Estuary and its adjacent waters in July, 2005. The analyses of the range of index value distribution, Pearson correlation and judgment ability were performed on fourteen candidate metrics. Six biological metrics were selected for the establishment of B-IBI, which were Shannon-Wiener index, the species number, total density, total biomass, Carapace Animals density percentage and Echinoderms density percentage. B-IBI was obtained by sum up all these indices after which were transformed into a uniform score by using the ratio scoring method. Base on 50 percentile of B-IBI value in reference sites, the criteria of health ranking was determined. The proposed criteria of benthic-index of biotic integrity were as follows: B-IBI > 2.48 was regarded as health, 1.86-2.48 sub-health, 1.24-1.86 fair, 0.62-1.24 poor, and B-IBI < 0.62 very poor. Assessing with these criteria, the results showed that among the 41 sites in Yangtze Estuary and its adjacent waters, 7 sites were health, 2 sites were sub-health, 8 sites were fair, 8 sites were poor and 16 sites were very poor. An independent data set sampled in June of 2006 was used to validate the index, the results indicated that final combined index correctly classified 89% of stations in the validation data set.

Assessment of the accuracy of a new tool for the screening of smartphone addiction

PubMed Central

2017-01-01

Objective To translate, adapt and validate the Smartphone Addiction Inventory (SPAI) in a Brazilian population of young adults. Method We employed the translation and back-translation method for the adaptation of the Brazilian version SPAI (SPAI-BR). The sample consisted of 415 university students. Data was collected through an electronic questionnaire, which consisted of the SPAI-BR and the Goodman Criteria (gold standard). The retests were carried out 10–15 days after the initial tests with 130 individuals. Results The SPAI-BR maintained semantic, idiomatic and conceptual equivalences from the original scale. The Confirmatory Factor Analysis confirmed the One-factor model of the SPAI with good fit indexes (x2 = 767.861, CFI = 0.913, TLI = 0.905, RMSE = 0.061, WRMR = 1.465). The Kuder-Richardson Coefficient showed good internal consistency. The analysis of the ROC curve established an area under the curve of 86.38%. The Intraclass-Correlation Coefficient of 0.926 between the test and the retest demonstrated an excellent temporal stability. The high correlation between SPAI-BR and the Goodman Criteria (rs = 0.750) established the convergent validity. Conclusion The SPAI-BR is a valid and reliable tool for the detection of Smartphone Addiction in Brazilian university students. PMID:28520798

A systematic review of instruments that measure attitudes toward homosexual men.

PubMed

Grey, Jeremy A; Robinson, Beatrice Bean E; Coleman, Eli; Bockting, Walter O

2013-01-01

Scientific interest in the measurement of homophobia and internalized homophobia has grown over the past 30 years, and new instruments and terms have emerged. To help researchers with the challenging task of identifying appropriate measures for studies in sexual-minority health, we reviewed measures of homophobia published in the academic literature from 1970 to 2012. Instruments that measured attitudes toward male homosexuals/homosexuality or measured homosexuals' internalized attitudes toward homosexuality were identified using measurement manuals and a systematic review. A total of 23 instruments met criteria for inclusion, and their features were summarized and compared. All 23 instruments met minimal criteria for adequate scale construction, including scale development, sampling, reliability, and evidence of validity. Validity evidence was diverse and was categorized as interaction with gay men, HIV/AIDS variables, mental health, and conservative religious or political beliefs. Homophobia was additionally correlated with authoritarianism and bias, gender ideology, gender differences, and reactions to homosexual stimuli. Internalized homophobia was validated by examining relationships with disclosing one's homosexuality and level of homosexual identity development. We hope this review will make the process of instrument selection more efficient by allowing researchers to easily locate, evaluate, and choose the proper measure based on their research question and population of interest.

Are implicit motives revealed in mere words? Testing the marker-word hypothesis with computer-based text analysis

PubMed Central

Schultheiss, Oliver C.

2013-01-01

Traditionally, implicit motives (i.e., non-conscious preferences for specific classes of incentives) are assessed through semantic coding of imaginative stories. The present research tested the marker-word hypothesis, which states that implicit motives are reflected in the frequencies of specific words. Using Linguistic Inquiry and Word Count (LIWC; Pennebaker et al., 2001), Study 1 identified word categories that converged with a content-coding measure of the implicit motives for power, achievement, and affiliation in picture stories collected in German and US student samples, showed discriminant validity with self-reported motives, and predicted well-validated criteria of implicit motives (gender difference for the affiliation motive; in interaction with personal-goal progress: emotional well-being). Study 2 demonstrated LIWC-based motive scores' causal validity by documenting their sensitivity to motive arousal. PMID:24137149

A program needs-driven approach to selecting dietary assessment methods for decision-making in food fortification programs.

PubMed

Coates, Jennifer; Colaiezzi, Brooke; Fiedler, John L; Wirth, James; Lividini, Keith; Rogers, Beatrice

2012-09-01

Dietary assessment data are essential for designing, monitoring, and evaluating food fortification and other food-based nutrition programs. Planners and managers must understand the validity, usefulness, and cost tradeoffs of employing alternative dietary assessment methods, but little guidance exists. To identify and apply criteria to assess the tradeoffs of using alternative dietary methods for meeting fortification programming needs. Twenty-five semistructured expert interviews were conducted and literature was reviewed for information on the validity, usefulness, and cost of using 24-hour recalls, Food Frequency Questionnaires/Fortification Rapid Assessment Tool (FFQ/FRAT), Food Balance Sheets (FBS), and Household Consumption and Expenditures Surveys (HCES) for program stage-specific information needs. Criteria were developed and applied to construct relative rankings of the four methods. Needs assessment: HCES offers the greatest suitability at the lowest cost for estimating the risk of inadequate intakes, but relative to 24-hour recall compromises validity. HCES should be used to identify vehicles and to estimate coverage and likely impact due to its low cost and moderate-to-high validity. Baseline assessment: 24-hour recall should be applied using a representative sample. Monitoring: A simple, low-cost FFQ can be used to monitor coverage. Impact evaluation: 24-hour recall should be used to assess changes in nutrient intakes. FBS have low validity relative to other methods for all programmatic purposes. Each dietary assessment method has strengths and weaknesses that vary by context and purpose. Method selection must be driven by the program's data needs, the suitability of the methods for the purpose, and a clear understanding of the tradeoffs involved.

Combined quantification of paclitaxel, docetaxel and ritonavir in human feces and urine using LC-MS/MS.

PubMed

Hendrikx, Jeroen J M A; Rosing, Hilde; Schinkel, Alfred H; Schellens, Jan H M; Beijnen, Jos H

2014-02-01

A combined assay for the determination of paclitaxel, docetaxel and ritonavir in human feces and urine is described. The drugs were extracted from 200 μL urine or 50 mg feces followed by high-performance liquid chromatography analysis coupled with positive ionization electrospray tandem mass spectrometry. The validation program included calibration model, accuracy and precision, carry-over, dilution test, specificity and selectivity, matrix effect, recovery and stability. Acceptance criteria were according to US Food and Drug Administration guidelines on bioanalytical method validation. The validated range was 0.5-500 ng/mL for paclitaxel and docetaxel, 2-2000 ng/mL for ritonavir in urine, 2-2000 ng/mg for paclitaxel and docetaxel, and 8-8000 ng/mg for ritonavir in feces. Inter-assay accuracy and precision were tested for all analytes at four concentration levels and were within 8.5% and <10.2%, respectively, in both matrices. Recovery at three concentration levels was between 77 and 94% in feces samples and between 69 and 85% in urine samples. Method development, including feces homogenization and spiking blank urine samples, are discussed. We demonstrated that each of the applied drugs could be quantified successfully in urine and feces using the described assay. The method was successfully applied for quantification of the analytes in feces and urine samples of patients. Copyright © 2013 John Wiley & Sons, Ltd.

Development and validation of a five-factor sexual satisfaction and distress scale for women: the Sexual Satisfaction Scale for Women (SSS-W).

PubMed

Meston, Cindy; Trapnell, Paul

2005-01-01

This article presents data based on the responses of over 800 women who contributed to the development of the Sexual Satisfaction Scale for Women (SSS-W). The aim of this study was to develop a comprehensive, multifaceted, valid, and reliable self-report measure of women's sexual satisfaction and distress. Phase I involved the initial selection of items based on past literature and on interviews of women diagnosed with sexual dysfunction and an exploratory factor analysis. Phase II involved an additional administration of the questionnaire, factor analyses, and refinement of the questionnaire items. Phase III involved administration of the final questionnaire to a sample of women with clinically diagnosed sexual dysfunction and controls. Psychometric evaluation of the SSS-W conducted in a sample of women meeting DSM-IV-TR criteria for female sexual dysfunction and in a control sample provided preliminary evidence of reliability and validity. The ability of the SSS-W to discriminate between sexually functional and dysfunctional women was demonstrated for each of the SSS-W domain scores and total score. The SSS-W is a brief, 30-item measure of sexual satisfaction and sexual distress, composed of five domains supported by factor analyses: contentment, communication, compatibility, relational concern, and personal concern. It exhibits sound psychometric properties and has a demonstrated ability to discriminate between clinical and nonclinical samples.

Ordinal-To-Interval Scale Conversion Tables and National Items for the New Zealand Version of the WHOQOL-BREF

PubMed Central

Billington, D. Rex; Hsu, Patricia Hsien-Chuan; Feng, Xuan Joanna; Medvedev, Oleg N.; Kersten, Paula; Landon, Jason; Siegert, Richard J.

2016-01-01

The World Health Organisation Quality of Life (WHOQOL) questionnaires are widely used around the world and can claim strong cross-cultural validity due to their development in collaboration with international field centres. To enhance conceptual equivalence of quality of life across cultures, optional national items are often developed for use alongside the core instrument. The present study outlines the development of national items for the New Zealand WHOQOL-BREF. Focus groups with members of the community as well as health experts discussed what constitutes quality of life in their opinion. Based on themes extracted of aspects not contained in the existing WHOQOL instrument, 46 candidate items were generated and subsequently rated for their importance by a random sample of 585 individuals from the general population. Applying importance criteria reduced these items to 24, which were then sent to another large random sample (n = 808) to be rated alongside the existing WHOQOL-BREF. A final set of five items met the criteria for national items. Confirmatory factor analysis identified four national items as belonging to the psychological domain of quality of life, and one item to the social domain. Rasch analysis validated these results and generated ordinal-to-interval conversion algorithms to allow use of parametric statistics for domain scores with and without national items. PMID:27812203

Statistical Design for Biospecimen Cohort Size in Proteomics-based Biomarker Discovery and Verification Studies

PubMed Central

Skates, Steven J.; Gillette, Michael A.; LaBaer, Joshua; Carr, Steven A.; Anderson, N. Leigh; Liebler, Daniel C.; Ransohoff, David; Rifai, Nader; Kondratovich, Marina; Težak, Živana; Mansfield, Elizabeth; Oberg, Ann L.; Wright, Ian; Barnes, Grady; Gail, Mitchell; Mesri, Mehdi; Kinsinger, Christopher R.; Rodriguez, Henry; Boja, Emily S.

2014-01-01

Protein biomarkers are needed to deepen our understanding of cancer biology and to improve our ability to diagnose, monitor and treat cancers. Important analytical and clinical hurdles must be overcome to allow the most promising protein biomarker candidates to advance into clinical validation studies. Although contemporary proteomics technologies support the measurement of large numbers of proteins in individual clinical specimens, sample throughput remains comparatively low. This problem is amplified in typical clinical proteomics research studies, which routinely suffer from a lack of proper experimental design, resulting in analysis of too few biospecimens to achieve adequate statistical power at each stage of a biomarker pipeline. To address this critical shortcoming, a joint workshop was held by the National Cancer Institute (NCI), National Heart, Lung and Blood Institute (NHLBI), and American Association for Clinical Chemistry (AACC), with participation from the U.S. Food and Drug Administration (FDA). An important output from the workshop was a statistical framework for the design of biomarker discovery and verification studies. Herein, we describe the use of quantitative clinical judgments to set statistical criteria for clinical relevance, and the development of an approach to calculate biospecimen sample size for proteomic studies in discovery and verification stages prior to clinical validation stage. This represents a first step towards building a consensus on quantitative criteria for statistical design of proteomics biomarker discovery and verification research. PMID:24063748

Statistical design for biospecimen cohort size in proteomics-based biomarker discovery and verification studies.

PubMed

Skates, Steven J; Gillette, Michael A; LaBaer, Joshua; Carr, Steven A; Anderson, Leigh; Liebler, Daniel C; Ransohoff, David; Rifai, Nader; Kondratovich, Marina; Težak, Živana; Mansfield, Elizabeth; Oberg, Ann L; Wright, Ian; Barnes, Grady; Gail, Mitchell; Mesri, Mehdi; Kinsinger, Christopher R; Rodriguez, Henry; Boja, Emily S

2013-12-06

Protein biomarkers are needed to deepen our understanding of cancer biology and to improve our ability to diagnose, monitor, and treat cancers. Important analytical and clinical hurdles must be overcome to allow the most promising protein biomarker candidates to advance into clinical validation studies. Although contemporary proteomics technologies support the measurement of large numbers of proteins in individual clinical specimens, sample throughput remains comparatively low. This problem is amplified in typical clinical proteomics research studies, which routinely suffer from a lack of proper experimental design, resulting in analysis of too few biospecimens to achieve adequate statistical power at each stage of a biomarker pipeline. To address this critical shortcoming, a joint workshop was held by the National Cancer Institute (NCI), National Heart, Lung, and Blood Institute (NHLBI), and American Association for Clinical Chemistry (AACC) with participation from the U.S. Food and Drug Administration (FDA). An important output from the workshop was a statistical framework for the design of biomarker discovery and verification studies. Herein, we describe the use of quantitative clinical judgments to set statistical criteria for clinical relevance and the development of an approach to calculate biospecimen sample size for proteomic studies in discovery and verification stages prior to clinical validation stage. This represents a first step toward building a consensus on quantitative criteria for statistical design of proteomics biomarker discovery and verification research.

An evaluation of general practice websites in the UK.

PubMed

Howitt, Alistair; Clement, Sarah; de Lusignan, Simon; Thiru, Krish; Goodwin, Daryl; Wells, Sally

2002-10-01

General practice websites are an emerging phenomenon, but there have been few critical evaluations of their content. Previously developed rating instruments to assess medical websites have been criticized for failing to report their reliability and validity. The purpose of this study was to develop a rating instrument for assessing UK general practice websites, and then to evaluate them critically. The STaRNet Website Assessment Tool (SWAT) was developed listing criteria that general practice websites may meet, which was then used to evaluate a random sample of websites drawn from an electronic database. A second assessor rated a subsample of the sites to assess the tool's inter-rater reliability. The setting was an information technology group of a general practice research network using a random sample of 108 websites identified from the database. The main outcome measures were identification of rating criteria and frequency counts from the website rating instrument. Ninety (93.3%) sites were accessible, of which 84 were UK general practice websites. Criteria most frequently met were those describing the scope of the website and their functionality. Apart from e-mail to practices, criteria related to electronic communication were rarely met. Criteria relating to the quality of information were least often met. Inter-rater reliability kappa values for the items in the tool ranged from -0.06 to 1.0 (mean 0.59). Values were >0.6 for 15 out of 25 criteria assessed in 40 sites which were rated by two assessors. General practice websites offer a wide range of information. They are technically satisfactory, but do not exploit fully the potential for electronic doctor-patient communication. The quality of information they provide is poor. The instrument may be developed as a template for general practices producing or revising their own websites.

A system of equations to approximate the pharmacokinetic parameters of lacosamide at steady state from one plasma sample.

PubMed

Cawello, Willi; Schäfer, Carina

2014-08-01

Frequent plasma sampling to monitor pharmacokinetic (PK) profile of antiepileptic drugs (AEDs), is invasive, costly and time consuming. For drugs with a well-defined PK profile, such as AED lacosamide, equations can accurately approximate PK parameters from one steady-state plasma sample. Equations were derived to approximate steady-state peak and trough lacosamide plasma concentrations (Cpeak,ss and Ctrough,ss, respectively) and area under concentration-time curve during dosing interval (AUCτ,ss) from one plasma sample. Lacosamide (ka: ∼2 h(-1); ke: ∼0.05 h(-1), corresponding to half-life of 13 h) was calculated to reach Cpeak,ss after ∼1 h (tmax,ss). Equations were validated by comparing approximations to reference PK parameters obtained from single plasma samples drawn 3-12h following lacosamide administration, using data from double-blind, placebo-controlled, parallel-group PK study. Values of relative bias (accuracy) between -15% and +15%, and root mean square error (RMSE) values≤15% (precision) were considered acceptable for validation. Thirty-five healthy subjects (12 young males; 11 elderly males, 12 elderly females) received lacosamide 100mg/day for 4.5 days. Equation-derived PK values were compared to reference mean Cpeak,ss, Ctrough,ss and AUCτ,ss values. Equation-derived PK data had a precision of 6.2% and accuracy of -8.0%, 2.9%, and -0.11%, respectively. Equation-derived versus reference PK values for individual samples obtained 3-12h after lacosamide administration showed correlation (R2) range of 0.88-0.97 for AUCτ,ss. Correlation range for Cpeak,ss and Ctrough,ss was 0.65-0.87. Error analyses for individual sample comparisons were independent of time. Derived equations approximated lacosamide Cpeak,ss, Ctrough,ss and AUCτ,ss using one steady-state plasma sample within validation range. Approximated PK parameters were within accepted validation criteria when compared to reference PK values. Copyright © 2014 Elsevier B.V. All rights reserved.

Multi-criteria development and incorporation into decision tools for health technology adoption.

PubMed

Poulin, Paule; Austen, Lea; Scott, Catherine M; Waddell, Cameron D; Dixon, Elijah; Poulin, Michelle; Lafrenière, René

2013-01-01

When introducing new health technologies, decision makers must integrate research evidence with local operational management information to guide decisions about whether and under what conditions the technology will be used. Multi-criteria decision analysis can support the adoption or prioritization of health interventions by using criteria to explicitly articulate the health organization's needs, limitations, and values in addition to evaluating evidence for safety and effectiveness. This paper seeks to describe the development of a framework to create agreed-upon criteria and decision tools to enhance a pre-existing local health technology assessment (HTA) decision support program. The authors compiled a list of published criteria from the literature, consulted with experts to refine the criteria list, and used a modified Delphi process with a group of key stakeholders to review, modify, and validate each criterion. In a workshop setting, the criteria were used to create decision tools. A set of user-validated criteria for new health technology evaluation and adoption was developed and integrated into the local HTA decision support program. Technology evaluation and decision guideline tools were created using these criteria to ensure that the decision process is systematic, consistent, and transparent. This framework can be used by others to develop decision-making criteria and tools to enhance similar technology adoption programs. The development of clear, user-validated criteria for evaluating new technologies adds a critical element to improve decision-making on technology adoption, and the decision tools ensure consistency, transparency, and real-world relevance.

40 CFR 610.24 - Validity of test data.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 40 Protection of Environment 30 2011-07-01 2011-07-01 false Validity of test data. 610.24 Section 610.24 Protection of Environment ENVIRONMENTAL PROTECTION AGENCY (CONTINUED) ENERGY POLICY FUEL ECONOMY RETROFIT DEVICES Test Procedures and Evaluation Criteria Evaluation Criteria for the Preliminary...

40 CFR 610.24 - Validity of test data.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 40 Protection of Environment 31 2012-07-01 2012-07-01 false Validity of test data. 610.24 Section 610.24 Protection of Environment ENVIRONMENTAL PROTECTION AGENCY (CONTINUED) ENERGY POLICY FUEL ECONOMY RETROFIT DEVICES Test Procedures and Evaluation Criteria Evaluation Criteria for the Preliminary...

40 CFR 610.24 - Validity of test data.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 40 Protection of Environment 30 2014-07-01 2014-07-01 false Validity of test data. 610.24 Section 610.24 Protection of Environment ENVIRONMENTAL PROTECTION AGENCY (CONTINUED) ENERGY POLICY FUEL ECONOMY RETROFIT DEVICES Test Procedures and Evaluation Criteria Evaluation Criteria for the Preliminary...

40 CFR 610.24 - Validity of test data.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 40 Protection of Environment 31 2013-07-01 2013-07-01 false Validity of test data. 610.24 Section 610.24 Protection of Environment ENVIRONMENTAL PROTECTION AGENCY (CONTINUED) ENERGY POLICY FUEL ECONOMY RETROFIT DEVICES Test Procedures and Evaluation Criteria Evaluation Criteria for the Preliminary...

The Holy Trinity of Methodological Rigor: A Skeptical View

ERIC Educational Resources Information Center

Coryn, Chris L. S.

2007-01-01

The author discusses validation hierarchies grounded in the tradition of quantitative research that generally consists of the criteria of validity, reliability and objectivity and compares this with similar criteria developed by the qualitative tradition, described as trustworthiness, dependability and confirmability. Although these quantitative…

40 CFR 610.24 - Validity of test data.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 40 Protection of Environment 29 2010-07-01 2010-07-01 false Validity of test data. 610.24 Section 610.24 Protection of Environment ENVIRONMENTAL PROTECTION AGENCY (CONTINUED) ENERGY POLICY FUEL ECONOMY RETROFIT DEVICES Test Procedures and Evaluation Criteria Evaluation Criteria for the Preliminary...

Updating the OMERACT filter: implications of filter 2.0 to select outcome instruments through assessment of "truth": content, face, and construct validity.

PubMed

Tugwell, Peter; Boers, Maarten; D'Agostino, Maria-Antonietta; Beaton, Dorcas; Boonen, Annelies; Bingham, Clifton O; Choy, Ernest; Conaghan, Philip G; Dougados, Maxime; Duarte, Catia; Furst, Daniel E; Guillemin, Francis; Gossec, Laure; Heiberg, Turid; van der Heijde, Désirée M; Hewlett, Sarah; Kirwan, John R; Kvien, Tore K; Landewé, Robert B; Mease, Philip J; Østergaard, Mikkel; Simon, Lee; Singh, Jasvinder A; Strand, Vibeke; Wells, George

2014-05-01

The Outcome Measures in Rheumatology (OMERACT) Filter provides guidelines for the development and validation of outcome measures for use in clinical research. The "Truth" section of the OMERACT Filter requires that criteria be met to demonstrate that the outcome instrument meets the criteria for content, face, and construct validity. Discussion groups critically reviewed a variety of ways in which case studies of current OMERACT Working Groups complied with the Truth component of the Filter and what issues remained to be resolved. The case studies showed that there is broad agreement on criteria for meeting the Truth criteria through demonstration of content, face, and construct validity; however, several issues were identified that the Filter Working Group will need to address. These issues will require resolution to reach consensus on how Truth will be assessed for the proposed Filter 2.0 framework, for instruments to be endorsed by OMERACT.

Estimations of natural variability between satellite measurements of trace species concentrations

NASA Astrophysics Data System (ADS)

Sheese, P.; Walker, K. A.; Boone, C. D.; Degenstein, D. A.; Kolonjari, F.; Plummer, D. A.; von Clarmann, T.

2017-12-01

In order to validate satellite measurements of atmospheric states, it is necessary to understand the range of random and systematic errors inherent in the measurements. On occasions where the measurements do not agree within those errors, a common "go-to" explanation is that the unexplained difference can be chalked up to "natural variability". However, the expected natural variability is often left ambiguous and rarely quantified. This study will look to quantify the expected natural variability of both O3 and NO2 between two satellite instruments: ACE-FTS (Atmospheric Chemistry Experiment - Fourier Transform Spectrometer) and OSIRIS (Optical Spectrograph and Infrared Imaging System). By sampling the CMAM30 (30-year specified dynamics simulation of the Canadian Middle Atmosphere Model) climate chemistry model throughout the upper troposphere and stratosphere at times and geolocations of coincident ACE-FTS and OSIRIS measurements at varying coincidence criteria, height-dependent expected values of O3 and NO2 variability will be estimated and reported on. The results could also be used to better optimize the coincidence criteria used in satellite measurement validation studies.

Hair testing for cocaine and metabolites by GC/MS: criteria to quantitatively assess cocaine use.

PubMed

López-Guarnido, O; Álvarez, I; Gil, F; Rodrigo, L; Cataño, H C; Bermejo, A M; Tabernero, M J; Pla, A; Hernández, A F

2013-08-01

A simple, rapid and sensitive method has been developed and validated for the determination of cocaine and its main metabolites (benzoylecgonine and cocaethylene) in human hair. The method involved solid-phase extraction with an Oasis HLB extraction cartridge and subsequent analysis by GC/MS. The limit of detection was 0.01 ng mg(-1) for cocaine, 0.04 for benzoylecgonine and 0.03 for cocaethylene. The method validation included linearity (with a correlation coefficient >0.99 over the range 0.2-50 ng mg(-1) ), intra- and inter-day precision (always lower than 12%) and accuracy (mean relative error always below 17%) to meet the bioanalytical acceptance criteria. The procedure was further applied to 40 hair samples from self-reported cocaine users arrested by the police who provided a positive urine-analysis for cocaine, and was demonstrated to be suitable for its application in forensic toxicology. New approaches were raised to detect false-negative results that allow a better interpretation of hair testing results. Copyright © 2012 John Wiley & Sons, Ltd.

A Framework for the Development and Interpretation of Different Sepsis Definitions and Clinical Criteria

PubMed Central

Angus, Derek C.; Seymour, Christopher W.; Coopersmith, Craig M.; Deutschman, Clifford; Klompas, Michael; Levy, Mitchell M.; Martin, Greg S.; Osborn, Tiffany M.; Rhee, Chanu; Watson, R. Scott

2016-01-01

Although sepsis was described more than 2,000 years ago, and clinicians still struggle to define it, there is no “gold standard,” and multiple competing approaches and terms exist. Challenges include the ever-changing knowledge base that informs our understanding of sepsis, competing views on which aspects of any potential definition are most important, and the tendency of most potential criteria to be distributed in at-risk populations in such a way as to hinder separation into discrete sets of patients. We propose that the development and evaluation of any definition or diagnostic criteria should follow four steps: 1) define the epistemologic underpinning, 2) agree on all relevant terms used to frame the exercise, 3) state the intended purpose for any proposed set of criteria, and 4) adopt a scientific approach to inform on their usefulness with regard to the intended purpose. Usefulness can be measured across six domains: 1) reliability (stability of criteria during retesting, between raters, over time, and across settings), 2) content validity (similar to face validity), 3) construct validity (whether criteria measure what they purport to measure), 4) criterion validity (how new criteria fare compared to standards), 5) measurement burden (cost, safety, and complexity), and 6) timeliness (whether criteria are available concurrent with care decisions). The relative importance of these domains of usefulness depends on the intended purpose, of which there are four broad categories: 1) clinical care, 2) research, 3) surveillance, and 4) quality improvement and audit. This proposed methodologic framework is intended to aid understanding of the strengths and weaknesses of different approaches, provide a mechanism for explaining differences in epidemiologic estimates generated by different approaches, and guide the development of future definitions and diagnostic criteria. PMID:26901559

A Framework for the Development and Interpretation of Different Sepsis Definitions and Clinical Criteria.

PubMed

Angus, Derek C; Seymour, Christopher W; Coopersmith, Craig M; Deutschman, Clifford S; Klompas, Michael; Levy, Mitchell M; Martin, Gregory S; Osborn, Tiffany M; Rhee, Chanu; Watson, R Scott

2016-03-01

Although sepsis was described more than 2,000 years ago, and clinicians still struggle to define it, there is no "gold standard," and multiple competing approaches and terms exist. Challenges include the ever-changing knowledge base that informs our understanding of sepsis, competing views on which aspects of any potential definition are most important, and the tendency of most potential criteria to be distributed in at-risk populations in such a way as to hinder separation into discrete sets of patients. We propose that the development and evaluation of any definition or diagnostic criteria should follow four steps: 1) define the epistemologic underpinning, 2) agree on all relevant terms used to frame the exercise, 3) state the intended purpose for any proposed set of criteria, and 4) adopt a scientific approach to inform on their usefulness with regard to the intended purpose. Usefulness can be measured across six domains: 1) reliability (stability of criteria during retesting, between raters, over time, and across settings), 2) content validity (similar to face validity), 3) construct validity (whether criteria measure what they purport to measure), 4) criterion validity (how new criteria fare compared to standards), 5) measurement burden (cost, safety, and complexity), and 6) timeliness (whether criteria are available concurrent with care decisions). The relative importance of these domains of usefulness depends on the intended purpose, of which there are four broad categories: 1) clinical care, 2) research, 3) surveillance, and 4) quality improvement and audit. This proposed methodologic framework is intended to aid understanding of the strengths and weaknesses of different approaches, provide a mechanism for explaining differences in epidemiologic estimates generated by different approaches, and guide the development of future definitions and diagnostic criteria.

Medical end-of-life practices among Canadian physicians: a pilot study.

PubMed

Marcoux, Isabelle; Boivin, Antoine; Mesana, Laura; Graham, Ian D; Hébert, Paul

2016-01-01

Medical end-of-life practices are hotly debated in Canada, and data from other countries are used to support arguments. The objective of this pilot study was twofold: to adapt and validate a questionnaire designed to measure the prevalence of these practices in Canada and the underlying decision-making process, and to assess the feasibility of a nationally representative study. In phase 1, questionnaires from previous studies were adapted to the Canadian context through consultations with a multidisciplinary committee and based on a scoping review. The modified questionnaire was validated through cognitive interviews with 14 physicians from medical specialties associated with a higher probability of being involved with dying patients recruited by means of snowball sampling. In phase 2, we selected a stratified random sample of 300 Canadian physicians in active practice from a national medical directory and used the modified tailored method design for mail and Web surveys. There were 4 criteria for success: modified questions are clearly understood; response patterns for sensitive questions are similar to those for other questions; respondents are comparable to the overall sampling frame; and mean questionnaire completion time is less than 20 minutes. Phase 1: main modifications to the questionnaire were related to documentation of all other medical practices (including practices intended to prolong life) and a question on the proportionality of drugs used. The final questionnaire contained 45 questions in a booklet style. Phase 2: of the 280 physicians with valid addresses, 87 (31.1%) returned the questionnaire; 11 of the 87 declined to participate, for a response rate of 27.1% (n = 76). Most respondents (64 [84%]) completed the mail questionnaire. All the criteria for success were met. It is feasible to study medical end-of-life practices, even for practices that are currently illegal, including the intentional use of lethal drugs. Results from this pilot study support conducting a large national study, but additional strategies would be necessary to improve the response rate.

Validation of the FFM PD count technique for screening personality pathology in later middle-aged and older adults.

PubMed

Van den Broeck, Joke; Rossi, Gina; De Clercq, Barbara; Dierckx, Eva; Bastiaansen, Leen

2013-01-01

Research on the applicability of the five factor model (FFM) to capture personality pathology coincided with the development of a FFM personality disorder (PD) count technique, which has been validated in adolescent, young, and middle-aged samples. This study extends the literature by validating this technique in an older sample. Five alternative FFM PD counts based upon the Revised NEO Personality Inventory (NEO PI-R) are computed and evaluated in terms of both convergent and divergent validity with the Assessment of DSM-IV Personality Disorders Questionnaire (shortly ADP-IV; DSM-IV, Diagnostic and Statistical Manual of Mental Disorders - Fourth edition). For the best working count for each PD normative data are presented, from which cut-off scores are derived. The validity of these cut-offs and their usefulness as a screening tool is tested against both a categorical (i.e., the DSM-IV - Text Revision), and a dimensional (i.e., the Dimensional Assessment of Personality Pathology; DAPP) measure of personality pathology. All but the Antisocial and Obsessive-Compulsive counts exhibited adequate convergent and divergent validity, supporting the use of this method in older adults. Using the ADP-IV and the DAPP - Short Form as validation criteria, results corroborate the use of the FFM PD count technique to screen for PDs in older adults, in particular for the Paranoid, Borderline, Histrionic, Avoidant, and Dependent PDs. Given the age-neutrality of the NEO PI-R and the considerable lack of valid personality assessment tools, current findings appear to be promising for the assessment of pathology in older adults.

Measures of Readiness to Transition to Adult Health Care for Youth With Chronic Physical Health Conditions: A Systematic Review and Recommendations for Measurement Testing and Development

PubMed Central

Daniel, Lauren C.; Brumley, Lauren D.; Barakat, Lamia P.; Wesley, Kimberly M.; Tuchman, Lisa K.

2014-01-01

Objective Review measures of readiness to transition to adult-oriented care for youth with chronic physical health conditions. Methods Identified measures via online searches and reference lists and reviewed methods of development, theoretical underpinnings, characteristics, and psychometrics. Measures were classified according to American Psychological Association Division 54 Evidence-Based Assessment (EBA) Task Force criteria. Strengths and weaknesses of reviewed measures were described. Results 56 measures were identified, of which 10 met inclusion criteria for this review. 6 were disease specific and 4 were generic. Some psychometric properties were reported for each; none reported predictive validity for transition outcomes. According to EBA criteria, the 10 measures met criteria for “promising” assessment. Conclusions Measurement development in transition readiness is still an underdeveloped area. Measures require further testing and new measures are needed. Recommendations include testing measures with larger and diverse samples, ground measures in theory, test psychometrics, and involve multiple stakeholders in measure development. PMID:24891440

American College of Rheumatology provisional criteria for defining clinical inactive disease in select categories of juvenile idiopathic arthritis.

PubMed

Wallace, Carol A; Giannini, Edward H; Huang, Bin; Itert, Lukasz; Ruperto, Nicolino

2011-07-01

To prospectively validate the preliminary criteria for clinical inactive disease (CID) in patients with select categories of juvenile idiopathic arthritis (JIA). We used the process for development of classification and response criteria recommended by the American College of Rheumatology Quality of Care Committee. Patient-visit profiles were extracted from the phase III randomized controlled trial of infliximab in polyarticular-course JIA (i.e., patients considered to resemble those with select categories of JIA) and sent to an international group of expert physician raters. Using the physician ratings as the gold standard, the sensitivity and specificity were calculated using the preliminary criteria. Modifications to the criteria were made, and these were sent to a larger group of pediatric rheumatologists to determine quantitative, face, and content validity. Variables weighted heaviest by physicians when making their judgment were the number of joints with active arthritis, erythrocyte sedimentation rate (ESR), physician's global assessment, and duration of morning stiffness. Three modifications were made: the definition of uveitis, the definition of abnormal ESR, and the addition of morning stiffness. These changes did not alter the accuracy of the preliminary set. The modified criteria, termed the "criteria for CID in select categories of JIA," have excellent feasibility and face, content, criterion, and discriminant validity to detect CID in select categories of JIA. The small changes made to the preliminary criteria set did not alter the area under the receiver operating characteristic curve (0.954) or accuracy (91%), but have increased face and content validity. Copyright © 2011 by the American College of Rheumatology.

Mapping the EORTC QLQ-C30 onto the EQ-5D-3L: assessing the external validity of existing mapping algorithms.

PubMed

Doble, Brett; Lorgelly, Paula

2016-04-01

To determine the external validity of existing mapping algorithms for predicting EQ-5D-3L utility values from EORTC QLQ-C30 responses and to establish their generalizability in different types of cancer. A main analysis (pooled) sample of 3560 observations (1727 patients) and two disease severity patient samples (496 and 93 patients) with repeated observations over time from Cancer 2015 were used to validate the existing algorithms. Errors were calculated between observed and predicted EQ-5D-3L utility values using a single pooled sample and ten pooled tumour type-specific samples. Predictive accuracy was assessed using mean absolute error (MAE) and standardized root-mean-squared error (RMSE). The association between observed and predicted EQ-5D utility values and other covariates across the distribution was tested using quantile regression. Quality-adjusted life years (QALYs) were calculated using observed and predicted values to test responsiveness. Ten 'preferred' mapping algorithms were identified. Two algorithms estimated via response mapping and ordinary least-squares regression using dummy variables performed well on number of validation criteria, including accurate prediction of the best and worst QLQ-C30 health states, predicted values within the EQ-5D tariff range, relatively small MAEs and RMSEs, and minimal differences between estimated QALYs. Comparison of predictive accuracy across ten tumour type-specific samples highlighted that algorithms are relatively insensitive to grouping by tumour type and affected more by differences in disease severity. Two of the 'preferred' mapping algorithms suggest more accurate predictions, but limitations exist. We recommend extensive scenario analyses if mapped utilities are used in cost-utility analyses.

Simultaneous determination of dextromethorphan, dextrorphan, and guaifenesin in human plasma using semi-automated liquid/liquid extraction and gradient liquid chromatography tandem mass spectrometry.

PubMed

Eichhold, Thomas H; McCauley-Myers, David L; Khambe, Deepa A; Thompson, Gary A; Hoke, Steven H

2007-01-17

A method for the simultaneous determination of dextromethorphan (DEX), dextrorphan (DET), and guaifenesin (GG) in human plasma was developed, validated, and applied to determine plasma concentrations of these compounds in samples from six clinical pharmacokinetic (PK) studies. Semi-automated liquid handling systems were used to perform the majority of the sample manipulation including liquid/liquid extraction (LLE) of the analytes from human plasma. Stable-isotope-labeled analogues were utilized as internal standards (ISTDs) for each analyte to facilitate accurate and precise quantification. Extracts were analyzed using gradient liquid chromatography coupled with tandem mass spectrometry (LC-MS/MS). Use of semi-automated LLE with LC-MS/MS proved to be a very rugged and reliable approach for analysis of more than 6200 clinical study samples. The lower limit of quantification was validated at 0.010, 0.010, and 1.0 ng/mL of plasma for DEX, DET, and GG, respectively. Accuracy and precision of quality control (QC) samples for all three analytes met FDA Guidance criteria of +/-15% for average QC accuracy with coefficients of variation less than 15%. Data from the thorough evaluation of the method during development, validation, and application are presented to characterize selectivity, linearity, over-range sample analysis, accuracy, precision, autosampler carry-over, ruggedness, extraction efficiency, ionization suppression, and stability. Pharmacokinetic data are also provided to illustrate improvements in systemic drug and metabolite concentration-time profiles that were achieved by formulation optimization.

AFNOR validation of Premi Test, a microbiological-based screening tube-test for the detection of antimicrobial residues in animal muscle tissue.

PubMed

Gaudin, Valerie; Juhel-Gaugain, Murielle; Morétain, Jean-Pierre; Sanders, Pascal

2008-12-01

Premi Test contains viable spores of a strain of Bacillus stearothermophilus which is sensitive to antimicrobial residues, such as beta-lactams, tetracyclines, macrolides and sulphonamides. The growth of the strain is inhibited by the presence of antimicrobial residues in muscle tissue samples. Premi Test was validated according to AFNOR rules (French Association for Normalisation). The AFNOR validation was based on the comparison of reference methods (French Official method, i.e. four plate test (FPT) and the STAR protocol (five plate test)) with the alternative method (Premi Test). A preliminary study was conducted in an expert laboratory (Community Reference Laboratory, CRL) on both spiked and incurred samples (field samples). Several method performance criteria (sensitivity, specificity, relative accuracy) were estimated and are discussed, in addition to detection capabilities. Adequate agreement was found between the alternative method and the reference methods. However, Premi Test was more sensitive to beta-lactams and sulphonamides than the FPT. Subsequently, a collaborative study with 11 laboratories was organised by the CRL. Blank and spiked meat juice samples were sent to participants. The expert laboratory (CRL) statistically analysed the results. It was concluded that Premi Test could be used for the routine determination of antimicrobial residues in muscle of different animal origin with acceptable analytical performance. The detection capabilities of Premi Test for beta-lactams (amoxicillin, ceftiofur), one macrolide (tylosin) and tetracycline were at the level of the respective maximum residue limits (MRL) in muscle samples or even lower.

Screening criteria for increased susceptibility to heat stress during work or leisure in hot environments in healthy individuals aged 31-70 years.

PubMed

Flouris, Andreas D; McGinn, Ryan; Poirier, Martin P; Louie, Jeffrey C; Ioannou, Leonidas G; Tsoutsoubi, Lydia; Sigal, Ronald J; Boulay, Pierre; Hardcastle, Stephen G; Kenny, Glen P

2018-01-01

Population aging and global warming generate important public health risks, as older adults have increased susceptibility to heat stress (SHS). We defined and validated sex-specific screening criteria for SHS during work and leisure activities in hot environments in individuals aged 31-70 years using age, anthropometry, and cardiorespiratory fitness. A total of 123 males and 44 females [44 ± 14 years; 22.9 ± 7.4% body fat; 40.3 ± 8.6 peak oxygen uptake (mlO 2 /kg/min)] participated, separated into the Analysis (n = 111) and Validation (n = 56) groups. Within these groups, participants were categorized into YOUNG (19-30 years; n = 47) and OLDER (31-70 years; n = 120). All participants performed exercise in the heat inside a direct calorimeter. Screening criteria for OLDER participants were defined from the Analysis group and were cross-validated in the Validation group. Results showed that 30% of OLDER individuals in the Analysis group were screened as SHS positive. A total of 274 statistically valid (p < 0.05) criteria were identified suggesting that OLDER participants were at risk for SHS when demonstrating two or more of the following (males/females): age ≥ 53.0/55.8 years; body mass index ≥29.5/25.7 kg/m 2 ; body fat percentage ≥ 28.8/34.9; body surface area ≤2.0/1.7 m 2 ; peak oxygen uptake ≤48.3/41.4 mlO 2 /kg fat free mass/min. In the Validation group, McNemar χ 2 comparisons confirmed acceptable validity for the developed criteria. We conclude that the developed criteria can effectively screen individuals 31-70 years who are at risk for SHS during work and leisure activities in hot environments and can provide simple and effective means to mitigate the public health risks caused by heat exposure.

[Prefrontal clinical symptoms in daily living: screening assessment by means of the short Prefrontal Symptoms Inventory (PSI-20)].

PubMed

Pedrero-Pérez, Eduardo J; Ruiz-Sánchez de León, José M; Morales-Alonso, Sara; Pedrero-Aguilar, Jara; Fernández-Méndez, Laura M

2015-05-01

Estimation of daily symptoms of frontal dysfunction is considered to be essential in order to endow neuro-psychological assessments with ecological validity. The questionnaires available today were constructed to estimate executive problems in daily life in populations with neurological damage. There is a need for instruments focused on measuring these behaviours in the general population or in clinical populations with mild or moderate impairment. To examine the factorial validity and to find evidence of concurrent validity of the short version of the Prefrontal Symptoms Inventory. Three samples were obtained: the first, from the Internet (n = 504); the second, in a non-clinical population by means of paper and pencil (n = 1,257); and the third, from patients being treated for substance addiction (n = 602). A factorial analysis without restraints was used on the first sample and the results were submitted to confirmatory factorial analysis on the other two samples. The three-factor structure that was found was confirmed with excellent indicators of fit in the other two samples. Evidence of concurrent validity was found with quality of life and mental health tests. We propose a short questionnaire for detecting failures of a prefrontal origin in daily living, which improves on the psychometric qualities of similar tests, but is oriented towards severe neurological pathologies. The structural stability of the test ensures it can be used in the general population, for the early detection of cognitive impairment, and in clinical populations with mild or moderate deterioration. A set of criteria are proposed for use in interpreting the results.

An assessment of the schedule for schizotypal personalities and the DSM-III criteria for diagnosing schizotypal personality disorder.

PubMed

Perry, J C; O'Connell, M E; Drake, R

1984-11-01

The authors assessed the reliability and validity of the DSM-III criteria for schizotypal personality disorder (SPD) and their measurement by the Schedule for Schizotypal Personalities (SSP) developed by Baron. Additional criteria not in DSM-III were also explored. Consensual clinical ratings of videotaped interviews of subjects were used to validate item content of the SSP and the schizotypal diagnosis. The SSP assessments, with the exception of odd speech, were found to be reliable and valid. Higher cutoff scores than those recommended by Baron may be helpful in discriminating schizotypal from other psychiatric patients. Six of eight DSM-III criteria and all experimental criteria were highly specific for SPD cases but varied widely in their sensitivities. Based on these pilot data, the authors recommend combining all of the criteria into four conceptual categories: 1) self-report cognitive-perceptual disturbances, 2) observable disorders of thought and communication, 3) deficits in drive or affect, and 4) interpersonal difficulties. When three of these were required to make the SPD diagnosis, all of the subjects in the present data set were correctly identified.

Validity criteria for Fermi’s golden rule scattering rates applied to metallic nanowires

NASA Astrophysics Data System (ADS)

Moors, Kristof; Sorée, Bart; Magnus, Wim

2016-09-01

Fermi’s golden rule underpins the investigation of mobile carriers propagating through various solids, being a standard tool to calculate their scattering rates. As such, it provides a perturbative estimate under the implicit assumption that the effect of the interaction Hamiltonian which causes the scattering events is sufficiently small. To check the validity of this assumption, we present a general framework to derive simple validity criteria in order to assess whether the scattering rates can be trusted for the system under consideration, given its statistical properties such as average size, electron density, impurity density et cetera. We derive concrete validity criteria for metallic nanowires with conduction electrons populating a single parabolic band subjected to different elastic scattering mechanisms: impurities, grain boundaries and surface roughness.

Performance measures and criteria for hydrologic and water quality models

USDA-ARS?s Scientific Manuscript database

Performance measures and criteria are essential for model calibration and validation. This presentation will include a summary of one of the papers that will be included in the 2014 Hydrologic and Water Quality Model Calibration & Validation Guidelines Special Collection of the ASABE Transactions. T...

Identifying and measuring stakeholder preferences for disease prioritisation: A case study of the pig industry in Australia.

PubMed

Brookes, V J; Hernández-Jover, M; Neslo, R; Cowled, B; Holyoake, P; Ward, M P

2014-01-01

We describe stakeholder preference modelling using a combination of new and recently developed techniques to elicit criterion weights to incorporate into a multi-criteria decision analysis framework to prioritise exotic diseases for the pig industry in Australia. Australian pig producers were requested to rank disease scenarios comprising nine criteria in an online questionnaire. Parallel coordinate plots were used to visualise stakeholder preferences, which aided identification of two diverse groups of stakeholders - one group prioritised diseases with impacts on livestock, and the other group placed more importance on diseases with zoonotic impacts. Probabilistic inversion was used to derive weights for the criteria to reflect the values of each of these groups, modelling their choice using a weighted sum value function. Validation of weights against stakeholders' rankings for scenarios based on real diseases showed that the elicited criterion weights for the group who prioritised diseases with livestock impacts were a good reflection of their values, indicating that the producers were able to consistently infer impacts from the disease information in the scenarios presented to them. The highest weighted criteria for this group were attack rate and length of clinical disease in pigs, and market loss to the pig industry. The values of the stakeholders who prioritised zoonotic diseases were less well reflected by validation, indicating either that the criteria were inadequate to consistently describe zoonotic impacts, the weighted sum model did not describe stakeholder choice, or that preference modelling for zoonotic diseases should be undertaken separately from livestock diseases. Limitations of this study included sampling bias, as the group participating were not necessarily representative of all pig producers in Australia, and response bias within this group. The method used to elicit criterion weights in this study ensured value trade-offs between a range of potential impacts, and that the weights were implicitly related to the scale of measurement of disease criteria. Validation of the results of the criterion weights against real diseases - a step rarely used in MCDA - added scientific rigour to the process. The study demonstrated that these are useful techniques for elicitation of criterion weights for disease prioritisation by stakeholders who are not disease experts. Preference modelling for zoonotic diseases needs further characterisation in this context. Copyright © 2013 Elsevier B.V. All rights reserved.

Determination of Pass/Fail Criteria for Promoted Combustion Testing

NASA Technical Reports Server (NTRS)

Sparks, Kyle M.; Stoltzfus, Joel M.; Steinberg, Theodore A.; Lynn, David

2009-01-01

Promoted ignition testing is used to determine the relative flammability of metal rods in oxygen-enriched atmospheres. In these tests, a promoter is used to ignite each metal rod to start the sample burning. Experiments were performed to better understand the promoted ignition test by obtaining insight into the effect a burning promoter has on the preheating of a test sample. Test samples of several metallic materials were prepared and coupled to fast-responding thermocouples along their length. Various ignition promoters were used to ignite the test samples. The thermocouple measurements and test video was synchronized to determine temperature increase with respect to time and length along each test sample. A recommended length of test sample that must be consumed to be considered a flammable material was determined based on the preheated zone measured from these tests. This length was determined to be 30 mm (1.18 in.). Validation of this length and its rationale are presented.

Scene recognition based on integrating active learning with dictionary learning

NASA Astrophysics Data System (ADS)

Wang, Chengxi; Yin, Xueyan; Yang, Lin; Gong, Chengrong; Zheng, Caixia; Yi, Yugen

2018-04-01

Scene recognition is a significant topic in the field of computer vision. Most of the existing scene recognition models require a large amount of labeled training samples to achieve a good performance. However, labeling image manually is a time consuming task and often unrealistic in practice. In order to gain satisfying recognition results when labeled samples are insufficient, this paper proposed a scene recognition algorithm named Integrating Active Learning and Dictionary Leaning (IALDL). IALDL adopts projective dictionary pair learning (DPL) as classifier and introduces active learning mechanism into DPL for improving its performance. When constructing sampling criterion in active learning, IALDL considers both the uncertainty and representativeness as the sampling criteria to effectively select the useful unlabeled samples from a given sample set for expanding the training dataset. Experiment results on three standard databases demonstrate the feasibility and validity of the proposed IALDL.

An Experimental Study of the Internal Consistency of Judgments Made in Bookmark Standard Setting

ERIC Educational Resources Information Center

Clauser, Brian E.; Baldwin, Peter; Margolis, Melissa J.; Mee, Janet; Winward, Marcia

2017-01-01

Validating performance standards is challenging and complex. Because of the difficulties associated with collecting evidence related to external criteria, validity arguments rely heavily on evidence related to internal criteria--especially evidence that expert judgments are internally consistent. Given its importance, it is somewhat surprising…

Validity of Evidence-Derived Criteria for Reactive Attachment Disorder: Indiscriminately Social/Disinhibited and Emotionally Withdrawn/Inhibited Types

ERIC Educational Resources Information Center

Gleason, Mary Margaret; Fox, Nathan A.; Drury, Stacy; Smyke, Anna; Egger, Helen L.; Nelson, Charles A., III; Gregas, Matthew C.; Zeanah, Charles H.

2011-01-01

Objective: This study examined the validity of criteria for indiscriminately social/disinhibited and emotionally withdrawn/inhibited reactive attachment disorder (RAD). Method: As part of a longitudinal intervention trial of previously institutionalized children, caregiver interviews and direct observational measurements provided continuous and…

Postcraniometric sex and ancestry estimation in South Africa: a validation study.

PubMed

Liebenberg, Leandi; Krüger, Gabriele C; L'Abbé, Ericka N; Stull, Kyra E

2018-05-24

With the acceptance of the Daubert criteria as the standards for best practice in forensic anthropological research, more emphasis is being placed on the validation of published methods. Methods, both traditional and novel, need to be validated, adjusted, and refined for optimal performance within forensic anthropological analyses. Recently, a custom postcranial database of modern South Africans was created for use in Fordisc 3.1. Classification accuracies of up to 85% for ancestry estimation and 98% for sex estimation were achieved using a multivariate approach. To measure the external validity and report more realistic performance statistics, an independent sample was tested. The postcrania from 180 black, white, and colored South Africans were measured and classified using the custom postcranial database. A decrease in accuracy was observed for both ancestry estimation (79%) and sex estimation (95%) of the validation sample. When incorporating both sex and ancestry simultaneously, the method achieved 70% accuracy, and 79% accuracy when sex-specific ancestry analyses were run. Classification matrices revealed that postcrania were more likely to misclassify as a result of ancestry rather than sex. While both sex and ancestry influence the size of an individual, sex differences are more marked in the postcranial skeleton and are therefore easier to identify. The external validity of the postcranial database was verified and therefore shown to be a useful tool for forensic casework in South Africa. While the classification rates were slightly lower than the original method, this is expected when a method is generalized.

Evaluation of clinical measurements and development of new diagnostic criteria for Takayasu arteritis in a Chinese population.

PubMed

Kong, X; Ma, L; Wu, L; Chen, H; Ma, L; Sun, Y; Wu, W; Ji, Z; Zhang, Z; Yang, C; Ye, S; Chen, S; Dai, S; Xue, Y; Qin, G; Zou, Y; Yu, Q; Jiang, L

2015-01-01

Takayasu arteritis (TA) is a chronic granulomatous large-vessel vasculitis. When diagnosing TA, the criteria designed by the American College of Rheumatology (ACR) are used commonly but they were just classification criteria. There is an urgent need for a new set of diagnostic criteria. One hundred and thirty-one TA patients and 132 control patients with other types of vascular disease were enrolled and both groups were distributed into a "training set" and a "validation set". All general information as well as clinical, laboratory and imaging data were collected. After comparing all the medical records of two groups in the training set, logistic regression and clinical judgment were used to form the new criteria for TA. The new criteria were tested by the validation set. New TA diagnostic criteria within total score 26 include age (<40 years), female, chest pain/chest distress, amaurosis, vascular bruits, a decreased/absent pulse, involvement of the aortic arch or its major branches, and involvement of the abdominal aorta or its branches. Patients with a score ≥ 8 were diagnosed as TA. The sensitivity and specificity of our new criteria were 91.92% and 93.94%, respectively, higher than those of the ACR criteria (75.76%, 85.86%) and the Ishikawa criteria (56.57%, 94.95%). The areas under the ROC curves of the new criteria and ACR criteria were 0.981 and 0.868, respectively (p<0.001). Sensitivity and specificity tested in the validation set were 90.63% and 96.97%, respectively. The new diagnostic criteria exhibited high sensitivity and specificity and have demonstrated to be feasible in the diagnosis of TA.

A systematic review of diagnostic criteria for psoriasis in adults and children: evidence from studies with a primary aim to develop or validate diagnostic criteria.

PubMed

Burden-Teh, E; Phillips, R C; Thomas, K S; Ratib, S; Grindlay, D; Murphy, R

2017-11-06

The diagnosis of psoriasis in adults and children is made clinically, for both patient management and the selection of participants in research. Diagnostic criteria provide a structure for clinical assessment, which in turn helps standardize patient recruitment into clinical trials and case definitions in observational studies. The aim of this systematic review was to identify and critically appraise the published studies to date that had a primary research aim to develop or validate diagnostic criteria for psoriasis. A search of Ovid MEDLINE and Ovid Embase was conducted in October 2016. The primary objective was to record the sensitivity and specificity of diagnostic criteria for psoriasis. Secondary objectives included diagnostic recommendations, applicability to children and study characteristics. Diagnostic accuracy studies were critically appraised for risk of bias using the QUADAS-2 tool. Twenty-three studies met the inclusion criteria. None detailed clinical examination-based diagnostic criteria. The included criteria varied from genetic and molecular diagnostic models to skin imaging, histopathology, and questionnaire-based, computer-aided and traditional Chinese medicine criteria. High sensitivity and specificity (> 90%) were reported in many studies. However, the study authors often did not specify how the criteria would be used clinically or in research. This review identified studies with varying risk of bias, and due to each study developing separate criteria meta-analysis was not possible. Clinical examination-based diagnostic criteria are currently lacking for psoriasis. Future research could follow an international collaborative approach and employ study designs allowing high-quality diagnostic accuracy testing. Existing and newly developed criteria require validation. © 2017 British Association of Dermatologists.

Validation of the classification criteria commonly used in Korea and a modified set of preliminary criteria for Behçet's disease: a multi-center study.

PubMed

Chang, H K; Lee, S S; Bai, H J; Lee, Y W; Yoon, B Y; Lee, C H; Lee, Y H; Song, G G; Chung, W T; Lee, S W; Choe, J Y; Kim, C G; Chang, D K

2004-01-01

Recently we have proposed a modified set of criteria to settle the questions raised regarding the International Study Group (ISG) criteria for Behçet's disease (BD). The aim of the present study was to validate the two pre-existing criteria sets commonly used in Korea, the ISG criteria and the criteria of the Behçet's Disease Research Committee of Japan (Japanese criteria), as well as the proposed modified criteria. The study population included 155 consecutive patients with BD and 170 controls with non-Behçet's rheumatic diseases. Detailed data for all of the subjects were recorded prospectively by the participating physicians on a standard form that listed the clinical features of BD. The sensitivity, specificity, and accuracy of each set of the criteria were measured. Of the three criteria sets employed, the modified criteria were the most accurate, with an accuracy of 96.3%. The ISG criteria often failed to classify the following patients with BD: patients with only oral and genital ulcerations, certain patients with intestinal ulcerations, patients who did not manifest oral ulcerations, and patients with acute disease but fewer than three recurrent oral ulceration relapses in a 1-year period. The Japanese criteria also failed to categorize the following patients with BD: patients with oral and genital ulcerations, and patients with oral ulcerations, skin lesions, and a positive pathergy reaction. In addition, the Japanese criteria misclassified some of the control subjects with non-Behçet's uveitis as having BD. The results of this study suggest that there are some points that need to be reconsidered in the clinical application of the two pre-existing sets of criteria. Although the modified criteria were the most accurate, further validation studies will be required in other ethnic populations.

Identifying and prioritizing the preference criteria using analytical hierarchical process for a student-lecturer allocation problem of internship programme

NASA Astrophysics Data System (ADS)

Faudzi, Syakinah; Abdul-Rahman, Syariza; Rahman, Rosshairy Abd; Hew, Jafri Hj. Zulkepli

2016-10-01

This paper discusses on identifying and prioritizing the student's preference criteria towards supervisor using Analytical Hierarchical Process (AHP) for student-lecturer allocation problem of internship programme. Typically a wide number of students undertake internship every semester and many preferences criteria may involve when assigning students to lecturer for supervision. Thus, identifying and prioritizing the preference criteria of assigning students to lecturer is critically needed especially when involving many preferences. AHP technique is used to prioritize the seven criteria which are capacity, specialization, academic position, availability, professional support, relationship and gender. Student's preference alternative is classified based on lecturer's academic position which are lecturer, senior lecturer, associate professor and professor. Criteria are ranked to find the best preference criteria and alternatives of the supervisor that students prefer to have. This problem is solved using Expert Choice 11 software. A sample of 30 respondents who are from semester 6 and above are randomly selected to participate in the study. By using questionnaire as our medium in collecting the student's data, consistency index is produced to validate the proposed study. Findings and result showed that, the most important preference criteria is professional support. It is followed by specialization, availability, relationship, gender, academic position and capacity. This study found that student would like to have a supportive supervisor because lack of supervision can lead the students to achieve low grade and knowledge from the internship session.

Seizures in the elderly: development and validation of a diagnostic algorithm.

PubMed

Dupont, Sophie; Verny, Marc; Harston, Sandrine; Cartz-Piver, Leslie; Schück, Stéphane; Martin, Jennifer; Puisieux, François; Alecu, Cosmin; Vespignani, Hervé; Marchal, Cécile; Derambure, Philippe

2010-05-01

Seizures are frequent in the elderly, but their diagnosis can be challenging. The objective of this work was to develop and validate an expert-based algorithm for the diagnosis of seizures in elderly people. A multidisciplinary group of neurologists and geriatricians developed a diagnostic algorithm using a combination of selected clinical, electroencephalographical and radiological criteria. The algorithm was validated by multicentre retrospective analysis of data of patients referred for specific symptoms and classified by the experts as epileptic patients or not. The algorithm was applied to all the patients, and the diagnosis provided by the algorithm was compared to the clinical diagnosis of the experts. Twenty-nine clinical, electroencephalographical and radiological criteria were selected for the algorithm. According to criteria combination, seizures were classified in four levels of diagnosis: certain, highly probable, possible or improbable. To validate the algorithm, the medical records of 269 elderly patients were analyzed (138 with epileptic seizures, 131 with non-epileptic manifestations). Patients were mainly referred for a transient focal deficit (40%), confusion (38%), unconsciousness (27%). The algorithm best classified certain and probable seizures versus possible and improbable seizures, with 86.2% sensitivity and 67.2% specificity. Using logistical regression, 2 simplified models were developed, the first with 13 criteria (Se 85.5%, Sp 90.1%), and the second with 7 criteria only (Se 84.8%, Sp 88.6%). In conclusion, the present study validated the use of a revised diagnostic algorithm to help diagnosis epileptic seizures in the elderly. A prospective study is planned to further validate this algorithm. Copyright 2010 Elsevier B.V. All rights reserved.

Evaluation of the psychometric properties of the PROMIS Cancer Fatigue Short Form with cancer patients.

PubMed

Cessna, Julie M; Jim, Heather S L; Sutton, Steven K; Asvat, Yasmin; Small, Brent J; Salsman, John M; Zachariah, Babu; Fishman, Mayer; Field, Teresa; Fernandez, Hugo; Perez, Lia; Jacobsen, Paul B

2016-02-01

Fatigue is common among cancer patients and adversely impacts quality of life. As such, it is important to measure fatigue accurately in a way that is not burdensome to patients. The 7-item Patient Reported Outcome Measurement Information System (PROMIS) Cancer Fatigue Short Form scale was recently developed using item response theory (IRT). The current study evaluated the psychometric properties of this scale in two samples of cancer patients using classical test theory (CTT). Two samples were used: 121 men with prostate cancer and 136 patients scheduled to undergo hematopoietic cell transplantation (HCT) for hematologic cancer. All participants completed the PROMIS Cancer Fatigue Short Form as well as validated measures of fatigue, vitality, and depression. HCT patients also completed measures of anxiety, perceived stress, and a clinical interview designed to identify cases of cancer-related fatigue. PROMIS Cancer Fatigue Short Form items loaded on a single factor (CFI=0.948) and the scale demonstrated good internal consistency reliability in both samples (Cronbach's alphas>0.86). Correlations with psychosocial measures were significant (p values<.0001) and in the expected direction, offering evidence for convergent and concurrent validity. PROMIS Fatigue scores were significantly higher in patients who met case definition criteria for cancer-related fatigue (p<.0001), demonstrating criterion validity. The current study provides evidence that the PROMIS Cancer Fatigue Short Form is a reliable and valid measure of fatigue in cancer patients. Copyright © 2015 Elsevier Inc. All rights reserved.

Validation and long-term evaluation of a modified on-line chiral analytical method for therapeutic drug monitoring of (R,S)-methadone in clinical samples.

PubMed

Ansermot, Nicolas; Rudaz, Serge; Brawand-Amey, Marlyse; Fleury-Souverain, Sandrine; Veuthey, Jean-Luc; Eap, Chin B

2009-08-01

Matrix effects, which represent an important issue in liquid chromatography coupled to mass spectrometry or tandem mass spectrometry detection, should be closely assessed during method development. In the case of quantitative analysis, the use of stable isotope-labelled internal standard with physico-chemical properties and ionization behaviour similar to the analyte is recommended. In this paper, an example of the choice of a co-eluting deuterated internal standard to compensate for short-term and long-term matrix effect in the case of chiral (R,S)-methadone plasma quantification is reported. The method was fully validated over a concentration range of 5-800 ng/mL for each methadone enantiomer with satisfactory relative bias (-1.0 to 1.0%), repeatability (0.9-4.9%) and intermediate precision (1.4-12.0%). From the results obtained during validation, a control chart process during 52 series of routine analysis was established using both intermediate precision standard deviation and FDA acceptance criteria. The results of routine quality control samples were generally included in the +/-15% variability around the target value and mainly in the two standard deviation interval illustrating the long-term stability of the method. The intermediate precision variability estimated in method validation was found to be coherent with the routine use of the method. During this period, 257 trough concentration and 54 peak concentration plasma samples of patients undergoing (R,S)-methadone treatment were successfully analysed for routine therapeutic drug monitoring.

Evaluation of the Psychometric Properties of the PROMIS Cancer Fatigue Short Form with Cancer Patients

PubMed Central

Cessna, Julie M.; Jim, Heather S.L.; Sutton, Steven K.; Asvat, Yasmin; Small, Brent J.; Salsman, John M.; Zachariah, Babu; Fishman, Mayer; Field, Teresa; Fernandez, Hugo; Perez, Lia; Jacobsen, Paul B.

2016-01-01

Objective Fatigue is common among cancer patients and adversely impacts quality of life. As such, it is important to measure fatigue accurately in a way that is not burdensome to patients. The 7-item Patient Reported Outcome Measurement Information System (PROMIS) Cancer Fatigue Short Form scale was recently developed using item response theory (IRT). The current study evaluated the psychometric properties of this scale in two samples of cancer patients using classical test theory (CTT). Methods Two samples were used: 121 men with prostate cancer and 136 patients scheduled to undergo hematopoietic cell transplantation (HCT) for hematologic cancer. All participants completed the PROMIS Cancer Fatigue Short Form as well as validated measures of fatigue, vitality, and depression. HCT patients also completed measures of anxiety, perceived stress, and a clinical interview designed to identify cases of cancer -related fatigue. Results PROMIS Cancer Fatigue Short Form items loaded on a single factor (CFI = 0.948) and the scale demonstrated good internal consistency reliability in both samples (Cronbach’s alphas > 0.86). Correlations with psychosocial measures were significant (p-values < .0001) and in the expected direction, offering evidence for convergent and concurrent validity. PROMIS Fatigue scores were significantly higher in patients who met case definition criteria for cancer-related fatigue (p < .0001), demonstrating criterion validity. Conclusion The current study provides evidence that the PROMIS Cancer Fatigue Short Form is a reliable and valid measure of fatigue in cancer patients. PMID:26800633

Association between the MMPI-2 restructured form (MMPI-2-RF) and malingered neurocognitive dysfunction among non-head injury disability claimants.

PubMed

Tarescavage, Anthony M; Wygant, Dustin B; Gervais, Roger O; Ben-Porath, Yossef S

2013-01-01

The current study examined the over-reporting Validity Scales of the MMPI-2 Restructured Form (MMPI-2-RF; Ben-Porath & Tellegen, 2008/2011) in relation to the Slick, Sherman, and Iverson (1999) criteria for the diagnosis of Malingered Neurocognitive Dysfunction in a sample of 916 consecutive non-head injury disability claimants. The classification of Malingered Neurocognitive Dysfunction was based on scores from several cognitive symptom validity tests and response bias indicators built into traditional neuropsychological tests. Higher scores on MMPI-2-RF Validity Scales, particularly the Response Bias Scale (Gervais, Ben-Porath, Wygant, & Green, 2007), were associated with probable and definite Malingered Neurocognitive Dysfunction. The MMPI-2-RF's Validity Scales classification accuracy of Malingered Neurocognitive Dysfunction improved when multiple scales were interpreted. Additionally, higher scores on MMPI-2-RF substantive scales measuring distress, internalizing dysfunction, thought dysfunction, and social avoidance were associated with probable and definite Malingered Neurocognitive Dysfunction. Implications for clinical practice and future directions are noted.

Application of the Modified Erikson Psychosocial Stage Inventory: 25 Years in Review.

PubMed

Darling-Fisher, Cynthia S

2018-04-01

The Modified Erikson Psychosocial Stage Inventory (MEPSI) is an 80-item, comprehensive measure of psychosocial development based on Erikson's theory with published reliability and validity data. Although designed as a comprehensive measure, some researchers have used individual subscales for specific developmental stages as a measure; however, these subscale reliability scores have not been generally shared. This article reviewed the literature to evaluate the use of the MEPSI: the major research questions, samples/populations studied, and individual subscale and total reliability and validity data. In total, 16 research articles (1990-2011) and 28 Dissertations/Theses (1991-2016) from nursing, social work, psychology, criminal justice, and religious studies met criteria. Results support the MEPSI's global reliability (aggregate scores ranged .89-.99) and validity in terms of consistent patterns of changes observed in the predicted direction. Reliability and validity data for individual subscales were more variable. Limitations of the tool and recommendations for possible revision and future research are addressed.

Is First-Order Vector Autoregressive Model Optimal for fMRI Data?

PubMed

Ting, Chee-Ming; Seghouane, Abd-Krim; Khalid, Muhammad Usman; Salleh, Sh-Hussain

2015-09-01

We consider the problem of selecting the optimal orders of vector autoregressive (VAR) models for fMRI data. Many previous studies used model order of one and ignored that it may vary considerably across data sets depending on different data dimensions, subjects, tasks, and experimental designs. In addition, the classical information criteria (IC) used (e.g., the Akaike IC (AIC)) are biased and inappropriate for the high-dimensional fMRI data typically with a small sample size. We examine the mixed results on the optimal VAR orders for fMRI, especially the validity of the order-one hypothesis, by a comprehensive evaluation using different model selection criteria over three typical data types--a resting state, an event-related design, and a block design data set--with varying time series dimensions obtained from distinct functional brain networks. We use a more balanced criterion, Kullback's IC (KIC) based on Kullback's symmetric divergence combining two directed divergences. We also consider the bias-corrected versions (AICc and KICc) to improve VAR model selection in small samples. Simulation results show better small-sample selection performance of the proposed criteria over the classical ones. Both bias-corrected ICs provide more accurate and consistent model order choices than their biased counterparts, which suffer from overfitting, with KICc performing the best. Results on real data show that orders greater than one were selected by all criteria across all data sets for the small to moderate dimensions, particularly from small, specific networks such as the resting-state default mode network and the task-related motor networks, whereas low orders close to one but not necessarily one were chosen for the large dimensions of full-brain networks.

Mindfulness, burnout, and effects on performance evaluations in internal medicine residents

PubMed Central

Braun, Sarah E; Auerbach, Stephen M; Rybarczyk, Bruce; Lee, Bennett; Call, Stephanie

2017-01-01

Purpose Burnout has been documented at high levels in medical residents with negative effects on performance. Some dispositional qualities, like mindfulness, may protect against burnout. The purpose of the present study was to assess burnout prevalence among internal medicine residents at a single institution, examine the relationship between mindfulness and burnout, and provide preliminary findings on the relation between burnout and performance evaluations in internal medicine residents. Methods Residents (n = 38) completed validated measures of burnout at three time points separated by 2 months and a validated measure of dispositional mindfulness at baseline. Program director end-of-year performance evaluations were also obtained on 22 milestones used to evaluate internal medicine resident performance; notably, these milestones have not yet been validated for research purposes; therefore, the investigation here is exploratory. Results Overall, 71.1% (n = 27) of the residents met criteria for burnout during the study. Lower scores on the “acting with awareness” facet of dispositional mindfulness significantly predicted meeting burnout criteria χ2(5) = 11.88, p = 0.04. Lastly, meeting burnout criteria significantly predicted performance on three of the performance milestones, with positive effects on milestones from the “system-based practices” and “professionalism” domains and negative effects on a milestone from the “patient care” domain. Conclusion Burnout rates were high in this sample of internal medicine residents and rates were consistent with other reports of burnout during medical residency. Dispositional mindfulness was supported as a protective factor against burnout. Importantly, results from the exploratory investigation of the relationship between burnout and resident evaluations suggested that burnout may improve performance on some domains of resident evaluations while compromising performance on other domains. Implications and directions for future research are discussed. PMID:28860889

The Cervical Dystonia Impact Profile (CDIP-58): Can a Rasch developed patient reported outcome measure satisfy traditional psychometric criteria?

PubMed Central

Cano, Stefan J; Warner, Thomas T; Thompson, Alan J; Bhatia, Kailash P; Fitzpatrick, Ray; Hobart, Jeremy C

2008-01-01

Background The United States Food and Drug Administration (FDA) are currently producing guidelines for the scientific adequacy of patient reported outcome measures (PROMs) in clinical trials, which will have implications for the selection of scales used in future clinical trials. In this study, we examine how the Cervical Dystonia Impact Profile (CDIP-58), a rigorous Rasch measurement developed neurologic PROM, stands up to traditional psychometric criteria for three reasons: 1) provide traditional psychometric evidence for the CDIP-58 in line with proposed FDA guidelines; 2) enable researchers and clinicians to compare it with existing dystonia PROMs; and 3) help researchers and clinicians bridge the knowledge gap between old and new methods of reliability and validity testing. Methods We evaluated traditional psychometric properties of data quality, scaling assumptions, targeting, reliability and validity in a group of 391 people with CD. The main outcome measures used were the CDIP-58, Medical Outcome Study Short Form-36, the 28-item General Health Questionnaire, and Hospital and Anxiety and Depression Scale. Results A total of 391 people returned completed questionnaires (corrected response rate 87%). Analyses showed: 1) data quality was high (low missing data ≤ 4%, subscale scores could be computed for > 96% of the sample); 2) item groupings passed tests for scaling assumptions; 3) good targeting (except for the Sleep subscale, ceiling effect = 27%); 4) good reliability (Cronbach's alpha ≥ 0.92, test-retest intraclass correlations ≥ 0.83); and 5) validity was supported. Conclusion This study has shown that new psychometric methods can produce a PROM that stands up to traditional criteria and supports the clinical advantages of Rasch analysis. PMID:18684327

The cervical dystonia impact profile (CDIP-58): can a Rasch developed patient reported outcome measure satisfy traditional psychometric criteria?

PubMed

Cano, Stefan J; Warner, Thomas T; Thompson, Alan J; Bhatia, Kailash P; Fitzpatrick, Ray; Hobart, Jeremy C

2008-08-06

The United States Food and Drug Administration (FDA) are currently producing guidelines for the scientific adequacy of patient reported outcome measures (PROMs) in clinical trials, which will have implications for the selection of scales used in future clinical trials. In this study, we examine how the Cervical Dystonia Impact Profile (CDIP-58), a rigorous Rasch measurement developed neurologic PROM, stands up to traditional psychometric criteria for three reasons: 1) provide traditional psychometric evidence for the CDIP-58 in line with proposed FDA guidelines; 2) enable researchers and clinicians to compare it with existing dystonia PROMs; and 3) help researchers and clinicians bridge the knowledge gap between old and new methods of reliability and validity testing. We evaluated traditional psychometric properties of data quality, scaling assumptions, targeting, reliability and validity in a group of 391 people with CD. The main outcome measures used were the CDIP-58, Medical Outcome Study Short Form-36, the 28-item General Health Questionnaire, and Hospital and Anxiety and Depression Scale. A total of 391 people returned completed questionnaires (corrected response rate 87%). Analyses showed: 1) data quality was high (low missing data < or = 4%, subscale scores could be computed for > 96% of the sample); 2) item groupings passed tests for scaling assumptions; 3) good targeting (except for the Sleep subscale, ceiling effect = 27%); 4) good reliability (Cronbach's alpha > or = 0.92, test-retest intraclass correlations > or = 0.83); and 5) validity was supported. This study has shown that new psychometric methods can produce a PROM that stands up to traditional criteria and supports the clinical advantages of Rasch analysis.

Validation of the French Version of the DSM-5 Yale Food Addiction Scale in a Nonclinical Sample

PubMed Central

Courtois, Robert; Gearhardt, Ashley N.; Gaillard, Philippe; Journiac, Kevin; Cathelain, Sarah; Réveillère, Christian; Ballon, Nicolas

2016-01-01

Objective: The Yale Food Addiction Scale (YFAS) is the only questionnaire that assesses food addiction (FA) based on substance dependence criteria in the Diagnostic and Statistical Manual of Mental Disorders (DSM), Fourth Edition, Text Revision. Following recent updating of addiction criteria, a new DSM-5 version (YFAS 2.0) has been developed. Our study tested the psychometric properties of the French YFAS 2.0 in a nonclinical population. Method: We assessed 330 nonclinical participants for FA (French YFAS 2.0), eating behaviour, and eating disorder (Binge Eating Scale, Emotional Overeating Questionnaire, Three-Factor Eating Questionnaire-R18, Questionnaire on Eating and Weight Patterns-Revised, Eating Disorder Diagnostic Scale). We tested the scale’s factor structure (confirmatory factor analysis based on 11 diagnostic criteria), internal consistency, and construct and incremental validity. Results: Prevalence of FA was 8.2%. Our results supported a 1-factor structure similar to the US version. In both its diagnostic and symptom count versions, the YFAS 2.0 had good internal consistency (Kuder-Richardson alpha was 0.83) and was associated with body mass index (BMI), binge eating, uncontrolled and emotional eating, binge eating disorder, and cognitive restraint. FA predicted BMI above and beyond binge eating frequency. Females had a higher prevalence of FA than males but not more FA symptoms. Conclusions: We validated a psychometrically sound French version of the YFAS 2.0 in a nonclinical population, in both its symptom count and diagnostic versions. Future studies should investigate psychometric properties of this questionnaire in clinical populations potentially at risk for FA (that is, patients with obesity, diabetes, hypertension, or other metabolic syndrome risk factors). PMID:28212499

Mindfulness, burnout, and effects on performance evaluations in internal medicine residents.

PubMed

Braun, Sarah E; Auerbach, Stephen M; Rybarczyk, Bruce; Lee, Bennett; Call, Stephanie

2017-01-01

Burnout has been documented at high levels in medical residents with negative effects on performance. Some dispositional qualities, like mindfulness, may protect against burnout. The purpose of the present study was to assess burnout prevalence among internal medicine residents at a single institution, examine the relationship between mindfulness and burnout, and provide preliminary findings on the relation between burnout and performance evaluations in internal medicine residents. Residents (n = 38) completed validated measures of burnout at three time points separated by 2 months and a validated measure of dispositional mindfulness at baseline. Program director end-of-year performance evaluations were also obtained on 22 milestones used to evaluate internal medicine resident performance; notably, these milestones have not yet been validated for research purposes; therefore, the investigation here is exploratory. Overall, 71.1% (n = 27) of the residents met criteria for burnout during the study. Lower scores on the "acting with awareness" facet of dispositional mindfulness significantly predicted meeting burnout criteria χ 2 (5) = 11.88, p = 0.04. Lastly, meeting burnout criteria significantly predicted performance on three of the performance milestones, with positive effects on milestones from the "system-based practices" and "professionalism" domains and negative effects on a milestone from the "patient care" domain. Burnout rates were high in this sample of internal medicine residents and rates were consistent with other reports of burnout during medical residency. Dispositional mindfulness was supported as a protective factor against burnout. Importantly, results from the exploratory investigation of the relationship between burnout and resident evaluations suggested that burnout may improve performance on some domains of resident evaluations while compromising performance on other domains. Implications and directions for future research are discussed.

Validation of the French Version of the DSM-5 Yale Food Addiction Scale in a Nonclinical Sample.

PubMed

Brunault, Paul; Courtois, Robert; Gearhardt, Ashley N; Gaillard, Philippe; Journiac, Kevin; Cathelain, Sarah; Réveillère, Christian; Ballon, Nicolas

2017-03-01

The Yale Food Addiction Scale (YFAS) is the only questionnaire that assesses food addiction (FA) based on substance dependence criteria in the Diagnostic and Statistical Manual of Mental Disorders (DSM), Fourth Edition, Text Revision. Following recent updating of addiction criteria, a new DSM-5 version (YFAS 2.0) has been developed. Our study tested the psychometric properties of the French YFAS 2.0 in a nonclinical population. We assessed 330 nonclinical participants for FA (French YFAS 2.0), eating behaviour, and eating disorder (Binge Eating Scale, Emotional Overeating Questionnaire, Three-Factor Eating Questionnaire-R18, Questionnaire on Eating and Weight Patterns-Revised, Eating Disorder Diagnostic Scale). We tested the scale's factor structure (confirmatory factor analysis based on 11 diagnostic criteria), internal consistency, and construct and incremental validity. Prevalence of FA was 8.2%. Our results supported a 1-factor structure similar to the US version. In both its diagnostic and symptom count versions, the YFAS 2.0 had good internal consistency (Kuder-Richardson alpha was 0.83) and was associated with body mass index (BMI), binge eating, uncontrolled and emotional eating, binge eating disorder, and cognitive restraint. FA predicted BMI above and beyond binge eating frequency. Females had a higher prevalence of FA than males but not more FA symptoms. We validated a psychometrically sound French version of the YFAS 2.0 in a nonclinical population, in both its symptom count and diagnostic versions. Future studies should investigate psychometric properties of this questionnaire in clinical populations potentially at risk for FA (that is, patients with obesity, diabetes, hypertension, or other metabolic syndrome risk factors).

Impact of applying the more stringent validation criteria of the revised European Society of Hypertension International Protocol 2010 on earlier validation studies.

PubMed

Stergiou, George S; Karpettas, Nikos; Atkins, Neil; O'Brien, Eoin

2011-04-01

Since 2002 when the European Society of Hypertension International Protocol (ESH-IP) was published it has become the preferred protocol for validating blood pressure monitors worldwide. In 2010, a revised version of the ESH-IP with more stringent criteria was published. This study assesses the impact of applying the revised ESH-IP criteria. A systematic literature review of ESH-IP studies reported between 2002 and 2010 was conducted. The impact of applying the ESH-IP 2010 criteria retrospectively on the data reported in these studies was investigated. The performance of the oscillometric devices in the last decade was also investigated on the basis of the ESH-IP criteria. Among 119 published studies, 112 with sufficient data were analyzed. According to ESH-IP 2002, the test device failed in 19 studies, whereas by applying the ESH-IP 2010 criteria in 28 additional studies increased the failure rate from 17 to 42%. Of these 28 studies, in 20 (71%) the test device failed at part 1 (accuracy per measurement) and in 22 (79%) at part 2 (accuracy per subject). Most of the failures involved the '5 mmHg or less' criterion. In the last decade there has been a consistent trend toward improved performance of oscillometric devices assessed on the basis of the ESH-IP criteria. This retrospective analysis shows that the stricter revised ESH-IP 2010 criteria will noticeably increase the failure rate of devices being validated. Oscillometric devices are becoming more accurate, and the revised ESH-IP by acknowledging this trend will allow more accurate devices to enter the market.

The International Criteria for Behçet's Disease (ICBD): a collaborative study of 27 countries on the sensitivity and specificity of the new criteria.

PubMed

2014-03-01

Behçet's disease (BD) is a chronic, relapsing, inflammatory vascular disease with no pathognomonic test. Low sensitivity of the currently applied International Study Group (ISG) clinical diagnostic criteria led to their reassessment. An International Team for the Revision of the International Criteria for BD (from 27 countries) submitted data from 2556 clinically diagnosed BD patients and 1163 controls with BD-mimicking diseases or presenting at least one major BD sign. These were randomly divided into training and validation sets. Logistic regression, 'leave-one-country-out' cross-validation and clinical judgement were employed to develop new International Criteria for BD (ICBD) with the training data. Existing and new criteria were tested for their performance in the validation set. For the ICBD, ocular lesions, oral aphthosis and genital aphthosis are each assigned 2 points, while skin lesions, central nervous system involvement and vascular manifestations 1 point each. The pathergy test, when used, was assigned 1 point. A patient scoring ≥4 points is classified as having BD. In the training set, 93.9% sensitivity and 92.1% specificity were assessed compared with 81.2% sensitivity and 95.9% specificity for the ISG criteria. In the validation set, ICBD demonstrated an unbiased estimate of sensitivity of 94.8% (95% CI: 93.4-95.9%), considerably higher than that of the ISG criteria (85.0%). Specificity (90.5%, 95% CI: 87.9-92.8%) was lower than that of the ISG-criteria (96.0%), yet still reasonably high. For countries with at least 90%-of-cases and controls having a pathergy test, adding 1 point for pathergy test increased the estimate of sensitivity from 95.5% to 98.5%, while barely reducing specificity from 92.1% to 91.6%. The new proposed criteria derived from multinational data exhibits much improved sensitivity over the ISG criteria while maintaining reasonable specificity. It is proposed that the ICBD criteria to be adopted both as a guide for diagnosis and classification of BD. © 2013 The Authors Journal of the European Academy of Dermatology and Venereology © 2013 European Academy of Dermatology and Venereology.

Validation of the French version of the yale food addiction scale: an examination of its factor structure, reliability, and construct validity in a nonclinical sample.

PubMed

Brunault, Paul; Ballon, Nicolas; Gaillard, Philippe; Réveillère, Christian; Courtois, Robert

2014-05-01

The concept of food addiction has recently been proposed by applying the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision, criteria for substance dependence to eating behaviour. Food addiction has received increased attention given that it may play a role in binge eating, eating disorders, and the recent increase in obesity prevalence. Currently, there is no psychometrically sound tool for assessing food addiction in French. Our study aimed to test the psychometric properties of a French version of the Yale Food Addiction Scale (YFAS) by establishing its factor structure and construct validity in a nonclinical population. A total of 553 participants were assessed for food addiction (French version of the YFAS) and binge eating behaviour (Bulimic Investigatory Test Edinburgh and Binge Eating Scale). We tested the scale's factor structure (factor analysis for dichotomous data based on tetrachoric correlation coefficients), internal consistency, and construct validity with measures of binge eating. Our results supported a 1-factor structure, which accounted for 54.1% of the variance. This tool had adequate reliability and high construct validity with measures of binge eating in this population, both in its diagnosis and symptom count version. A 2-factor structure explained an additional 9.1% of the variance, and could differentiate between patients with high, compared with low, levels of insight regarding addiction symptoms. In our study, we validated a psychometrically sound French version of the YFAS, both in its symptom count and diagnostic version. Future studies should validate this tool in clinical samples.

Poor Validity of the DSM-IV Schizoid Personality Disorder Construct as a Diagnostic Category.

PubMed

Hummelen, Benjamin; Pedersen, Geir; Wilberg, Theresa; Karterud, Sigmund

2015-06-01

This study sought to evaluate the construct validity of schizoid personality disorder (SZPD) by investigating a sample of 2,619 patients from the Norwegian Network of Personality-Focused Treatment Programs by a variety of statistical techniques. Nineteen patients (0.7%) reached the diagnostic threshold of SZPD. Results from the factor analyses indicated that SZPD consists of three factors: social detachment, withdrawal, and restricted affectivity/ anhedonia. Overall, internal consistency and diagnostic efficiency were poor and best for the criteria that belong to the social detachment factor. These findings pose serious questions about the clinical utility of SZPD as a diagnostic category. On the other hand, the three factors were in concordance with findings from previous studies and with the trait model for personality disorders in DSM-5, supporting the validity of SZPD as a dimensional construct. The authors recommend that SZPD should be deleted as a diagnostic category in future editions of DSM-5.

Development and validation of the Family Motivational Climate Questionnaire (FMC-Q).

PubMed

Alonso Tapia, Jesús; Simón Rueda, Cecilia; Asensio Fuentes, César

2013-01-01

The goal of this study was to develop and validate the Family Motivational Climate Questionnaire (FMCQ). Parental involvement (PI) affects children's academic orientations. However, PI questionnaires had not considered parenting behaviours from the perspective of motivational theories. It was therefore decided to develop the FMCQ. 570 Secondary-School students formed the sample. To validate the FMCQ, confirmatory factor analyses, reliability analysis and correlation and regression analyses were conducted. Children's attribution to parents of perceived change in motivational variables affecting achievement, were used as external criteria. Results support most of the hypotheses either related to the FMCQ structure or to its moderating role as predictor of school achievement and of attribution to parents of changes in different motivational variables --interest, effort, perceived ability, success expectancies, resilience, and satisfaction. The results underline the importance of acting on FMC-components in order to improve Children's motivation and achievement.

Genetic and environmental structure of DSM-IV criteria for Antisocial Personality Disorder: a twin study

PubMed Central

Rosenström, Tom; Ystrom, Eivind; Torvik, Fartein Ask; Czajkowski, Nikolai Olavi; Gillespie, Nathan A.; Aggen, Steven H.; Krueger, Robert F.; Kendler, Kenneth S; Reichborn-Kjennerud, Ted

2017-01-01

Results from previous studies on DSM-IV and DSM-5 Antisocial Personality Disorder (ASPD) have suggested that the construct is etiologically multidimensional. To our knowledge, however, the structure of genetic and environmental influences in ASPD has not been examined using an appropriate range of biometric models and diagnostic interviews. The 7 ASPD criteria (section A) were assessed in a population-based sample of 2794 Norwegian twins by a structured interview for DSM-IV personality disorders. Exploratory analyses were conducted at the phenotypic level. Multivariate biometric models, including both independent and common pathways, were compared. A single phenotypic factor was found, and the best-fitting biometric model was a single-factor common pathway model, with common-factor heritability of 51% (95% CI = 40–67%). In other words, both genetic and environmental correlations between the ASPD criteria could be accounted for by a single common latent variable. The findings support the validity of ASPD as a unidimensional diagnostic construct. PMID:28108863

Genetic and Environmental Structure of DSM-IV Criteria for Antisocial Personality Disorder: A Twin Study.

PubMed

Rosenström, Tom; Ystrom, Eivind; Torvik, Fartein Ask; Czajkowski, Nikolai Olavi; Gillespie, Nathan A; Aggen, Steven H; Krueger, Robert F; Kendler, Kenneth S; Reichborn-Kjennerud, Ted

2017-05-01

Results from previous studies on DSM-IV and DSM-5 Antisocial Personality Disorder (ASPD) have suggested that the construct is etiologically multidimensional. To our knowledge, however, the structure of genetic and environmental influences in ASPD has not been examined using an appropriate range of biometric models and diagnostic interviews. The 7 ASPD criteria (section A) were assessed in a population-based sample of 2794 Norwegian twins by a structured interview for DSM-IV personality disorders. Exploratory analyses were conducted at the phenotypic level. Multivariate biometric models, including both independent and common pathways, were compared. A single phenotypic factor was found, and the best-fitting biometric model was a single-factor common pathway model, with common-factor heritability of 51% (95% CI 40-67%). In other words, both genetic and environmental correlations between the ASPD criteria could be accounted for by a single common latent variable. The findings support the validity of ASPD as a unidimensional diagnostic construct.

The validity of two clinical tests of visual-motor perception.

PubMed

Wallbrown, J D; Wallbrown, F H; Engin, A W

1977-04-01

The study investigated the relative efficiency of the Bender and MPD as assessors of achievement-related errors in visual-motor perception. Clinical experience with these two tests suggests that beyond first grade the MPD is more sensitive than the Bender for purposes of measuring deficits in visual-motor perception that interfere with effective classroom learning. The sample was composed of 153 third-grade children from two upper-middle-class elementary schools in a surburban school system in central Ohio. For three of the four achievement criteria, the results were clearly congruent with the hypothesis stated above. That is, SpCD errors from the MPD not only showed significantly higher negative rs with the criteria (reading vocabulary, reading comprehension, and mathematics computation) than Koppitz errors from the Bender, but also accounted for a much higher proportion of the variance in these criteria. Thus, the findings suggest that psychologists engaged in the assessment of older children seriously should consider adding the MPD to their assessment battery.

Measurement of ethical food choice motives.

PubMed

Lindeman, M; Väänänen, M

2000-02-01

The two studies describe the development of three complementary scales to the Food Choice Questionnaire developed by Steptoe, Pollard & Wardle (1995). The new items address various ethical food choice motives and were derived from previous studies on vegetarianism and ethical food choice. The items were factor analysed in Study 1 (N=281) and the factor solution was confirmed in Study 2 (N=125), in which simple validity criteria were also included. Furthermore, test-retest reliability was assessed with a separate sample of subjects (N=36). The results indicated that the three new scales, Ecological Welfare (including subscales for Animal Welfare and Environment Protection), Political Values and Religion, are reliable and valid instruments for a brief screening of ethical food choice reasons. Copyright 2000 Academic Press.

Advancing implementation science through measure development and evaluation: a study protocol.

PubMed

Lewis, Cara C; Weiner, Bryan J; Stanick, Cameo; Fischer, Sarah M

2015-07-22

Significant gaps related to measurement issues are among the most critical barriers to advancing implementation science. Three issues motivated the study aims: (a) the lack of stakeholder involvement in defining pragmatic measure qualities; (b) the dearth of measures, particularly for implementation outcomes; and (c) unknown psychometric and pragmatic strength of existing measures. Aim 1: Establish a stakeholder-driven operationalization of pragmatic measures and develop reliable, valid rating criteria for assessing the construct. Aim 2: Develop reliable, valid, and pragmatic measures of three critical implementation outcomes, acceptability, appropriateness, and feasibility. Aim 3: Identify Consolidated Framework for Implementation Research and Implementation Outcome Framework-linked measures that demonstrate both psychometric and pragmatic strength. For Aim 1, we will conduct (a) interviews with stakeholder panelists (N = 7) and complete a literature review to populate pragmatic measure construct criteria, (b) Q-sort activities (N = 20) to clarify the internal structure of the definition, (c) Delphi activities (N = 20) to achieve consensus on the dimension priorities, (d) test-retest and inter-rater reliability assessments of the emergent rating system, and (e) known-groups validity testing of the top three prioritized pragmatic criteria. For Aim 2, our systematic development process involves domain delineation, item generation, substantive validity assessment, structural validity assessment, reliability assessment, and predictive validity assessment. We will also assess discriminant validity, known-groups validity, structural invariance, sensitivity to change, and other pragmatic features. For Aim 3, we will refine our established evidence-based assessment (EBA) criteria, extract the relevant data from the literature, rate each measure using the EBA criteria, and summarize the data. The study outputs of each aim are expected to have a positive impact as they will establish and guide a comprehensive measurement-focused research agenda for implementation science and provide empirically supported measures, tools, and methods for accomplishing this work.

Validation of Self-Report Impairment Measures for Section III Obsessive-Compulsive and Avoidant Personality Disorders.

PubMed

Liggett, Jacqueline; Carmichael, Kieran L C; Smith, Alexander; Sellbom, Martin

2017-01-01

This study examined the validity of newly developed disorder-specific impairment scales (IS), modeled on the Level of Personality Functioning Scale, for obsessive-compulsive (OCPD) and avoidant (AvPD) personality disorders. The IS focused on content validity (items directly reflected the disorder-specific impairments listed in DSM-5 Section III) and severity of impairment. A community sample of 313 adults completed personality inventories indexing the DSM-5 Sections II and III diagnostic criteria for OCPD and AvPD, as well as measures of impairment in the domains of self- and interpersonal functioning. Results indicated that both impairment measures (for AvPD in particular) showed promise in their ability to measure disorder-specific impairment, demonstrating convergent validity with their respective Section II counterparts and discriminant validity with their noncorresponding Section II disorder and with each other. The pattern of relationships between scores on the IS and scores on external measures of personality functioning, however, did not indicate that it is useful to maintain a distinction between impairment in the self- and interpersonal domains, at least for AvPD and OCPD.

Children's Physical Activity While Gardening: Development of a Valid and Reliable Direct Observation Tool.

PubMed

Myers, Beth M; Wells, Nancy M

2015-04-01

Gardens are a promising intervention to promote physical activity (PA) and foster health. However, because of the unique characteristics of gardening, no extant tool can capture PA, postures, and motions that take place in a garden. The Physical Activity Research and Assessment tool for Garden Observation (PARAGON) was developed to assess children's PA levels, tasks, postures, and motions, associations, and interactions while gardening. PARAGON uses momentary time sampling in which a trained observer watches a focal child for 15 seconds and then records behavior for 15 seconds. Sixty-five children (38 girls, 27 boys) at 4 elementary schools in New York State were observed over 8 days. During the observation, children simultaneously wore Actigraph GT3X+ accelerometers. The overall interrater reliability was 88% agreement, and Ebel was .97. Percent agreement values for activity level (93%), garden tasks (93%), motions (80%), associations (95%), and interactions (91%) also met acceptable criteria. Validity was established by previously validated PA codes and by expected convergent validity with accelerometry. PARAGON is a valid and reliable observation tool for assessing children's PA in the context of gardening.

Proposal and Testing of a Methodology for Evaluating an Occupational Health Program at a U.S. Army Installation

DTIC Science & Technology

1983-08-01

the literature for ten of the thirteen peptic ulcer diagnostic criteria most often cited in predeveloped listings compiled by various professional...Dershewitz, M.D., Richard A. Gross, M.D., and John W. Williamson, M.D., "Validating Audit Criteria: An Analytic Approach Illustrated by Peptic Ulcer ...A., M.D.; Gross, Richard A., M.D.; and Williamson, John W., M.D., "Validating Audit Criteria: An Analytic Approach Illustrated by Peptic Ulcer Disease

Dimensional indicators of generalized anxiety disorder severity for DSM-V.

PubMed

Niles, Andrea N; Lebeau, Richard T; Liao, Betty; Glenn, Daniel E; Craske, Michelle G

2012-03-01

For DSM-V, simple dimensional measures of disorder severity will accompany diagnostic criteria. The current studies examine convergent validity and test-retest reliability of two potential dimensional indicators of worry severity for generalized anxiety disorder (GAD): percent of the day worried and number of worry domains. In study 1, archival data from diagnostic interviews from a community sample of individuals diagnosed with one or more anxiety disorders (n = 233) were used to assess correlations between percent of the day worried and number of worry domains with other measures of worry severity (clinical severity rating (CSR), age of onset, number of comorbid disorders, Penn state worry questionnaire (PSWQ)) and DSM-IV criteria (excessiveness, uncontrollability and number of physical symptoms). Both measures were significantly correlated with CSR and number of comorbid disorders, and with all three DSM-IV criteria. In study 2, test-retest reliability of percent of the day worried and number of worry domains were compared to test-retest reliability of DSM-IV diagnostic criteria in a non-clinical sample of undergraduate students (n = 97) at a large west coast university. All measures had low test-retest reliability except percent of the day worried, which had moderate test-retest reliability. Findings suggest that these two indicators capture worry severity, and percent of the day worried may be the most reliable existing indicator. These measures may be useful as dimensional measures for DSM-V. Copyright © 2012 Elsevier Ltd. All rights reserved.

Predictive Validity of DSM-IV and ICD-10 Criteria for ADHD and Hyperkinetic Disorder

ERIC Educational Resources Information Center

Lee, Soyoung I.; Schachar, Russell J.; Chen, Shirley X.; Ornstein, Tisha J.; Charach, Alice; Barr, Cathy; Ickowicz, Abel

2008-01-01

Background: The goal of this study was to compare the predictive validity of the two main diagnostic schemata for childhood hyperactivity--attention-deficit hyperactivity disorder (ADHD; "Diagnostic and Statistical Manual"-IV) and hyperkinetic disorder (HKD; "International Classification of Diseases"-10th Edition). Methods: Diagnostic criteria for…

Incremental Validity of the MMPI-2 PSY-5 Scales in Assessing Self-Reported Personality Disorder Criteria

ERIC Educational Resources Information Center

Wygant, Dustin B.; Sellbom, Martin; Graham, John R.; Schenk, Paul W.

2006-01-01

The Minnesota Multiphasic Personality Inventory-2 (MMPI-2) Personality Psychopathology-Five (PSY-5) scales were developed to measure abnormal personality symptomatology. The present study examines the incremental validity of the PSY-5 scales beyond the clinical and content scales in assessing criteria associated with personality disorders. The…

Use of soft data for multi-criteria calibration and validation of APEX: Impact on model simulations

USDA-ARS?s Scientific Manuscript database

It is widely known that the use of soft data and multiple model performance criteria in model calibration and validation is critical to ensuring the model capture major hydrologic and water quality processes. The Agricultural Policy/Environmental eXtender (APEX) is a hydrologic and water quality mod...

Exploring the Role of Assessment Criteria during Teachers' Collaborative Judgement Processes of Students' Portfolios

ERIC Educational Resources Information Center

Van der Schaaf, Marieke; Baartman, Liesbeth; Prins, Frans

2012-01-01

Student portfolios are increasingly used for assessing student competences in higher education, but results about the construct validity of portfolio assessment are mixed. A prerequisite for construct validity is that the portfolio assessment is based on relevant portfolio content. Assessment criteria, are often used to enhance this condition.…

The Conceptualisation and Measurement of DSM-5 Internet Gaming Disorder: The Development of the IGD-20 Test

PubMed Central

Pontes, Halley M.; Király, Orsolya; Demetrovics, Zsolt; Griffiths, Mark D.

2014-01-01

Background Over the last decade, there has been growing concern about ‘gaming addiction’ and its widely documented detrimental impacts on a minority of individuals that play excessively. The latest (fifth) edition of the American Psychiatric Association's Diagnostic and Statistical Manual of Mental Disorders (DSM-5) included nine criteria for the potential diagnosis of Internet Gaming Disorder (IGD) and noted that it was a condition that warranted further empirical study. Aim: The main aim of this study was to develop a valid and reliable standardised psychometrically robust tool in addition to providing empirically supported cut-off points. Methods A sample of 1003 gamers (85.2% males; mean age 26 years) from 57 different countries were recruited via online gaming forums. Validity was assessed by confirmatory factor analysis (CFA), criterion-related validity, and concurrent validity. Latent profile analysis was also carried to distinguish disordered gamers from non-disordered gamers. Sensitivity and specificity analyses were performed to determine an empirical cut-off for the test. Results The CFA confirmed the viability of IGD-20 Test with a six-factor structure (salience, mood modification, tolerance, withdrawal, conflict and relapse) for the assessment of IGD according to the nine criteria from DSM-5. The IGD-20 Test proved to be valid and reliable. According to the latent profile analysis, 5.3% of the total participants were classed as disordered gamers. Additionally, an optimal empirical cut-off of 71 points (out of 100) seemed to be adequate according to the sensitivity and specificity analyses carried. Conclusions The present findings support the viability of the IGD-20 Test as an adequate standardised psychometrically robust tool for assessing internet gaming disorder. Consequently, the new instrument represents the first step towards unification and consensus in the field of gaming studies. PMID:25313515

The conceptualisation and measurement of DSM-5 Internet Gaming Disorder: the development of the IGD-20 Test.

PubMed

Pontes, Halley M; Király, Orsolya; Demetrovics, Zsolt; Griffiths, Mark D

2014-01-01

Over the last decade, there has been growing concern about 'gaming addiction' and its widely documented detrimental impacts on a minority of individuals that play excessively. The latest (fifth) edition of the American Psychiatric Association's Diagnostic and Statistical Manual of Mental Disorders (DSM-5) included nine criteria for the potential diagnosis of Internet Gaming Disorder (IGD) and noted that it was a condition that warranted further empirical study. The main aim of this study was to develop a valid and reliable standardised psychometrically robust tool in addition to providing empirically supported cut-off points. A sample of 1003 gamers (85.2% males; mean age 26 years) from 57 different countries were recruited via online gaming forums. Validity was assessed by confirmatory factor analysis (CFA), criterion-related validity, and concurrent validity. Latent profile analysis was also carried to distinguish disordered gamers from non-disordered gamers. Sensitivity and specificity analyses were performed to determine an empirical cut-off for the test. The CFA confirmed the viability of IGD-20 Test with a six-factor structure (salience, mood modification, tolerance, withdrawal, conflict and relapse) for the assessment of IGD according to the nine criteria from DSM-5. The IGD-20 Test proved to be valid and reliable. According to the latent profile analysis, 5.3% of the total participants were classed as disordered gamers. Additionally, an optimal empirical cut-off of 71 points (out of 100) seemed to be adequate according to the sensitivity and specificity analyses carried. The present findings support the viability of the IGD-20 Test as an adequate standardised psychometrically robust tool for assessing internet gaming disorder. Consequently, the new instrument represents the first step towards unification and consensus in the field of gaming studies.

Systematic review of prediction models for delirium in the older adult inpatient.

PubMed

Lindroth, Heidi; Bratzke, Lisa; Purvis, Suzanne; Brown, Roger; Coburn, Mark; Mrkobrada, Marko; Chan, Matthew T V; Davis, Daniel H J; Pandharipande, Pratik; Carlsson, Cynthia M; Sanders, Robert D

2018-04-28

To identify existing prognostic delirium prediction models and evaluate their validity and statistical methodology in the older adult (≥60 years) acute hospital population. Systematic review. PubMed, CINAHL, PsychINFO, SocINFO, Cochrane, Web of Science and Embase were searched from 1 January 1990 to 31 December 2016. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses and CHARMS Statement guided protocol development. age >60 years, inpatient, developed/validated a prognostic delirium prediction model. alcohol-related delirium, sample size ≤50. The primary performance measures were calibration and discrimination statistics. Two authors independently conducted search and extracted data. The synthesis of data was done by the first author. Disagreement was resolved by the mentoring author. The initial search resulted in 7,502 studies. Following full-text review of 192 studies, 33 were excluded based on age criteria (<60 years) and 27 met the defined criteria. Twenty-three delirium prediction models were identified, 14 were externally validated and 3 were internally validated. The following populations were represented: 11 medical, 3 medical/surgical and 13 surgical. The assessment of delirium was often non-systematic, resulting in varied incidence. Fourteen models were externally validated with an area under the receiver operating curve range from 0.52 to 0.94. Limitations in design, data collection methods and model metric reporting statistics were identified. Delirium prediction models for older adults show variable and typically inadequate predictive capabilities. Our review highlights the need for development of robust models to predict delirium in older inpatients. We provide recommendations for the development of such models. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

The development and psychometric evaluation of the Internet Disorder Scale (IDS-15).

PubMed

Pontes, Halley M; Griffiths, Mark D

2017-01-01

Previously published research suggests that improvement in the assessment of Internet addiction (IA) is paramount in advancing the field. However, little has been done to address inconsistencies in the assessment of IA using a more updated framework. The aim of the present study was to develop a new instrument to assess IA based on a modification of the nine Internet Gaming Disorder (IGD) criteria as suggested by the American Psychiatric Association in the latest (fifth) edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-5), and to provide a taxonomy of the potential risk of IA risk among participants. A heterogeneous sample of Internet users (n=1105) was recruited online (61.3% males, mean age 33years). Construct validity of the new instrument - Internet Disorder Scale (IDS-15) - was assessed by means of factorial, convergent, and discriminant validity. Criterion-related validity and reliability were also investigated. Additionally, latent profile analysis (LPA) was carried out to differentiate and characterize Internet users based on their potential IA risk. The construct and criterion-related validity of the IDS-15 were both warranted. The IDS-15 proved to be a valid and reliable tool. Using the LPA, participants were classed as "low addiction risk" (n=183, 18.2%), "medium addiction risk" (n=456, 41.1%), and "high addiction risk" (n=455, 40.77%). Furthermore, key differences emerged among these classes in terms of age, relationship status, cigarette consumption, weekly Internet usage, age of Internet use initiation, and IDS-15 total scores. The present findings support the viability of using adapted IGD criteria as a framework to assess IA. Copyright © 2015 Elsevier Ltd. All rights reserved.

The cross-cultural validity of posttraumatic stress disorder: implications for DSM-5.

PubMed

Hinton, Devon E; Lewis-Fernández, Roberto

2011-09-01

There is considerable debate about the cross-cultural applicability of the posttraumatic stress disorder (PTSD) category as currently specified. Concerns include the possible status of PTSD as a Western culture-bound disorder and the validity of individual items and criteria thresholds. This review examines various types of cross-cultural validity of the PTSD criteria as defined in DSM-IV-TR, and presents options and preliminary recommendations to be considered for DSM-5. Searches were conducted of the mental health literature, particularly since 1994, regarding cultural-, race-, or ethnicity-related factors that might limit the universal applicability of the diagnostic criteria of PTSD in DSM-IV-TR and the possible criteria for DSM-5. Substantial evidence of the cross-cultural validity of PTSD was found. However, evidence of cross-cultural variability in certain areas suggests the need for further research: the relative salience of avoidance/numbing symptoms, the role of the interpretation of trauma-caused symptoms in shaping symptomatology, and the prevalence of somatic symptoms. This review also indicates the need to modify certain criteria, such as the items on distressing dreams and on foreshortened future, to increase their cross-cultural applicability. Text additions are suggested to increase the applicability of the manual across cultural contexts: specifying that cultural syndromes-such as those indicated in the DSM-IV-TR Glossary-may be a prominent part of the trauma response in certain cultures, and that those syndromes may influence PTSD symptom salience and comorbidity. The DSM-IV-TR PTSD category demonstrates various types of validity. Criteria modification and textual clarifications are suggested to further improve its cross-cultural applicability. © 2010 Wiley-Liss, Inc.

Application of a framework to assess the usefulness of alternative sepsis criteria

PubMed Central

Seymour, Christopher W.; Coopersmith, Craig M.; Deutschman, Clifford S; Gesten, Foster; Klompas, Michael; Levy, Mitchell; Martin, Gregory S.; Osborn, Tiffany M.; Rhee, Chanu; Warren, David; Watson, R. Scott; Angus, Derek C.

2016-01-01

The current definition for sepsis is life-threatening, acute organ dysfunction secondary to a dysregulated host response to infection. Criteria to operationalize this definition can be judged by 6 domains of usefulness (reliability; content, construct and criterion validity, measurement burden, and timeliness). The relative importance of these 6 domains depends on the intended purpose for the criteria (clinical care, basic and clinical research, surveillance, or quality improvement (QI) and audit). For example, criteria for clinical care should have high content and construct validity, timeliness, and low measurement burden to facilitate prompt care. Criteria for surveillance or QI/audit place greater emphasis on reliability across individuals and sites and lower emphasis on timeliness. Criteria for clinical trials require timeliness to ensure prompt enrollment and reasonable reliability but can tolerate high measurement burden. Basic research also tolerates high measurement burden and may not need stability over time. In an illustrative case study, we compared examples of criteria designed for clinical care, surveillance and QI/audit among 396,241 patients admitted to 12 academic and community hospitals in an integrated health system. Case rates differed 4-fold and mortality 3-fold. Predictably, clinical care criteria, which emphasized timeliness and low burden and therefore used vital signs and routine laboratory tests, had the highest case identification with lowest mortality. QI /audit criteria, which emphasized reliability and criterion validity, used discharge information and had the lowest case identification with highest mortality. Using this framework to identify the purpose and apply domains of usefulness can help with the evaluation of existing sepsis diagnostic criteria and provide a roadmap for future work. PMID:26901560

Application of a Framework to Assess the Usefulness of Alternative Sepsis Criteria.

PubMed

Seymour, Christopher W; Coopersmith, Craig M; Deutschman, Clifford S; Gesten, Foster; Klompas, Michael; Levy, Mitchell; Martin, Gregory S; Osborn, Tiffany M; Rhee, Chanu; Warren, David K; Watson, R Scott; Angus, Derek C

2016-03-01

The current definition of sepsis is life-threatening, acute organ dysfunction secondary to a dysregulated host response to infection. Criteria to operationalize this definition can be judged by six domains of usefulness (reliability, content, construct and criterion validity, measurement burden, and timeliness). The relative importance of these six domains depends on the intended purpose for the criteria (clinical care, basic and clinical research, surveillance, or quality improvement [QI] and audit). For example, criteria for clinical care should have high content and construct validity, timeliness, and low measurement burden to facilitate prompt care. Criteria for surveillance or QI/audit place greater emphasis on reliability across individuals and sites and lower emphasis on timeliness. Criteria for clinical trials require timeliness to ensure prompt enrollment and reasonable reliability but can tolerate high measurement burden. Basic research also tolerates high measurement burden and may not need stability over time. In an illustrative case study, we compared examples of criteria designed for clinical care, surveillance and QI/audit among 396,241 patients admitted to 12 academic and community hospitals in an integrated health system. Case rates differed four-fold and mortality three-fold. Predictably, clinical care criteria, which emphasized timeliness and low burden and therefore used vital signs and routine laboratory tests, had the greater case identification with lowest mortality. QI/audit criteria, which emphasized reliability and criterion validity, used discharge information and had the lowest case identification with highest mortality. Using this framework to identify the purpose and apply domains of usefulness can help with the evaluation of existing sepsis diagnostic criteria and provide a roadmap for future work.

Measurement of General and Specific Approaches to Physical Activity Parenting: A Systematic Review

PubMed Central

McDonald, Samantha; Cohen, Alysia

2013-01-01

Abstract Background Parents play a significant role in shaping youth physical activity (PA). However, interventions targeting PA parenting have been ineffective. Methodological inconsistencies related to the measurement of parental influences may be a contributing factor. The purpose of this article is to review the extant peer-reviewed literature related to the measurement of general and specific parental influences on youth PA. Methods A systematic review of studies measuring constructs of PA parenting was conducted. Computerized searches were completed using PubMed, MEDLINE, Academic Search Premier, SPORTDiscus, and PsycINFO. Reference lists of the identified articles were manually reviewed as well as the authors' personal collections. Articles were selected on the basis of strict inclusion criteria and details regarding the measurement protocols were extracted. A total of 117 articles met the inclusionary criteria. Methodological articles that evaluated the validity and reliability of PA parenting measures (n=10) were reviewed separately from parental influence articles (n=107). Results A significant percentage of studies used measures with indeterminate validity and reliability. A significant percentage of articles did not provide sample items, describe the response format, or report the possible range of scores. No studies were located that evaluated sensitivity to change. Conclusion The reporting of measurement properties and the use of valid and reliable measurement scales need to be improved considerably. PMID:23944923

Automatic personality assessment through social media language.

PubMed

Park, Gregory; Schwartz, H Andrew; Eichstaedt, Johannes C; Kern, Margaret L; Kosinski, Michal; Stillwell, David J; Ungar, Lyle H; Seligman, Martin E P

2015-06-01

Language use is a psychologically rich, stable individual difference with well-established correlations to personality. We describe a method for assessing personality using an open-vocabulary analysis of language from social media. We compiled the written language from 66,732 Facebook users and their questionnaire-based self-reported Big Five personality traits, and then we built a predictive model of personality based on their language. We used this model to predict the 5 personality factors in a separate sample of 4,824 Facebook users, examining (a) convergence with self-reports of personality at the domain- and facet-level; (b) discriminant validity between predictions of distinct traits; (c) agreement with informant reports of personality; (d) patterns of correlations with external criteria (e.g., number of friends, political attitudes, impulsiveness); and (e) test-retest reliability over 6-month intervals. Results indicated that language-based assessments can constitute valid personality measures: they agreed with self-reports and informant reports of personality, added incremental validity over informant reports, adequately discriminated between traits, exhibited patterns of correlations with external criteria similar to those found with self-reported personality, and were stable over 6-month intervals. Analysis of predictive language can provide rich portraits of the mental life associated with traits. This approach can complement and extend traditional methods, providing researchers with an additional measure that can quickly and cheaply assess large groups of participants with minimal burden. (c) 2015 APA, all rights reserved).

An Investigation Into HPLC Data Quality Problems

NASA Technical Reports Server (NTRS)

Hooker, Stanford B.; VanHeukelem, Laurie

2011-01-01

This report summarizes the analyses and results produced by a five-member investigative team of Government, university, and industry experts, established by NASA HQ. The team examined data quality problems associated with high performance liquid chromatography (HPLC) analyses of pigment concentrations in seawater samples produced by the San Diego State University (SDSU) Center for Hydro-Optics and Remote Sensing (CHORS). This report shows CHORS did not validate the methods used before placing them into service to analyze field samples for NASA principal investigators (PIs), even though the HPLC literature contained easily accessible method validation procedures, and the importance of implementing them, more than a decade ago. In addition, there were so many sources of significant variance in the CHORS methodologies, that the HPLC system rarely operated within performance criteria capable of producing the requisite data quality. It is the recommendation of the investigative team to a) not correct the data, b) make all the data that was temporarily sequestered available for scientific use, and c) label the affected data with an appropriate warning, e.g., "These data are not validated and should not be used as the sole basis for a scientific result, conclusion, or hypothesis--independent corroborating evidence is required."

Comparison of Enzyme-Linked Immunosorbent Assay, Surface Plasmon Resonance and Biolayer Interferometry for Screening of Deoxynivalenol in Wheat and Wheat Dust.

PubMed

Sanders, Melanie; McPartlin, Daniel; Moran, Kara; Guo, Yirong; Eeckhout, Mia; O'Kennedy, Richard; De Saeger, Sarah; Maragos, Chris

2016-04-11

A sample preparation method was developed for the screening of deoxynivalenol (DON) in wheat and wheat dust. Extraction was carried out with water and was successful due to the polar character of DON. For detection, an enzyme-linked immunosorbent assay (ELISA) was compared to the sensor-based techniques of surface plasmon resonance (SPR) and biolayer interferometry (BLI) in terms of sensitivity, affinity and matrix effect. The matrix effects from wheat and wheat dust using SPR were too high to further use this screenings method. The preferred ELISA and BLI methods were validated according to the criteria established in Commission Regulation 519/2014/EC and Commission Decision 2002/657/EC. A small survey was executed on 16 wheat lots and their corresponding dust samples using the validated ELISA method. A linear correlation (r = 0.889) was found for the DON concentration in dust versus the DON concentration in wheat (LOD wheat: 233 μg/kg, LOD wheat dust: 458 μg/kg).

Validity of the Family Asthma Management System Scale with an Urban African-American Sample

PubMed Central

Klinnert, Mary D.; Holsey, Chanda Nicole; McQuaid, Elizabeth L.

2011-01-01

Objective To examine the reliability and validity of the Family Asthma Management System Scale for low-income African-American children with poor asthma control and caregivers under stress. The FAMSS assesses eight aspects of asthma management from a family systems perspective. Methods Forty-three children, ages 8–13, and caregivers were interviewed with the FAMSS; caregivers completed measures of primary care quality, family functioning, parenting stress, and psychological distress. Children rated their relatedness with the caregiver, and demonstrated inhaler technique. Medical records were reviewed for dates of outpatient visits for asthma. Results The FAMSS demonstrated good internal consistency. Higher scores were associated with adequate inhaler technique, recent outpatient care, less parenting stress and better family functioning. Higher scores on the Collaborative Relationship with Provider subscale were associated with greater perceived primary care quality. Conclusions The FAMSS demonstrated relevant associations with asthma management criteria and family functioning for a low-income, African-American sample. PMID:19776230

Comparative assessment of bioanalytical method validation guidelines for pharmaceutical industry.

PubMed

Kadian, Naveen; Raju, Kanumuri Siva Rama; Rashid, Mamunur; Malik, Mohd Yaseen; Taneja, Isha; Wahajuddin, Muhammad

2016-07-15

The concepts, importance, and application of bioanalytical method validation have been discussed for a long time and validation of bioanalytical methods is widely accepted as pivotal before they are taken into routine use. United States Food and Drug Administration (USFDA) guidelines issued in 2001 have been referred for every guideline released ever since; may it be European Medical Agency (EMA) Europe, National Health Surveillance Agency (ANVISA) Brazil, Ministry of Health and Labour Welfare (MHLW) Japan or any other guideline in reference to bioanalytical method validation. After 12 years, USFDA released its new draft guideline for comments in 2013, which covers the latest parameters or topics encountered in bioanalytical method validation and approached towards the harmonization of bioanalytical method validation across the globe. Even though the regulatory agencies have general agreement, significant variations exist in acceptance criteria and methodology. The present review highlights the variations, similarities and comparison between bioanalytical method validation guidelines issued by major regulatory authorities worldwide. Additionally, other evaluation parameters such as matrix effect, incurred sample reanalysis including other stability aspects have been discussed to provide an ease of access for designing a bioanalytical method and its validation complying with the majority of drug authority guidelines. Copyright © 2016. Published by Elsevier B.V.

Evaluation Criteria for the Educational Web-Information System

ERIC Educational Resources Information Center

Seok, Soonhwa; Meyen, Edward; Poggio, John C.; Semon, Sarah; Tillberg-Webb, Heather

2008-01-01

This article addresses how evaluation criteria improve educational Web-information system design, and the tangible and intangible benefits of using evaluation criteria, when implemented in an educational Web-information system design. The evaluation criteria were developed by the authors through a content validation study applicable to…

[Validation of SHI Claims Data Exemplified by Gender-specific Diagnoses].

PubMed

Hartmann, J; Weidmann, C; Biehle, R

2016-10-01

Aim: Use of statutory health insurance (SHI) data in health services research is increasing steadily and questions of validity are gaining importance. Using gender-specific diagnosis as an example, the aim of this study was to estimate the prevalence of implausible diagnosis and demonstrate an internal validation strategy. Method: The analysis is based on the SHI data from Baden-Württemberg for 2012. Subject of validation are gender-specific outpatient diagnoses that mismatch with the gender of the insured. To uncover this implausibility, it is necessary to clarify whether the diagnosis or the gender is wrong. The validation criteria used were the presence of further gender-specific diagnoses, the presence of gender-specific settlement items, the specialization of the physician in charge and the gender assignment of the first name of the insured. To review the quality of the validation, it was verified if the gender was changed during the following year. Results: Around 5.1% of all diagnoses were gender-specific and there was a mismatch between diagnosis and gender in 0.04% of these cases. All validation criteria were useful to sort out implausibility, whereas the last one was the most effective. Only 14% remained unsolved. From the total of 1 145 insured with implausible gender-specific diagnoses, one year later 128 had a new gender (in the data). 119 of these cases were rightly classified as insured with wrong gender and 9 cases were in the unsolved group. This confirms that the validation works well. Conclusion: Implausibility in SHI data is relatively small and can be solved with appropriate validation criteria. When validating SHI data, it is advisable to question all data used critically, to use multiple validation criteria instead of just one and to abandon the idea that reality and the associated data conform to standardized norms. Keeping these aspects in mind, analysis of SHI data is a good starting point for research in health services. © Georg Thieme Verlag KG Stuttgart · New York.

Reliability and validity of a semi-structured DSM-based diagnostic interview module for the assessment of Attention Deficit Hyperactivity Disorder in adult psychiatric outpatients.

PubMed

Gorlin, Eugenia I; Dalrymple, Kristy; Chelminski, Iwona; Zimmerman, Mark

2016-08-30

Despite growing recognition that the symptoms and functional impairments of Attention Deficit/Hyperactivity Disorder (ADHD) persist into adulthood, only a few psychometrically sound diagnostic measures have been developed for the assessment of ADHD in adults, and none have been validated for use in a broad treatment-seeking psychiatric sample. The current study presents the reliability and validity of a semi-structured DSM-based diagnostic interview module for ADHD, which was administered to 1194 adults presenting to an outpatient psychiatric practice. The module showed excellent internal consistency and interrater reliability, good convergent and discriminant validity (as indexed by relatively high correlations with self-report measures of ADHD and ADHD-related constructs and little or no correlation with other, non-ADHD symptom domains), and good construct validity (as indexed by significantly higher rates of psychosocial impairment and self-reported family history of ADHD in individuals who meet criteria for an ADHD diagnosis). This instrument is thus a reliable and valid diagnostic tool for the detection of ADHD in adults presenting for psychiatric evaluation and treatment. Published by Elsevier Ireland Ltd.

Validation of the Davidson Trauma Scale in its original and a new shorter version in people exposed to the F-27 earthquake in Chile

PubMed Central

Leiva-Bianchi, Marcelo C.; Araneda, Andrea C.

2013-01-01

Background On February 27, 2010 (F-27), an earthquake and tsunami occurred having a significant impact on the mental health of the Chilean population, leading to an increase in cases of post-traumatic stress disorder (PTSD). Objectives Within this context, validated for the first time in Chile was the Davidson Trauma Scale (DTS) using three samples (each one consisting of 200 participants), two of them random from the Chilean population. Results Reliability analyses (i.e., α=0.933), concurrent validity (63% of the items are significantly correlated with the criteria variable “degree of damage to home”) and construct validity (i.e., CMIN = 3.754, RMSEA = 0.118, NFI = 0.808, CFI = 0.850 and PNFI = 0.689) indicate validity between regular and good for DTS. However, a new short version of the scale (DTS-SF) created using the items with heavier factor weights, presented better fits (CMIN = 2.170, RMSEA = 0.077, NFI = 0.935, CFI = 0.963, PNFI = 0.697). Discussion Finally, the usefulness of DTS and DTS-SF is discussed, the latter being briefer, valid and having better psychometric characteristics. PMID:23983920

Update of Standard Practices for New Method Validation in Forensic Toxicology.

PubMed

Wille, Sarah M R; Coucke, Wim; De Baere, Thierry; Peters, Frank T

2017-01-01

International agreement concerning validation guidelines is important to obtain quality forensic bioanalytical research and routine applications as it all starts with the reporting of reliable analytical data. Standards for fundamental validation parameters are provided in guidelines as those from the US Food and Drug Administration (FDA), the European Medicines Agency (EMA), the German speaking Gesellschaft fur Toxikologie und Forensische Chemie (GTFCH) and the Scientific Working Group of Forensic Toxicology (SWGTOX). These validation parameters include selectivity, matrix effects, method limits, calibration, accuracy and stability, as well as other parameters such as carryover, dilution integrity and incurred sample reanalysis. It is, however, not easy for laboratories to implement these guidelines into practice as these international guidelines remain nonbinding protocols, that depend on the applied analytical technique, and that need to be updated according the analyst's method requirements and the application type. In this manuscript, a review of the current guidelines and literature concerning bioanalytical validation parameters in a forensic context is given and discussed. In addition, suggestions for the experimental set-up, the pros and cons of statistical approaches and adequate acceptance criteria for the validation of bioanalytical applications are given. Copyright© Bentham Science Publishers; For any queries, please email at epub@benthamscience.org.

Vascular cognitive impairment neuropathology guidelines (VCING): the contribution of cerebrovascular pathology to cognitive impairment.

PubMed

Skrobot, Olivia A; Attems, Johannes; Esiri, Margaret; Hortobágyi, Tibor; Ironside, James W; Kalaria, Rajesh N; King, Andrew; Lammie, George A; Mann, David; Neal, James; Ben-Shlomo, Yoav; Kehoe, Patrick G; Love, Seth

2016-11-01

There are no generally accepted protocols for post-mortem assessment in cases of suspected vascular cognitive impairment. Neuropathologists from seven UK centres have collaborated in the development of a set of vascular cognitive impairment neuropathology guidelines (VCING), representing a validated consensus approach to the post-mortem assessment and scoring of cerebrovascular disease in relation to vascular cognitive impairment. The development had three stages: (i) agreement on a sampling protocol and scoring criteria, through a series of Delphi method surveys; (ii) determination of inter-rater reliability for each type of pathology in each region sampled (Gwet's AC2 coefficient); and (iii) empirical testing and validation of the criteria, by blinded post-mortem assessment of brain tissue from 113 individuals (55 to 100 years) without significant neurodegenerative disease who had had formal cognitive assessments within 12 months of death. Fourteen different vessel and parenchymal pathologies were assessed in 13 brain regions. Almost perfect agreement (AC2 > 0.8) was found when the agreed criteria were used for assessment of leptomeningeal, cortical and capillary cerebral amyloid angiopathy, large infarcts, lacunar infarcts, microhaemorrhage, larger haemorrhage, fibrinoid necrosis, microaneurysms, perivascular space dilation, perivascular haemosiderin leakage, and myelin loss. There was more variability (but still reasonably good agreement) in assessment of the severity of arteriolosclerosis (0.45-0.91) and microinfarcts (0.52-0.84). Regression analyses were undertaken to identify the best predictors of cognitive impairment. Seven pathologies-leptomeningeal cerebral amyloid angiopathy, large infarcts, lacunar infarcts, microinfarcts, arteriolosclerosis, perivascular space dilation and myelin loss-predicted cognitive impairment. Multivariable logistic regression determined the best predictive models of cognitive impairment. The preferred model included moderate/severe occipital leptomeningeal cerebral amyloid angiopathy, moderate/severe arteriolosclerosis in occipital white matter, and at least one large infarct (area under the receiver operating characteristic curve 77%). The presence of 0, 1, 2 or 3 of these features resulted in predicted probabilities of vascular cognitive impairment of 16%, 43%, 73% or 95%, respectively. We have developed VCING criteria that are reproducible and clinically predictive. Assuming our model can be validated in an independent dataset, we believe that this will be helpful for neuropathologists in reporting a low, intermediate or high likelihood that cerebrovascular disease contributed to cognitive impairment.10.1093/brain/aww214_video_abstractaww214_video_abstract. © The Author (2016). Published by Oxford University Press on behalf of the Guarantors of Brain. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Validity of the CAGE questionnaire for men who have sex with men (MSM) in China.

PubMed

Chen, Yen-Tyng; Ibragimov, Umedjon; Nehl, Eric J; Zheng, Tony; He, Na; Wong, Frank Y

2016-03-01

Detection of heavy drinking among men who have sex with men (MSM) is crucial for both intervention and treatment. The CAGE questionnaire is a popular screening instrument for alcohol use problems. However, the validity of CAGE for Chinese MSM is unknown. Data were from three waves of cross-sectional assessments among general MSM (n=523) and men who sell sex to other men ("money boys" or MBs, n=486) in Shanghai, China. Specifically, participants were recruited using respondent-driven, community popular opinion leader, and venue-based sampling methods. The validity of the CAGE was examined for different cutoff scores and individual CAGE items using self-reported heavy drinking (≥14 drinks in the past week) as a criterion. In the full sample, 75 (7.4%) of participants were classified as heavy drinkers. 32 (6.1%) of general MSM and 43 (8.9%) of MBs were heavy drinkers. The area under curve statistics for overall sample was 0.7 (95% CI: 0.36-0.77). Overall, the sensitivities (ranging from 18.7 to 66.7%), specificities (ranging from 67.5 to 95.8%), and positive predictive values (ranging from 14.1 to 26.4%) for different cutoff scores were inadequate using past week heavy drinking as the criterion. The ability of CAGE to discriminate heavy drinkers from non-heavy drinkers was limited. Our findings showed the inadequate validity of CAGE as a screening instrument for current heavy drinking in Chinese MSM. Further research using a combination of validity criteria is needed to determine the applicability of CAGE for this population. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Validation of a Spanish-language version of the ADHD Rating Scale IV in a Spanish sample.

PubMed

Vallejo-Valdivielso, M; Soutullo, C A; de Castro-Manglano, P; Marín-Méndez, J J; Díez-Suárez, A

2017-07-14

The purpose of this study is to validate a Spanish-language version of the 18-item ADHD Rating Scale-IV (ADHD-RS-IV.es) in a Spanish sample. From a total sample of 652 children and adolescents aged 6 to 17 years (mean age was 11.14±3.27), we included 518 who met the DSM-IV-TR criteria for ADHD and 134 healthy controls. To evaluate the factorial structure, validity, and reliability of the scale, we performed a confirmatory factor analysis (CFA) using structural equation modelling on a polychoric correlation matrix and maximum likelihood estimation. The scale's discriminant validity and predictive value were estimated using ROC (receiver operating characteristics) curve analysis. Both the full scale and the subscales of the Spanish-language version of the ADHD-RS-IV showed good internal consistency. Cronbach's alpha was 0.94 for the full scale and ≥ 0.90 for the subscales, and ordinal alpha was 0.95 and ≥ 0.90, respectively. CFA showed that a two-factor model (inattention and hyperactivity/impulsivity) provided the best fit for the data. ADHD-RS-IV.es offered good discriminant ability to distinguish between patients with ADHD and controls (AUC=0.97). The two-factor structure of the Spanish-language version of the ADHD-RS-IV (ADHD-RS-IV.es) is consistent with those of the DSM-IV-TR and DSM-5 as well as with the model proposed by the author of the original scale. Furthermore, it has good discriminant ability. ADHD-RS-IV.es is therefore a valid and reliable tool for determining presence and severity of ADHD symptoms in the Spanish population. Copyright © 2017 Sociedad Española de Neurología. Publicado por Elsevier España, S.L.U. All rights reserved.

Identifying Depressed Older Adults in Primary Care: A Secondary Analysis of a Multisite Randomized Controlled Trial

PubMed Central

Voils, Corrine I.; Olsen, Maren K.; Williams, John W.; for the IMPACT Study Investigators

2008-01-01

Objective: To determine whether a subset of depressive symptoms could be identified to facilitate diagnosis of depression in older adults in primary care. Method: Secondary analysis was conducted on 898 participants aged 60 years or older with major depressive disorder and/or dysthymic disorder (according to DSM-IV criteria) who participated in the Improving Mood–Promoting Access to Collaborative Treatment (IMPACT) study, a multisite, randomized trial of collaborative care for depression (recruitment from July 1999 to August 2001). Linear regression was used to identify a core subset of depressive symptoms associated with decreased social, physical, and mental functioning. The sensitivity and specificity, adjusting for selection bias, were evaluated for these symptoms. The sensitivity and specificity of a second subset of 4 depressive symptoms previously validated in a midlife sample was also evaluated. Results: Psychomotor changes, fatigue, and suicidal ideation were associated with decreased functioning and served as the core set of symptoms. Adjusting for selection bias, the sensitivity of these 3 symptoms was 0.012 and specificity 0.994. The sensitivity of the 4 symptoms previously validated in a midlife sample was 0.019 and specificity was 0.997. Conclusion: We identified 3 depression symptoms that were highly specific for major depressive disorder in older adults. However, these symptoms and a previously identified subset were too insensitive for accurate diagnosis. Therefore, we recommend a full assessment of DSM-IV depression criteria for accurate diagnosis. PMID:18311416

Hermeneutic Haunting: E. D. Hirsch, Jr. and the Ghost of Interpretive Validity

ERIC Educational Resources Information Center

O'Neill, Linda

2011-01-01

This article applies criteria for validity in interpretation to Eric Donald Hirsch, Jr.'s interpretations of John Dewey. Specifically, three criteria that Hirsch, himself, established in his earlier work are used to evaluate Hirsch's interpretation of John Dewey as a member of a class (romantics) who embraced a naive naturalism (trait) more often…

The relationship between external and internal validity of randomized controlled trials: A sample of hypertension trials from China.

PubMed

Zhang, Xin; Wu, Yuxia; Ren, Pengwei; Liu, Xueting; Kang, Deying

2015-10-30

To explore the relationship between the external validity and the internal validity of hypertension RCTs conducted in China. Comprehensive literature searches were performed in Medline, Embase, Cochrane Central Register of Controlled Trials (CCTR), CBMdisc (Chinese biomedical literature database), CNKI (China National Knowledge Infrastructure/China Academic Journals Full-text Database) and VIP (Chinese scientific journals database) as well as advanced search strategies were used to locate hypertension RCTs. The risk of bias in RCTs was assessed by a modified scale, Jadad scale respectively, and then studies with 3 or more grading scores were included for the purpose of evaluating of external validity. A data extract form including 4 domains and 25 items was used to explore relationship of the external validity and the internal validity. Statistic analyses were performed by using SPSS software, version 21.0 (SPSS, Chicago, IL). 226 hypertension RCTs were included for final analysis. RCTs conducted in university affiliated hospitals (P < 0.001) or secondary/tertiary hospitals (P < 0.001) were scored at higher internal validity. Multi-center studies (median = 4.0, IQR = 2.0) were scored higher internal validity score than single-center studies (median = 3.0, IQR = 1.0) (P < 0.001). Funding-supported trials had better methodological quality (P < 0.001). In addition, the reporting of inclusion criteria also leads to better internal validity (P = 0.004). Multivariate regression indicated sample size, industry-funding, quality of life (QOL) taken as measure and the university affiliated hospital as trial setting had statistical significance (P < 0.001, P < 0.001, P = 0.001, P = 0.006 respectively). Several components relate to the external validity of RCTs do associate with the internal validity, that do not stand in an easy relationship to each other. Regarding the poor reporting, other possible links between two variables need to trace in the future methodological researches.

Representativeness and response rates from the Domestic/International Gastroenterology Surveillance Study (DIGEST).

PubMed

Tijssen, J G

1999-01-01

The Domestic/international Gastroenterology Surveillance Study (DIGEST) examined the prevalence of upper gastrointestinal symptoms among the general population in 10 countries, and the impact of these symptoms on healthcare usage and quality of life. This report discusses the validation of the DIGEST sample and reviews the response rates from the survey. External validation of the DIGEST sample was conducted by comparing the age, age by gender and annual household incomes of the sample with census-derived data. A comparison was also made between Psychological General Well-Being Index (PGWBI) scores from study subjects in the Scandinavian countries and the USA and the total sample population norms. Under- and oversampling, defined as > or =5% difference from the population norms, was evident in eight out of 10 countries, but no systematic bias was evident. The final distribution of the sample by gender was 51% female and 49% male. Although differences in PGWBI scores were noted between DIGEST subjects and population norms, these differences were <0.30 standard deviations--markedly below the difference considered as relevant for the PGWBI. Response for the survey in individual countries ranged from 17% in the USA to 61% in Norway, with a survey-wide rate of 27%. The overall response rate, including primary non-respondents, was 13.4%. The majority of nonresponse (51.4%) was attributed to failure to establish contact with the subjects, with 41.7% of subjects declining to be interviewed and the remaining 6.9% of subjects not meeting the age and sex criteria used for the survey. The DIGEST sample exhibited good external validity, providing a foundation for comparison between data derived from individual countries in the survey.

Do We Really Know the Prevalence of MIH?

PubMed

Hernandez, M; Boj, J R; Espasa, E

2016-01-01

To analyze the existing variability on molar incisor hypomineralization prevalence in the literature; to distinguish the various molar incisor hypomineralization prevalence rates in different countries, areas, and regions of the world; and to know the valid diagnostic criteria used for the correct identification of molar incisor hypomineralization prevalence. A literature review from Medline and Cochrane Library online databases was performed using five terms individually or in combination. Articles not reporting diagnostic criteria employed and articles not written English were excluded. The results were analyzed by country, region, year of study, sample size, range of age, and prevalence rate. A total of 37 articles in English were selected from 1987 to 2014 and from those only 14 employed the EAPD's 2003 diagnostic criteria. The reported age range varied from 5.5 to 17 years; the most frequently range used was 7 to 9 years. A wide prevalence range from 2.8% to 44% was found and 82.61% of the articles reported calibrated examiners. Comparison among the results of the studies is difficult due to the use of different indexes and diagnostic criteria, the analysis variability, selection methods, and different age groups. In reality, we are probably far from knowing the real MIH prevalence.

Testing the validity of preventing chronic regional pain syndrome with vitamin C after distal radius fracture. [Corrected].

PubMed

Malay, Sunitha; Chung, Kevin C

2014-11-01

The American Academy of Orthopaedic Surgeons recommends the use of vitamin C to prevent complex regional pain syndrome (CRPS) for patients with distal radius fractures (DRFs). We hypothesized that the evidence for supporting this recommendation is weak, based on epidemiological principles of association and causality. The specific aim of this project was to test the validity of this recommendation. We conducted a literature review to retrieve articles reporting on the use of vitamin C to prevent CRPS. Data collected included sample size, study design type, dose of vitamin C used, and outcome measures of association expressed as relative risk (RR) and odds ratio. We then applied Hill criteria to evaluate the relationship between vitamin C and CRPS. We obtained 225 articles from the database search. After the exclusion of duplicates, unrelated articles, editorial letters, and commentaries, we found 4 articles and 1 systematic review relevant to our topic. Six of the 9 Hill criteria were met, and an earlier meta-analysis showed a quantified reduction in CRPS risk. However, criteria like biological plausibility, specificity, and coherence were not met. The number of causal/association criteria met was adequate to support the scientific premise of the effect of vitamin C in preventing CRPS after DRF. Furthermore, vitamin C administration is of relatively low cost and has few complications unless administered in large doses. Owing to sufficient epidemiological evidence availability, the American Academy of Orthopaedic Surgeons recommendation of vitamin C to prevent CRPS has practical merit. Therapeutic II. Copyright © 2014 American Society for Surgery of the Hand. Published by Elsevier Inc. All rights reserved.

Community-acquired bacterial pneumonia in human immunodeficiency virus-infected patients: validation of severity criteria. The Grupo Andaluz para el Estudio de las Enfermedades Infecciosas.

PubMed

Cordero, E; Pachón, J; Rivero, A; Girón, J A; Gómez-Mateos, J; Merino, M D; Torres-Tortosa, M; González-Serrano, M; Aliaga, L; Collado, A; Hernández-Quero, J; Barrera, A; Nuño, E

2000-12-01

Severity criteria for community-acquired pneumonia (CAP) have always excluded patients with human immunodeficiency virus (HIV) infection. A 1-yr, multicenter, prospective observational study of HIV-infected patients with bacterial CAP was done to validate the criteria used in the American Thoracic Society (ATS) guidelines for CAP, and to determine the prognosis-associated factors in the HIV-infected population with bacterial CAP. Overall, 355 cases were included, with an attributable mortality of 9.3%. Patients who met the ATS criteria had a longer hospital stay (p = 0.01), longer duration of fever (p < 0.001), and higher attributable mortality (13.1% versus 3.5%, p = 0.02) than those who did not. Three factors were independently related to mortality: CD4(+) cell count < 100/microl, radiologic progression of disease, and shock. Pleural effusion, cavities, and/or multilobar infiltrates at admission were independently associated with radiologic progression. A prognostic rule based on the five criteria of shock, CD4(+) cell count < 100/microl, pleural effusion, cavities, and multilobar infiltrates had a high negative predictive value for mortality (97.1%). The attributable mortality for severe pneumonia was 11.3%, as compared with 1.3% for nonsevere disease (p = 0.008). The ATS severity criteria are valid in HIV-infected patients with bacterial CAP. Our study provides the basis for identification of patients who may require hospitalization determined by clinical judgment and the five clinical criteria of shock, a CD4(+) cell count < 100/microl, pleural effusion, cavities, and multilobar involvement. These prognostic factors should be validated in independent cohort studies.

[Chronic pain disorder with somatic and psychological factors (F45.41) : Validation criteria on operationalization of the ICD-10-GM diagnosis].

PubMed

Arnold, B; Lutz, J; Nilges, P; Pfingsten, M; Rief, Winfried; Böger, A; Brinkschmidt, T; Casser, H-R; Irnich, D; Kaiser, U; Klimczyk, K; Sabatowski, R; Schiltenwolf, M; Söllner, W

2017-12-01

In 2009 the diagnosis chronic pain disorder with somatic and psychological factors (F45.41) was integrated into the German version of the International Classification of Diseases, version 10 (ICD-10-GM). In 2010 Paul Nilges and Winfried Rief published operationalization criteria for this diagnosis. In the present publication the ad hoc commission on multimodal interdisciplinary pain therapy of the German Pain Society now presents a formula for a clear validation of these operationalization criteria of the ICD code F45.41.

Molecular Weights of Bovine and Porcine Heparin Samples: Comparison of Chromatographic Methods and Results of a Collaborative Survey.

PubMed

Bertini, Sabrina; Risi, Giulia; Guerrini, Marco; Carrick, Kevin; Szajek, Anita Y; Mulloy, Barbara

2017-07-19

In a collaborative study involving six laboratories in the USA, Europe, and India the molecular weight distributions of a panel of heparin sodium samples were determined, in order to compare heparin sodium of bovine intestinal origin with that of bovine lung and porcine intestinal origin. Porcine samples met the current criteria as laid out in the USP Heparin Sodium monograph. Bovine lung heparin samples had consistently lower average molecular weights. Bovine intestinal heparin was variable in molecular weight; some samples fell below the USP limits, some fell within these limits and others fell above the upper limits. These data will inform the establishment of pharmacopeial acceptance criteria for heparin sodium derived from bovine intestinal mucosa. The method for MW determination as described in the USP monograph uses a single, broad standard calibrant to characterize the chromatographic profile of heparin sodium on high-resolution silica-based GPC columns. These columns may be short-lived in some laboratories. Using the panel of samples described above, methods based on the use of robust polymer-based columns have been developed. In addition to the use of the USP's broad standard calibrant for heparin sodium with these columns, a set of conditions have been devised that allow light-scattering detected molecular weight characterization of heparin sodium, giving results that agree well with the monograph method. These findings may facilitate the validation of variant chromatographic methods with some practical advantages over the USP monograph method.

Real external predictivity of QSAR models: how to evaluate it? Comparison of different validation criteria and proposal of using the concordance correlation coefficient.

PubMed

Chirico, Nicola; Gramatica, Paola

2011-09-26

The main utility of QSAR models is their ability to predict activities/properties for new chemicals, and this external prediction ability is evaluated by means of various validation criteria. As a measure for such evaluation the OECD guidelines have proposed the predictive squared correlation coefficient Q(2)(F1) (Shi et al.). However, other validation criteria have been proposed by other authors: the Golbraikh-Tropsha method, r(2)(m) (Roy), Q(2)(F2) (Schüürmann et al.), Q(2)(F3) (Consonni et al.). In QSAR studies these measures are usually in accordance, though this is not always the case, thus doubts can arise when contradictory results are obtained. It is likely that none of the aforementioned criteria is the best in every situation, so a comparative study using simulated data sets is proposed here, using threshold values suggested by the proponents or those widely used in QSAR modeling. In addition, a different and simple external validation measure, the concordance correlation coefficient (CCC), is proposed and compared with other criteria. Huge data sets were used to study the general behavior of validation measures, and the concordance correlation coefficient was shown to be the most restrictive. On using simulated data sets of a more realistic size, it was found that CCC was broadly in agreement, about 96% of the time, with other validation measures in accepting models as predictive, and in almost all the examples it was the most precautionary. The proposed concordance correlation coefficient also works well on real data sets, where it seems to be more stable, and helps in making decisions when the validation measures are in conflict. Since it is conceptually simple, and given its stability and restrictiveness, we propose the concordance correlation coefficient as a complementary, or alternative, more prudent measure of a QSAR model to be externally predictive.

Content validation of the 'Mosaic of Opinions About Abortion' (Mosai).

PubMed

Cacique, Denis Barbosa; Passini Junior, Renato; Osis, Maria José Martins Duarte

2013-01-01

This study aimed to develop and validate the contents of the Mosaico de Opiniões Sobre o Aborto Induzido (Mosai), a structured questionnaire intended to be used as a tool to collect information about the views of health professionals about the morality of abortion. The contents of the first version of the questionnaire was developed based on the technique of thematic content analysis of books, articles, films, websites and newspapers reporting cases of abortion and arguing about their practice. The Mosai was composed of 6 moral dilemmas (vignettes) related to induced abortion, whose outcomes should be chosen by the respondents and could be justified by the classification of 15 patterns of arguments about the morality of abortion. In order to validate its contents, the questionnaire was submitted to the scrutiny of a panel of 12 experts, an intentional sample consisted of doctors, lawyers, ethicists, sociologists, nurses and statisticians, who evaluated the criteria of clarity of writing, relevance, appropriateness to sample and suitability to the fields. These scores were analyzed by the method of concordance rate, while the free comments were analyzed using the analysis technique content. All the moral dilemmas and arguments were considered valid according to the rate of agreement, however, some comments led to the exclusion of a dilemma about emergency contraception, among other changes. The content of Mosai was considered valid to serve as a tool to collect the opinions of healthcare professionals regarding the morality of abortion. Copyright © 2013 Elsevier Editora Ltda. All rights reserved.

Examination of MMPI-2-RF Substantive Scales as Indicators of Acute Suicidal Affective Disturbance Components.

PubMed

Rogers, Megan L; Anestis, Joye C; Harrop, Tiffany M; Schneider, Matthew; Bender, Theodore W; Ringer, Fallon B; Joiner, Thomas E

2017-01-01

A new suicide-specific diagnostic entity, acute suicidal affective disturbance (ASAD), was recently proposed to fill a void in the nomenclature. Although several studies have examined the reliability, validity, and potential clinical utility of ASAD, no studies have examined personality indicators of ASAD. This study sought to examine the association between personality and psychopathology factors, as assessed by the Minnesota Multiphasic Personality Inventory-2-Revised Form (MMPI-2-RF), and constructs that comprise ASAD in a sample of 554 psychiatric outpatients who completed all measures prior to their intake appointments. A smaller subset of patients (N = 58) also completed a measure designed to assess lifetime ASAD symptoms. Results indicated that ASAD symptoms were associated with traits characterized by emotional turmoil and atypical cognitive processes. Further, suicide-related criteria that comprise ASAD were related to low positive emotionality and hopelessness, whereas the overarousal criteria were associated with somatic symptoms and an inability to tolerate frustration and stress. These findings expand on previous research that examines the convergent and discriminant validity of ASAD and could inform clinical treatment by providing insight into personality traits that might be associated with acute suicide risk.

Teaching learning methods of an entrepreneurship curriculum.

PubMed

Esmi, Keramat; Marzoughi, Rahmatallah; Torkzadeh, Jafar

2015-10-01

One of the most significant elements of entrepreneurship curriculum design is teaching-learning methods, which plays a key role in studies and researches related to such a curriculum. It is the teaching method, and systematic, organized and logical ways of providing lessons that should be consistent with entrepreneurship goals and contents, and should also be developed according to the learners' needs. Therefore, the current study aimed to introduce appropriate, modern, and effective methods of teaching entrepreneurship and their validation. This is a mixed method research of a sequential exploratory kind conducted through two stages: a) developing teaching methods of entrepreneurship curriculum, and b) validating developed framework. Data were collected through "triangulation" (study of documents, investigating theoretical basics and the literature, and semi-structured interviews with key experts). Since the literature on this topic is very rich, and views of the key experts are vast, directed and summative content analysis was used. In the second stage, qualitative credibility of research findings was obtained using qualitative validation criteria (credibility, confirmability, and transferability), and applying various techniques. Moreover, in order to make sure that the qualitative part is reliable, reliability test was used. Moreover, quantitative validation of the developed framework was conducted utilizing exploratory and confirmatory factor analysis methods and Cronbach's alpha. The data were gathered through distributing a three-aspect questionnaire (direct presentation teaching methods, interactive, and practical-operational aspects) with 29 items among 90 curriculum scholars. Target population was selected by means of purposive sampling and representative sample. Results obtained from exploratory factor analysis showed that a three factor structure is an appropriate method for describing elements of teaching-learning methods of entrepreneurship curriculum. Moreover, the value for Kaiser Meyer Olkin measure of sampling adequacy equaled 0.72 and the value for Bartlett's test of variances homogeneity was significant at the 0.0001 level. Except for internship element, the rest had a factor load of higher than 0.3. Also, the results of confirmatory factor analysis showed the model appropriateness, and the criteria for qualitative accreditation were acceptable. Developed model can help instructors in selecting an appropriate method of entrepreneurship teaching, and it can also make sure that the teaching is on the right path. Moreover, the model is comprehensive and includes all the effective teaching methods in entrepreneurship education. It is also based on qualities, conditions, and requirements of Higher Education Institutions in Iranian cultural environment.

Psychometric evaluation of the SF-36 (v.2) questionnaire in a probability sample of Brazilian households: results of the survey Pesquisa Dimensões Sociais das Desigualdades (PDSD), Brazil, 2008.

PubMed

Laguardia, Josué; Campos, Monica R; Travassos, Claudia M; Najar, Alberto L; Anjos, Luiz A; Vasconcellos, Miguel M

2011-08-03

In Brazil, despite the growing use of SF-36 in different research environments, most of the psychometric evaluation of the translated questionnaire was from studies with samples of patients. The purpose of this paper is to examine if the Brazilian version of SF-36 satisfies scaling assumptions, reliability and validity required for valid interpretation of the SF-36 summated ratings scales in the general population. 12,423 individuals and their spouses living in 8,048 households were selected from a stratified sample of all permanent households along the country to be interviewed using the Brazilian SF-36 (version 2). Psychometric tests were performed to evaluate the scaling assumptions based on IQOLA methodology. Data quality was satisfactory with questionnaire completion rate of 100%. The ordering of the item means within scales clustered as hypothesized. All item-scale correlations exceeded the suggested criteria for reliability with success rate of 100% and low floor and ceiling effects. All scales reached the criteria for group comparison and factor analysis identified two principal components that jointly accounted for 67.5% of the total variance. Role emotional and vitality were strongly correlated with physical and mental components, respectively, while social functioning was moderately correlated with both components. Role physical and mental health scales were, respectively, the most valid measures of the physical and mental health component. In the comparisons between groups that differed by the presence or absence of depression, subjects who reported having the disease had lower mean scores in all scales and mental health scale discriminated best between the two groups. Among those healthy and with one, two or three and more chronic illness, the average scores were inverted related to the number of diseases. Body pain, general health and vitality were the most discriminating scales between healthy and diseased groups. Higher scores were associated with individuals of male sex, age below 40 years old and high schooling. The Brazilian version of SF-36 performed well and the findings suggested that it is a reliable and valid measure of health related quality of life among the general population as well as a promising measure for research on health inequalities in Brazil.

Psychometric evaluation of the SF-36 (v.2) questionnaire in a probability sample of Brazilian households: results of the survey Pesquisa Dimensões Sociais das Desigualdades (PDSD), Brazil, 2008

PubMed Central

2011-01-01

Background In Brazil, despite the growing use of SF-36 in different research environments, most of the psychometric evaluation of the translated questionnaire was from studies with samples of patients. The purpose of this paper is to examine if the Brazilian version of SF-36 satisfies scaling assumptions, reliability and validity required for valid interpretation of the SF-36 summated ratings scales in the general population. Methods 12,423 individuals and their spouses living in 8,048 households were selected from a stratified sample of all permanent households along the country to be interviewed using the Brazilian SF-36 (version 2). Psychometric tests were performed to evaluate the scaling assumptions based on IQOLA methodology. Results Data quality was satisfactory with questionnaire completion rate of 100%. The ordering of the item means within scales clustered as hypothesized. All item-scale correlations exceeded the suggested criteria for reliability with success rate of 100% and low floor and ceiling effects. All scales reached the criteria for group comparison and factor analysis identified two principal components that jointly accounted for 67.5% of the total variance. Role emotional and vitality were strongly correlated with physical and mental components, respectively, while social functioning was moderately correlated with both components. Role physical and mental health scales were, respectively, the most valid measures of the physical and mental health component. In the comparisons between groups that differed by the presence or absence of depression, subjects who reported having the disease had lower mean scores in all scales and mental health scale discriminated best between the two groups. Among those healthy and with one, two or three and more chronic illness, the average scores were inverted related to the number of diseases. Body pain, general health and vitality were the most discriminating scales between healthy and diseased groups. Higher scores were associated with individuals of male sex, age below 40 years old and high schooling. Conclusions The Brazilian version of SF-36 performed well and the findings suggested that it is a reliable and valid measure of health related quality of life among the general population as well as a promising measure for research on health inequalities in Brazil. PMID:21812986

Rapid and Accurate Behavioral Health Diagnostic Screening: Initial Validation Study of a Web-Based, Self-Report Tool (the SAGE-SR)

PubMed Central

Purcell, Susan E; Rhea, Karen; Maier, Philip; First, Michael; Zweede, Lisa; Sinisterra, Manuela; Nunn, M Brad; Austin, Marie-Paule; Brodey, Inger S

2018-01-01

Background The Structured Clinical Interview for DSM (SCID) is considered the gold standard assessment for accurate, reliable psychiatric diagnoses; however, because of its length, complexity, and training required, the SCID is rarely used outside of research. Objective This paper aims to describe the development and initial validation of a Web-based, self-report screening instrument (the Screening Assessment for Guiding Evaluation-Self-Report, SAGE-SR) based on the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5) and the SCID-5-Clinician Version (CV) intended to make accurate, broad-based behavioral health diagnostic screening more accessible within clinical care. Methods First, study staff drafted approximately 1200 self-report items representing individual granular symptoms in the diagnostic criteria for the 8 primary SCID-CV modules. An expert panel iteratively reviewed, critiqued, and revised items. The resulting items were iteratively administered and revised through 3 rounds of cognitive interviewing with community mental health center participants. In the first 2 rounds, the SCID was also administered to participants to directly compare their Likert self-report and SCID responses. A second expert panel evaluated the final pool of items from cognitive interviewing and criteria in the DSM-5 to construct the SAGE-SR, a computerized adaptive instrument that uses branching logic from a screener section to administer appropriate follow-up questions to refine the differential diagnoses. The SAGE-SR was administered to healthy controls and outpatient mental health clinic clients to assess test duration and test-retest reliability. Cutoff scores for screening into follow-up diagnostic sections and criteria for inclusion of diagnoses in the differential diagnosis were evaluated. Results The expert panel reduced the initial 1200 test items to 664 items that panel members agreed collectively represented the SCID items from the 8 targeted modules and DSM criteria for the covered diagnoses. These 664 items were iteratively submitted to 3 rounds of cognitive interviewing with 50 community mental health center participants; the expert panel reviewed session summaries and agreed on a final set of 661 clear and concise self-report items representing the desired criteria in the DSM-5. The SAGE-SR constructed from this item pool took an average of 14 min to complete in a nonclinical sample versus 24 min in a clinical sample. Responses to individual items can be combined to generate DSM criteria endorsements and differential diagnoses, as well as provide indices of individual symptom severity. Preliminary measures of test-retest reliability in a small, nonclinical sample were promising, with good to excellent reliability for screener items in 11 of 13 diagnostic screening modules (intraclass correlation coefficient [ICC] or kappa coefficients ranging from .60 to .90), with mania achieving fair test-retest reliability (ICC=.50) and other substance use endorsed too infrequently for analysis. Conclusions The SAGE-SR is a computerized adaptive self-report instrument designed to provide rigorous differential diagnostic information to clinicians. PMID:29572204

The dimensionality of DSM-IV alcohol use disorders among adolescent and adult drinkers and symptom patterns by age, gender, and race/ethnicity.

PubMed

Harford, Thomas C; Yi, Hsiao-ye; Faden, Vivian B; Chen, Chiung M

2009-05-01

There is limited information on the validity of Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition (DSM-IV) alcohol use disorders (AUD) symptom criteria among adolescents in the general population. The purpose of this study is to assess the DSM-IV AUD symptom criteria as reported by adolescent and adult drinkers in a single representative sample of the U.S. population aged 12 years and older. This design avoids potential confounding due to differences in survey methodology when comparing adolescents and adults from different surveys. A total of 133,231 current drinkers (had at least 1 drink in the past year) aged 12 years and older were drawn from respondents to the 2002 to 2005 National Surveys on Drug Use and Health. DSM-IV AUD criteria were assessed by questions related to specific symptoms occurring during the past 12 months. Factor analytic and item response theory models were applied to the 11 AUD symptom criteria to assess the probabilities of symptom item endorsements across different values of the underlying trait. A 1-factor model provided an adequate and parsimonious interpretation for the 11 AUD criteria for the total sample and for each of the gender-age groups. The MIMIC model exhibited significant indication for item bias among some criteria by gender, age, and race/ethnicity. Symptom criteria for "tolerance,"time spent," and "hazardous use" had lower item thresholds (i.e., lower severity) and low item discrimination, and they were well separated from the other symptoms, especially in the 2 younger age groups (12 to 17 and 18 to 25). "Larger amounts,"cut down,"withdrawal," and "legal problems" had higher item thresholds but generally lower item discrimination, and they tend to exhibit greater dispersion at higher AUD severity, particularly in the youngest age group (12 to 17). Findings from the present study do not provide support for the 2 separate DSM-IV diagnoses of alcohol abuse and dependence among either adolescents or adults. Variations in criteria severity for both abuse and dependence offer support for a dimensional approach to diagnosis which should be considered in the ongoing development of DSM-V.

Development and Validation of Quality Criteria for Providing Patient- and Family-centered Injury Care.

PubMed

Boyd, Jamie M; Burton, Rachael; Butler, Barb L; Dyer, Dianne; Evans, David C; Felteau, Melissa; Gruen, Russell L; Jaffe, Kenneth M; Kortbeek, John; Lang, Eddy; Lougheed, Val; Moore, Lynne; Narciso, Michelle; Oxland, Peter; Rivara, Frederick P; Roberts, Derek; Sarakbi, Diana; Vine, Karen; Stelfox, Henry T

2017-08-01

The aim of this study was to develop and evaluate the content validity of quality criteria for providing patient- and family-centered injury care. Quality criteria have been developed for clinical injury care, but not patient- and family-centered injury care. Using a modified Research AND Development Corporation (RAND)/University of California, Los Angeles (UCLA) Appropriateness Methodology, a panel of 16 patients, family members, injury and quality of care experts serially rated and revised criteria for patient- and family-centered injury care identified from patient and family focus groups. The criteria were then sent to 384 verified trauma centers in the United States, Canada, Australia, and New Zealand for evaluation. A total of 46 criteria were rated and revised by the panel over 4 rounds of review producing 14 criteria related to clinical care (n = 4; transitions of care, pain management, patient safety, provider competence), communication (n = 3; information for patients/families; communication of discharge plans to patients/families, communication between hospital and community providers), holistic care (n = 4; patient hygiene, kindness and respect, family access to patient, social and spiritual support) and end-of-life care (n = 3; decision making, end-of-life care, family follow-up). Medical directors, managers, or coordinators representing 254 trauma centers (66% response rate) rated 12 criteria to be important (95% of responses) for patient- and family-centered injury care. Fewer centers rated family access to the patient (80%) and family follow-up after patient death (65%) to be important criteria. Fourteen-candidate quality criteria for patient- and family-centered injury care were developed and shown to have content validity. These may be used to guide quality improvement practices.

Validation of the Spanish Version of the Yale Food Addiction Scale 2.0 (YFAS 2.0) and Clinical Correlates in a Sample of Eating Disorder, Gambling Disorder, and Healthy Control Participants.

PubMed

Granero, Roser; Jiménez-Murcia, Susana; Gerhardt, Ashley N; Agüera, Zaida; Aymamí, Neus; Gómez-Peña, Mónica; Lozano-Madrid, María; Mallorquí-Bagué, Núria; Mestre-Bach, Gemma; Neto-Antao, Maria I; Riesco, Nadine; Sánchez, Isabel; Steward, Trevor; Soriano-Mas, Carles; Vintró-Alcaraz, Cristina; Menchón, José M; Casanueva, Felipe F; Diéguez, Carlos; Fernández-Aranda, Fernando

2018-01-01

Aims: Due to the increasing evidence of shared vulnerabilities between addictive behaviors and excessive food intake, the concept of food addiction in specific clinical populations has become a topic of scientific interest. The aim of this study was to validate the Yale Food Addiction Scale (YFAS) 2.0 in a Spanish sample. We also sought to explore food addiction and its clinical correlates in eating disorder (ED) and gambling disorder (GD) patients. Methods: The sample included 301 clinical cases (135 ED and 166 GD), diagnosed according to DSM-5 criteria, and 152 healthy controls (HC) recruited from the general population. Results: Food addiction was more prevalent in patients with ED, than in patients with GD and HC (77.8, 7.8, and 3.3%, respectively). Food addiction severity was associated with higher BMI, psychopathology and specific personality traits, such as higher harm avoidance, and lower self-directedness. The psychometrical properties of the Spanish version of the YFAS 2.0 were excellent with good convergent validity. Moreover, it obtained good accuracy in discriminating between diagnostic subtypes. Conclusions: Our results provide empirical support for the use of the Spanish YFAS 2.0 as a reliable and valid tool to assess food addiction among several clinical populations (namely ED and GD). The prevalence of food addiction is heterogeneous between disorders. Common risk factors such as high levels of psychopathology and low self-directedness appear to be present in individuals with food addiction.

A twin study of specific bulimia nervosa symptoms.

PubMed

Mazzeo, S E; Mitchell, K S; Bulik, C M; Aggen, S H; Kendler, K S; Neale, M C

2010-07-01

Twin studies have suggested that additive genetic factors significantly contribute to liability to bulimia nervosa (BN). However, the diagnostic criteria for BN remain controversial. In this study, an item-factor model was used to examine the BN diagnostic criteria and the genetic and environmental contributions to BN in a population-based twin sample. The validity of the equal environment assumption (EEA) for BN was also tested. Participants were 1024 female twins (MZ n=614, DZ n=410) from the population-based Mid-Atlantic Twin Registry. BN was assessed using symptom-level (self-report) items consistent with DSM-IV and ICD-10 diagnostic criteria. Items assessing BN were included in an item-factor model. The EEA was measured by items assessing similarity of childhood and adolescent environment, which have demonstrated construct validity. Scores on the EEA factor were used to specify the degree to which twins shared environmental experiences in this model. The EEA was not violated for BN. Modeling results indicated that the majority of the variance in BN was due to additive genetic factors. There was substantial variability in additive genetic and environmental contributions to specific BN symptoms. Most notably, vomiting was very strongly influenced by additive genetic factors, while other symptoms were much less heritable, including the influence of weight on self-evaluation. These results highlight the importance of assessing eating disorders at the symptom level. Refinement of eating disorder phenotypes could ultimately lead to improvements in treatment and targeted prevention, by clarifying sources of variation for specific components of symptomatology.

[Introduction of an accreditation system for hospital informed consent forms].

PubMed

López-Picazo, J J; Tomás-Garcia, N; Calle-Urra, J E; Parra-Hidalgo, P; Valverde-Iniesta, J J

2015-01-01

To describe an accreditation system for informed consent forms (ICF) in a tertiary hospital, as an intervention to improve their quality, and to check the improvements achieved. Following an external evaluation of the ICF quality in a public hospital in Murcia (Spain), an accreditation committee set the ICF requirements and associated procedures. Effectiveness is assessed by comparing two external evaluations carried out by the EMCA Program (2011 and 2013) and based on 19 criteria and a sample of 60 ICF for every public hospital in Murcia Region. To be accredited, every ICF must meet the 19 external criteria plus 5 based on legibility, readability and scientific and technical validity. A form to fill in the contents of every ICF was agreed, which would be reviewed, approved and validated for five years. Before the implementation, 8.2 defects/ICF were detected. The accreditation system obtained an 89% improvement (0.9 defects/ICF) and achieved significant improvements in 18 criteria, 16 of which are benchmarked. The accreditation system achieved a substantial improvement in the ICF (obtaining a better result in external evaluations) and guarantees their contents, legibility and readability. This system needs to be extended to other hospitals, since it is not clear whether common ICFs would be suitable. However, this improvement is structural and does not guarantee that the overall information/consent procedure is done properly, thus complementary strategies for measurement and improvement are required. Copyright © 2014 SECA. Published by Elsevier Espana. All rights reserved.

Finite element analysis of dental implants with validation: to what extent can we expect the model to predict biological phenomena? A literature review and proposal for classification of a validation process.

PubMed

Chang, Yuanhan; Tambe, Abhijit Anil; Maeda, Yoshinobu; Wada, Masahiro; Gonda, Tomoya

2018-03-08

A literature review of finite element analysis (FEA) studies of dental implants with their model validation process was performed to establish the criteria for evaluating validation methods with respect to their similarity to biological behavior. An electronic literature search of PubMed was conducted up to January 2017 using the Medical Subject Headings "dental implants" and "finite element analysis." After accessing the full texts, the context of each article was searched using the words "valid" and "validation" and articles in which these words appeared were read to determine whether they met the inclusion criteria for the review. Of 601 articles published from 1997 to 2016, 48 that met the eligibility criteria were selected. The articles were categorized according to their validation method as follows: in vivo experiments in humans (n = 1) and other animals (n = 3), model experiments (n = 32), others' clinical data and past literature (n = 9), and other software (n = 2). Validation techniques with a high level of sufficiency and efficiency are still rare in FEA studies of dental implants. High-level validation, especially using in vivo experiments tied to an accurate finite element method, needs to become an established part of FEA studies. The recognition of a validation process should be considered when judging the practicality of an FEA study.

Validation of Proposed "DSM-5" Criteria for Autism Spectrum Disorder

ERIC Educational Resources Information Center

Frazier, Thomas W.; Youngstrom, Eric A.; Speer, Leslie; Embacher, Rebecca; Law, Paul; Constantino, John; Findling, Robert L.; Hardan, Antonio Y.; Eng, Charis

2012-01-01

Objective: The primary aim of the present study was to evaluate the validity of proposed "DSM-5" criteria for autism spectrum disorder (ASD). Method: We analyzed symptoms from 14,744 siblings (8,911 ASD and 5,863 non-ASD) included in a national registry, the Interactive Autism Network. Youth 2 through 18 years of age were included if at least one…

Effects of Task Index Variations On Transfer of Training Criteria. Final Report.

ERIC Educational Resources Information Center

Mirabella, Angelo; Wheaton, George R.

The concluding series of a research program designed to validate a battery of task indexes for use in forecasting the effectiveness of training devices is described. Phase I collated 17 task indexes and applied them to sonar training devices, while in Phase II the 17 index battery was validated, using skill acquisition measures as criteria.…

The Error Prone Model and the Basic Grants Validation Selection System. Draft Final Report.

ERIC Educational Resources Information Center

System Development Corp., Falls Church, VA.

An evaluation of existing and proposed mechanisms to ensure data accuracy for the Pell Grant program is reported, and recommendations for efficient detection of fraud and error in the program are offered. One study objective was to examine the existing system of pre-established criteria (PEC), which are validation criteria that select students on…

Validation of the French Version of the Yale Food Addiction Scale: An Examination of Its Factor Structure, Reliability, and Construct Validity in a Nonclinical Sample

PubMed Central

Brunault, Paul; Ballon, Nicolas; Gaillard, Philippe; Réveillère, Christian; Courtois, Robert

2014-01-01

Objective: The concept of food addiction has recently been proposed by applying the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision, criteria for substance dependence to eating behaviour. Food addiction has received increased attention given that it may play a role in binge eating, eating disorders, and the recent increase in obesity prevalence. Currently, there is no psychometrically sound tool for assessing food addiction in French. Our study aimed to test the psychometric properties of a French version of the Yale Food Addiction Scale (YFAS) by establishing its factor structure and construct validity in a nonclinical population. Method: A total of 553 participants were assessed for food addiction (French version of the YFAS) and binge eating behaviour (Bulimic Investigatory Test Edinburgh and Binge Eating Scale). We tested the scale’s factor structure (factor analysis for dichotomous data based on tetrachoric correlation coefficients), internal consistency, and construct validity with measures of binge eating. Results: Our results supported a 1-factor structure, which accounted for 54.1% of the variance. This tool had adequate reliability and high construct validity with measures of binge eating in this population, both in its diagnosis and symptom count version. A 2-factor structure explained an additional 9.1% of the variance, and could differentiate between patients with high, compared with low, levels of insight regarding addiction symptoms. Conclusions: In our study, we validated a psychometrically sound French version of the YFAS, both in its symptom count and diagnostic version. Future studies should validate this tool in clinical samples. PMID:25007281

Development and validation of a liquid chromatography-tandem mass spectrometry analytical method for the therapeutic drug monitoring of eight novel anticancer drugs.

PubMed

Herbrink, M; de Vries, N; Rosing, H; Huitema, A D R; Nuijen, B; Schellens, J H M; Beijnen, J H

2018-04-01

To support therapeutic drug monitoring of patients with cancer, a fast and accurate method for simultaneous quantification of the registered anticancer drugs afatinib, axitinib, ceritinib, crizotinib, dabrafenib, enzalutamide, regorafenib and trametinib in human plasma using liquid chromatography tandem mass spectrometry was developed and validated. Human plasma samples were collected from treated patients and stored at -20°C. Analytes and internal standards (stable isotopically labeled analytes) were extracted with acetonitrile. An equal amount of 10 mm NH 4 CO 3 was added to the supernatant to yield the final extract. A 2 μL aliquot of this extract was injected onto a C 18 -column, gradient elution was applied and triple-quadrupole mass spectrometry in positive-ion mode was used for detection. All results were within the acceptance criteria of the latest US Food and Drug Administration guidance and European Medicines Agency guidelines on method validation, except for the carry-over of ceritinib and crizotinib. These were corrected for by the injection order of samples. Additional stability tests were carried out for axitinib and dabrafenib in relation to their reported photostability. In conclusion, the described method to simultaneously quantify the eight selected anticancer drugs in human plasma was successfully validated and applied for therapeutic drug monitoring in cancer patients treated with these drugs. Copyright © 2017 John Wiley & Sons, Ltd.

Evaluating the Medical Symptom Validity Test (MSVT) in a Sample of Veterans Between the Ages of 18 to 64.

PubMed

Reslan, Summar; Axelrod, Bradley N

2017-01-01

The purpose of the current study was to compare three potential profiles of the Medical Symptom Validity Test (MSVT; Pass, Genuine Memory Impairment Profile [GMIP], and Fail) on other freestanding and embedded performance validity tests (PVTs). Notably, a quantitatively computed version of the GMIP was utilized in this investigation. Data obtained from veterans referred for a neuropsychological evaluation in a metropolitan Veteran Affairs medical center were included (N = 494). Individuals age 65 and older were not included to exclude individuals with dementia from this investigation. The sample revealed 222 (45%) in the Pass group. Of the 272 who failed the easy subtests of the MSVT, 221 (81%) met quantitative criteria for the GMIP and 51 (19%) were classified as Fail. The Pass group failed fewer freestanding and embedded PVTs and obtained higher raw scores on all PVTs than both GMIP and Fail groups. The differences in performances of the GMIP and Fail groups were minimal. Specifically, GMIP protocols failed fewer freestanding PVTs than the Fail group; failure on embedded PVTs did not differ between GMIP and Fail. The MSVT GMIP incorporates the presence of clinical correlates of disability to assist with this distinction, but future research should consider performances on other freestanding measures of performance validity to differentiate cognitive impairment from invalidity.

Measuring self-determination motivation in a physical fitness setting: validation of the Behavioral Regulation in Exercise Questionnaire-2 (BREQ-2) in a Spanish sample.

PubMed

Murcia, J A M; Gimeno, E C; Camacho, A M

2007-09-01

The aim of this study is the validation in the Spanish context of the Behavioural Regulation in Exercise Questionnaire-2 (BREQ-2) scale, developed by Markland et al., from the point of view of the self-determination theory and to compare the effect of gender, age and exercise duration and mode. For the validation of the instrument, two studies were carried out (n=250 and n=311) with a total sample formed of 561 adults in the metropolitan area of the city of Murcia, Spain, who do non-competitive sport and physical activities. They were given the adaptation of the questionnaire BREQ-2 by Markland et al. to fill in. After an exploratory factor analysis and a confirmatory factor analysis, an adaptation of the scale was obtained with 18 items and 5 factors with acceptable reliability coefficients and a total variance explained of 68.8%. The two highest assessed forms of behavioral regulation were intrinsic and identified, with the women showing more intrinsic regulation. Those that exercised for less time were the ones that showed higher levels of amotivation and the older people showed a greater tendency to identified regulation. The BREQ-2 scale has all the required conditions, as far as reliability and validity criteria are concerned, to be used in the Spanish context in different areas of physical activity.

Advanced forensic validation for human spermatozoa identification using SPERM HY-LITER™ Express with quantitative image analysis.

PubMed

Takamura, Ayari; Watanabe, Ken; Akutsu, Tomoko

2017-07-01

Identification of human semen is indispensable for the investigation of sexual assaults. Fluorescence staining methods using commercial kits, such as the series of SPERM HY-LITER™ kits, have been useful to detect human sperm via strong fluorescence. These kits have been examined from various forensic aspects. However, because of a lack of evaluation methods, these studies did not provide objective, or quantitative, descriptions of the results nor clear criteria for the decisions reached. In addition, the variety of validations was considerably limited. In this study, we conducted more advanced validations of SPERM HY-LITER™ Express using our established image analysis method. Use of this method enabled objective and specific identification of fluorescent sperm's spots and quantitative comparisons of the sperm detection performance under complex experimental conditions. For body fluid mixtures, we examined interference with the fluorescence staining from other body fluid components. Effects of sample decomposition were simulated in high humidity and high temperature conditions. Semen with quite low sperm concentrations, such as azoospermia and oligospermia samples, represented the most challenging cases in application of the kit. Finally, the tolerance of the kit against various acidic and basic environments was analyzed. The validations herein provide useful information for the practical applications of the SPERM HY-LITER™ Express kit, which were previously unobtainable. Moreover, the versatility of our image analysis method toward various complex cases was demonstrated.

Improving the sensitivity and specificity of a bioanalytical assay for the measurement of certolizumab pegol.

PubMed

Smeraglia, John; Silva, John-Paul; Jones, Kieran

2017-08-01

In order to evaluate placental transfer of certolizumab pegol (CZP), a more sensitive and selective bioanalytical assay was required to accurately measure low CZP concentrations in infant and umbilical cord blood. Results & methodology: A new electrochemiluminescence immunoassay was developed to measure CZP levels in human plasma. Validation experiments demonstrated improved selectivity (no matrix interference observed) and a detection range of 0.032-5.0 μg/ml. Accuracy and precision met acceptance criteria (mean total error ≤20.8%). Dilution linearity and sample stability were acceptable and sufficient to support the method. The electrochemiluminescence immunoassay was validated for measuring low CZP concentrations in human plasma. The method demonstrated a more than tenfold increase in sensitivity compared with previous assays, and improved selectivity for intact CZP.

Special physical examination tests for superior labrum anterior-posterior shoulder tears: an examination of clinical usefulness.

PubMed

Sandrey, Michelle A

2013-01-01

Calvert E, Chambers GK, Regan W, Hawkins RH, Leith JM. Special physical examination tests for superior labrum anterior-posterior shoulder injuries are clinically limited and invalid: a diagnostic systematic review. J Clin Epidemiol. 2009;62(5):558-563. The systematic review focused on diagnostic accuracy studies to determine if evidence was sufficient to support the use of superior labrum anterior-posterior (SLAP) physical examination tests as valid and reliable. The primary question was whether there was sufficient evidence in the published literature to support the use of SLAP physical examination tests as valid and reliable diagnostic test procedures. Studies published in English were identified through database searches on MEDLINE, EMBASE, and the Cochrane database (1970-2004) using the search term SLAP lesions. The medical subject headings of arthroscopy, shoulder joint, and athletic injuries were combined with test or testing, physical examination, and sensitivity and specificity to locate additional sources. Other sources were identified by rereviewing the reference lists of included studies and review articles. Studies were eligible based on the following criteria: (1) published in English, (2) focused on the physical examination of SLAP lesions, and (3) presented original data. A study was excluded if the article was limited to a clinical description of 1 or more special tests without any research focus to provide clinical accuracy data or if it did not focus on the topic. The abstracts that were located through the search strategies were reviewed, and potentially relevant abstracts were selected. Strict epidemiologic methods were used to obtain and collate all relevant studies; the authors developed a study questionnaire to record study name, year of publication, study design, sample size, and statistics. Validity of the diagnostic test study was determined by applying the 5 criteria proposed by Calvert et al. If the study met the inclusion and validity criteria, 95% confidence intervals were calculated for each sensitivity, specificity, and positive and negative likelihood ratio reported. No specific information was provided about the procedure if the reviewers disagreed on how the evaluation criteria were applied. The specific search criteria led to the identification of 29 full-text articles. The studies were reviewed, and inclusion and exclusion criteria were applied. This resulted in 14 excluded studies and 15 eligible studies for analysis. Of the 15 eligible studies, 1 evaluated only a single physical examination test for a SLAP lesion or biceps tendon injury, and 10 studies evaluated 2 to 6 physical examination tests for a SLAP lesion or biceps tendon injury. Nine studies reported sensitivities and specificities greater than 75%, 4 had sensitivities less than 75%, 3 had specificities less than 75%, 1 did not report sensitivity, and 2 did not report specificities. When validity was assessed for those 15 papers, only 1 study that evaluated the biceps tendon met the 5 critical appraisal criteria of Calvert et al and calculated 95% confidence intervals. When the Speed and Yergason tests were each compared with the gold standard (arthroscopy), the confidence intervals for the positive and negative likelihood ratios spanned 1. This indicated that the test result is unlikely to change the odds of having or not having the condition, respectively. The literature currently used as a reference for teaching in medical schools and continuing education lacks the necessary validity to help rule in or out a SLAP lesion or biceps tendon involvement. Based on the results from the systematic review conducted by Calvert et al, no tests clinically diagnose a SLAP lesion. This is a cause for concern as magnetic resonance imaging or magnetic resonance arthrography, which are frequently used to assess a possible SLAP lesion, may also have diagnostic flaws and may be cost prohibitive. Performing arthroscopy on every patient to rule the condition in or out is unethical, especially if a SLAP lesion is not present. More rigorous validity studies should be conducted for SLAP lesion physical examination tests using the Quality Assessment of Diagnostic Accuracy Studies (QUADAS) tool or Standards for Reporting Diagnostic Accuracy (STARD) criteria.

Special Physical Examination Tests for Superior Labrum Anterior-Posterior Shoulder Tears: An Examination of Clinical Usefulness

PubMed Central

Sandrey, Michelle A.

2013-01-01

Reference/Citation: Calvert E, Chambers GK, Regan W, Hawkins RH, Leith JM. Special physical examination tests for superior labrum anterior-posterior shoulder injuries are clinically limited and invalid: a diagnostic systematic review. J Clin Epidemiol. 2009;62(5):558–563. Clinical Question: The systematic review focused on diagnostic accuracy studies to determine if evidence was sufficient to support the use of superior labrum anterior-posterior (SLAP) physical examination tests as valid and reliable. The primary question was whether there was sufficient evidence in the published literature to support the use of SLAP physical examination tests as valid and reliable diagnostic test procedures. Data Sources: Studies published in English were identified through database searches on MEDLINE, EMBASE, and the Cochrane database (1970–2004) using the search term SLAP lesions. The medical subject headings of arthroscopy, shoulder joint, and athletic injuries were combined with test or testing, physical examination, and sensitivity and specificity to locate additional sources. Other sources were identified by rereviewing the reference lists of included studies and review articles. Study Selection: Studies were eligible based on the following criteria: (1) published in English, (2) focused on the physical examination of SLAP lesions, and (3) presented original data. A study was excluded if the article was limited to a clinical description of 1 or more special tests without any research focus to provide clinical accuracy data or if it did not focus on the topic. Data Extraction: The abstracts that were located through the search strategies were reviewed, and potentially relevant abstracts were selected. Strict epidemiologic methods were used to obtain and collate all relevant studies; the authors developed a study questionnaire to record study name, year of publication, study design, sample size, and statistics. Validity of the diagnostic test study was determined by applying the 5 criteria proposed by Calvert et al. If the study met the inclusion and validity criteria, 95% confidence intervals were calculated for each sensitivity, specificity, and positive and negative likelihood ratio reported. No specific information was provided about the procedure if the reviewers disagreed on how the evaluation criteria were applied. Main Results: The specific search criteria led to the identification of 29 full-text articles. The studies were reviewed, and inclusion and exclusion criteria were applied. This resulted in 14 excluded studies and 15 eligible studies for analysis. Of the 15 eligible studies, 1 evaluated only a single physical examination test for a SLAP lesion or biceps tendon injury, and 10 studies evaluated 2 to 6 physical examination tests for a SLAP lesion or biceps tendon injury. Nine studies reported sensitivities and specificities greater than 75%, 4 had sensitivities less than 75%, 3 had specificities less than 75%, 1 did not report sensitivity, and 2 did not report specificities. When validity was assessed for those 15 papers, only 1 study that evaluated the biceps tendon met the 5 critical appraisal criteria of Calvert et al and calculated 95% confidence intervals. When the Speed and Yergason tests were each compared with the gold standard (arthroscopy), the confidence intervals for the positive and negative likelihood ratios spanned 1. This indicated that the test result is unlikely to change the odds of having or not having the condition, respectively. Conclusions: The literature currently used as a reference for teaching in medical schools and continuing education lacks the necessary validity to help rule in or out a SLAP lesion or biceps tendon involvement. Based on the results from the systematic review conducted by Calvert et al, no tests clinically diagnose a SLAP lesion. This is a cause for concern as magnetic resonance imaging or magnetic resonance arthrography, which are frequently used to assess a possible SLAP lesion, may also have diagnostic flaws and may be cost prohibitive. Performing arthroscopy on every patient to rule the condition in or out is unethical, especially if a SLAP lesion is not present. More rigorous validity studies should be conducted for SLAP lesion physical examination tests using the Quality Assessment of Diagnostic Accuracy Studies (QUADAS) tool or Standards for Reporting Diagnostic Accuracy (STARD) criteria. PMID:23914880

Placing symptoms in context: the role of contextual criteria in reducing false positives in Diagnostic and Statistical Manual of Mental Disorders diagnoses.

PubMed

Wakefield, Jerome C; First, Michael B

2012-02-01

The Diagnostic and Statistical Manual of Mental Disorders (DSM) definition of mental disorder requires that symptoms be caused by a dysfunction in the individual; when dysfunction is absent, symptoms represent normal-range distress or eccentricity and, if diagnosed as a mental disorder, are false positives. We hypothesized that because of psychiatry's lack of direct laboratory tests to distinguish dysfunction from normal-range distress, the context in which symptoms occur (eg, lack of imminent danger in a panic attack) is often essential to determining whether symptoms are caused by a dysfunction. If this is right, then the DSM diagnostic criteria should include many contextual criteria added to symptom syndromes to prevent dysfunction false positives. Despite their potential importance, such contextual criteria have not been previously reviewed. We, thus, systematically reviewed DSM categories to establish the extent of such uses of contextual criteria and created a typology of such uses. Of 111 sampled categories, 68 (61%) used context to prevent dysfunction false positives. Contextual criteria fell into 7 types: (1) exclusion of specific false-positive scenarios; (2) requiring that patients experience preconditions for normal responses (eg, requiring that individuals experience adequate sexual stimulation before being diagnosed with sexual dysfunctions); (3) requiring that symptoms be disproportionate relative to circumstances; (4) for childhood disorders, requiring that symptoms be developmentally inappropriate; (5) requiring that symptoms occur in multiple contexts; (6) requiring a substantial discrepancy between beliefs and reality; and (7) a residual category. Most DSM categories include contextual criteria to eliminate false-positive diagnoses and increase validity of descriptive criteria. Future revisions should systematically evaluate each category's need for contextual criteria. Copyright © 2012 Elsevier Inc. All rights reserved.

Evaluation of Micronutrient Sensors for Food Matrices in Resource-Limited Settings: A Systematic Narrative Review.

PubMed

Waller, Anna W; Lotton, Jennifer L; Gaur, Shashank; Andrade, Jeanette M; Andrade, Juan E

2018-06-21

In resource-limited settings, mass food fortification is a common strategy to ensure the population consumes appropriate quantities of essential micronutrients. Food and government organizations in these settings, however, lack tools to monitor the quality and compliance of fortified products and their efficacy to enhance nutrient status. The World Health Organization has developed general guidelines known as ASSURED (Affordable, Sensitive, Specific, User-friendly, Rapid and Robust, Equipment-free, and Deliverable to end-users) to aid the development of useful diagnostic tools for these settings. These guidelines assume performance aspects such as sufficient accuracy, reliability, and validity. The purpose of this systematic narrative review is to examine the micronutrient sensor literature on its adherence towards the ASSURED criteria along with accuracy, reliability, and validation when developing micronutrient sensors for resource-limited settings. Keyword searches were conducted in three databases: Web of Science, PubMed, and Scopus and were based on 6-point inclusion criteria. A 16-question quality assessment tool was developed to determine the adherence towards quality and performance criteria. Of the 2,365 retrieved studies, 42 sensors were included based on inclusion/exclusion criteria. Results showed that improvements to the current sensor design are necessary, especially their affordability, user-friendliness, robustness, equipment-free, and deliverability within the ASSURED criteria, and accuracy and validity of the additional criteria to be useful in resource-limited settings. Although it requires further validation, the 16-question quality assessment tool can be used as a guide in the development of sensors for resource-limited settings. © 2018 Institute of Food Technologists®.

Cyclosporine A area-under-time-concentration-curve in rheumatologic patients after the first dose. Which of the sparse sampling strategies will predict the best?

PubMed

Koristkova, B; Grundmann, M; Suchy, D; Perinova, I; Brozmanova, H; Mayer, O

2011-05-01

The aim of the present study was to validate the limited sampling strategies (LSS:s) for prediction of AUC of cyclosporine A (CsA) after the first dose in rheumatologic patients. 22 patients suffering from rheumathoid arthritis, systemic lupus erythematodus, ankylosing spondylitis dermato(poly)myositis or seronegative spondylarthritis were treated with Neoral® (female/male: 11/3, mean ± SD: age 49 ± 14 y, body weight 75 ± 12 kg, height 166 ± 7 cm, dose 71 ± 25 mg, dose per kg 1.0 ± 0.3 mg/kg), or Consupren® (7/1, 78 ± 36, 175 ± 8, 82 ± 22, 1.1 ± 0.3). Two patients whose C12h were missing were excluded from the AUC0-12 calculation. Whole blood levels of CsA were analyzed with HPLC. Blood samples were collected at 0, 0.5, 1, 1.5, 2, 3, 4, 6, 8, and 12 hours after taking the first dose. Altogether 115 LSS:s obtained from the literature were validated. A linear trapezoidal rule was used as a reference method. Mean percentage prediction error (%PE) < ± 15% and maximal one value of absolute %PE > 30% were considered to be acceptable. The root mean squared error (RMSE) was evaluated for equations that passed the criteria. The best performance with all values of the absolute %PE < 30% was found in three LSS:s for AUC0-12 and two for AUC0-8: AUC0-12 = 123.792 + 1.165 × C1h + 3.021 × C3h + 7.33 × C8h; 97.6 + 1.27 × C1h + 3.14 × C3h + 4.06 × C6h; or 124.3 + 1.34 × C1h - 0.16 × C2h + 3.27 × C3h + 3.96 × C6h; AUC0-8 = -19.8 + 1.99 × C2h + 2.38 × C4h + 3.15 × C6h or -22.4 + 2.51 × C2h + 5.49 × C6h. Validation criteria were further fulfilled in AUC0-12 = 24 + 3.66 × C0h + 2.11 × C1.5h + 4.54 × C4h or 0.2 + 2 × C2h + 10.2 × C6h; AUC0-8 = 55.37 + 2.89 × C0h + 1.08 × C1 + 0.9 × C2h + 2.23 × C3h; and AUC0-4 = -41 + 1.17 × C1h + 1.85 × C2h. Only one equation proposed for AUC0-6 did not pass the validation criteria. Equations validated for prediction of AUC0-12, AUC0-8 and AUC0-4 might be used for LSS:s of CsA independently of the length of treatment, indication, dosage or galenic formulation.

Transformational and transactional leadership: a meta-analytic test of their relative validity.

PubMed

Judge, Timothy A; Piccolo, Ronald F

2004-10-01

This study provided a comprehensive examination of the full range of transformational, transactional, and laissez-faire leadership. Results (based on 626 correlations from 87 sources) revealed an overall validity of .44 for transformational leadership, and this validity generalized over longitudinal and multisource designs. Contingent reward (.39) and laissez-faire (-.37) leadership had the next highest overall relations; management by exception (active and passive) was inconsistently related to the criteria. Surprisingly, there were several criteria for which contingent reward leadership had stronger relations than did transformational leadership. Furthermore, transformational leadership was strongly correlated with contingent reward (.80) and laissez-faire (-.65) leadership. Transformational and contingent reward leadership generally predicted criteria controlling for the other leadership dimensions, although transformational leadership failed to predict leader job performance. (c) 2004 APA, all rights reserved

Simultaneous determination of trace migration of phthalate esters in honey and royal jelly by GC-MS.

PubMed

Zhou, Jinhui; Qi, Yitao; Wu, Hongmei; Diao, Qingyun; Tian, Feifei; Li, Yi

2014-03-01

A simple, rapid, and reliable liquid-liquid extraction coupled to GC-MS method was developed and validated for the quantification of 22 phthalate esters (PAEs) in honey and royal jelly. Instrument parameters for GC-MS were tested to obtain the satisfactory separation between 22 PAEs with high sensitivity. The extraction procedure was optimized in order to achieve the best recovery. The following criteria were used to validate the developed method: linearity, LOD, lower LOQ, precision, accuracy, matrix effect and carry-over. Correlation coefficients were >0.999 by applying the linear regression model based on the least-squares method with a weighting factor (1/x). The intra- and interday precision were within 12.7% in terms of RSD, and the accuracy was within -11.8% in terms of relative error. The mean extraction recoveries ranged between 80.1 and 110.9% for honey and royal jelly. No significant matrix effect and carry-over for PAEs were observed for the analysis of honey and royal jelly samples. A total of 20 real samples were analyzed for a mini-survey using the developed method. Seven PAEs in honey samples and five PAEs in royal jelly samples were found, indicating potential contamination with several PAEs. © 2014 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.

Validation of cross-cultural child mental health and psychosocial research instruments: adapting the Depression Self-Rating Scale and Child PTSD Symptom Scale in Nepal

PubMed Central

2011-01-01

Background The lack of culturally adapted and validated instruments for child mental health and psychosocial support in low and middle-income countries is a barrier to assessing prevalence of mental health problems, evaluating interventions, and determining program cost-effectiveness. Alternative procedures are needed to validate instruments in these settings. Methods Six criteria are proposed to evaluate cross-cultural validity of child mental health instruments: (i) purpose of instrument, (ii) construct measured, (iii) contents of construct, (iv) local idioms employed, (v) structure of response sets, and (vi) comparison with other measurable phenomena. These criteria are applied to transcultural translation and alternative validation for the Depression Self-Rating Scale (DSRS) and Child PTSD Symptom Scale (CPSS) in Nepal, which recently suffered a decade of war including conscription of child soldiers and widespread displacement of youth. Transcultural translation was conducted with Nepali mental health professionals and six focus groups with children (n = 64) aged 11-15 years old. Because of the lack of child mental health professionals in Nepal, a psychosocial counselor performed an alternative validation procedure using psychosocial functioning as a criterion for intervention. The validation sample was 162 children (11-14 years old). The Kiddie-Schedule for Affective Disorders and Schizophrenia (K-SADS) and Global Assessment of Psychosocial Disability (GAPD) were used to derive indication for treatment as the external criterion. Results The instruments displayed moderate to good psychometric properties: DSRS (area under the curve (AUC) = 0.82, sensitivity = 0.71, specificity = 0.81, cutoff score ≥ 14); CPSS (AUC = 0.77, sensitivity = 0.68, specificity = 0.73, cutoff score ≥ 20). The DSRS items with significant discriminant validity were "having energy to complete daily activities" (DSRS.7), "feeling that life is not worth living" (DSRS.10), and "feeling lonely" (DSRS.15). The CPSS items with significant discriminant validity were nightmares (CPSS.2), flashbacks (CPSS.3), traumatic amnesia (CPSS.8), feelings of a foreshortened future (CPSS.12), and easily irritated at small matters (CPSS.14). Conclusions Transcultural translation and alternative validation feasibly can be performed in low clinical resource settings through task-shifting the validation process to trained mental health paraprofessionals using structured interviews. This process is helpful to evaluate cost-effectiveness of psychosocial interventions. PMID:21816045

Development and validation of a new Prescription Quality Index

PubMed Central

Hassan, Norul Badriah; Ismail, Hasanah Che; Naing, Lin; Conroy, Ronán M; Abdul Rahman, Abdul Rashid

2010-01-01

AIMS The aims were to develop and validate a new Prescription Quality Index (PQI) for the measurement of prescription quality in chronic diseases. METHODS The PQI were developed and validated based on three separate surveys and one pilot study. Criteria were developed based on literature search, discussions and brainstorming sessions. Validity of the criteria was examined using modified Delphi method. Pre-testing was performed on 30 patients suffering from chronic diseases. The modified version was then subjected to reviews by pharmacists and clinicians in two separate surveys. The rater-based PQI with 22 criteria was then piloted in 120 patients with chronic illnesses. Results were analysed using SPSS version 12.0.1 RESULTS Exploratory principal components analysis revealed multiple factors contributing to prescription quality. Cronbach's α for the entire 22 criteria was 0.60. The average intra-rater and inter-rater reliability showed good to moderate stability (intraclass correlation coefficient 0.76 and 0.52, respectively). The PQI was significantly and negatively correlated with age (correlation coefficient −0.34, P < 0.001), number of drugs in prescriptions (correlation coefficient −0.51, P < 0.001) and number of chronic diseases/conditions (correlation coefficient −0.35, P < 0.001). CONCLUSIONS The PQI is a promising new instrument for measuring prescription quality. It has been shown that the PQI is a valid, reliable and responsive tool to measure quality of prescription in chronic diseases. PMID:20840442

Intermittent explosive disorder: development of integrated research criteria for Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition.

PubMed

Coccaro, Emil F

2011-01-01

This study was designed to develop a revised diagnostic criteria set for intermittent explosive disorder (IED) for consideration for inclusion in Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-V). This revised criteria set was developed by integrating previous research criteria with elements from the current DSM-IV set of diagnostic criteria. Evidence supporting the reliability and validity of IED-IR ("IED Integrated Criteria") in a new and well-characterized group of subjects with personality disorder is presented. Clinical, phenomenologic, and diagnostic data from 201 individuals with personality disorder were reviewed. All IED diagnoses were assigned using a best-estimate process (eg, kappa for IED-IR >0.85). In addition, subjects meeting IED-IR criteria had higher scores on dimensional measures of aggression and had lower global functioning scores than non-IED-IR subjects, even when related variables were controlled. The IED-IR criteria were more sensitive than the DSM-IV criteria only in identifying subjects with significant impulsive-aggressive behavior by a factor of 16. We conclude that the IED-IR criteria can be reliably applied and have sufficient validity to warrant consideration as DSM-V criteria for IED. Copyright © 2011 Elsevier Inc. All rights reserved.

Validation of the Italian version of the Yale Food Addiction Scale 2.0 (I-YFAS 2.0) in a sample of undergraduate students.

PubMed

Aloi, Matteo; Rania, Marianna; Rodríguez Muñoz, Rita Cristina; Jiménez Murcia, Susana; Fernández-Aranda, Fernando; De Fazio, Pasquale; Segura-Garcia, Cristina

2017-09-01

Food addiction (FA) refers to a condition characterized by addiction in relation to some high-fat and high-sugar carbohydrate that leads to clinically significant impairment or distress on several areas of functioning. The Yale Food Addiction Scale 2.0 (YFAS 2.0) has been recently updated to measure FA according to the DSM-5 criteria for substance-related and addictive disorders. This study aimed at validating the Italian version of YFAS 2.0. A sample of 574 Italian university students was involved in this research. Confirmatory Factor Analysis (CFA) and Kuder-Richardson's alpha for dichotomous data were run to evaluate scale structure and reliability. Correlations between YFAS 2.0 and eating psychopathology, binge eating, sleep, and mood symptoms were evaluated. Analogously to the original version, a single factor structure emerged at the CFA. The alpha coefficient was 0.87. Moreover, sound, from moderate to high, correlations were found with other measures. The Italian version of the YFAS 2.0 has demonstrated in a sample of university students to be a useful tool to investigate food addictions. Level of evidence Level V, descriptive study.

Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF) predictors of police officer problem behavior.

PubMed

Tarescavage, Anthony M; Corey, David M; Ben-Porath, Yossef S

2015-02-01

The purpose of this study was to investigate the predictive validity of the Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF) in a sample of law enforcement officers. MMPI-2-RF scores were collected from preemployment psychological evaluations of 136 male police officers, and supervisor ratings of performance and problem behavior were subsequently obtained during the initial probationary period. The sample produced meaningfully lower and less variant substantive scale scores than the general population and the MMPI-2-RF Police Candidate comparison group, which significantly affected effect sizes for the zero-order correlations. After applying a correction for range restriction, MMPI-2-RF substantive scales demonstrated moderate to strong associations with criteria, particularly in the Emotional Dysfunction and Interpersonal Functioning domains. Relative risk ratio analyses showed that cutoffs of 45T and 50T maintained reasonable selection ratios because of the exceptionally low scores in this sample and were associated with significantly increased risk for problematic behavior. These results provide support for the predictive validity of the MMPI-2-RF substantive scales in this setting. Implications of these findings and limitations of these results are discussed. © The Author(s) 2014.

Validity, Responsibility, and Aporia

ERIC Educational Resources Information Center

Koro-Ljungberg, Mirka

2010-01-01

In this article, the author problematizes external, objectified, oversimplified, and mechanical approaches to validity in qualitative research, which endorse simplistic and reductionist views of knowledge and data. Instead of promoting one generalizable definition or operational criteria for validity, the author's "deconstructive validity work"…

Choosing front-of-package food labelling nutritional criteria: how smart were 'Smart Choices'?

PubMed

Roberto, Christina A; Bragg, Marie A; Livingston, Kara A; Harris, Jennifer L; Thompson, Jackie M; Seamans, Marissa J; Brownell, Kelly D

2012-02-01

The 'Smart Choices' programme was an industry-driven, front-of-package (FOP) nutritional labelling system introduced in the USA in August 2009, ostensibly to help consumers select healthier options during food shopping. Its nutritional criteria were developed by members of the food industry in collaboration with nutrition and public health experts and government officials. The aim of the present study was to test the extent to which products labelled as 'Smart Choices' could be classified as healthy choices on the basis of the Nutrient Profile Model (NPM), a non-industry-developed, validated nutritional standard. A total of 100 packaged products that qualified for a 'Smart Choices' designation were sampled from eight food and beverage categories. All products were evaluated using the NPM method. In all, 64 % of the products deemed 'Smart Choices' did not meet the NPM standard for a healthy product. Within each 'Smart Choices' category, 0 % of condiments, 8·70 % of fats and oils, 15·63 % of cereals and 31·58 % of snacks and sweets met NPM thresholds. All sampled soups, beverages, desserts and grains deemed 'Smart Choices' were considered healthy according to the NPM standard. The 'Smart Choices' programme is an example of industries' attempts at self-regulation. More than 60 % of foods that received the 'Smart Choices' label did not meet standard nutritional criteria for a 'healthy' food choice, suggesting that industries' involvement in designing labelling systems should be scrutinized. The NPM system may be a good option as the basis for establishing FOP labelling criteria, although more comparisons with other systems are needed.

Analytical method for the identification and assay of 12 phthalates in cosmetic products: application of the ISO 12787 international standard "Cosmetics-Analytical methods-Validation criteria for analytical results using chromatographic techniques".

PubMed

Gimeno, Pascal; Maggio, Annie-Françoise; Bousquet, Claudine; Quoirez, Audrey; Civade, Corinne; Bonnet, Pierre-Antoine

2012-08-31

Esters of phthalic acid, more commonly named phthalates, may be present in cosmetic products as ingredients or contaminants. Their presence as contaminant can be due to the manufacturing process, to raw materials used or to the migration of phthalates from packaging when plastic (polyvinyl chloride--PVC) is used. 8 phthalates (DBP, DEHP, BBP, DMEP, DnPP, DiPP, DPP, and DiBP), classified H360 or H361, are forbidden in cosmetics according to the European regulation on cosmetics 1223/2009. A GC/MS method was developed for the assay of 12 phthalates in cosmetics, including the 8 phthalates regulated. Analyses are carried out on a GC/MS system with electron impact ionization mode (EI). The separation of phthalates is obtained on a cross-linked 5%-phenyl/95%-dimethylpolysiloxane capillary column 30 m × 0.25 mm (i.d.) × 0.25 mm film thickness using a temperature gradient. Phthalate quantification is performed by external calibration using an internal standard. Validation elements obtained on standard solutions, highlight a satisfactory system conformity (resolution>1.5), a common quantification limit at 0.25 ng injected, an acceptable linearity between 0.5 μg mL⁻¹ and 5.0 μg mL⁻¹ as well as a precision and an accuracy in agreement with in-house specifications. Cosmetic samples ready for analytical injection are analyzed after a dilution in ethanol whereas more complex cosmetic matrices, like milks and creams, are assayed after a liquid/liquid extraction using ter-butyl methyl ether (TBME). Depending on the type of cosmetics analyzed, the common limits of quantification for the 12 phthalates were set at 0.5 or 2.5 μg g⁻¹. All samples were assayed using the analytical approach described in the ISO 12787 international standard "Cosmetics-Analytical methods-Validation criteria for analytical results using chromatographic techniques". This analytical protocol is particularly adapted when it is not possible to make reconstituted sample matrices. Copyright © 2012 Elsevier B.V. All rights reserved.

[How valid are student self-reports of bullying in schools?].

PubMed

Morbitzer, Petra; Spröber, Nina; Hautzinger, Martin

2009-01-01

In this study we examine the reliability and validity of students' self-reports about bullying and victimization in schools. 208 5th class students of four "middle schools" in Southern Germany filled in the Bully-Victim-Questionnaire (Olweus, 1989, adapted by Lösel, Bliesener, Averbeck, 1997) and the School Climate Survey (Brockenborough, 2001) to assess the prevalence of bullying/victimization, and to evaluate attitudes towards aggression and support for victims. By using reliability and validity criteria, one third (31%) of the questionnaires was classified as "unreliable/invalid". Mean comparisons of the "unreliable/invalid" group and the "valid" group of the subscales concerning bullying/victimization found significant differences. The "unreliable/invalid" group stated higher values of bullying and victimization. Based on the "unreliable/invalid" questionnaires more students could be identified as bullies/victims or bully-victims. The prevalence of bullying/victimization in the whole sample was reduced if "unreliable/invalid" questionnaires were excluded. The results are discussed in the framework of theories about the presentation of the self ("impression management', "social desirability") and systematic response patterns ("extreme response bias").

[Design and validation of the scale for the detection of violence in courtship in young people in the Sevilla University (Spain)].

PubMed

García-Carpintero, María Ángeles; Rodríguez-Santero, Javier; Porcel-Gálvez, Ana María

To design and validate a specific instrument to detect exercised and suffered in the relations of young couples in violence. Descriptive study of validation clinimetric. Stratified by sex and area of knowledge, which was adopted as inclusion criteria have or have had any relationship. The sample consisted of 447 subjects. We obtained the Multidimensional Scale Dating Violence (EMVN), 32 items with three dimensions: physical and sexual assault, behavior control (cyberbullying, surveillance and harassment) and abuse psicoemocional (disparagement and domination), as a victim or as aggressor. No statistically significant differences were found between the violence exerted and the violence suffered, but it was based on sex. The EMVN is a valid and reliable scale that measures the different elements of violence in couples of young people and you can suppose a resource for the comprehensive detection of violent behaviors in dating relationships that are established among young people. Copyright © 2017 SESPAS. Publicado por Elsevier España, S.L.U. All rights reserved.

Portuguese Children's Sleep Habits Questionnaire - validation and cross-cultural comparison.

PubMed

Silva, Filipe Glória; Silva, Cláudia Rocha; Braga, Lígia Barbosa; Neto, Ana Serrão

2014-01-01

To validate the Portuguese version of the Children's Sleep Habits Questionnaire (CSHQ-PT) and compare it to the versions from other countries. The questionnaire was previously adapted to the Portuguese language according to international guidelines. 500 questionnaires were delivered to the parents of a Portuguese community sample of children aged 2 to 10 years old. 370 (74%) valid questionnaires were obtained, 55 children met exclusion criteria and 315 entered in the validation study. The CSHQ-PT internal consistency (Cronbach's α) was 0.78 for the total scale and ranged from 0.44 to 0.74 for subscales. The test-retest reliability for subscales (Pearson's correlations, n=58) ranged from 0.59 to 0.85. Our data did not adjust to the original 8 domains structure in Confirmatory Factor Analysis but the Exploratory Factor Analysis extracted 5 factors that have correspondence to CSHQ subscales. The CSHQ-PT evidenced psychometric properties that are comparable to the versions from other countries and adequate for the screening of sleep disturbances in children from 2 to 10 years old. Copyright © 2013 Sociedade Brasileira de Pediatria. Published by Elsevier Editora Ltda. All rights reserved.

Toward the development of a children's science curiosity measure

NASA Astrophysics Data System (ADS)

Harty, Harold; Beall, Dwight

Based on the need for, suggestions about the construction, and existing measures serving as models found in the literature both inside and outside of science education, the Children's Science Curiosity Scale has undergone six versions using four different samples of fifth graders. Respectable internal consistency (alpha) and test-retest reliabilities have been calculated. Concurrent validity has been demonstrated by significant positive correlations with another recognized curiosity measure, and by way of significant differences between students who were interested in science and students uncertain about interest in science. Somewhat weak predictive validity has been decided by way of significant positive correlations with students' semester science grades. Construct validity has been described and established by eight judges using six criteria, and supported through the use of factor analysis where four underlying factors were hypothesized as characteristics of science curiosity. Sex differences were also explored where significant differences were not found between the genders. Suggestions have been made concerning future attempts at instrument refinement, establishing conceptual validity, future research involving other variables, and classroom use in a variety of contexts.

Rapid bacteriological screening of cosmetic raw materials by using bioluminescence.

PubMed

Nielsen, P; Van Dellen, E

1989-01-01

Incoming cosmetic raw materials are routinely tested for microbial content. Standard plate count methods require up to 72 h. A rapid, sensitive, and inexpensive raw material screening method was developed that detects the presence of bacteria by means of ATP (bioluminescence). With a 24-h broth enrichment, the minimum bacterial ATP detection threshold of 1 cfu/g sample can be achieved using purified firefly luciferin-luciferase and an ATP releasing reagent. By using this rapid screen, microbiologically free material may be released for production within 24 h, while contaminated material undergoes further quantitative and identification testing. In order for a raw material to be validated for this method it must be evaluated for (1) a potential nonmicrobial light-contributing reaction resulting in a false positive or, (2) degradation of the ATP giving a false negative, and (3) confirmation that the raw material has not overwhelmed the buffering capacity of the enrichment broth. The key criteria for a rapid screen was the sensitivity to detect less than one colony forming unit per g product, the speed to do this within 24 h, and cost efficiency. Bioluminescence meets these criteria. With an enrichment step, it can detect less than one cfu/g sample. After the enrichment step, analysis time per sample is approximately 2 min and the cost for material and reagents is less than one dollar per sample.

Comorbidity in Hoarding Disorder

PubMed Central

Frost, Randy O.; Steketee, Gail; Tolin, David F.

2011-01-01

Hoarding Disorder (HD) is currently under consideration for inclusion as a distinct disorder in DSM-5 (1). Few studies have examined comorbidity patterns in people who hoard, and the ones that have suffer from serious methodological shortcomings including drawing from populations already diagnosed with obsessive compulsive disorder (OCD), using outdated definitions of hoarding, and relying on inadequate assessments of hoarding. The present study is the first large-scale study (n=217) of comorbidity in a sample of people meeting recently proposed criteria for hoarding disorder (1) and relying on validated assessment procedures. The HD sample was compared to 96 participants meeting criteria for OCD without HD. High comorbidity rates were observed for major depressive disorder (MDD) as well as acquisition-related impulse control disorders (compulsive buying, kleptomania, and acquiring free things). Fewer than 20% of HD participants met criteria for OCD, and the rate of OCD in HD was higher for men than women. Rates of MDD and acquisition-related impulse control disorders were higher among HD than OCD participants. No specific anxiety disorder was more frequent in HD, but social phobia was more frequent among men with HD than among men with OCD. Inattentive ADHD was diagnosed in 28% of HD participants and was significantly more frequent than among OCD participants (3%). These findings form important base rates for developing research and treatments for hoarding disorder. PMID:21770000

DSM-5 illness anxiety disorder and somatic symptom disorder: Comorbidity, correlates, and overlap with DSM-IV hypochondriasis.

PubMed

Newby, Jill M; Hobbs, Megan J; Mahoney, Alison E J; Wong, Shiu Kelvin; Andrews, Gavin

2017-10-01

To investigate the reliability, validity and utility of DSM-5 illness anxiety disorder (IAD) and somatic symptom disorder (SSD), and explore their overlap with DSM-IV Hypochondriasis in a health anxious sample. Treatment-seeking patients with health anxiety (N=118) completed structured diagnostic interviews to assess DSM-IV Hypochondriasis, DSM-5 IAD, SSD, and comorbid mental disorders, and completed self-report measures of health anxiety, comorbid symptoms, cognitions and behaviours, and service utilization. IAD and SSD were more reliable diagnoses than Hypochondriasis (kappa estimates: IAD: 0.80, SSD: 0.92, Hypochondriasis: 0.60). 45% of patients were diagnosed with SSD, 47% with IAD, and 8% with comorbid IAD/SSD. Most patients with IAD fluctuated between seeking and avoiding care (61%), whereas care-seeking (25%) and care-avoidant subtypes were less common (14%). Half the sample met criteria for DSM-IV Hypochondriasis; of those, 56% met criteria for SSD criteria, 36% for IAD, and 8% for comorbid IAD/SSD. Compared to IAD, SSD was characterized by more severe health anxiety, somatic symptoms, depression, and higher health service use, and higher rates of major depressive disorder, panic disorder and agoraphobia. DSM-5 IAD and SSD classifications reliably detect more cases of clinically significant health anxiety than DSM-IV Hypochondriasis. The differences between IAD and SSD appear to be due to severity. Future research should explore the generalizability of these findings to other samples, and whether diagnostic status predicts treatment response and long-term outcome. Copyright © 2017 Elsevier Inc. All rights reserved.

Validation of Standardized Questionnaires Evaluating Symptoms of Depression in Rheumatoid Arthritis Patients: Approaches to Screening for a Frequent Yet Underrated Challenge.

PubMed

Englbrecht, Matthias; Alten, Rieke; Aringer, Martin; Baerwald, Christoph G; Burkhardt, Harald; Eby, Nancy; Fliedner, Gerhard; Gauger, Bettina; Henkemeier, Ulf; Hofmann, Michael W; Kleinert, Stefan; Kneitz, Christian; Krueger, Klaus; Pohl, Christoph; Roske, Anne-Eve; Schett, Georg; Schmalzing, Marc; Tausche, Anne-Kathrin; Peter Tony, Hans; Wendler, Joerg

2017-01-01

To validate standard self-report questionnaires for depression screening in patients with rheumatoid arthritis (RA) and compare these measures to one another and to the Montgomery-Åsberg Depression Rating Scale (MADRS), a standardized structured interview. In 9 clinical centers across Germany, depressive symptomatology was assessed in 262 adult RA patients at baseline (T0) and at 12 ± 2 weeks followup (T1) using the World Health Organization 5-Item Well-Being Index (WHO-5), the Patient Health Questionnaire (PHQ-9), and the Beck Depression Inventory II (BDI-II). The construct validity of these depression questionnaires (using convergent and discriminant validity) was evaluated using Spearman's correlations at both time points. The test-retest reliability of the questionnaires was evaluated in RA patients who had not undergone a psychotherapeutic intervention or received antidepressants between T0 and T1. The sensitivity and the specificity of the questionnaires were calculated using the results of the MADRS, a structured interview, as the gold standard. According to Spearman's correlation coefficients, all questionnaires met convergent validity criteria (ρ > |0.50|), with the BDI-II performing best, while correlations with age and disease activity for all questionnaires met the criteria for discriminant validity (ρ < |0.50|). The only questionnaire to meet the predefined retest reliability criterion (ρ ≥ 0.70) was the BDI-II (r s  = 0.77), which also achieved the best results for both sensitivity and specificity (>80%) when using the MADRS as the gold standard. The BDI-II best met the predefined criteria, and the PHQ-9 met most of the validity criteria, with lower sensitivity and specificity. © 2016, American College of Rheumatology.

Tier One Performance Screen Initial Operational Test and Evaluation: 2011 Annual Report

DTIC Science & Technology

2013-01-01

OPERATIONAL TEST AND EVALUATION: 2011 ANNUAL REPORT EXECUTIVE SUMMARY Research Requirement: In addition to educational, physical , and...34 Table 5.4. Incremental Validity Estimates for the TAPAS and TOPS Composite Scales over the AFQT for Predicting IMT Physical Fitness Criteria by...Validity Estimates for the TAPAS and TOPS Composite Scales over the AFQT for Predicting In-Unit Physical Fitness Criteria by Education Tier

Predictive Validity of the Air Force Officer Qualifying Test for USAF Air Battle Manager Training Performance

DTIC Science & Technology

2008-09-01

performance criteria including passing/failing training, training grades, class rank (Carretta & Ree, 2003; Olea & Ree, 1994), and several non...are consistent with prior validations of the AFOQT versus academic performance criteria in pilot (Carretta & Ree, 1995; Olea & Ree, 1994; Ree...Carretta, & Teachout, 1995)) and navigator ( Olea & Ree, 1994) training. Subsequent analyses took three different approaches to examine the

Statistical Validation of Surrogate Endpoints: Another Look at the Prentice Criterion and Other Criteria.

PubMed

Saraf, Sanatan; Mathew, Thomas; Roy, Anindya

2015-01-01

For the statistical validation of surrogate endpoints, an alternative formulation is proposed for testing Prentice's fourth criterion, under a bivariate normal model. In such a setup, the criterion involves inference concerning an appropriate regression parameter, and the criterion holds if the regression parameter is zero. Testing such a null hypothesis has been criticized in the literature since it can only be used to reject a poor surrogate, and not to validate a good surrogate. In order to circumvent this, an equivalence hypothesis is formulated for the regression parameter, namely the hypothesis that the parameter is equivalent to zero. Such an equivalence hypothesis is formulated as an alternative hypothesis, so that the surrogate endpoint is statistically validated when the null hypothesis is rejected. Confidence intervals for the regression parameter and tests for the equivalence hypothesis are proposed using bootstrap methods and small sample asymptotics, and their performances are numerically evaluated and recommendations are made. The choice of the equivalence margin is a regulatory issue that needs to be addressed. The proposed equivalence testing formulation is also adopted for other parameters that have been proposed in the literature on surrogate endpoint validation, namely, the relative effect and proportion explained.

Analysis of Carbamate Pesticides: Validation of Semi-Volatile Analysis by HPLC-MS/MS by EPA Method MS666

DOE Office of Scientific and Technical Information (OSTI.GOV)

Owens, J; Koester, C

The Environmental Protection Agency's (EPA) Region 5 Chicago Regional Laboratory (CRL) developed a method for analysis of aldicarb, bromadiolone, carbofuran, oxamyl, and methomyl in water by high performance liquid chromatography tandem mass spectrometry (HPLC-MS/MS), titled Method EPA MS666. This draft standard operating procedure (SOP) was distributed to multiple EPA laboratories and to Lawrence Livermore National Laboratory, which was tasked to serve as a reference laboratory for EPA's Environmental Reference Laboratory Network (ERLN) and to develop and validate analytical procedures. The primary objective of this study was to validate and verify the analytical procedures described in MS666 for analysis of carbamatemore » pesticides in aqueous samples. The gathered data from this validation study will be used to: (1) demonstrate analytical method performance; (2) generate quality control acceptance criteria; and (3) revise the SOP to provide a validated method that would be available for use during a homeland security event. The data contained in this report will be compiled, by EPA CRL, with data generated by other EPA Regional laboratories so that performance metrics of Method EPA MS666 can be determined.« less

Analysis of Ethanolamines: Validation of Semi-Volatile Analysis by HPLC-MS/MS by EPA Method MS888

DOE Office of Scientific and Technical Information (OSTI.GOV)

Owens, J; Vu, A; Koester, C

The Environmental Protection Agency's (EPA) Region 5 Chicago Regional Laboratory (CRL) developed a method titled 'Analysis of Diethanolamine, Triethanolamine, n-Methyldiethanolamine, and n-Ethyldiethanolamine in Water by Single Reaction Monitoring Liquid Chromatography/Tandem Mass Spectrometry (LC/MS/MS): EPA Method MS888'. This draft standard operating procedure (SOP) was distributed to multiple EPA laboratories and to Lawrence Livermore National Laboratory, which was tasked to serve as a reference laboratory for EPA's Environmental Reference Laboratory Network (ERLN) and to develop and validate analytical procedures. The primary objective of this study was to validate and verify the analytical procedures described in 'EPA Method MS888' for analysis of themore » listed ethanolamines in aqueous samples. The gathered data from this validation study will be used to: (1) demonstrate analytical method performance; (2) generate quality control acceptance criteria; and (3) revise the SOP to provide a validated method that would be available for use during a homeland security event. The data contained in this report will be compiled, by EPA CRL, with data generated by other EPA Regional laboratories so that performance metrics of 'EPA Method MS888' can be determined.« less

Development of code evaluation criteria for assessing predictive capability and performance

NASA Technical Reports Server (NTRS)

Lin, Shyi-Jang; Barson, S. L.; Sindir, M. M.; Prueger, G. H.

1993-01-01

Computational Fluid Dynamics (CFD), because of its unique ability to predict complex three-dimensional flows, is being applied with increasing frequency in the aerospace industry. Currently, no consistent code validation procedure is applied within the industry. Such a procedure is needed to increase confidence in CFD and reduce risk in the use of these codes as a design and analysis tool. This final contract report defines classifications for three levels of code validation, directly relating the use of CFD codes to the engineering design cycle. Evaluation criteria by which codes are measured and classified are recommended and discussed. Criteria for selecting experimental data against which CFD results can be compared are outlined. A four phase CFD code validation procedure is described in detail. Finally, the code validation procedure is demonstrated through application of the REACT CFD code to a series of cases culminating in a code to data comparison on the Space Shuttle Main Engine High Pressure Fuel Turbopump Impeller.

Exploring PE Teachers' "Gut Feelings": An Attempt to Verbalise and Discuss Teachers' Internalised Grading Criteria

ERIC Educational Resources Information Center

Svennberg, Lena; Meckbach, Jane; Redelius, Karin

2014-01-01

Research shows that teachers' grading is influenced by non-achievement factors in addition to official criteria, such as knowledge and skills. Some grading criteria are internalised by the teacher, who is sometimes unable to verbalise the criteria used and refers to what is called a "gut feeling". Therefore, transparency, validity and…

Differentiation between Wegener's granulomatosis and microscopic polyangiitis by an artificial neural network and by traditional methods.

PubMed

Linder, Roland; Orth, Isabelle; Hagen, E Christian; van der Woude, Fokko J; Schmitt, Wilhelm H

2011-06-01

To investigate the operating characteristics of the American College of Rheumatology (ACR) traditional format criteria for Wegener's granulomatosis (WG), the Sørensen criteria for WG and microscopic polyangiitis (MPA), and the Chapel Hill nomenclature for WG and MPA. Further, to develop and validate improved criteria for distinguishing WG from MPA by an artificial neural network (ANN) and by traditional approaches [classification tree (CT), logistic regression (LR)]. All criteria were applied to 240 patients with WG and 78 patients with MPA recruited by a multicenter study. To generate new classification criteria (ANN, CT, LR), 23 clinical measurements were assessed. Validation was performed by applying the same approaches to an independent monocenter cohort of 46 patients with WG and 21 patients with MPA. A total of 70.8% of the patients with WG and 7.7% of the patients with MPA from the multicenter cohort fulfilled the ACR criteria for WG (accuracy 76.1%). The accuracy of the Chapel Hill criteria for WG and MPA was only 35.0% and 55.3% (Sørensen criteria: 67.2% and 92.4%). In contrast, the ANN and CT achieved an accuracy of 94.3%, based on 4 measurements (involvement of nose, sinus, ear, and pulmonary nodules), all associated with WG. LR led to an accuracy of 92.8%. Inclusion of antineutrophil cytoplasmic antibodies did not improve the allocation. Validation of methods resulted in accuracy of 91.0% (ANN and CT) and 88.1% (LR). The ACR, Sørensen, and Chapel Hill criteria did not reliably separate WG from MPA. In contrast, an appropriately trained ANN and a CT differentiated between these disorders and performed better than LR.

Validation of psychoanalytic theories: towards a conceptualization of references.

PubMed

Zachrisson, Anders; Zachrisson, Henrik Daae

2005-10-01

The authors discuss criteria for the validation of psychoanalytic theories and develop a heuristic and normative model of the references needed for this. Their core question in this paper is: can psychoanalytic theories be validated exclusively from within psychoanalytic theory (internal validation), or are references to sources of knowledge other than psychoanalysis also necessary (external validation)? They discuss aspects of the classic truth criteria correspondence and coherence, both from the point of view of contemporary psychoanalysis and of contemporary philosophy of science. The authors present arguments for both external and internal validation. Internal validation has to deal with the problems of subjectivity of observations and circularity of reasoning, external validation with the problem of relevance. They recommend a critical attitude towards psychoanalytic theories, which, by carefully scrutinizing weak points and invalidating observations in the theories, reduces the risk of wishful thinking. The authors conclude by sketching a heuristic model of validation. This model combines correspondence and coherence with internal and external validation into a four-leaf model for references for the process of validating psychoanalytic theories.

Tear cytokine profile as a noninvasive biomarker of inflammation for ocular surface diseases: standard operating procedures.

PubMed

Wei, Yi; Gadaria-Rathod, Neha; Epstein, Seth; Asbell, Penny

2013-12-23

To provide standard operating procedures (SOPs) for measuring tear inflammatory cytokine concentrations and to validate the resulting profile as a minimally invasive objective metric and biomarker of ocular surface inflammation for use in multicenter clinical trials on dry eye disease (DED). Standard operating procedures were established and then validated with cytokine standards, quality controls, and masked tear samples collected from local and distant clinical sites. The concentrations of the inflammatory cytokines in tears were quantified using a high-sensitivity human cytokine multiplex kit. A panel of inflammatory cytokines was initially investigated, from which four key inflammatory cytokines (IL-1β, IL-6, INF-γ, and TNF-α) were chosen. Results with cytokine standards statistically satisfied the manufacturer's quality control criteria. Results with pooled tear samples were highly reproducible and reliable with tear volumes ranging from 4 to 10 μL. Incorporation of the SOPs into clinical trials was subsequently validated. Tear samples were collected at a distant clinical site, stored, and shipped to our Biomarker Laboratory, where a masked analysis of the four tear cytokines was successfully performed. Tear samples were also collected from a feasibility study on DED. Inflammatory cytokine concentrations were decreased in tears of subjects who received anti-inflammatory treatment. Standard operating procedures for human tear cytokine assessment suitable for multicenter clinical trials were established. Tear cytokine profiling using these SOPs may provide objective metrics useful for diagnosing, classifying, and analyzing treatment efficacy in inflammatory conditions of the ocular surface, which may further elucidate the mechanisms involved in the pathogenesis of ocular surface disease.

Mild cognitive impairment as a risk factor for Parkinson's disease dementia.

PubMed

Hoogland, Jeroen; Boel, Judith A; de Bie, Rob M A; Geskus, Ronald B; Schmand, Ben A; Dalrymple-Alford, John C; Marras, Connie; Adler, Charles H; Goldman, Jennifer G; Tröster, Alexander I; Burn, David J; Litvan, Irene; Geurtsen, Gert J

2017-07-01

The International Parkinson and Movement Disorder Society criteria for mild cognitive impairment in PD were recently formulated. The aim of this international study was to evaluate the predictive validity of the comprehensive (level II) version of these criteria by assessment of their contribution to the hazard of PD dementia. Individual patient data were selected from four separate studies on cognition in PD that provided information on demographics, motor examination, depression, neuropsychological examination suitable for application of level II criteria, and longitudinal follow-up for conversion to dementia. Survival analysis evaluated the predictive value of level II criteria for cognitive decline toward dementia as expressed by the relative hazard of dementia. A total of 467 patients were included. The analyses showed a clear contribution of impairment according to level II mild cognitive impairment criteria, age, and severity of PD motor symptoms to the hazard of dementia. There was a trend of increasing hazard of dementia with declining neuropsychological performance. This is the first large international study evaluating the predictive validity of level II mild cognitive impairment criteria for PD. The results showed a clear and unique contribution of classification according to level II criteria to the hazard of PD dementia. This finding supports their predictive validity and shows that they contribute important new information on the hazard of dementia, beyond known demographic and PD-specific factors of influence. © 2017 International Parkinson and Movement Disorder Society. © 2017 International Parkinson and Movement Disorder Society.

Emotional suppression and breast cancer: validation research on the Spanish Adaptation of the Courtauld Emotional Control Scale (CECS).

PubMed

Durá, Estrella; Andreu, Yolanda; Galdón, Maria José; Ibáñez, Elena; Pérez, Sandra; Ferrando, Maite; Murgui, Sergio; Martínez, Paula

2010-05-01

Emotional suppression has played an important role in the research on psychosocial factors related to cancer. It has been argued to be an important psychological factor predicting worse psychosocial adjustment in people with cancer and it may mediate health outcomes. The reference instrument in the research on emotional suppression is the Courtauld Emotional Control Scale (CECS). The present study analysed construct validity of a new Spanish adaptation of the CECS in a sample of 175 breast cancer patients. The results confirmed the proposal by Watson and Greer claiming that the CECS is composed of three subscales that measure different dimensions, but not independent, from emotional control. The present Spanish version of the CECS showed high internal consistency in each subseale as well as the total score. According to Derogatis (BSI-18) criteria, emotional suppression predicts clinically significant distress. In short, our results support the reliability, validity and utility of this Spanish adaptation of the CECS in clinical and research settings.

The development and validation of an UHPLC–MS/MS method for the rapid quantification of the antiretroviral agent dapivirine in human plasma

PubMed Central

Seserko, Lauren A; Emory, Joshua F; Hendrix, Craig W; Marzinke, Mark A

2014-01-01

Background Dapivirine is a non-nucleoside reverse transcriptase inhibitor designed to prevent HIV-1 viral replication and subsequent propagation. A sensitive method is required to quantify plasma concentrations to assess drug efficacy. Results Dapivirine-spiked plasma was combined with acetonitrile containing deuterated IS and was processed for analysis. The method has an analytical measuring range from 20 to 10,000 pg/ml. For the LLOQ, low, mid and high QCs, intra- and inter-assay precision (%CV) ranged from 5.58 to 13.89% and 5.23 to 13.36%, respectively, and intra- and inter-day accuracy (% deviation) ranged from -5.61 to 0.75% and -4.30 to 6.24%, respectively. Conclusion A robust and sensitive LC–MS/MS assay for the high-throughput quantification of the antiretroviral drug dapivirine in human plasma was developed and validated following bioanalytical validation guidelines. The assay meets criteria for the analysis of samples from large research trials. PMID:24256358

The development and validation of an UHPLC-MS/MS method for the rapid quantification of the antiretroviral agent dapivirine in human plasma.

PubMed

Seserko, Lauren A; Emory, Joshua F; Hendrix, Craig W; Marzinke, Mark A

2013-11-01

Dapivirine is a non-nucleoside reverse transcriptase inhibitor designed to prevent HIV-1 viral replication and subsequent propagation. A sensitive method is required to quantify plasma concentrations to assess drug efficacy. Dapivirine-spiked plasma was combined with acetonitrile containing deuterated IS and was processed for analysis. The method has an analytical measuring range from 20 to 10,000 pg/ml. For the LLOQ, low, mid and high QCs, intra- and inter-assay precision (%CV) ranged from 5.58 to 13.89% and 5.23 to 13.36%, respectively, and intra- and inter-day accuracy (% deviation) ranged from -5.61 to 0.75% and -4.30 to 6.24%, respectively. A robust and sensitive LC-MS/MS assay for the high-throughput quantification of the antiretroviral drug dapivirine in human plasma was developed and validated following bioanalytical validation guidelines. The assay meets criteria for the analysis of samples from large research trials.

The Development of Statistics Textbook Supported with ICT and Portfolio-Based Assessment

NASA Astrophysics Data System (ADS)

Hendikawati, Putriaji; Yuni Arini, Florentina

2016-02-01

This research was development research that aimed to develop and produce a Statistics textbook model that supported with information and communication technology (ICT) and Portfolio-Based Assessment. This book was designed for students of mathematics at the college to improve students’ ability in mathematical connection and communication. There were three stages in this research i.e. define, design, and develop. The textbooks consisted of 10 chapters which each chapter contains introduction, core materials and include examples and exercises. The textbook developed phase begins with the early stages of designed the book (draft 1) which then validated by experts. Revision of draft 1 produced draft 2 which then limited test for readability test book. Furthermore, revision of draft 2 produced textbook draft 3 which simulated on a small sample to produce a valid model textbook. The data were analysed with descriptive statistics. The analysis showed that the Statistics textbook model that supported with ICT and Portfolio-Based Assessment valid and fill up the criteria of practicality.

Validation of the Fibromyalgia Survey Questionnaire within a Cross-Sectional Survey

PubMed Central

Häuser, Winfried; Jung, Eva; Erbslöh-Möller, Brigitte; Gesmann, Mechthild; Kühn-Becker, Hedi; Petermann, Franz; Langhorst, Jost; Weiss, Thomas; Winkelmann, Andreas; Wolfe, Frederick

2012-01-01

The Fibromyalgia Survey Questionnaire (FSQ) assesses the key symptoms of fibromyalgia syndrome. The FSQ can be administrated in survey research and settings where the use of interviews to evaluate the number of pain sites and extent of somatic symptom intensity and tender point examination would be difficult. We validated the FSQ in a cross-sectional survey with FMS patients. In a cross-sectional survey, participants with physician diagnosis of FMS were recruited by FMS-self help organisations and nine clinical institutions of different levels of care. Participants answered the FSQ (composed by the Widespread Pain Index [WPI] and the Somatic Severity Score [SSS]) assessing the Fibromyalgia Survey Diagnostic Criteria (FSDC) and the Patient Health Questionnaire PHQ 4. American College of Rheumatology 1990 classification criteria were assessed in a subgroup of participants. 1,651 persons diagnosed with FMS were included into analysis. The acceptance of the FSQ-items ranged between 78.9 to 98.1% completed items. The internal consistency of the items of the SSS ranged between 0.75–0.82. 85.5% of the study participants met the FSDC. The concordance rate of the FSDC and ACR 1990 criteria was 72.7% in a subsample of 128 patients. The Pearson correlation of the SSS with the PHQ 4 depression score was 0.52 (p<0.0001) and with the PHQ anxiety score was 0.51 (p<0.0001) (convergent validity). 64/202 (31.7%) of the participants not meeting the FSDC criteria and 152/1283 (11.8%) of the participants meeting the FSDC criteria reported an improvement (slightly too very much better) in their health status since FMS-diagnosis (Chi2 = 55, p<0.0001) (discriminant validity). The study demonstrated the feasibility of the FSQ in a cross-sectional survey with FMS-patients. The reliability, convergent and discriminant validity of the FSQ were good. Further validation studies of the FSQ in clinical and general population settings are necessary. PMID:22662163

Subtyping attention-deficit/hyperactivity disorder using temperament dimensions: toward biologically based nosologic criteria

PubMed Central

Karalunas, Sarah L.; Fair, Damien; Musser, Erica D.; Aykes, Kamari; Iyer, Swathi P.; Nigg, Joel T.

2014-01-01

Importance Psychiatric nosology is limited by behavioral and biological heterogeneity within existing disorder categories. The imprecise nature of current nosological distinctions limits both mechanistic understanding and clinical prediction. Here, we demonstrate an approach consistent with the NIMH Research Domain Criteria (RDoC) initiative to identifying superior, neurobiologically-valid subgroups with better predictive capacity than existing psychiatric categories for childhood Attention-Deficit Hyperactivity Disorder (ADHD). Objective Refine subtyping of childhood ADHD by using biologically-based behavioral dimensions (i.e. temperament), novel classification algorithms, and multiple external validators. In doing so, we demonstrate how refined nosology is capable of improving on current predictive capacity of long-term outcomes relative to current DSM-based nosology. Design, Setting, Participants 437 clinically well-characterized, community-recruited children with and without ADHD participated in an on-going longitudinal study. Baseline data were used to classify children into subgroups based on temperament dimensions and to examine external validators including physiological and MRI measures. One-year longitudinal follow-up data are reported for a subgroup of the ADHD sample to address stability and clinical prediction. Main Outcome Measures Parent/guardian ratings of children on a measure of temperament were used as input features in novel community detection analyses to identify subgroups within the sample. Groups were validated using three widely-accepted external validators: peripheral physiology (cardiac measures of respiratory sinus arrhythmia and pre-ejection period), central nervous system functioning (via resting-state functional connectivity MRI), and clinical outcomes (at one-year longitudinal follow-up). Results The community detection algorithm suggested three novel types of ADHD, labeled as “Mild” (normative emotion regulation); “Surgent” (extreme levels of positive approach-motivation); and “Irritable” (extreme levels of negative emotionality, anger, and poor soothability). Types were independent of existing clinical demarcations, including DSM-5 presentations or symptom severity. These types showed stability over time and were distinguished by unique patterns of cardiac physiological response, resting-state functional brain connectivity, and clinical outcome one year later. Conclusions and Relevance Results suggest that a biologically-informed temperament-based typology, developed with a discovery-based community detection algorithm, provided a superior description of heterogeneity in the ADHD population than any current clinical nosology. This demonstration sets the stage for more aggressive attempts at a tractable, biologically-based nosology. PMID:25006969

Similarities and Differences in Diagnostic Criterion.

PubMed

Wei, Zhengde; Zhang, Xiaochu

2017-01-01

In this chapter, the main content is to discuss the similarities and differences in diagnostic criteria between substance and non-substance addictions. Firstly, diagnostic criteria of substance addiction were introduced, mainly focused on Diagnostic and Statistical Manual for the Mental Disorders, fifth edition (DSM-5). Then, we described the diagnostic criteria of several non-substance addictions, including gambling disorder, internet addiction, food addiction and hypersexual disorder. Depending on the proof, substance and non-substance addictions have many similarities in symptoms. Though the proposed diagnostic criteria of many non-substance addictions are currently most useful as survey instruments to access the prevalence of the problem, there is little or no validating proof for these diagnostic criteria. Finally, animal model is useful tool for addiction research. But, present animal models for gambling studying do not meet enough diagnostic criteria and could not be regarded as gambling disorder. By introducing the animal models evolved to resemble the diagnostic criteria of substance addiction and two classical paradigms for substance addiction, self-administration and conditioned place preference, we hope it is helpful to improve the validation of animal model of gambling disorder.

Modified scoring criteria for the RBANS figures.

PubMed

Duff, Kevin; Leber, W R; Patton, Doyle E; Schoenberg, Mike R; Mold, James W; Scott, James G; Adams, Russell L

2007-01-01

Visual construction and memory tasks are routinely used in neuropsychological assessment, but their subjective scoring criteria can negatively affect the reliability of these instruments. The current study examined the standard scoring criteria for the Figure Copy and Recall subtests of the RBANS and compared them to a modified set of scoring criteria in two samples. In both a large community dwelling sample of older adults and in a mixed clinical sample, the original scoring criteria consistently led to lower scores than the modified criteria. Inter-rater reliability was high for the modified scoring criteria, and no age effects were found with the modified scoring criteria. In both samples, the modified scoring criteria led to Figure Copy scores that more closely approximated other performances on the RBANS compared to the standard criteria, whereas both scoring systems led to plausible Figure Recall scores. Despite these results, the present study cannot identify one scoring criterion as the "better," but only points out the significant differences between them. Such differences can have important clinical implications, and practitioners and researchers who utilize the RBANS with patient samples should be cautious when interpreting low scores on Figure Copy and Recall if the standard criteria are used.

External Validation of the Acoustic Voice Quality Index Version 03.01 With Extended Representativity.

PubMed

Barsties, Ben; Maryn, Youri

2016-07-01

The Acoustic Voice Quality Index (AVQI) is an objective method to quantify the severity of overall voice quality in concatenated continuous speech and sustained phonation segments. Recently, AVQI was successfully modified to be more representative and ecologically valid because the internal consistency of AVQI was balanced out through equal proportion of the 2 speech types. The present investigation aims to explore its external validation in a large data set. An expert panel of 12 speech-language therapists rated the voice quality of 1058 concatenated voice samples varying from normophonia to severe dysphonia. The Spearman rank-order correlation coefficients (r) were used to measure concurrent validity. The AVQI's diagnostic accuracy was evaluated with several estimates of its receiver operating characteristics (ROC). Finally, 8 of the 12 experts were chosen because of reliability criteria. A strong correlation was identified between AVQI and auditoryperceptual rating (r = 0.815, P = .000). It indicated that 66.4% of the auditory-perceptual rating's variation was explained by AVQI. Additionally, the ROC results showed again the best diagnostic outcome at a threshold of AVQI = 2.43. This study highlights external validation and diagnostic precision of the AVQI version 03.01 as a robust and ecologically valid measurement to objectify voice quality. © The Author(s) 2016.

PTSD or not PTSD? Comparing the proposed ICD-11 and the DSM-5 PTSD criteria among young survivors of the 2011 Norway attacks and their parents.

PubMed

Hafstad, G S; Thoresen, S; Wentzel-Larsen, T; Maercker, A; Dyb, G

2017-05-01

The conceptualization of post-traumatic stress disorder (PTSD) in the upcoming International Classification of Diseases (ICD)-11 differs in many respects from the diagnostic criteria in the Diagnostic and Statistical Manual for Mental Disorders, fifth edition (DSM-5). The consequences of these differences for individuals and for estimation of prevalence rates are largely unknown. This study investigated the concordance of the two diagnostic systems in two separate samples at two separate waves. Young survivors of the 2011 Norway attacks (n = 325) and their parents (n = 451) were interviewed at 4-6 months (wave 1) and 15-18 months (wave 2) after the shooting. PTSD was assessed with the UCLA PTSD Reaction Index for DSM-IV adapted for DSM-5, and a subset was used as diagnostic criteria for ICD-11. In survivors, PTSD prevalence did not differ significantly at any time point, but in parents, the DSM-5 algorithm produced significantly higher prevalence rates than the ICD-11 criteria. The overlap was fair for survivors, but amongst parents a large proportion of individuals met the criteria for only one of the diagnostic systems. No systematic differences were found between ICD-11 and DSM-5 in predictive validity. The proposed ICD-11 criteria and the DSM-5 criteria performed equally well when identifying individuals in distress. Nevertheless, the overlap between those meeting the PTSD diagnosis for both ICD-11 and DSM-5 was disturbingly low, with the ICD-11 criteria identifying fewer people than the DSM-5. This represents a major challenge in identifying individuals suffering from PTSD worldwide, possibly resulting in overtreatment or unmet needs for trauma-specific treatment, depending on the area of the world in which patients are being diagnosed.

Antisocial personality disorder and psychopathy in women: a literature review on the reliability and validity of assessment instruments.

PubMed

Dolan, Mairead; Völlm, Birgit

2009-01-01

Crime rates are low in women compared to men. The two disorders most commonly associated with offending behaviour, antisocial personality disorder (ASPD) and psychopathy, are also less prevalent in female samples. However, developments in forensic psychiatry have often ignored gender, and the utility of constructs such as psychopathy and their assessment instruments in female samples remains unclear. This article presents a review of studies looking at rates of ASPD and psychopathy and on the reliability and validity of assessment instruments of these disorders in women. Gender differences in symptom patterns will be considered. The literature seems to suggest that DSM-IV criteria for ASPD may lead to an underestimation of the prevalence of the disorder in women due to the requirement of childhood conduct disorder symptoms. The Psychopathy Checklist-Revised (PCL-R) is a valid and reliable instrument to identify psychopathy in women but there are gender differences in the factor structure and item loadings on this measure. Research to date seems to suggest a three-factor model may be most strongly supported in females. Preliminary evidence suggests the PCL-R may have some value in predicting future offending while the PCL:SV may be useful in predicting institutional violence. Clinical implications are discussed.

Norwegian version of the rating anxiety in dementia scale (RAID-N): a validity and reliability study.

PubMed

Goyal, Alka R; Bergh, Sverre; Engedal, Knut; Kirkevold, Marit; Kirkevold, Øyvind

2017-12-01

Dementia-specific anxiety scales in the Norwegian language are lacking; the aim of this study was to investigate the validity and inter-rater reliability of a Norwegian version of the Rating Anxiety in Dementia (RAID-N) scale. The validity of the RAID-N was tested in a sample of 101 patients with dementia from seven Norwegian nursing homes. One psychogeriatrician (n = 50) or a physician with long experience with nursing home patients (n = 51) 'blind' to the RAID-N score diagnosed anxiety according to DSM-5 criteria of generalised anxiety disorder (GAD). A receiver operating characteristic (ROC) analysis assessed the best cut-off point for the RAID-N, and the area under the curve (AUC) was calculated. Inter-rater reliability was tested in a subgroup of 53 patients by intraclass correlation (ICC) and Cohen's kappa. Twenty-eight of 101 (27.7%) met the GAD criteria. The mean RAID-N score for patients with GAD was 16.1 (SD 6.3) and without GAD, 8.8 (SD 6.5) (p < 0.001). A cut-off score of ≥12 on the RAID-N gave a sensitivity of 82.1%, specificity of 70.0%, and 73.3% accuracy in identifying clinically significant GAD in patients with dementia. Inter-rater reliability on overall RAID-N items was good (ICC = 0.82), Cohen's kappa was 0.58 for total RAID-N score, with satisfactory internal consistency (Cronbach's alpha = 0.81). The RAID-N has fairly good validity and inter-rater reliability, and could be useful to assess GAD in patients with dementia. Further studies should investigate the optimal RAID-N cut-off score in different settings.

Brief Report: Validation of a Definition of Flare in Patients With Established Gout.

PubMed

Gaffo, Angelo L; Dalbeth, Nicola; Saag, Kenneth G; Singh, Jasvinder A; Rahn, Elizabeth J; Mudano, Amy S; Chen, Yi-Hsing; Lin, Ching-Tsai; Bourke, Sandra; Louthrenoo, Worawit; Vazquez-Mellado, Janitzia; Hernández-Llinas, Hansel; Neogi, Tuhina; Vargas-Santos, Ana Beatriz; da Rocha Castelar-Pinheiro, Geraldo; Amorim, Rodrigo B C; Uhlig, Till; Hammer, Hilde B; Eliseev, Maxim; Perez-Ruiz, Fernando; Cavagna, Lorenzo; McCarthy, Geraldine M; Stamp, Lisa K; Gerritsen, Martijn; Fana, Viktoria; Sivera, Francisca; Taylor, William

2018-03-01

To perform external validation of a provisional definition of disease flare in patients with gout. Five hundred nine patients with gout were enrolled in a cross-sectional study during a routine clinical care visit at 17 international sites. Data were collected to classify patients as experiencing or not experiencing a gout flare, according to a provisional definition. A local expert rheumatologist performed the final independent adjudication of gout flare status. Sensitivity, specificity, predictive values, and receiver operating characteristic (ROC) curves were used to determine the diagnostic performance of gout flare definitions. The mean ± SD age of the patients was 57.5 ± 13.9 years, and 89% were male. The definition requiring fulfillment of at least 3 of 4 criteria (patient-defined gout flare, pain at rest score of >3 on a 0-10-point numerical rating scale, presence of at least 1 swollen joint, and presence of at least 1 warm joint) was 85% sensitive and 95% specific in confirming the presence of a gout flare, with an accuracy of 92%. The ROC area under the curve was 0.97. The definition based on a classification and regression tree algorithm (entry point, pain at rest score >3, followed by patient-defined flare "yes") was 73% sensitive and 96% specific. The definition of gout flare that requires fulfillment of at least 3 of 4 patient-reported criteria is now validated to be sensitive, specific, and accurate for gout flares, as demonstrated using an independent large international patient sample. The availability of a validated gout flare definition will improve the ascertainment of an important clinical outcome in studies of gout. © 2017, American College of Rheumatology.

Validation of a HLA-A2 tetramer flow cytometric method, IFNgamma real time RT-PCR, and IFNgamma ELISPOT for detection of immunologic response to gp100 and MelanA/MART-1 in melanoma patients

PubMed Central

Xu, Yuanxin; Theobald, Valerie; Sung, Crystal; DePalma, Kathleen; Atwater, Laura; Seiger, Keirsten; Perricone, Michael A; Richards, Susan M

2008-01-01

Background HLA-A2 tetramer flow cytometry, IFNγ real time RT-PCR and IFNγ ELISPOT assays are commonly used as surrogate immunological endpoints for cancer immunotherapy. While these are often used as research assays to assess patient's immunologic response, assay validation is necessary to ensure reliable and reproducible results and enable more accurate data interpretation. Here we describe a rigorous validation approach for each of these assays prior to their use for clinical sample analysis. Methods Standard operating procedures for each assay were established. HLA-A2 (A*0201) tetramer assay specific for gp100209(210M) and MART-126–35(27L), IFNγ real time RT-PCR and ELISPOT methods were validated using tumor infiltrating lymphocyte cell lines (TIL) isolated from HLA-A2 melanoma patients. TIL cells, specific for gp100 (TIL 1520) or MART-1 (TIL 1143 and TIL1235), were used alone or spiked into cryopreserved HLA-A2 PBMC from healthy subjects. TIL/PBMC were stimulated with peptides (gp100209, gp100pool, MART-127–35, or influenza-M1 and negative control peptide HIV) to further assess assay performance characteristics for real time RT-PCR and ELISPOT methods. Validation parameters included specificity, accuracy, precision, linearity of dilution, limit of detection (LOD) and limit of quantification (LOQ). In addition, distribution was established in normal HLA-A2 PBMC samples. Reference ranges for assay controls were established. Results The validation process demonstrated that the HLA-A2 tetramer, IFNγ real time RT-PCR, and IFNγ ELISPOT were highly specific for each antigen, with minimal cross-reactivity between gp100 and MelanA/MART-1. The assays were sensitive; detection could be achieved at as few as 1/4545–1/6667 cells by tetramer analysis, 1/50,000 cells by real time RT-PCR, and 1/10,000–1/20,000 by ELISPOT. The assays met criteria for precision with %CV < 20% (except ELISPOT using high PBMC numbers with %CV < 25%) although flow cytometric assays and cell based functional assays are known to have high assay variability. Most importantly, assays were demonstrated to be effective for their intended use. A positive IFNγ response (by RT-PCR and ELISPOT) to gp100 was demonstrated in PBMC from 3 melanoma patients. Another patient showed a positive MART-1 response measured by all 3 validated methods. Conclusion Our results demonstrated the tetramer flow cytometry assay, IFNγ real-time RT-PCR, and INFγ ELISPOT met validation criteria. Validation approaches provide a guide for others in the field to validate these and other similar assays for assessment of patient T cell response. These methods can be applied not only to cancer vaccines but to other therapeutic proteins as part of immunogenicity and safety analyses. PMID:18945350

Internet-Related Disorders: Development of the Short Compulsive Internet Use Scale.

PubMed

Besser, Bettina; Rumpf, Hans-Jürgen; Bischof, Anja; Meerkerk, Gert-Jan; Higuchi, Susumu; Bischof, Gallus

2017-11-01

The addiction treatment system only reaches a small number of individuals suffering from Internet-related disorders. Therefore, it is important to improve case detection for preventive measures and brief interventions. Existing screening instruments are often time-consuming and rarely validated using clinical criteria. The aim of this study is to develop an optimized short screening for problematic Internet use and Internet addiction (IA). A regression analysis was conducted in random subsamples of a merged sample (N = 3,040; N = 1,209) to examine the item performance of the Compulsive Internet Use Scale (CIUS). Based on the results, a short version of the CIUS was developed and compared with the original CIUS. A fully structured diagnostic interview, covering the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5) criteria for the Internet gaming disorder with a broader focus on all Internet activities, was conducted. A five-item version of the short screening performed best across the samples. Comparing the area under the curve (AUC) of the receiver operating characteristic between the Short CIUS and the original test revealed no significant difference (AUC = 0.968; 0.977). A cutoff point of 7 turned out to perform best for case detection and yielded a sensitivity of 0.95 and a specificity of 0.87, Cronbach's alpha was 0.77. The analysis showed that the performance of the Short CIUS is just as good in detecting problematical Internet use and IA as the performance of the original CIUS. The Short CIUS provides an economical and valid instrument for the assessment of problematic Internet use and IA.

Measurement of students' perceptions of nursing as a career.

PubMed

Matutina, Robin E; Newman, Susan D; Jenkins, Carolyn M

2010-09-01

Middle school has been identified as the prime age group to begin nursing recruitment efforts because students have malleable perceptions about nursing as a future career choice. The purpose of this integrative review is to present a brief overview of research processes related to middle school students' perceptions of nursing as a future career choice and to critically evaluate the current instruments used to measure middle and high school students' perceptions of nursing as a career choice. An integrative review of the years 1989 to 2009 was conducted searching Cumulative Index to Nursing and Allied Health Literature (CINAHL), National Library of Medicine PubMed service (PubMed), and Ovid MEDLINE databases using the key words career, choice, future, ideal, nursing, and perception. Reference lists of retrieved studies were hand searched, yielding a total of 22 studies. Inclusion criteria were (a) sample of middle school students, (b) sample of high school students, (c) mixed sample including middle or high school students, and (4) samples other than middle or high school students if the instrument was tested with middle or high school students in a separate study. Ten studies met these criteria. Of the 10 studies, samples were 30% middle school students; 40% high school students; 10% mixed, including school-aged students; and 20% college students with an instrument tested in middle school students. Eighty percent of participants were White females. Overall, participants' socioeconomic status was not identified. A single study included a theoretical framework. Five instruments were identified and each could be completed in 15 to 30 min. The most commonly used instrument is available free of charge. Seventy percent of the studies used Cronbach's alpha to report instrument reliability (0.63 to 0.93), whereas 30% failed to report reliability. Fifty percent of the studies established validity via a "panel of experts," with three of those studies further describing the panel of experts. Samples of white females may hinder generalization. Socioeconomic status was not consistently reported and may be an important factor with regard to perceptions of nursing as a career choice. An overall absence of theoretical framework hinders empirical data from being applied to nursing theories that in turn may support nursing concepts. The reporting of reliability and validity may be improved by further defining panel of experts and expanding the number of experts (more than seven). More in-depth evaluation of the psychometric properties of the instruments with more diverse populations is needed. Rigorously tested instruments may be useful in determining middle school students' perceptions about nursing. Therefore, future researchers should consider testing existing instruments in the middle school population, adhering to theoretical frameworks, diversifying the sample population, and clearly reporting reliability and validity to gain knowledge about middle school students' perceptions about a nursing career.

Validation of a Rapid Bacteria Endospore Enumeration System for Planetary Protection Application

NASA Astrophysics Data System (ADS)

Chen, Fei; Kern, Roger; Kazarians, Gayane; Venkateswaran, Kasthuri

NASA monitors spacecraft surfaces to assure that the presence of bacterial endospores meets strict criteria at launch, to minimize the risk of inadvertent contamination of the surface of Mars. Currently, the only approved method for enumerating the spores is a culture based assay that requires three days to produce results. In order to meet the demanding schedules of spacecraft assembly, a more rapid spore detection assay is being considered as an alternate method to the NASA standard culture-based assay. The Millipore Rapid Microbiology Detection System (RMDS) has been used successfully for rapid bioburden enumeration in the pharmaceutical and food industries. The RMDS is rapid and simple, shows high sensitivity (to 1 colony forming unit [CFU]/sample), and correlates well with traditional culture-based methods. It combines membrane filtration, adenosine triphosphate (ATP) bioluminescence chemistry, and image analysis based on photon detection with a Charge Coupled Device (CCD) camera. In this study, we have optimized the assay conditions and evaluated the use of the RMDS as a rapid spore detection tool for NASA applications. In order to select for spores, the samples were subjected to a heat shock step before proceeding with the RMDS incubation protocol. Seven species of Bacillus (nine strains) that have been repeatedly isolated from clean room environments were assayed. All strains were detected by the RMDS in 5 hours and these assay times were repeatedly demonstrated along with low image background noise. Validation experiments to compare the Rapid Sore Assay (RSA) and NASA standard assay (NSA) were also performed. The evaluation criteria were modeled after the FDA Guideline of Process Validation, and Analytical Test Methods. This body of research demonstrates that the Rapid Spore Assay (RSA) is quick, and of equivalent sensitivity to the NASA standard assay, potentially reducing the assay time for bacterial endospores from over 72 hours to less than 8 hours. Accordingly, JPL has produced a report recommending that NASA adopt the RSA method as a suitable alternative to the NASA standard assay.

Validity Evidence in Scale Development: The Application of Cross Validation and Classification-Sequencing Validation

ERIC Educational Resources Information Center

Acar, Tu¨lin

2014-01-01

In literature, it has been observed that many enhanced criteria are limited by factor analysis techniques. Besides examinations of statistical structure and/or psychological structure, such validity studies as cross validation and classification-sequencing studies should be performed frequently. The purpose of this study is to examine cross…

Toward a Unified Validation Framework in Mixed Methods Research

ERIC Educational Resources Information Center

Dellinger, Amy B.; Leech, Nancy L.

2007-01-01

The primary purpose of this article is to further discussions of validity in mixed methods research by introducing a validation framework to guide thinking about validity in this area. To justify the use of this framework, the authors discuss traditional terminology and validity criteria for quantitative and qualitative research, as well as…

Comparative analyses of basal rate of metabolism in mammals: data selection does matter.

PubMed

Genoud, Michel; Isler, Karin; Martin, Robert D

2018-02-01

Basal rate of metabolism (BMR) is a physiological parameter that should be measured under strictly defined experimental conditions. In comparative analyses among mammals BMR is widely used as an index of the intensity of the metabolic machinery or as a proxy for energy expenditure. Many databases with BMR values for mammals are available, but the criteria used to select metabolic data as BMR estimates have often varied and the potential effect of this variability has rarely been questioned. We provide a new, expanded BMR database reflecting compliance with standard criteria (resting, postabsorptive state; thermal neutrality; adult, non-reproductive status for females) and examine potential effects of differential selectivity on the results of comparative analyses. The database includes 1739 different entries for 817 species of mammals, compiled from the original sources. It provides information permitting assessment of the validity of each estimate and presents the value closest to a proper BMR for each entry. Using different selection criteria, several alternative data sets were extracted and used in comparative analyses of (i) the scaling of BMR to body mass and (ii) the relationship between brain mass and BMR. It was expected that results would be especially dependent on selection criteria with small sample sizes and with relatively weak relationships. Phylogenetically informed regression (phylogenetic generalized least squares, PGLS) was applied to the alternative data sets for several different clades (Mammalia, Eutheria, Metatheria, or individual orders). For Mammalia, a 'subsampling procedure' was also applied, in which random subsamples of different sample sizes were taken from each original data set and successively analysed. In each case, two data sets with identical sample size and species, but comprising BMR data with different degrees of reliability, were compared. Selection criteria had minor effects on scaling equations computed for large clades (Mammalia, Eutheria, Metatheria), although less-reliable estimates of BMR were generally about 12-20% larger than more-reliable ones. Larger effects were found with more-limited clades, such as sciuromorph rodents. For the relationship between BMR and brain mass the results of comparative analyses were found to depend strongly on the data set used, especially with more-limited, order-level clades. In fact, with small sample sizes (e.g. <100) results often appeared erratic. Subsampling revealed that sample size has a non-linear effect on the probability of a zero slope for a given relationship. Depending on the species included, results could differ dramatically, especially with small sample sizes. Overall, our findings indicate a need for due diligence when selecting BMR estimates and caution regarding results (even if seemingly significant) with small sample sizes. © 2017 Cambridge Philosophical Society.

Common Criteria Evaluation and Validation Scheme for Information Technology Security: Guidance to Validators of IT Security Evaluations

DTIC Science & Technology

2002-02-01

NVLAP procedures are compatible with, among others, the most recent official publications of ISO / IEC 17025 (formally ISO / IEC Guide 25), ISO Guides 2, 30... IEC Guide 17025 and the relevant requirements of ISO 9002-1994. NVLAP Handbook 150-20 contains information that is specific to Common Criteria...Evaluation Technical Report EAP Evaluation Acceptance Package IEC International Electrotechnical Commission ISO International

Multi-point objective-oriented sequential sampling strategy for constrained robust design

NASA Astrophysics Data System (ADS)

Zhu, Ping; Zhang, Siliang; Chen, Wei

2015-03-01

Metamodelling techniques are widely used to approximate system responses of expensive simulation models. In association with the use of metamodels, objective-oriented sequential sampling methods have been demonstrated to be effective in balancing the need for searching an optimal solution versus reducing the metamodelling uncertainty. However, existing infilling criteria are developed for deterministic problems and restricted to one sampling point in one iteration. To exploit the use of multiple samples and identify the true robust solution in fewer iterations, a multi-point objective-oriented sequential sampling strategy is proposed for constrained robust design problems. In this article, earlier development of objective-oriented sequential sampling strategy for unconstrained robust design is first extended to constrained problems. Next, a double-loop multi-point sequential sampling strategy is developed. The proposed methods are validated using two mathematical examples followed by a highly nonlinear automotive crashworthiness design example. The results show that the proposed method can mitigate the effect of both metamodelling uncertainty and design uncertainty, and identify the robust design solution more efficiently than the single-point sequential sampling approach.

The 2002 NIMH Provisional Diagnostic Criteria for Depression of Alzheimer's Disease (PDC-dAD): Gauging their Validity over a Decade Later.

PubMed

Sepehry, Amir A; Lee, Philip E; Hsiung, Ging-Yuek R; Beattie, B Lynn; Feldman, Howard H; Jacova, Claudia

2017-01-01

Presented herein is evidence for criterion, content, and convergent/discriminant validity of the NIMH-Provisional Diagnostic Criteria for depression of Alzheimer's Disease (PDC-dAD) that were formulated to address depression in Alzheimer's disease (AD). Using meta-analytic and systematic review methods, we examined criterion validity evidence in epidemiological and clinical studies comparing the PDC-dAD to Diagnostic and Statistical Manual of Mental Disorders fourth edition (DSM-IV), and International Classification of Disease (ICD 9) depression diagnostic criteria. We estimated prevalence of depression by PDC, DSM, and ICD with an omnibus event rate effect-size. We also examined diagnostic agreement between PDC and DSM. To gauge content validity, we reviewed rates of symptom endorsement for each diagnostic approach. Finally, we examined the PDC's relationship with assessment scales (global cognition, neuropsychiatric, and depression definition) for convergent validity evidence. The aggregate evidence supports the validity of the PDC-dAD. Our findings suggest that depression in AD differs from other depressive disorders including Major Depressive Disorder (MDD) in that dAD is more prevalent, with generally a milder presentation and with unique features not captured by the DSM. Although the PDC are the current standard for diagnosis of depression in AD, we identified the need for their further optimization based on predictive validity evidence.

Individual progression of carotid intima media thickness as a surrogate for vascular risk (PROG-IMT): Rationale and design of a meta-analysis project

PubMed Central

Lorenz, Matthias W.; Bickel, Horst; Bots, Michiel L.; Breteler, Monique M.B.; Catapano, Alberico L.; Desvarieux, Moise; Hedblad, Bo; Iglseder, Bernhard; Johnsen, Stein Harald; Juraska, Michal; Kiechl, Stefan; Mathiesen, Ellisiv B.; Norata, Giuseppe D.; Grigore, Liliana; Polak, Joseph; Poppert, Holger; Rosvall, Maria; Rundek, Tatjana; Sacco, Ralph L.; Sander, Dirk; Sitzer, Matthias; Steinmetz, Helmuth; Stensland, Eva; Willeit, Johann; Witteman, Jacqueline; Yanez, David; Thompson, Simon G.

2013-01-01

Carotid intima media thickness (IMT) progression is increasingly used as a surrogate for vascular risk. This use is supported by data from a few clinical trials investigating statins, but established criteria of surrogacy are only partially fulfilled. To provide a valid basis for the use of IMT progression as a study end point, we are performing a 3-step meta-analysis project based on individual participant data. Objectives of the 3 successive stages are to investigate (1) whether IMT progression prospectively predicts myocardial infarction, stroke, or death in population-based samples; (2) whether it does so in prevalent disease cohorts; and (3) whether interventions affecting IMT progression predict a therapeutic effect on clinical end points. Recruitment strategies, inclusion criteria, and estimates of the expected numbers of eligible studies are presented along with a detailed analysis plan. PMID:20435179

Reliability Criteria for Thick Bonding Wire.

PubMed

Dagdelen, Turker; Abdel-Rahman, Eihab; Yavuz, Mustafa

2018-04-17

Bonding wire is one of the main interconnection techniques. Thick bonding wire is widely used in power modules and other high power applications. This study examined the case for extending the use of traditional thin wire reliability criteria, namely wire flexure and aspect ratio, to thick wires. Eleven aluminum (Al) and aluminum coated copper (CucorAl) wire samples with diameter 300 μm were tested experimentally. The wire response was measured using a novel non-contact method. High fidelity FEM models of the wire were developed and validated. We found that wire flexure is not correlated to its stress state or fatigue life. On the other hand, aspect ratio is a consistent criterion of thick wire fatigue life. Increasing the wire aspect ratio lowers its critical stress and increases its fatigue life. Moreover, we found that CucorAl wire has superior performance and longer fatigue life than Al wire.

Reliability Criteria for Thick Bonding Wire

PubMed Central

Yavuz, Mustafa

2018-01-01

Bonding wire is one of the main interconnection techniques. Thick bonding wire is widely used in power modules and other high power applications. This study examined the case for extending the use of traditional thin wire reliability criteria, namely wire flexure and aspect ratio, to thick wires. Eleven aluminum (Al) and aluminum coated copper (CucorAl) wire samples with diameter 300 μm were tested experimentally. The wire response was measured using a novel non-contact method. High fidelity FEM models of the wire were developed and validated. We found that wire flexure is not correlated to its stress state or fatigue life. On the other hand, aspect ratio is a consistent criterion of thick wire fatigue life. Increasing the wire aspect ratio lowers its critical stress and increases its fatigue life. Moreover, we found that CucorAl wire has superior performance and longer fatigue life than Al wire. PMID:29673194

Differentiation of depression and anxiety groups using defense mechanisms.

PubMed

Olson, Trevor R; Presniak, Michelle D; MacGregor, Michael Wm

2009-11-01

We examined whether participants in depressed and anxious groups could be classified correctly using observer and self-report measures of defense mechanisms. A sample of 1182 university students completed the Personality Assessment Inventory and those scoring in the clinical range on either depression or anxiety indices were selected for participation. In total, 25 participants met criteria for the depressed group and 94 met criteria for the anxious group. Individual defense scores from the Defense-Q and the Defense Style Questionnaire were separately entered into 2 stepwise discriminant analyses. After cross-validation, the Defense-Q and Defense Style Questionnaire analyses classified participants with 75.0% and 71.3% accuracy, respectively. The results indicated that depression and anxiety groups can be significantly differentiated by defense use alone. Important differences in defensive functioning between these groups were confirmed and differences between observer and self-report measures of defenses mechanisms and current challenges in defense research were highlighted.

[Criteria of scientific validity in research].

PubMed

Pelletier, Céline; Pagé, Ginette

2002-03-01

The purpose of this article is to present the evaluative criteria of qualitative and quantitative research. Philosophical foundations of positivism, postpositivism and constructivism are explored. Triangulation and crystallization expose the controversies about them. Finally, Lincoln and Guba criteria are retained for the evaluation of qualitative and quantitative research.

Validation of the Spanish version of Mackey childbirth satisfaction rating scale.

PubMed

Caballero, Pablo; Delgado-García, Beatriz E; Orts-Cortes, Isabel; Moncho, Joaquin; Pereyra-Zamora, Pamela; Nolasco, Andreu

2016-04-16

The "Mackey Childbirth Satisfaction Rating Scale" (MCSRS) is a complete non-validated scale which includes the most important factors associated with maternal satisfaction. Our primary purpose was to describe the internal structure of the scale and validate the reliability and validity of concept of its Spanish version MCSRS-E. The MCSRS was translated into Spanish, back-translated and adapted to the Spanish population. It was then administered following a pilot test with women who met the study participant requirements. The scale structure was obtained by performing an exploratory factorial analysis using a sample of 304 women. The structures obtained were tested by conducting a confirmatory factorial analysis using a sample of 159 women. To test the validity of concept, the structure factors were correlated with expectations prior to childbirth experiences. McDonald's omegas were calculated for each model to establish the reliability of each factor. The study was carried out at four University Hospitals; Alicante, Elche, Torrevieja and Vinalopo Salud of Elche. The inclusion criteria were women aged 18-45 years old who had just delivered a singleton live baby at 38-42 weeks through vaginal delivery. Women who had difficulty speaking and understanding Spanish were excluded. The process generated 5 different possible internal structures in a nested model more consistent with the theory than other internal structures of the MCSRS applied hitherto. All of them had good levels of validation and reliability. This nested model to explain internal structure of MCSRS-E can accommodate different clinical practice scenarios better than the other structures applied to date, and it is a flexible tool which can be used to identify the aspects that should be changed to improve maternal satisfaction and hence maternal health.

Simultaneous quantification of fluoxetine and norfluoxetine in colostrum and mature human milk using a 2-dimensional liquid chromatography-tandem mass spectrometry system.

PubMed

Lopes, Bianca Rebelo; Cassiano, Neila Maria; Carvalho, Daniela Miarelli; Moisés, Elaine Christine Dantas; Cass, Quezia Bezerra

2018-02-20

A two-dimensional liquid chromatography system coupled to triple quadrupole tandem mass spectrometer (2D LC-MS/MS) was employed for the determination of fluoxetine (FLU) and norfluoxetine (N-FLU) in colostrum and mature milk by direct sample injection. With a run time of 12 min representing a gain in throughput analysis, the validated methods furnished selectivity, extraction efficiency, accuracy, and precision in accordance with the criteria preconized by the European Medicines Agency guidelines. With a linear range of 3.00-150 ng/mL for FLU and 4.00-200 ng/mL for N-FLU they were applied to the analysis of colostrum and mature milk samples from nursing mothers. The paper discusses the differences and similarity of sample preparation for this two sample matrices. The herein reported methods are an advance in sample preparation procedures providing waste reduction and a sustainable approach. Copyright © 2017 Elsevier B.V. All rights reserved.

Airport Landside - Volume III : ALSIM Calibration and Validation.

DOT National Transportation Integrated Search

1982-06-01

This volume discusses calibration and validation procedures applied to the Airport Landside Simulation Model (ALSIM), using data obtained at Miami, Denver and LaGuardia Airports. Criteria for the selection of a validation methodology are described. T...

OMERACT-based fibromyalgia symptom subgroups: an exploratory cluster analysis.

PubMed

Vincent, Ann; Hoskin, Tanya L; Whipple, Mary O; Clauw, Daniel J; Barton, Debra L; Benzo, Roberto P; Williams, David A

2014-10-16

The aim of this study was to identify subsets of patients with fibromyalgia with similar symptom profiles using the Outcome Measures in Rheumatology (OMERACT) core symptom domains. Female patients with a diagnosis of fibromyalgia and currently meeting fibromyalgia research survey criteria completed the Brief Pain Inventory, the 30-item Profile of Mood States, the Medical Outcomes Sleep Scale, the Multidimensional Fatigue Inventory, the Multiple Ability Self-Report Questionnaire, the Fibromyalgia Impact Questionnaire-Revised (FIQ-R) and the Short Form-36 between 1 June 2011 and 31 October 2011. Hierarchical agglomerative clustering was used to identify subgroups of patients with similar symptom profiles. To validate the results from this sample, hierarchical agglomerative clustering was repeated in an external sample of female patients with fibromyalgia with similar inclusion criteria. A total of 581 females with a mean age of 55.1 (range, 20.1 to 90.2) years were included. A four-cluster solution best fit the data, and each clustering variable differed significantly (P <0.0001) among the four clusters. The four clusters divided the sample into severity levels: Cluster 1 reflects the lowest average levels across all symptoms, and cluster 4 reflects the highest average levels. Clusters 2 and 3 capture moderate symptoms levels. Clusters 2 and 3 differed mainly in profiles of anxiety and depression, with Cluster 2 having lower levels of depression and anxiety than Cluster 3, despite higher levels of pain. The results of the cluster analysis of the external sample (n = 478) looked very similar to those found in the original cluster analysis, except for a slight difference in sleep problems. This was despite having patients in the validation sample who were significantly younger (P <0.0001) and had more severe symptoms (higher FIQ-R total scores (P = 0.0004)). In our study, we incorporated core OMERACT symptom domains, which allowed for clustering based on a comprehensive symptom profile. Although our exploratory cluster solution needs confirmation in a longitudinal study, this approach could provide a rationale to support the study of individualized clinical evaluation and intervention.

Internal Consistency, Retest Reliability, and their Implications For Personality Scale Validity

PubMed Central

McCrae, Robert R.; Kurtz, John E.; Yamagata, Shinji; Terracciano, Antonio

2010-01-01

We examined data (N = 34,108) on the differential reliability and validity of facet scales from the NEO Inventories. We evaluated the extent to which (a) psychometric properties of facet scales are generalizable across ages, cultures, and methods of measurement; and (b) validity criteria are associated with different forms of reliability. Composite estimates of facet scale stability, heritability, and cross-observer validity were broadly generalizable. Two estimates of retest reliability were independent predictors of the three validity criteria; none of three estimates of internal consistency was. Available evidence suggests the same pattern of results for other personality inventories. Internal consistency of scales can be useful as a check on data quality, but appears to be of limited utility for evaluating the potential validity of developed scales, and it should not be used as a substitute for retest reliability. Further research on the nature and determinants of retest reliability is needed. PMID:20435807

Multiclass method for the determination of 62 antibiotics in milk.

PubMed

Moretti, Simone; Cruciani, Gabriele; Romanelli, Sara; Rossi, Rosanna; Saluti, Giorgio; Galarini, Roberta

2016-09-01

A multiclass method for screening and confirmatory analysis of antimicrobial residues in milk has been developed and validated. Sixty-two antibiotics belonging to ten different drug families (amphenicols, cephalosporins, lincosamides, macrolides, penicillin, pleuromutilins, quinolones, rifamycins, sulfonamides and tetracyclines) have been included. After the addition of an aqueous solution of EDTA, the milk samples were extracted twice with acetonitrile, evaporated and dissolved in ammonium acetate. After centrifugation, 10 µl were analysed using LC-Q-Orbitrap operating in positive electrospray ionization mode. The method was validated in bovine milk in the range 2-150 µg kg(-1) for all antibiotics; for four compounds with maximum residue limits higher than 100 µg kg(-1) , the validation interval has been extended until 333 µg kg(-1) . The estimated performance characteristics were satisfactory complying with the requirements of Commission Decision 2002/657/EC. Good accuracies were obtained also taking advantage from the versatility of the hybrid mass analyser. Identification criteria were achieved verifying the mass accuracy and ion ratio of two ions, including the pseudomolecular one, where possible. Finally, the developed procedure was applied to 13 real cases of suspect milk samples (microbiological assay) confirming the presence of one or more antibiotics, although frequently, the maximum residue limits were not exceeded. The availability of rapid multiclass confirmatory methods can avoid wastes of suspect, but compliant, raw milk samples. Copyright © 2016 John Wiley & Sons, Ltd. Copyright © 2016 John Wiley & Sons, Ltd.

Validity and Reliability of Published Comprehensive Theory of Mind Tests for Normal Preschool Children: A Systematic Review.

PubMed

Ziatabar Ahmadi, Seyyede Zohreh; Jalaie, Shohreh; Ashayeri, Hassan

2015-09-01

Theory of mind (ToM) or mindreading is an aspect of social cognition that evaluates mental states and beliefs of oneself and others. Validity and reliability are very important criteria when evaluating standard tests; and without them, these tests are not usable. The aim of this study was to systematically review the validity and reliability of published English comprehensive ToM tests developed for normal preschool children. We searched MEDLINE (PubMed interface), Web of Science, Science direct, PsycINFO, and also evidence base Medicine (The Cochrane Library) databases from 1990 to June 2015. Search strategy was Latin transcription of 'Theory of Mind' AND test AND children. Also, we manually studied the reference lists of all final searched articles and carried out a search of their references. Inclusion criteria were as follows: Valid and reliable diagnostic ToM tests published from 1990 to June 2015 for normal preschool children; and exclusion criteria were as follows: the studies that only used ToM tests and single tasks (false belief tasks) for ToM assessment and/or had no description about structure, validity or reliability of their tests. METHODological quality of the selected articles was assessed using the Critical Appraisal Skills Programme (CASP). In primary searching, we found 1237 articles in total databases. After removing duplicates and applying all inclusion and exclusion criteria, we selected 11 tests for this systematic review. There were a few valid, reliable and comprehensive ToM tests for normal preschool children. However, we had limitations concerning the included articles. The defined ToM tests were different in populations, tasks, mode of presentations, scoring, mode of responses, times and other variables. Also, they had various validities and reliabilities. Therefore, it is recommended that the researchers and clinicians select the ToM tests according to their psychometric characteristics, validity and reliability.

Validity and Reliability of Published Comprehensive Theory of Mind Tests for Normal Preschool Children: A Systematic Review

PubMed Central

Ziatabar Ahmadi, Seyyede Zohreh; Jalaie, Shohreh; Ashayeri, Hassan

2015-01-01

Objective: Theory of mind (ToM) or mindreading is an aspect of social cognition that evaluates mental states and beliefs of oneself and others. Validity and reliability are very important criteria when evaluating standard tests; and without them, these tests are not usable. The aim of this study was to systematically review the validity and reliability of published English comprehensive ToM tests developed for normal preschool children. Method: We searched MEDLINE (PubMed interface), Web of Science, Science direct, PsycINFO, and also evidence base Medicine (The Cochrane Library) databases from 1990 to June 2015. Search strategy was Latin transcription of ‘Theory of Mind’ AND test AND children. Also, we manually studied the reference lists of all final searched articles and carried out a search of their references. Inclusion criteria were as follows: Valid and reliable diagnostic ToM tests published from 1990 to June 2015 for normal preschool children; and exclusion criteria were as follows: the studies that only used ToM tests and single tasks (false belief tasks) for ToM assessment and/or had no description about structure, validity or reliability of their tests. Methodological quality of the selected articles was assessed using the Critical Appraisal Skills Programme (CASP). Result: In primary searching, we found 1237 articles in total databases. After removing duplicates and applying all inclusion and exclusion criteria, we selected 11 tests for this systematic review. Conclusion: There were a few valid, reliable and comprehensive ToM tests for normal preschool children. However, we had limitations concerning the included articles. The defined ToM tests were different in populations, tasks, mode of presentations, scoring, mode of responses, times and other variables. Also, they had various validities and reliabilities. Therefore, it is recommended that the researchers and clinicians select the ToM tests according to their psychometric characteristics, validity and reliability. PMID:27006666

Bioanalytical high-throughput selected reaction monitoring-LC/MS determination of selected estrogen receptor modulators in human plasma: 2000 samples/day.

PubMed

Zweigenbaum, J; Henion, J

2000-06-01

The high-throughput determination of small molecules in biological matrixes has become an important part of drug discovery. This work shows that increased throughput LC/MS/MS techniques can be used for the analysis of selected estrogen receptor modulators in human plasma where more than 2000 samples may be analyzed in a 24-h period. The compounds used to demonstrate the high-throughput methodology include tamoxifen, raloxifene, 4-hydroxytamoxifen, nafoxidine, and idoxifene. Tamoxifen and raloxifene are used in both breast cancer therapy and osteoporosis and have shown prophylactic potential for the reduction of the risk of breast cancer. The described strategy provides LC/MS/MS separation and quantitation for each of the five test articles in control human plasma. The method includes sample preparation employing liquid-liquid extraction in the 96-well format, an LC separation of the five compounds in less than 30 s, and selected reaction monitoring detection from low nano- to microgram per milliter levels. Precision and accuracy are determined where each 96-well plate is considered a typical "tray" having calibration standards and quality control (QC) samples dispersed through each plate. A concept is introduced where 24 96-well plates analyzed in 1 day is considered a "grand tray", and the method is cross-validated with standards placed only at the beginning of the first plate and the end of the last plate. Using idoxifene-d5 as an internal standard, the results obtained for idoxifene and tamoxifen satisfy current bioanalytical method validation criteria on two separate days where 2112 and 2304 samples were run, respectively. Method validation included 24-h autosampler stability and one freeze-thaw cycle stability for the extracts. Idoxifene showed acceptable results with accuracy ranging from 0.3% for the high quality control (QC) to 15.4% for the low QC and precision of 3.6%-13.9% relative standard deviation. Tamoxifen showed accuracy ranging from 1.6% to 13.8% and precision from 7.8% to 15.2%. The linear dynamic range for these compounds was 3 orders of magnitude. The limit of quantification was 5 and 50 ng/ mL for tamoxifen and idoxifene, respectively. The other compounds in this study in general satisfy the more relaxed bioanalytical acceptance criteria for modern drug discovery. It is suggested that the quantification levels reported in this high-throughput analysis example are adequate for many drug discovery and related early pharmaceutical studies.

Emotional disorders: cluster 4 of the proposed meta-structure for DSM-V and ICD-11.

PubMed

Goldberg, D P; Krueger, R F; Andrews, G; Hobbs, M J

2009-12-01

The extant major psychiatric classifications DSM-IV, and ICD-10, are atheoretical and largely descriptive. Although this achieves good reliability, the validity of a medical diagnosis would be greatly enhanced by an understanding of risk factors and clinical manifestations. In an effort to group mental disorders on the basis of aetiology, five clusters have been proposed. This paper considers the validity of the fourth cluster, emotional disorders, within that proposal. We reviewed the literature in relation to 11 validating criteria proposed by a Study Group of the DSM-V Task Force, as applied to the cluster of emotional disorders. An emotional cluster of disorders identified using the 11 validators is feasible. Negative affectivity is the defining feature of the emotional cluster. Although there are differences between disorders in the remaining validating criteria, there are similarities that support the feasibility of an emotional cluster. Strong intra-cluster co-morbidity may reflect the action of common risk factors and also shared higher-order symptom dimensions in these emotional disorders. Emotional disorders meet many of the salient criteria proposed by the Study Group of the DSM-V Task Force to suggest a classification cluster.

Comparison of Enzyme-Linked Immunosorbent Assay, Surface Plasmon Resonance and Biolayer Interferometry for Screening of Deoxynivalenol in Wheat and Wheat Dust

PubMed Central

Sanders, Melanie; McPartlin, Daniel; Moran, Kara; Guo, Yirong; Eeckhout, Mia; O’Kennedy, Richard; De Saeger, Sarah; Maragos, Chris

2016-01-01

A sample preparation method was developed for the screening of deoxynivalenol (DON) in wheat and wheat dust. Extraction was carried out with water and was successful due to the polar character of DON. For detection, an enzyme-linked immunosorbent assay (ELISA) was compared to the sensor-based techniques of surface plasmon resonance (SPR) and biolayer interferometry (BLI) in terms of sensitivity, affinity and matrix effect. The matrix effects from wheat and wheat dust using SPR were too high to further use this screenings method. The preferred ELISA and BLI methods were validated according to the criteria established in Commission Regulation 519/2014/EC and Commission Decision 2002/657/EC. A small survey was executed on 16 wheat lots and their corresponding dust samples using the validated ELISA method. A linear correlation (r = 0.889) was found for the DON concentration in dust versus the DON concentration in wheat (LOD wheat: 233 μg/kg, LOD wheat dust: 458 μg/kg). PMID:27077883

Cultural concepts of distress and psychiatric disorders: literature review and research recommendations for global mental health epidemiology

PubMed Central

Kohrt, Brandon A; Rasmussen, Andrew; Kaiser, Bonnie N; Haroz, Emily E; Maharjan, Sujen M; Mutamba, Byamah B; de Jong, Joop TVM; Hinton, Devon E

2014-01-01

Background Burgeoning global mental health endeavors have renewed debates about cultural applicability of psychiatric categories. This study’s goal is to review strengths and limitations of literature comparing psychiatric categories with cultural concepts of distress (CCD) such as cultural syndromes, culture-bound syndromes, and idioms of distress. Methods The Systematic Assessment of Quality in Observational Research (SAQOR) was adapted based on cultural psychiatry principles to develop a Cultural Psychiatry Epidemiology version (SAQOR-CPE), which was used to rate quality of quantitative studies comparing CCD and psychiatric categories. A meta-analysis was performed for each psychiatric category. Results Forty-five studies met inclusion criteria, with 18 782 unique participants. Primary objectives of the studies included comparing CCD and psychiatric disorders (51%), assessing risk factors for CCD (18%) and instrument validation (16%). Only 27% of studies met SAQOR-CPE criteria for medium quality, with the remainder low or very low quality. Only 29% of studies employed representative samples, 53% used validated outcome measures, 44% included function assessments and 44% controlled for confounding. Meta-analyses for anxiety, depression, PTSD and somatization revealed high heterogeneity (I2 > 75%). Only general psychological distress had low heterogeneity (I2 = 8%) with a summary effect odds ratio of 5.39 (95% CI 4.71-6.17). Associations between CCD and psychiatric disorders were influenced by methodological issues, such as validation designs (β = 16.27, 95%CI 12.75-19.79) and use of CCD multi-item checklists (β = 6.10, 95%CI 1.89-10.31). Higher quality studies demonstrated weaker associations of CCD and psychiatric disorders. Conclusions Cultural concepts of distress are not inherently unamenable to epidemiological study. However, poor study quality impedes conceptual advancement and service application. With improved study design and reporting using guidelines such as the SAQOR-CPE, CCD research can enhance detection of mental health problems, reduce cultural biases in diagnostic criteria and increase cultural salience of intervention trial outcomes. PMID:24366490

Developing Save Your Food Kit (Sayofu Kit) to Support Inquiry, Improve Student Learning Outcomes at SMP Plus Hidayatul Mubtadiin and Public Awareness on Food Additives

NASA Astrophysics Data System (ADS)

Astutik, J.

2017-02-01

Food additives are materials that can not be separated from the lives of students and the community. Based on the preliminary questionnaire, it indicates the lack of kit supporting material additives in some schools and communities. The research objectives of this development are (1) to develop Kit experiment (SAYOFU KIT) and supplementary books to improve student learning outcomes in the classroom and public awareness on food additives (2) to describe the feasibility and potential effectiveness of SAYOFU KIT developed (3) to analyze the practice of SAYOFU KIT and benefits for students and the community. This development study uses 4-D models Thiagarajan, et al (1974). Through some stages, they are: defining, designing, developing and disseminating which involes the students and community. The developed SAYOFU KIT includes additives sample kit, borax test kit, curcumin test kit, formaldehyde test kit, modification heater to the identification of dyes and dye test paper. The study is conducted at SMP Plus Hidayatul Mubtadiin, and TKIT Al Uswah. The products are validated by experts and education practitioners. Qualitative data processing uses descriptive method, whereas quantitative data by using the N-gain. The average yield of expert validation of SAYOFU KIT with supplementary books 76.50% teacher’s book and 76.30% student’s book are eligible. The average yield of 96.81% validation of educational practitioners criteria, piloting a small group of 83.15%, and 82.89% field trials are very decent. The average yield on the student questionnaire responses SAYOFU kit and supplementary book is 87.6% with the criteria very well worth it. N-Gain 0:56 cognitive achievement with the criteria enough. The results of the public poll showed 95% feel the benefits SAYOFU kits for testing food. Based from description indicates that SAYOFU Kit developed feasible, practical, useful to support inquiry learning and improve student learning outcomes as well as public awareness of food additives.

Freezing of gait and fall detection in Parkinson's disease using wearable sensors: a systematic review.

PubMed

Silva de Lima, Ana Lígia; Evers, Luc J W; Hahn, Tim; Bataille, Lauren; Hamilton, Jamie L; Little, Max A; Okuma, Yasuyuki; Bloem, Bastiaan R; Faber, Marjan J

2017-08-01

Despite the large number of studies that have investigated the use of wearable sensors to detect gait disturbances such as Freezing of gait (FOG) and falls, there is little consensus regarding appropriate methodologies for how to optimally apply such devices. Here, an overview of the use of wearable systems to assess FOG and falls in Parkinson's disease (PD) and validation performance is presented. A systematic search in the PubMed and Web of Science databases was performed using a group of concept key words. The final search was performed in January 2017, and articles were selected based upon a set of eligibility criteria. In total, 27 articles were selected. Of those, 23 related to FOG and 4 to falls. FOG studies were performed in either laboratory or home settings, with sample sizes ranging from 1 PD up to 48 PD presenting Hoehn and Yahr stage from 2 to 4. The shin was the most common sensor location and accelerometer was the most frequently used sensor type. Validity measures ranged from 73-100% for sensitivity and 67-100% for specificity. Falls and fall risk studies were all home-based, including samples sizes of 1 PD up to 107 PD, mostly using one sensor containing accelerometers, worn at various body locations. Despite the promising validation initiatives reported in these studies, they were all performed in relatively small sample sizes, and there was a significant variability in outcomes measured and results reported. Given these limitations, the validation of sensor-derived assessments of PD features would benefit from more focused research efforts, increased collaboration among researchers, aligning data collection protocols, and sharing data sets.

IT Security Standards and Legal Metrology - Transfer and Validation

NASA Astrophysics Data System (ADS)

Thiel, F.; Hartmann, V.; Grottker, U.; Richter, D.

2014-08-01

Legal Metrology's requirements can be transferred into the IT security domain applying a generic set of standardized rules provided by the Common Criteria (ISO/IEC 15408). We will outline the transfer and cross validation of such an approach. As an example serves the integration of Legal Metrology's requirements into a recently developed Common Criteria based Protection Profile for a Smart Meter Gateway designed under the leadership of the Germany's Federal Office for Information Security. The requirements on utility meters laid down in the Measuring Instruments Directive (MID) are incorporated. A verification approach to check for meeting Legal Metrology's requirements by their interpretation through Common Criteria's generic requirements is also presented.

[Validation of the American College of Rheumatology classification criteria for primary Sjogren's syndrome in Chinese patients].

PubMed

Wei, Pan; Lu, Song-he; Fu, Jing-ya; Yan, Zhi-min; Hua, Hong

2014-04-18

To validate the American College of Rheumatology Classification (ACR) Criteria (2012) for the diagnosis of primary Sjogren's syndrome in Chinese patients. All patients involved in this study came from the Department of Oral Medicine Peking University Stomatology Hospital. They were devided into two groups of pSS and non-pSS according to the diagnoses made by two experts. Both groups of the patients had completed medical records kept in the hospital. A total of 239 pSS patients (160 with labial salivary gland biopsy, and 79 without biopsy) and 52 age-matched non-pSS patients [(55.17±14.295),and (55.90±13.38) years old, P>0.05] (9 with biopsy, and 43 without biopsy) were involved in this study. The sensitivity and specificity of ACR criteria in diagnosing pSS were 90.37 % and 88.46 % respectively. The positive and negative likelihood ratios were 7.83 and 0.109, respectively. The sensitivities of ACR criteria in diagnosing pSS patients with and without labial biopsy were 88.75% and 93.67 %, respectively, with specificities of 88.89% and 88.37%, respectively. The most sensitive item adopted in ACR criteria was the ocular staining score with a sensitivity of 85.77%, and the most specific item was the labial salivary gland biopsy, with a specificity of 88.89%. The sensitivity and specificity of ACR criteria in diagnosing Chinese pSS patients were relatively high, and may serve as the diagnosis criteria in research and clinical practice. However, the ACR criteria need to be validated and further revised in the future .

Socially supportive activity inventory: reliability and validity of a social activity instrument for long-term care institutions.

PubMed

Hsu, Ya-Chuan

2011-09-01

: Diverse social and recreational activities in elder care institutions have been provided to enrich a person's mental well-being amidst what is a relatively monotonous life. However, few instruments that measure the social activities of long-term care residents are available. : This study was designed to develop a culturally sensitive instrument (Socially Supportive Activity Inventory, SSAI) to assess quantity and quality of social activities for long-term care institutions and validate the instrument's psychometric properties. : The SSAI was developed on the basis of the social support theory, a synthesis of literature, and Taiwanese cultural mores. The instrument was rigorously subjected to a two-stage process to evaluate its reliability and validity. In Stage 1, six experts from diverse backgrounds were recruited to evaluate instrument items and estimate the content validity of the instrument using a content validity questionnaire. Items were modified and refined on the basis of the responses of the expert panel and a set of criteria. After obtaining approval from a university institutional review board, in the second stage of evaluating test-retest reliability, a convenience sample of 10 Taiwanese institutionalized elders in a pilot study, recruited from a nursing home, completed the revised instrument at two separate times over 2 weeks. : Results showed a content validity of .96. Test-retest reliability from a sample of 10 participants yielded stability coefficients of .76-1.00. The stability coefficient was 1.00 for the component of frequency, .76-1.00 for the component of meaningfulness, and .78-1.00 for the component of enjoyment. : The SSAI is a highly relevant and reliable culturally based instrument that can measure social activity in long-term care facilities. Because of the pilot nature of this study, future directions include further exploration of the SSAI instrument's psychometric properties. This should be done by enlarging the sample size to include more long-term care facilities and individual participants. Future studies can utilize diverse measures of social activity for comparison and validation of the SSAI.

Assessment of generalizability, applicability and predictability (GAP) for evaluating external validity in studies of universal family-based prevention of alcohol misuse in young people: systematic methodological review of randomized controlled trials.

PubMed

Fernandez-Hermida, Jose Ramon; Calafat, Amador; Becoña, Elisardo; Tsertsvadze, Alexander; Foxcroft, David R

2012-09-01

To assess external validity characteristics of studies from two Cochrane Systematic Reviews of the effectiveness of universal family-based prevention of alcohol misuse in young people. Two reviewers used an a priori developed external validity rating form and independently assessed three external validity dimensions of generalizability, applicability and predictability (GAP) in randomized controlled trials. The majority (69%) of the included 29 studies were rated 'unclear' on the reporting of sufficient information for judging generalizability from sample to study population. Ten studies (35%) were rated 'unclear' on the reporting of sufficient information for judging applicability to other populations and settings. No study provided an assessment of the validity of the trial end-point measures for subsequent mortality, morbidity, quality of life or other economic or social outcomes. Similarly, no study reported on the validity of surrogate measures using established criteria for assessing surrogate end-points. Studies evaluating the benefits of family-based prevention of alcohol misuse in young people are generally inadequate at reporting information relevant to generalizability of the findings or implications for health or social outcomes. Researchers, study authors, peer reviewers, journal editors and scientific societies should take steps to improve the reporting of information relevant to external validity in prevention trials. © 2012 The Authors. Addiction © 2012 Society for the Study of Addiction.

Rapid and Accurate Behavioral Health Diagnostic Screening: Initial Validation Study of a Web-Based, Self-Report Tool (the SAGE-SR).

PubMed

Brodey, Benjamin; Purcell, Susan E; Rhea, Karen; Maier, Philip; First, Michael; Zweede, Lisa; Sinisterra, Manuela; Nunn, M Brad; Austin, Marie-Paule; Brodey, Inger S

2018-03-23

The Structured Clinical Interview for DSM (SCID) is considered the gold standard assessment for accurate, reliable psychiatric diagnoses; however, because of its length, complexity, and training required, the SCID is rarely used outside of research. This paper aims to describe the development and initial validation of a Web-based, self-report screening instrument (the Screening Assessment for Guiding Evaluation-Self-Report, SAGE-SR) based on the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5) and the SCID-5-Clinician Version (CV) intended to make accurate, broad-based behavioral health diagnostic screening more accessible within clinical care. First, study staff drafted approximately 1200 self-report items representing individual granular symptoms in the diagnostic criteria for the 8 primary SCID-CV modules. An expert panel iteratively reviewed, critiqued, and revised items. The resulting items were iteratively administered and revised through 3 rounds of cognitive interviewing with community mental health center participants. In the first 2 rounds, the SCID was also administered to participants to directly compare their Likert self-report and SCID responses. A second expert panel evaluated the final pool of items from cognitive interviewing and criteria in the DSM-5 to construct the SAGE-SR, a computerized adaptive instrument that uses branching logic from a screener section to administer appropriate follow-up questions to refine the differential diagnoses. The SAGE-SR was administered to healthy controls and outpatient mental health clinic clients to assess test duration and test-retest reliability. Cutoff scores for screening into follow-up diagnostic sections and criteria for inclusion of diagnoses in the differential diagnosis were evaluated. The expert panel reduced the initial 1200 test items to 664 items that panel members agreed collectively represented the SCID items from the 8 targeted modules and DSM criteria for the covered diagnoses. These 664 items were iteratively submitted to 3 rounds of cognitive interviewing with 50 community mental health center participants; the expert panel reviewed session summaries and agreed on a final set of 661 clear and concise self-report items representing the desired criteria in the DSM-5. The SAGE-SR constructed from this item pool took an average of 14 min to complete in a nonclinical sample versus 24 min in a clinical sample. Responses to individual items can be combined to generate DSM criteria endorsements and differential diagnoses, as well as provide indices of individual symptom severity. Preliminary measures of test-retest reliability in a small, nonclinical sample were promising, with good to excellent reliability for screener items in 11 of 13 diagnostic screening modules (intraclass correlation coefficient [ICC] or kappa coefficients ranging from .60 to .90), with mania achieving fair test-retest reliability (ICC=.50) and other substance use endorsed too infrequently for analysis. The SAGE-SR is a computerized adaptive self-report instrument designed to provide rigorous differential diagnostic information to clinicians. ©Benjamin Brodey, Susan E Purcell, Karen Rhea, Philip Maier, Michael First, Lisa Zweede, Manuela Sinisterra, M Brad Nunn, Marie-Paule Austin, Inger S Brodey. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 23.03.2018.

[Quality of the pharmacotherapeutic recommendations for the integrated care procedures in Andalusia].

PubMed

Corte, Rosa María Muñoz; Estepa, Raúl García; Ramos, Bernardo Santos; Paloma, Francisco Javier Bautista

2009-01-01

To evaluate the quality of the pharmacotherapeutic recommendations included in the Integrated Care Procedures (PAIs regarding its initials in Spanish) of the Andalusian Ministry of Health, published up to March 2008, through the design and validation of a tool. The assessment tool was designed based on similar instruments, specifically the AGREE. Other criteria included were taken from various literature sources or were devised by ourselves. The tool was validated prior to being used. After applying it to all the PAIs, we examined the degree of compliance with these pharmacotherapeutic criteria, both as a whole and by PAIs subgroups. The developed tool is a questionnaire of 20 items, divided into 4 sections. The first section consists of the essential criteria, and the rest make reference to more specific, non essential criteria: definition of the level of evidence, thoroughness of information and definition of indicators. It was found that 4 of the 60 PAIs do not contain any type of therapeutic recommendation. No PAI fulfils all the items listed in the tool, however, 70 % of them fulfil the essential quality criteria established. There is a great variability in the content of pharmacotherapeutic recommendations for each PAI. Once the validity of the tool has been proved, it could be used to assess the quality of the therapeutic recommendations in clinical practice guidelines.

Analyses related to the development of DSM-5 criteria for substance use related disorders: 3. An assessment of Pathological Gambling criteria.

PubMed

Denis, Cécile; Fatséas, Mélina; Auriacombe, Marc

2012-04-01

The DSM-5 Substance-Related Disorders Work Group proposed to include Pathological Gambling within the current Substance-Related Disorders section. The objective of the current report was to assess four possible sets of diagnostic criteria for Pathological Gambling. Gamblers (N=161) were defined as either Pathological or Non-Pathological according to four classification methods. (a) Option 1: the current DSM-IV criteria for Pathological Gambling; (b) Option 2: dropping the "Illegal Acts" criterion, while keeping the threshold at 5 required criteria endorsed; (c) Option 3: the proposed DSM-5 approach, i.e., deleting "Illegal Acts" and lowering the threshold of required criteria from 5 to 4; (d) Option 4: to use a set of Pathological Gambling criteria modeled on the DSM-IV Substance Dependence criteria. Cronbach's alpha and eigenvalues were calculated for reliability, Phi, discriminant function analyses, correlations and multivariate regression models were performed for validity and kappa coefficients were calculated for diagnostic consistency of each option. All criteria sets were reliable and valid. Some criteria had higher discriminant properties than others. The proposed DSM-5 criteria in Options 2 and 3 performed well and did not appear to alter the meanings of the diagnoses of Pathological Gambling from DSM-IV. Future work should further explore if Pathological Gambling might be assessed using the same criteria as those used for Substance Use Disorders. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Measuring production loss due to health and work environment problems: construct validity and implications.

PubMed

Karlsson, Malin Lohela; Bergström, Gunnar; Björklund, Christina; Hagberg, Jan; Jensen, Irene

2013-12-01

The aim was to validate two measures of production loss, health-related and work environment-related production loss, concerning their associations with health status and work environment factors. Validity was assessed by evaluating the construct validity. Health problems related and work environment-related problems (or factors) were included in separate analyses and evaluated regarding the significant difference in proportion of explained variation (R) of production loss. health problems production loss was not found to fulfill the criteria for convergent validity in this study; however, the measure of work environment-related production loss did fulfill the criteria that were set up. The measure of work environment-related production loss can be used to screen for production loss due to work environment problems as well as an outcome measure when evaluating the effect of organizational interventions.

Rett syndrome diagnostic criteria: lessons from the Natural History Study.

PubMed

Percy, Alan K; Neul, Jeffrey L; Glaze, Daniel G; Motil, Kathleen J; Skinner, Steven A; Khwaja, Omar; Lee, Hye-Seung; Lane, Jane B; Barrish, Judy O; Annese, Fran; McNair, Lauren; Graham, Joy; Barnes, Katherine

2010-12-01

Analysis of 819 participants enrolled in the Rett syndrome (RTT) Natural History Study validates recently revised diagnostic criteria. 765 females fulfilled 2002 consensus criteria for classic (653/85.4%) or variant (112/14.6%) RTT. All participants classified as classic RTT fulfilled each revised main criterion; supportive criteria were not uniformly present. All variant RTT participants met at least 3 of 6 main criteria in the 2002, 2 of 4 main criteria in the current format, and 5 of 11 supportive criteria in both. This analysis underscores the critical role of main criteria for classic RTT; variant RTT requires both main and supportive criteria.

Reducing the Diagnostic Heterogeneity of Schizoaffective Disorder.

PubMed

Seldin, Katherine; Armstrong, Kristan; Schiff, Max L; Heckers, Stephan

2017-01-01

Clinical outcome studies of schizoaffective disorder patients have yielded conflicting results. One reason is the heterogeneity of samples drawn from the schizoaffective disorder population. Here, we studied schizoaffective disorder patients who showed marked functional impairment and continuous signs of illness for at least 6 months (i.e., DSM criteria B and C for schizophrenia). We assessed 176 chronic psychosis patients with a structured interview (SCID-IV-TR) and the Diagnostic Interview for Genetic Studies schizoaffective disorder module. We diagnosed 114 patients with schizophrenia and 62 with schizoaffective disorder. The two groups were similar with regard to age, gender, and race. We tested for group differences in antecedent risk factors, clinical features, and functional outcome. The schizoaffective disorder group differed from the schizophrenia group on two measures only: they showed higher rates of suicidality (more suicide attempts, p  < 0.01; more hospitalizations to prevent suicide, p  < 0.01) and higher anxiety disorder comorbidity ( p  < 0.01). When schizoaffective disorder patients meet DSM criteria B and C for schizophrenia, they resemble schizophrenia patients on several measures used to assess validity. The increased rate of anxiety disorders and suicidality warrants clinical attention. Our data suggest that a more explicit definition of schizoaffective disorder reduces heterogeneity and may increase validity.

A New Generation of Crystallographic Validation Tools for the Protein Data Bank

PubMed Central

Read, Randy J.; Adams, Paul D.; Arendall, W. Bryan; Brunger, Axel T.; Emsley, Paul; Joosten, Robbie P.; Kleywegt, Gerard J.; Krissinel, Eugene B.; Lütteke, Thomas; Otwinowski, Zbyszek; Perrakis, Anastassis; Richardson, Jane S.; Sheffler, William H.; Smith, Janet L.; Tickle, Ian J.; Vriend, Gert; Zwart, Peter H.

2011-01-01

Summary This report presents the conclusions of the X-ray Validation Task Force of the worldwide Protein Data Bank (PDB). The PDB has expanded massively since current criteria for validation of deposited structures were adopted, allowing a much more sophisticated understanding of all the components of macromolecular crystals. The size of the PDB creates new opportunities to validate structures by comparison with the existing database, and the now-mandatory deposition of structure factors creates new opportunities to validate the underlying diffraction data. These developments highlighted the need for a new assessment of validation criteria. The Task Force recommends that a small set of validation data be presented in an easily understood format, relative to both the full PDB and the applicable resolution class, with greater detail available to interested users. Most importantly, we recommend that referees and editors judging the quality of structural experiments have access to a concise summary of well-established quality indicators. PMID:22000512

A new generation of crystallographic validation tools for the protein data bank.

PubMed

Read, Randy J; Adams, Paul D; Arendall, W Bryan; Brunger, Axel T; Emsley, Paul; Joosten, Robbie P; Kleywegt, Gerard J; Krissinel, Eugene B; Lütteke, Thomas; Otwinowski, Zbyszek; Perrakis, Anastassis; Richardson, Jane S; Sheffler, William H; Smith, Janet L; Tickle, Ian J; Vriend, Gert; Zwart, Peter H

2011-10-12

This report presents the conclusions of the X-ray Validation Task Force of the worldwide Protein Data Bank (PDB). The PDB has expanded massively since current criteria for validation of deposited structures were adopted, allowing a much more sophisticated understanding of all the components of macromolecular crystals. The size of the PDB creates new opportunities to validate structures by comparison with the existing database, and the now-mandatory deposition of structure factors creates new opportunities to validate the underlying diffraction data. These developments highlighted the need for a new assessment of validation criteria. The Task Force recommends that a small set of validation data be presented in an easily understood format, relative to both the full PDB and the applicable resolution class, with greater detail available to interested users. Most importantly, we recommend that referees and editors judging the quality of structural experiments have access to a concise summary of well-established quality indicators. Copyright © 2011 Elsevier Ltd. All rights reserved.

Systematic review of the psychometric properties and theoretical grounding of instruments evaluating self-care in people with type 2 diabetes mellitus.

PubMed

Caro-Bautista, Jorge; Martín-Santos, Francisco Javier; Morales-Asencio, Jose Miguel

2014-06-01

To determine the psychometric properties and theoretical grounding of instruments that evaluate self-care behaviour or barriers in people with type 2 diabetes. There are many instruments designed to evaluate self-care behaviour or barriers in this population, but knowledge about their psychometric validation processes is lacking. Systematic review. We conducted a search for psychometric or validation studies published between January 1990-December 2012. We carried out searches in Pubmed, CINAHL, PsycINFO, ProQuolid, BibliPRO and Google SCHOLAR to identify instruments that evaluated self-care behaviours or barriers to diabetes self-care. We conducted a systematic review with the following inclusion criteria: Psychometric or clinimetric validation studies that included patients with type 2 diabetes (exclusively or partially) and which analysed self-care behaviour or barriers to self-care and proxies like self-efficacy or empowerment, from a multidimensional approach. Language: Spanish or English. Two authors independently assessed the quality of the studies and extracted data using Terwee's proposed criteria: psychometrics properties, dimensionality, theoretical ground and population used for validation through each included instrument. Sixteen instruments achieved the inclusion criteria for the review. We detected important methodological flaws in many of the selected instruments. Only the Self-management Profile for Type 2 Diabetes and Problem Areas in Diabetes Scale met half of Terwee's quality criteria. There are no instruments for identifying self-care behaviours or barriers elaborated with a strong validation process. Further research should be carried out to provide patients, clinicians and researchers with valid and reliable instruments that are methodologically solid and theoretically grounded. © 2013 John Wiley & Sons Ltd.

The German Version of the Manchester Triage System and Its Quality Criteria – First Assessment of Validity and Reliability

PubMed Central

Gräff, Ingo; Goldschmidt, Bernd; Glien, Procula; Bogdanow, Manuela; Fimmers, Rolf; Hoeft, Andreas; Kim, Se-Chan; Grigutsch, Daniel

2014-01-01

Background The German Version of the Manchester Triage System (MTS) has found widespread use in EDs across German-speaking Europe. Studies about the quality criteria validity and reliability of the MTS currently only exist for the English-language version. Most importantly, the content of the German version differs from the English version with respect to presentation diagrams and change indicators, which have a significant impact on the category assigned. This investigation offers a preliminary assessment in terms of validity and inter-rater reliability of the German MTS. Methods Construct validity of assigned MTS level was assessed based on comparisons to hospitalization (general / intensive care), mortality, ED and hospital length of stay, level of prehospital care and number of invasive diagnostics. A sample of 45,469 patients was used. Inter-rater agreement between an expert and triage nurses (reliability) was calculated separately for a subset group of 167 emergency patients. Results For general hospital admission the area under the curve (AUC) of the receiver operating characteristic was 0.749; for admission to ICU it was 0.871. An examination of MTS-level and number of deceased patients showed that the higher the priority derived from MTS, the higher the number of deaths (p<0.0001 / χ2 Test). There was a substantial difference in the 30-day survival among the 5 MTS categories (p<0.0001 / log-rank test).The AUC for the predict 30-day mortality was 0.613. Categories orange and red had the highest numbers of heart catheter and endoscopy. Category red and orange were mostly accompanied by an emergency physician, whereas categories blue and green were walk-in patients. Inter-rater agreement between expert triage nurses was almost perfect (κ = 0.954). Conclusion The German version of the MTS is a reliable and valid instrument for a first assessment of emergency patients in the emergency department. PMID:24586477

Performance of Different Diagnostic Criteria for Familial Mediterranean Fever in Children with Periodic Fevers: Results from a Multicenter International Registry.

PubMed

Demirkaya, Erkan; Saglam, Celal; Turker, Turker; Koné-Paut, Isabelle; Woo, Pat; Doglio, Matteo; Amaryan, Gayane; Frenkel, Joost; Uziel, Yosef; Insalaco, Antonella; Cantarini, Luca; Hofer, Michael; Boiu, Sorina; Duzova, Ali; Modesto, Consuelo; Bryant, Annette; Rigante, Donato; Papadopoulou-Alataki, Efimia; Guillaume-Czitrom, Severine; Kuemmerle-Deschner, Jasmine; Neven, Bénédicte; Lachmann, Helen; Martini, Alberto; Ruperto, Nicolino; Gattorno, Marco; Ozen, Seza

2016-01-01

Our aims were to validate the pediatric diagnostic criteria in a large international registry and to compare them with the performance of previous criteria for the diagnosis of familial Mediterranean fever (FMF). Pediatric patients with FMF from the Eurofever registry were used for the validation of the existing criteria. The other periodic fevers served as controls: mevalonate kinase deficiency (MKD), tumor necrosis factor receptor-associated periodic syndrome (TRAPS), cryopyrin-associated periodic syndrome (CAPS), aphthous stomatitis, pharyngitis, adenitis syndrome (PFAPA), and undefined periodic fever from the same registry. The performances of Tel Hashomer, Livneh, and the Yalcinkaya-Ozen criteria were assessed. The FMF group included 339 patients. The control group consisted of 377 patients (53 TRAPS, 45 MKD, 32 CAPS, 160 PFAPA, 87 undefined periodic fevers). Patients with FMF were correctly diagnosed using the Yalcinkaya-Ozen criteria with a sensitivity rate of 87.4% and a specificity rate of 40.7%. On the other hand, Tel Hashomer and Livneh criteria displayed a sensitivity of 45.0 and 77.3%, respectively. Both of the latter criteria displayed a better specificity than the Yalcinkaya-Ozen criteria: 97.2 and 41.1% for the Tel Hashomer and Livneh criteria, respectively. The overall accuracy for the Yalcinkaya-Ozen criteria was 65 and 69.6% (using 2 and 3 criteria), respectively. Ethnicity and residence had no effect on the performance of the Yalcinkaya-Ozen criteria. The Yalcinkaya-Ozen criteria yielded a better sensitivity than the other criteria in this international cohort of patients and thus can be used as a tool for FMF diagnosis in pediatric patients from either the European or eastern Mediterranean region. However, the specificity was lower than the previously suggested adult criteria.

Sleep disturbances as an evidence-based suicide risk factor.

PubMed

Bernert, Rebecca A; Kim, Joanne S; Iwata, Naomi G; Perlis, Michael L

2015-03-01

Increasing research indicates that sleep disturbances may confer increased risk for suicidal behaviors, including suicidal ideation, suicide attempts, and death by suicide. Despite increased investigation, a number of methodological problems present important limitations to the validity and generalizability of findings in this area, which warrant additional focus. To evaluate and delineate sleep disturbances as an evidence-based suicide risk factor, a systematic review of the extant literature was conducted with methodological considerations as a central focus. The following methodologic criteria were required for inclusion: the report (1) evaluated an index of sleep disturbance; (2) examined an outcome measure for suicidal behavior; (3) adjusted for presence of a depression diagnosis or depression severity, as a covariate; and (4) represented an original investigation as opposed to a chart review. Reports meeting inclusion criteria were further classified and reviewed according to: study design and timeframe; sample type and size; sleep disturbance, suicide risk, and depression covariate assessment measure(s); and presence of positive versus negative findings. Based on keyword search, the following search engines were used: PubMed and PsycINFO. Search criteria generated N = 82 articles representing original investigations focused on sleep disturbances and suicide outcomes. Of these, N = 18 met inclusion criteria for review based on systematic analysis. Of the reports identified, N = 18 evaluated insomnia or poor sleep quality symptoms, whereas N = 8 assessed nightmares in association with suicide risk. Despite considerable differences in study designs, samples, and assessment techniques, the comparison of such reports indicates preliminary, converging evidence for sleep disturbances as an empirical risk factor for suicidal behaviors, while highlighting important, future directions for increased investigation.

Correlation of the ionisation response at selected points of IC sensitive regions with SEE sensitivity parameters under pulsed laser irradiation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Gordienko, A V; Mavritskii, O B; Egorov, A N

2014-12-31

The statistics of the ionisation response amplitude measured at selected points and their surroundings within sensitive regions of integrated circuits (ICs) under focused femtosecond laser irradiation is obtained for samples chosen from large batches of two types of ICs. A correlation between these data and the results of full-chip scanning is found for each type. The criteria for express validation of IC single-event effect (SEE) hardness based on ionisation response measurements at selected points are discussed. (laser applications and other topics in quantum electronics)

Externalizing disorders: cluster 5 of the proposed meta-structure for DSM-V and ICD-11.

PubMed

Krueger, R F; South, S C

2009-12-01

The extant major psychiatric classifications DSM-IV and ICD-10 are purportedly atheoretical and largely descriptive. Although this achieves good reliability, the validity of a medical diagnosis is greatly enhanced by an understanding of the etiology. In an attempt to group mental disorders on the basis of etiology, five clusters have been proposed. We consider the validity of the fifth cluster, externalizing disorders, within this proposal. We reviewed the literature in relation to 11 validating criteria proposed by the Study Group of the DSM-V Task Force, in terms of the extent to which these criteria support the idea of a coherent externalizing spectrum of disorders. This cluster distinguishes itself by the central role of disinhibitory personality in mental disorders spread throughout sections of the current classifications, including substance dependence, antisocial personality disorder and conduct disorder. Shared biomarkers, co-morbidity and course offer additional evidence for a valid cluster of externalizing disorders. Externalizing disorders meet many of the salient criteria proposed by the Study Group of the DSM-V Task Force to suggest a classification cluster.

Diagnostic Criteria for Temporomandibular Disorders (DC/TMD) for Clinical and Research Applications: Recommendations of the International RDC/TMD Consortium Network* and Orofacial Pain Special Interest Group†

PubMed Central

Schiffman, Eric; Ohrbach, Richard; Truelove, Edmond; Look, John; Anderson, Gary; Goulet, Jean-Paul; List, Thomas; Svensson, Peter; Gonzalez, Yoly; Lobbezoo, Frank; Michelotti, Ambra; Brooks, Sharon L.; Ceusters, Werner; Drangsholt, Mark; Ettlin, Dominik; Gaul, Charly; Goldberg, Louis J.; Haythornthwaite, Jennifer A.; Hollender, Lars; Jensen, Rigmor; John, Mike T.; De Laat, Antoon; de Leeuw, Reny; Maixner, William; van der Meulen, Marylee; Murray, Greg M.; Nixdorf, Donald R.; Palla, Sandro; Petersson, Arne; Pionchon, Paul; Smith, Barry; Visscher, Corine M.; Zakrzewska, Joanna; Dworkin, Samuel F.

2015-01-01

Aims The original Research Diagnostic Criteria for Temporomandibular Disorders (RDC/TMD) Axis I diagnostic algorithms have been demonstrated to be reliable. However, the Validation Project determined that the RDC/TMD Axis I validity was below the target sensitivity of ≥ 0.70 and specificity of ≥ 0.95. Consequently, these empirical results supported the development of revised RDC/TMD Axis I diagnostic algorithms that were subsequently demonstrated to be valid for the most common pain-related TMD and for one temporomandibular joint (TMJ) intra-articular disorder. The original RDC/TMD Axis II instruments were shown to be both reliable and valid. Working from these findings and revisions, two international consensus workshops were convened, from which recommendations were obtained for the finalization of new Axis I diagnostic algorithms and new Axis II instruments. Methods Through a series of workshops and symposia, a panel of clinical and basic science pain experts modified the revised RDC/TMD Axis I algorithms by using comprehensive searches of published TMD diagnostic literature followed by review and consensus via a formal structured process. The panel's recommendations for further revision of the Axis I diagnostic algorithms were assessed for validity by using the Validation Project's data set, and for reliability by using newly collected data from the ongoing TMJ Impact Project—the follow-up study to the Validation Project. New Axis II instruments were identified through a comprehensive search of the literature providing valid instruments that, relative to the RDC/TMD, are shorter in length, are available in the public domain, and currently are being used in medical settings. Results The newly recommended Diagnostic Criteria for TMD (DC/TMD) Axis I protocol includes both a valid screener for detecting any pain-related TMD as well as valid diagnostic criteria for differentiating the most common pain-related TMD (sensitivity ≥ 0.86, specificity ≥ 0.98) and for one intra-articular disorder (sensitivity of 0.80 and specificity of 0.97). Diagnostic criteria for other common intra-articular disorders lack adequate validity for clinical diagnoses but can be used for screening purposes. Inter-examiner reliability for the clinical assessment associated with the validated DC/TMD criteria for pain-related TMD is excellent (kappa ≥ 0.85). Finally, a comprehensive classification system that includes both the common and less common TMD is also presented. The Axis II protocol retains selected original RDC/TMD screening instruments augmented with new instruments to assess jaw function as well as behavioral and additional psychosocial factors. The Axis II protocol is divided into screening and comprehensive self-report instrument sets. The screening instruments’ 41 questions assess pain intensity, pain-related disability, psychological distress, jaw functional limitations, and parafunctional behaviors, and a pain drawing is used to assess locations of pain. The comprehensive instruments, composed of 81 questions, assess in further detail jaw functional limitations and psychological distress as well as additional constructs of anxiety and presence of comorbid pain conditions. Conclusion The recommended evidence-based new DC/TMD protocol is appropriate for use in both clinical and research settings. More comprehensive instruments augment short and simple screening instruments for Axis I and Axis II. These validated instruments allow for identification of patients with a range of simple to complex TMD presentations. PMID:24482784

Is there any evidence for the validity of diagnostic criteria used for accommodative and nonstrabismic binocular dysfunctions?

PubMed Central

Cacho-Martínez, Pilar; García-Muñoz, Ángel; Ruiz-Cantero, María Teresa

2013-01-01

Purpose To analyze the diagnostic criteria used in the scientific literature published in the past 25 years for accommodative and nonstrabismic binocular dysfunctions and to explore if the epidemiological analysis of diagnostic validity has been used to propose which clinical criteria should be used for diagnostic purposes. Methods We carried out a systematic review of papers on accommodative and non-strabic binocular disorders published from 1986 to 2012 analysing the MEDLINE, CINAHL, PsycINFO and FRANCIS databases. We admitted original articles about diagnosis of these anomalies in any population. We identified 839 articles and 12 studies were included. The quality of included articles was assessed using the QUADAS-2 tool. Results The review shows a wide range of clinical signs and cut-off points between authors. Only 3 studies (regarding accommodative anomalies) assessed diagnostic accuracy of clinical signs. Their results suggest using the accommodative amplitude and monocular accommodative facility for diagnosing accommodative insufficiency and a high positive relative accommodation for accommodative excess. The remaining 9 articles did not analyze diagnostic accuracy, assessing a diagnosis with the criteria the authors considered. We also found differences between studies in the way of considering patients’ symptomatology. 3 studies of 12 analyzed, performed a validation of a symptom survey used for convergence insufficiency. Conclusions Scientific literature reveals differences between authors according to diagnostic criteria for accommodative and nonstrabismic binocular dysfunctions. Diagnostic accuracy studies show that there is only certain evidence for accommodative conditions. For binocular anomalies there is only evidence about a validated questionnaire for convergence insufficiency with no data of diagnostic accuracy. PMID:24646897

Analysis of 2000 cases treated with gamma knife surgery: validating eligibility criteria for a prospective multi-institutional study of stereotactic radiosurgery alone for treatment of patients with 1-10 brain metastases (JLGK0901) in Japan

PubMed Central

Higuchi, Yoshinori; Nagano, Osamu; Sato, Yasunori; Yamamoto, Masaaki; Ono, Junichi; Saeki, Naokatsu; Miyakawa, Akifumi; Hirai, Tatsuo

2012-01-01

Objective The Japan Leksell Gamma Knife (JLGK) Society has conducted a prospective multi-institute study (JLGK0901, UNIN000001812) for selected patients in order to prove the effectiveness of stereotactic radiosurgery (SRS) alone using the gamma knife (GK) for 1-10 brain lesions. Herein, we verify the validity of 5 major patient selection criteria for the JLGK0901 trial. Materials and Methods Between 1998 and 2010, 2246 consecutive cases with 10352 brain metastases treated with GK were analyzed to determine the validity of the following 5 major JLGK0901 criteria; 1) 1-10 brain lesions, 2) less than 10 cm3 volume of the largest tumor, 3) no more than 15 cm3 total tumor volume, 4) no cerebrospinal fluid (CSF) dissemination, 5) Karnofsky performance status (KPS) score ≥70. Results For cases with >10 brain metastases, salvage treatments for new lesions were needed more frequently. The tumor control rate for lesions larger than 10 cm3 was significantly lower than that of tumors <10 cm3. Overall, neurological and qualitative survivals (OS, NS, QS) of cases with >15 cm3 total tumor volume or positive magnetic resonance imaging findings of CSF were significantly poorer. Outcomes in cases with KPS <70 were significantly poorer in terms of OS. Conclusion Our retrospective results of 2246 GK-treated cases verified the validity of the 5 major JLGK0901 criteria. The inclusion criteria for the JLGK0901 study are appearently good indications for SRS. PMID:29296339

Estimated glomerular filtration rate is an early biomarker of cardiac surgery-associated acute kidney injury.

PubMed

Candela-Toha, Ángel; Pardo, María Carmen; Pérez, Teresa; Muriel, Alfonso; Zamora, Javier

2018-04-20

and objective Acute kidney injury (AKI) diagnosis is still based on serum creatinine and diuresis. However, increases in creatinine are typically delayed 48h or longer after injury. Our aim was to determine the utility of routine postoperative renal function blood tests, to predict AKI one or 2days in advance in a cohort of cardiac surgery patients. Using a prospective database, we selected a sample of patients who had undergone major cardiac surgery between January 2002 and December 2013. The ability of the parameters to predict AKI was based on Acute Kidney Injury Network serum creatinine criteria. A cohort of 3,962 cases was divided into 2groups of similar size, one being exploratory and the other a validation sample. The exploratory group was used to show primary objectives and the validation group to confirm results. The ability to predict AKI of several kidney function parameters measured in routine postoperative blood tests, was measured with time-dependent ROC curves. The primary endpoint was time from measurement to AKI diagnosis. AKI developed in 610 (30.8%) and 623 (31.4%) patients in the exploratory and validation samples, respectively. Estimated glomerular filtration rate using the MDRD-4 equation showed the best AKI prediction capacity, with values for the AUC ROC curves between 0.700 and 0.946. We obtained different cut-off values for estimated glomerular filtration rate depending on the degree of AKI severity and on the time elapsed between surgery and parameter measurement. Results were confirmed in the validation sample. Postoperative estimated glomerular filtration rate using the MDRD-4 equation showed good ability to predict AKI following cardiac surgery one or 2days in advance. Copyright © 2018 Sociedad Española de Nefrología. Published by Elsevier España, S.L.U. All rights reserved.

A Competency Model for Clinical Physicians in China: A Cross-Sectional Survey

PubMed Central

Liu, Zhuang; Tian, Lei; Chang, Qing; Sun, Baozhi; Zhao, Yuhong

2016-01-01

Background Around the world, regulatory bodies have taken the lead in determining the competencies required to become a physician. As a first step in addressing this project, it was decided to develop a set of core competencies that were unique to China and that might serve as a basis for medical education. The purpose of this paper was to construct a competency model for clinical physicians in China. Methods Data was collected using a cross-sectional survey of 6247 clinicians from seven administrative regions (31 provinces, autonomous regions and municipalities directly under the central government) in China. The total sample was randomly divided into two sub-samples, an initial sample (Sample 1) and a replication sample (Sample 2). Independent exploratory factor analysis was conducted in each sample and the results were compared to determine the stability. After that the confirmatory factor analysis was used to ascertain the competency model for physicians. The reliability, convergent and discriminant validity of competency-based instrument were also examined. Results 76 items with 8 dimensions were identified, accounting for 68.41% of the construct’s total variance in the initial sample and 67.47% in the replication sample. For the two samples, the overall scale reliability (Cronbach’s alpha) was both 0.985 with dimensions from 0.905 to 0.954 for the initial sample and from 0.902 to 0.955 for the replication sample after deleting the items. In confirmatory factor analysis, the result showed that all items had acceptable goodness of fit index. RMSEA and SRMR were less than 0.08 (RMSEA = 0.046, SRMR = 0.040), while GFI, NFI, IFI, and CFI were higher than 0.9 (GFI = 0.905, NFI = 0.903, IFI = 0.909, CFI = 0.909), leading to acceptable construct validity. All construct reliability values of the factors were higher than 0.70, and all average variance extracted values exceeded 0.50. Thus, we considered the reliability and validity of the 8 dimensions were acceptable. Conclusions The instrument was shown to be both valid and reliable for measuring clinical physicians’ competency in China. The results of the competency-based instrument can be used by ministry of health and administrators of hospitals to assess physicians’ competencies, encourage and guide them to modify their behaviors according to the evaluation criteria, and also cultivate physicians with strong clinical practice, innovation and independent scientific research ability. Through these measurements and understandings, the overall level of clinical physicians will be increased in China. PMID:27935991

The Dimensionality of DSM-IV Alcohol Use Disorders among Adolescent and Adult Drinkers and Symptom Patterns by Age, Gender, and Race/Ethnicity

PubMed Central

Harford, Thomas C.; Yi, Hsiao-ye; Faden, Vivian B.; Chen, Chiung M.

2015-01-01

Background There is limited information on the validity of Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition (DSM-IV) alcohol use disorders (AUD) symptom criteria among adolescents in the general population. The purpose of the present study is to assess the DSM-IV AUD symptom criteria as reported by adolescent and adult drinkers in a single representative sample of the U.S. population ages 12 years and older. This design avoids potential confounding due to differences in survey methodology when comparing adolescents and adults from different surveys. Methods A total of 133,231 current drinkers (had at least one drink in the past year) ages 12 years and older were drawn from respondents to the 2002–2005 National Surveys on Drug Use and Health. DSM-IV AUD criteria were assessed by questions related to specific symptoms occurring during the past 12 months. Factor analytic (FA) and item response theory (IRT) models were applied to the 11 AUD symptom criteria to assess the probabilities of symptom item endorsements across different values of the underlying trait. Results A one-factor model provided an adequate and parsimonious interpretation for the 11 AUD criteria for the total sample and for each of the gender-age groups. The MIMIC model exhibited significant indication for item bias among some criteria by gender, age, and race/ethnicity. Symptom criteria for “tolerance,” “time spent,” and “hazardous use” had lower item thresholds (i.e., lower severity) and low item discrimination, and they were well separated from the other symptoms, especially in the two younger age groups (12–17 and 18–25). “Larger amounts,” “cut down,” “withdrawal,” and “legal problems” had higher item thresholds but generally lower item discrimination, and they tend to exhibit greater dispersion at higher AUD severity, particularly in the youngest age group (12–17). Conclusions Findings from the present study do not provide support for the two separate DSM-IV diagnoses of alcohol abuse and dependence among either adolescents or adults. Variations in criteria severity for both abuse and dependence offer support for a dimensional approach to diagnosis which should be considered in the ongoing development of DSM-V. PMID:19320629

Validating a large geophysical data set: Experiences with satellite-derived cloud parameters

NASA Technical Reports Server (NTRS)

Kahn, Ralph; Haskins, Robert D.; Knighton, James E.; Pursch, Andrew; Granger-Gallegos, Stephanie

1992-01-01

We are validating the global cloud parameters derived from the satellite-borne HIRS2 and MSU atmospheric sounding instrument measurements, and are using the analysis of these data as one prototype for studying large geophysical data sets in general. The HIRS2/MSU data set contains a total of 40 physical parameters, filling 25 MB/day; raw HIRS2/MSU data are available for a period exceeding 10 years. Validation involves developing a quantitative sense for the physical meaning of the derived parameters over the range of environmental conditions sampled. This is accomplished by comparing the spatial and temporal distributions of the derived quantities with similar measurements made using other techniques, and with model results. The data handling needed for this work is possible only with the help of a suite of interactive graphical and numerical analysis tools. Level 3 (gridded) data is the common form in which large data sets of this type are distributed for scientific analysis. We find that Level 3 data is inadequate for the data comparisons required for validation. Level 2 data (individual measurements in geophysical units) is needed. A sampling problem arises when individual measurements, which are not uniformly distributed in space or time, are used for the comparisons. Standard 'interpolation' methods involve fitting the measurements for each data set to surfaces, which are then compared. We are experimenting with formal criteria for selecting geographical regions, based upon the spatial frequency and variability of measurements, that allow us to quantify the uncertainty due to sampling. As part of this project, we are also dealing with ways to keep track of constraints placed on the output by assumptions made in the computer code. The need to work with Level 2 data introduces a number of other data handling issues, such as accessing data files across machine types, meeting large data storage requirements, accessing other validated data sets, processing speed and throughput for interactive graphical work, and problems relating to graphical interfaces.

Prevalence and impact of fibromyalgia on function and quality of life in individuals from the general population: results from a nationwide study in Spain.

PubMed

Mas, A J; Carmona, L; Valverde, M; Ribas, B

2008-01-01

To estimate the prevalence of fibromyalgia (FM) and to compare some descriptive epidemiological and quality of life data between persons with and without FM criteria in a representative sample of the general Spanish population. Cross sectional study of 2,192 Spaniards aged 20 or above, selected by cluster sampling. Subjects were invited to a structured interview carried out by trained rheumatologists to ascertain various musculoskeletal disorders. The visit included screening and examination, validated instruments for measuring function (HAQ) and quality of life (SF-12) and questions about socio-demographic characteristics and musculoskeletal, mental, and other general symptoms. FM was suspected in subjects with widespread pain for more than three months. FM was defined by theAmerican College of Rheumatology classification criteria. All estimates are adjusted to sampling scheme. The prevalence of FM in Spain is 2.4% (95% CI: 1.5-3.2). FM is significantly more frequent in women (4.2%) than in men (0.2%), with an OR for women of 22.5 (95%CI: 7.2- 69.9), mainly in the 40-49 years age interval. It is more frequent in rural (4.1%) than in urban settings (1.7%), with an OR for rural settings of 2.5 (95%CI: 1.03-5.9). FM is associated with a low educational level, to a low social class, and to self-reported depression. The scores in the HAQ and in the SF-12 were significantly lower in FM subjects, despite adjustment by covariates. FM has a high prevalence in the general population. FM is associated to female gender, comorbidities, age between 40 and 59 years, and a rural setting. Persons fulfilling FM criteria show impaired functioning and quality of life.

Determination of Dornic Acidity as a Method to Select Donor Milk in a Milk Bank

PubMed Central

Garcia-Lara, Nadia Raquel; Escuder-Vieco, Diana; Chaves-Sánchez, Fernando; De la Cruz-Bertolo, Javier; Pallas-Alonso, Carmen Rosa

2013-01-01

Abstract Background Dornic acidity may be an indirect measurement of milk's bacteria content and its quality. There are no uniform criteria among different human milk banks on milk acceptance criteria. The main aim of this study is to report the correlation between Dornic acidity and bacterial growth in donor milk in order to validate the Dornic acidity value as an adequate method to select milk prior to its pasteurization. Materials and Methods From 105 pools, 4-mL samples of human milk were collected. Dornic acidity measurement and culture in blood and McConkey's agar cultures were performed. Based on Dornic acidity degrees, we classified milk into three quality categories: top quality (acidity <4°D), intermediate (acidity between 4°D and 7°D), and milk unsuitable to be consumed (acidity ≥8°D). Spearman's correlation coefficient was used to perform statistical analysis. Results Seventy percent of the samples had Dornic acidity under 4°D, and 88% had a value under 8°D. A weak positive correlation was observed between the bacterial growth in milk and Dornic acidity. The overall discrimination performance of Dornic acidity was higher for predicting growth of Gram-negative organisms. In milk with Dornic acidity of ≥4°D, such a measurement has a sensitivity of 100% for detecting all the samples with bacterial growth with Gram-negative bacteria of over 105 colony-forming units/mL. Conclusions The correlation between Dornic acidity and bacterial growth in donor milk is weak but positive. The measurement of Dornic acidity could be considered as a simple and economical method to select milk to pasteurize in a human milk bank based in quality and safety criteria. PMID:23373435

Determination of Dornic acidity as a method to select donor milk in a milk bank.

PubMed

Vázquez-Román, Sara; Garcia-Lara, Nadia Raquel; Escuder-Vieco, Diana; Chaves-Sánchez, Fernando; De la Cruz-Bertolo, Javier; Pallas-Alonso, Carmen Rosa

2013-02-01

Dornic acidity may be an indirect measurement of milk's bacteria content and its quality. There are no uniform criteria among different human milk banks on milk acceptance criteria. The main aim of this study is to report the correlation between Dornic acidity and bacterial growth in donor milk in order to validate the Dornic acidity value as an adequate method to select milk prior to its pasteurization. From 105 pools, 4-mL samples of human milk were collected. Dornic acidity measurement and culture in blood and McConkey's agar cultures were performed. Based on Dornic acidity degrees, we classified milk into three quality categories: top quality (acidity <4°D), intermediate (acidity between 4°D and 7°D), and milk unsuitable to be consumed (acidity ≥ 8°D). Spearman's correlation coefficient was used to perform statistical analysis. Seventy percent of the samples had Dornic acidity under 4°D, and 88% had a value under 8°D. A weak positive correlation was observed between the bacterial growth in milk and Dornic acidity. The overall discrimination performance of Dornic acidity was higher for predicting growth of Gram-negative organisms. In milk with Dornic acidity of ≥ 4°D, such a measurement has a sensitivity of 100% for detecting all the samples with bacterial growth with Gram-negative bacteria of over 10(5) colony-forming units/mL. The correlation between Dornic acidity and bacterial growth in donor milk is weak but positive. The measurement of Dornic acidity could be considered as a simple and economical method to select milk to pasteurize in a human milk bank based in quality and safety criteria.

Current Issues in the Diagnosis of Attention Deficit Hyperactivity Disorder, Oppositional Defiant Disorder, and Conduct Disorder

PubMed Central

Frick, Paul J.; Nigg, Joel T.

2015-01-01

This review evaluates the diagnostic criteria for three of the most common disorders for which children and adolescents are referred for mental health treatment: attention deficit hyperactivity disorder (ADHD), oppositional defiant disorder (ODD), and conduct disorder (CD). Although research supports the validity and clinical utility of these disorders, several issues are highlighted that could enhance the current diagnostic criteria. For ADHD, defining the core features of the disorder and its fit with other disorders, enhancing the validity of the criteria through the lifespan, considering alternative ways to form subtypes of the disorder, and modifying the age-of-onset criterion are discussed relative to the current diagnostic criteria. For ODD, eliminating the exclusionary criteria of CD, recognizing important symptom domains within the disorder, and using the cross-situational pervasiveness of the disorder as an index of severity are highlighted as important issues for improving classification. Finally, for CD, enhancing the current subtypes related to age of onset and integrating callous-unemotional traits into the diagnostic criteria are identified as key issues for improving classification. PMID:22035245

Presenting an Evaluation Model for the Cancer Registry Software.

PubMed

Moghaddasi, Hamid; Asadi, Farkhondeh; Rabiei, Reza; Rahimi, Farough; Shahbodaghi, Reihaneh

2017-12-01

As cancer is increasingly growing, cancer registry is of great importance as the main core of cancer control programs, and many different software has been designed for this purpose. Therefore, establishing a comprehensive evaluation model is essential to evaluate and compare a wide range of such software. In this study, the criteria of the cancer registry software have been determined by studying the documents and two functional software of this field. The evaluation tool was a checklist and in order to validate the model, this checklist was presented to experts in the form of a questionnaire. To analyze the results of validation, an agreed coefficient of %75 was determined in order to apply changes. Finally, when the model was approved, the final version of the evaluation model for the cancer registry software was presented. The evaluation model of this study contains tool and method of evaluation. The evaluation tool is a checklist including the general and specific criteria of the cancer registry software along with their sub-criteria. The evaluation method of this study was chosen as a criteria-based evaluation method based on the findings. The model of this study encompasses various dimensions of cancer registry software and a proper method for evaluating it. The strong point of this evaluation model is the separation between general criteria and the specific ones, while trying to fulfill the comprehensiveness of the criteria. Since this model has been validated, it can be used as a standard to evaluate the cancer registry software.

Validity of the diagnosis of pre-eclampsia in the Medical Birth Registry of Norway.

PubMed

Thomsen, Liv C V; Klungsøyr, Kari; Roten, Linda T; Tappert, Christian; Araya, Elisabeth; Baerheim, Gunhild; Tollaksen, Kjersti; Fenstad, Mona H; Macsali, Ferenc; Austgulen, Rigmor; Bjørge, Line

2013-08-01

Evaluating the validity of pre-eclampsia registration in the Medical Birth Registry of Norway (MBRN) according to both broader and restricted disease definitions. Retrospective nested cohort study. Multicenter study. In this study, two cohorts of women with pre-eclamptic pregnancies registered in the MBRN were selected. Study group 1 contained 966 pregnancies from 1967 to 2002. Concomitant participation in the Nord-Trøndelag Health Study 2 was required. Study group 2 comprised 1138 pregnancies recorded in 1967-2005, examined as a pre-eclampsia biobank was established. Diagnostic criteria vary. The broader criteria for pre-eclampsia, used by the MBRN, are one measurement of hypertension and proteinuria (Criterion A). Criteria used internationally today require two measurements of hypertension and proteinuria (Criterion B). The diagnostic validities in Study groups 1 and 2 were judged against medical records according to Criterion A and B, respectively. Positive predictive value (PPV) and trend analyses. The diagnosis was confirmed in 88.3% of pregnancies in Study group 1, and in 63.6% in Study group 2. PPV was high for Study group 1 throughout the period. For Study group 2, results improved significantly after 1986. This study ascertains high PPV of pre-eclampsia in the MBRN using broader traditional criteria, although the PPV decreases through assessment using restricted modern criteria. This illustrates how inclusion of direct measurements may improve registration of complex disorders defined by changing diagnostic criteria. © 2013 Nordic Federation of Societies of Obstetrics and Gynecology.

Assessment of shrimp farming impact on groundwater quality using analytical hierarchy process

NASA Astrophysics Data System (ADS)

Anggie, Bernadietta; Subiyanto, Arief, Ulfah Mediaty; Djuniadi

2018-03-01

Improved shrimp farming affects the groundwater quality conditions. Assessment of shrimp farming impact on groundwater quality conventionally has less accuracy. This paper presents the implementation of Analytical Hierarchy Process (AHP) method for assessing shrimp farming impact on groundwater quality. The data used is the impact data of shrimp farming in one of the regions in Indonesia from 2006-2016. Criteria used in this study were 8 criteria and divided into 49 sub-criteria. The weighting by AHP performed to determine the importance level of criteria and sub-criteria. Final priority class of shrimp farming impact were obtained from the calculation of criteria's and sub-criteria's weights. The validation was done by comparing priority class of shrimp farming impact and water quality conditions. The result show that 50% of the total area was moderate priority class, 37% was low priority class and 13% was high priority class. From the validation result impact assessment for shrimp farming has been high accuracy to the groundwater quality conditions. This study shows that assessment based on AHP has a higher accuracy to shrimp farming impact and can be used as the basic fisheries planning to deal with impacts that have been generated.

Teaching learning methods of an entrepreneurship curriculum

PubMed Central

ESMI, KERAMAT; MARZOUGHI, RAHMATALLAH; TORKZADEH, JAFAR

2015-01-01

Introduction One of the most significant elements of entrepreneurship curriculum design is teaching-learning methods, which plays a key role in studies and researches related to such a curriculum. It is the teaching method, and systematic, organized and logical ways of providing lessons that should be consistent with entrepreneurship goals and contents, and should also be developed according to the learners’ needs. Therefore, the current study aimed to introduce appropriate, modern, and effective methods of teaching entrepreneurship and their validation Methods This is a mixed method research of a sequential exploratory kind conducted through two stages: a) developing teaching methods of entrepreneurship curriculum, and b) validating developed framework. Data were collected through “triangulation” (study of documents, investigating theoretical basics and the literature, and semi-structured interviews with key experts). Since the literature on this topic is very rich, and views of the key experts are vast, directed and summative content analysis was used. In the second stage, qualitative credibility of research findings was obtained using qualitative validation criteria (credibility, confirmability, and transferability), and applying various techniques. Moreover, in order to make sure that the qualitative part is reliable, reliability test was used. Moreover, quantitative validation of the developed framework was conducted utilizing exploratory and confirmatory factor analysis methods and Cronbach’s alpha. The data were gathered through distributing a three-aspect questionnaire (direct presentation teaching methods, interactive, and practical-operational aspects) with 29 items among 90 curriculum scholars. Target population was selected by means of purposive sampling and representative sample. Results Results obtained from exploratory factor analysis showed that a three factor structure is an appropriate method for describing elements of teaching-learning methods of entrepreneurship curriculum. Moreover, the value for Kaiser Meyer Olkin measure of sampling adequacy equaled 0.72 and the value for Bartlett’s test of variances homogeneity was significant at the 0.0001 level. Except for internship element, the rest had a factor load of higher than 0.3. Also, the results of confirmatory factor analysis showed the model appropriateness, and the criteria for qualitative accreditation were acceptable. Conclusion Developed model can help instructors in selecting an appropriate method of entrepreneurship teaching, and it can also make sure that the teaching is on the right path. Moreover, the model is comprehensive and includes all the effective teaching methods in entrepreneurship education. It is also based on qualities, conditions, and requirements of Higher Education Institutions in Iranian cultural environment. PMID:26457314

Approximating a DSM-5 Diagnosis of PTSD Using DSM-IV Criteria

PubMed Central

Rosellini, Anthony J.; Stein, Murray B.; Colpe, Lisa J.; Heeringa, Steven G.; Petukhova, Maria V.; Sampson, Nancy A.; Schoenbaum, Michael; Ursano, Robert J.; Kessler, Ronald C.

2015-01-01

Background Diagnostic criteria for DSM-5 posttraumatic stress disorder (PTSD) are in many ways similar to DSM-IV criteria, raising the possibility that it might be possible to closely approximate DSM-5 diagnoses using DSM-IV symptoms. If so, the resulting transformation rules could be used to pool research data based on the two criteria sets. Methods The Pre-Post Deployment Study (PPDS) of the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS) administered a blended 30-day DSM-IV and DSM-5 PTSD symptom assessment based on the civilian PTSD Checklist for DSM-IV (PCL-C) and the PTSD Checklist for DSM-5 (PCL-5). This assessment was completed by 9,193 soldiers from three US Army Brigade Combat Teams approximately three months after returning from Afghanistan. PCL-C items were used to operationalize conservative and broad approximations of DSM-5 PTSD diagnoses. The operating characteristics of these approximations were examined compared to diagnoses based on actual DSM-5 criteria. Results The estimated 30-day prevalence of DSM-5 PTSD based on conservative (4.3%) and broad (4.7%) approximations of DSM-5 criteria using DSM-IV symptom assessments were similar to estimates based on actual DSM-5 criteria (4.6%). Both approximations had excellent sensitivity (92.6-95.5%), specificity (99.6-99.9%), total classification accuracy (99.4-99.6%), and area under the receiver operating characteristic curve (0.96-0.98). Conclusions DSM-IV symptoms can be used to approximate DSM-5 diagnoses of PTSD among recently-deployed soldiers, making it possible to recode symptom-level data from earlier DSM-IV studies to draw inferences about DSM-5 PTSD. However, replication is needed in broader trauma-exposed samples to evaluate the external validity of this finding. PMID:25845710

Ethical Implications of Validity-vs.-Reliability Trade-Offs in Educational Research

ERIC Educational Resources Information Center

Fendler, Lynn

2016-01-01

In educational research that calls itself empirical, the relationship between validity and reliability is that of trade-off: the stronger the bases for validity, the weaker the bases for reliability (and vice versa). Validity and reliability are widely regarded as basic criteria for evaluating research; however, there are ethical implications of…

Evaluation and optimization of the extended information process unit (E-IPU) validation module integrating the sysmex flag systems and the recommendations of the French-speaking cellular hematology group (GFHC).

PubMed

Cornet, Edouard; Mullier, François; Despas, Noemie; Jacqmin, Hugues; Geara, Carole; Boubaya, Marouane; Chatelain, Bernard; Troussard, Xavier

2016-10-01

The French-Speaking Cellular Haematology Group (GFHC) recently published criteria for microscopic analysis of a blood smears when a hemogram is requested. In order to evaluate and improve these recommendations using an XN (Sysmex) analyzer, we assessed 31,836 samples categorized into two sub-groups of patients either receiving or not receiving care in the clinical hematology/oncology departments of two university hospitals. By combining the manufacturer's recommendations and the GFHC recommendations, 21.3% of samples had a positive review flag in phase 1 of our study (17,991 samples). In phase 2 (13,845 samples), increasing the immature granulocytes (IG) percentage from 5-10% as a review trigger threshold, and ignoring slides with isolated flags 'PLT HIGH' (thrombocytosis) or 'MCV LOW' (microcytosis) or 'Blast/Abn Lymph and Atypical Lymph' (blast cells/abnormal lymphocytes and atypical lymphocytes) (in the absence of abnormal cells on a previous blood smear within 72 h), enabled us to significantly reduce the number of slides reviewed from 21.3-15.0% (p < 0.0001), without loss of clinical value. This decrease occurred in both sub-groups (hematology 48.7-38.0%, non-hematology 18.3-11.7%, p < 0.0001). In conclusion, the application of the GFHC criteria adapted to XN analyzers has enabled us to optimize the hematology laboratory processes, and thus reduce the production costs and the turnaround time of hemogram results.

Muscle dysmorphia: a South African sample.

PubMed

Hitzeroth, V; Wessels, C; Zungu-Dirwayi, N; Oosthuizen, P; Stein, D J

2001-10-01

It has recently been suggested that muscle dysmorphia, a pathological preoccupation with muscularity, is a subtype of body dysmorphic disorder (BDD). There are, however, few studies of the phenomenology of this putative entity. Twenty-eight amateur competitive body builders in the Western Cape, South Africa, were studied using a structured diagnostic interview that incorporated demographic data, body-building activities and clinical questions focusing on muscle dysmorphia and BDD. There was a high rate of muscle dysmorphia in the sample (53.6%). Those with muscle dysmorphia were significantly more likely to have comorbid BDD based on preoccupations other than muscularity (33%). Use of the proposed diagnostic criteria for muscle dysmorphia indicated that this is a common and relevant entity. Its conceptualization as a subtype of BDD seems valid. The disorder deserves additional attention from both clinicians and researchers.

[Autism Spectrum Disorder in DSM-5 - concept, validity, and reliability, impact on clinical care and future research].

PubMed

Freitag, Christine M

2014-05-01

Autism Spectrum Disorder (ASD) in DSM-5 comprises the former DSM-IV-TR diagnoses of Autistic Disorder, Asperger's Disorder and PDD-nos. The criteria for ASD in DSM-5 were considerably revised from those of ICD-10 and DSM-IV-TR. The present article compares the diagnostic criteria, presents studies on the validity and reliability of ASD, and discusses open questions. It ends with a clinical and research perspective.

Senior Friendly Hospitals: Development and Application of Criteria: A Descriptive Study.

PubMed

Rashmi, M R; Kasthuri, Arvind; Rodrigues, Rashmi J

2016-01-01

The world's population is rapidly aging. Between 2000 and 2050, the proportion of the world's population over the age of 60 will double from about 11% to 22%; more so in the developing countries. The prevalence of frailty and morbidity among the elderly is high. There is a need to assess the "preparedness" of the health care system including hospitals to respond to the needs of the elderly. 1. To develop criteria for a senior friendly hospital and 2. To assess the feasibility of application of these criteria. A descriptive study was done at Bangalore, India, involving 100 subjects sampled by purposive sampling. Study population consisted of senior citizens, their caretakers, physicians, hospital support staff, nurses, geriatricians, hospital administrators, and architects. They were interviewed using a validated translated interview schedule. The study consisted of two phases; Phase 1: Developing a checklist to assess senior friendliness of a hospital by using modified Delphi technique. Phase 2: Application of the checklist thus developed to selected hospitals in order to assess the feasibility of administration. The data was then analyzed using Statistical Package for the Social Sciences (SPSS) for frequencies, proportions, central tendency and dispersion, interclass reliability, intraclass reliability, and Cronbach's alpha. A checklist containing 44 items to assess the senior friendliness of a hospital was developed. The checklist was found feasible and easy to administer. The checklist thus developed to assess senior friendliness of a hospital has wider application as it has a potential to be considered for framing senior friendly hospital guidelines/policies.

External Validation of Early Weight Loss Nomograms for Exclusively Breastfed Newborns.

PubMed

Schaefer, Eric W; Flaherman, Valerie J; Kuzniewicz, Michael W; Li, Sherian X; Walsh, Eileen M; Paul, Ian M

2015-12-01

Nomograms that show hour-by-hour percentiles of weight loss during the birth hospitalization were recently developed to aid clinical care of breastfeeding newborns. The nomograms for breastfed neonates were based on a sample of 108,907 newborns delivered at 14 Kaiser Permanente medical centers in Northern California (United States). The objective of this study was to externally validate the published nomograms for newborn weight loss using data from a geographically distinct population. Data were compiled from the Penn State Milton S. Hershey Medical Center located in Hershey, PA. For singleton neonates delivered at ≥36 weeks of gestation between January 2013 and September 2014, weights were obtained between 6 hours and 48 hours (vaginal delivery) or 60 hours (cesarean delivery) for neonates who were exclusively breastfeeding. Quantile regression methods appropriate for repeated measures were used to estimate 50th, 75th, 90th, and 95th percentiles of weight loss as a function of time after birth. These percentile estimates were compared with the published nomograms. Of the 1,587 newborns who met inclusion criteria, 1,148 were delivered vaginally, and 439 were delivered via cesarean section. These newborns contributed 1,815 weights for vaginal deliveries (1.6 per newborn) and 893 weights for cesarean deliveries (2.0 per newborn). Percentile estimates from this Penn State sample were similar to the published nomograms. Deviations in percentile estimates for the Penn State sample were similar to deviations observed after fitting the same model separately to each medical center that made up the Kaiser Permanente sample. The published newborn weight loss nomograms for breastfed neonates were externally validated in a geographically distinct population.

How to Use the ADI-R for Classifying Autism Spectrum Disorders? Psychometric Properties of Criteria from the Literature in 1,204 Dutch Children

ERIC Educational Resources Information Center

de Bildt, Annelies; Oosterling, Iris J.; van Lang, Natasja D. J.; Kuijper, Sanne; Dekker, Vera; Sytema, Sjoerd; Oerlemans, Anoek M.; van Steijn, Daphne J.; Visser, Janne C.; Rommelse, Nanda N.; Minderaa, Ruud B.; van Engeland, Herman; van der Gaag, Rutger-Jan; Buitelaar, Jan K.; de Jonge, Maretha V.

2013-01-01

The algorithm of the Autism Diagnostic Interview-Revised provides criteria for autism versus non-autism according to DSM-IV. Criteria for the broader autism spectrum disorders are needed. This study investigated the validity of seven sets of criteria from the literature, in 1,204 Dutch children (aged 3-18 years) with and without mental…

Preliminary bioelectrical impedance analysis (BIA) equation for body composition assessment in young females from Colombia

NASA Astrophysics Data System (ADS)

Caicedo-Eraso, J. C.; González-Correa, C. H.; González-Correa, C. A.

2013-04-01

A previous study showed that reported BIA equations for body composition are not suitable for Colombian population. The purpose of this study was to develop and validate a preliminary BIA equation for body composition assessment in young females from Colombia, using hydrodensitometry as reference method. A sample of 30 young females was evaluated. Inclusion and exclusion criteria were defined to minimize the variability of BIA. Height, weight, BIA, residual lung volume (RV) and underwater weight (UWW) were measured. A preliminary BIA equation was developed (r2 = 0.72, SEE = 2.48 kg) by stepwise multiple regression with fat-free mass (FFM) as dependent variable and weight, height and impedance measurements as independent variables. The quality of regression was evaluated and a cross-validation against 50% of sample confirmed that results obtained with the preliminary BIA equation is interchangeable with results obtained with hydrodensitometry (r2 = 0.84, SEE = 2.62 kg). The preliminary BIA equation can be used for body composition assessment in young females from Colombia until a definitive equation is developed. The next step will be increasing the sample, including a second reference method, as deuterium oxide dilution (D2O), and using multi-frequency BIA (MF-BIA). It would also be desirable to develop equations for males and other ethnic groups in Colombia.

A combined model based on spleen stiffness measurement and Baveno VI criteria to rule out high-risk varices in advanced chronic liver disease.

PubMed

Colecchia, Antonio; Ravaioli, Federico; Marasco, Giovanni; Colli, Agostino; Dajti, Elton; Di Biase, Anna Rita; Bacchi Reggiani, Maria Letizia; Berzigotti, Annalisa; Pinzani, Massimo; Festi, Davide

2018-05-03

Recently, Baveno VI guidelines suggested that esophagogastroduodenoscopy (EGD) can be avoided in patients with compensated advanced chronic liver disease (cACLD) who have a liver stiffness measurement (LSM) <20 kPa and platelet count >150,000/mm 3 . We aimed to: assess the performance of spleen stiffness measurement (SSM) in ruling out patients with high-risk varices (HRV); validate Baveno VI criteria in a large population and assess how the sequential use of Baveno VI criteria and SSM could safely avoid the need for endoscopy. We retrospectively analyzed 498 patients with cACLD who had undergone LSM/SSM by transient elastography (TE) (FibroScan®), platelet count and EGDs from 2012 to 2016 referred to our tertiary centre. The new combined model was validated internally by a split-validation method, and externally in a prospective multicentre cohort of 115 patients. SSM, LSM, platelet count and Child-Pugh-B were independent predictors of HRV. Applying the newly identified SSM cut-off (≤46 kPa) or Baveno VI criteria, 35.8% and 21.7% of patients in the internal validation cohort could have avoided EGD, with only 2% of HRVs being missed with either model. The combination of SSM with Baveno VI criteria would have avoided an additional 22.5% of EGDs, reaching a final value of 43.8% spared EGDs, with <5% missed HRVs. Results were confirmed in the prospective external validation cohort, as the combined Baveno VI/SSM ≤46 model would have safely spared (0 HRV missed) 37.4% of EGDs, compared to 16.5% when using the Baveno VI criteria alone. A non-invasive prediction model combining SSM with Baveno VI criteria may be useful to rule out HRV and could make it possible to avoid a significantly larger number of unnecessary EGDs compared to Baveno VI criteria only. Spleen stiffness measurement assessed by transient elastography, the most widely used elastography technique, is a non-invasive technique that can help the physician to better stratify the degree of portal hypertension and the risk of esophageal varices in patients with compensated advanced chronic liver disease. Performing spleen stiffness measurement together with liver stiffness measurement during the same examination is simple and fast and this sequential model can identify a greater number of patients that can safely avoid endoscopy, which is an invasive and expensive examination. Crown Copyright © 2018. Published by Elsevier B.V. All rights reserved.

Development and validation of a simple and robust method for arsenic speciation in human urine using HPLC/ICP-MS.

PubMed

Sen, Indranil; Zou, Wei; Alvaran, Josephine; Nguyen, Linda; Gajek, Ryszard; She, Jianwen

2015-01-01

In order to better distinguish the different toxic inorganic and organic forms of arsenic (As) exposure in individuals, we have developed and validated a simple and robust analytical method for determining the following six As species in human urine: arsenous (III) acid (As-III), As (V) acid, monomethylarsonic acid, dimethylarsinic acid, arsenobetaine (AsB), and arsenocholine. In this method, human urine is diluted using a pH 5.8 buffer, separation is performed using an anion exchange column with isocratic HPLC, and detection is achieved using inductively coupled plasma-MS. The method uses a single mobile phase consisting of low concentrations of both phosphate buffer (5 mM) and ammonium nitrate salt (5 mM) at pH 9.0; this minimizes the column equilibration time and overcomes challenges with separation between AsB and As-III. In addition, As-III oxidation is prevented by degassing the sample preparation buffer at pH 5.8, degassing the mobile phase online at pH 9.0, and by the use of low temperature (-70 °C) and flip-cap airtight tubes for long term storage of samples. The method was validated using externally provided reference samples. Results were in agreement with target values at varying concentrations and successfully passed external performance test criteria. Internal QC samples were prepared and repeatedly analyzed to assess the method's long-term precision, and further analyses were completed on anonymous donor urine to assess the quality of the method's baseline separation. Results from analyses of external reference samples agreed with target values at varying concentrations, and results from precision studies yielded absolute CV values of 3-14% and recovery from 82 to 115% for the six As species. Analysis of anonymous donor urine confirmed the well-resolved baseline separation capabilities of the method for real participant samples.

Cream of the Crop: Clinical Representativeness of Eligible and Ineligible Cannabis Users in Research.

PubMed

Rosen, Alexis S; Sodos, Louise M; Hirst, Rayna B; Vaughn, Dylan; Lorkiewicz, Sara A

2018-03-06

Experts have recommended criteria (Gonzalez et al., 2002) for recruiting pure chronic cannabis users (i.e., those without polysubstance use or psychiatric illness) when evaluating cannabis' non-acute effects on cognition. We sought to demonstrate the implications of using such criteria by examining characteristics of respondents who completed an eligibility screening for a parent study evaluating the cognitive effects of chronic cannabis use. Over a 3-year, 8-month period, 612 respondents from the community completed an eligibility screening based on recommendations in the cannabis literature. Using independent samples t-tests and chi-square tests, we examined whether qualified/eligible respondents (n = 219) differed from non-qualified/ineligible respondents (n = 393). Compared to ineligible cannabis users, eligible cannabis-using respondents were significantly younger, used cannabis more frequently, used alcohol less frequently, and were less likely to have a history of other drug use, a psychiatric diagnosis, or to have used psychiatric medication. Conclusions/Importance: Our findings indicate that eligible/pure cannabis users are not representative of typical cannabis users in the general community (i.e., ineligible users with polysubstance use and/or psychiatric diagnoses) who ultimately comprised the majority of our cannabis-using sample (65.2%). Thus, typical cannabis users may be more accurately characterized as polysubstance users, posing a number of challenges related to the generalizability of findings from studies utilizing pure samples of cannabis users. Recruiting samples of typical cannabis users will improve external validity in research. Furthermore, reporting comprehensive characteristics of such samples will enable consumers to gauge the applicability of study findings to populations of interest.

Lack of reliability of nanotechnology in the of free plasma DNA in samples of patients with prostate cancer

PubMed Central

2013-01-01

Background Several studies seek biological markers that give diagnostic and degree of tumor development. The aim of this study was to validate the determination of plasma DNA using nanotechnology (Nanovue™-NV) in samples of 80 patients with prostate cancer. Methods Blood samples of 80 patients of the Urology Ambulatory of Faculdade de Medicina do ABC with prostate cancer confirmed by anatomical-pathology criteria were analyzed. DNA extraction was performed using a GFX TM kit (Amersham Pharmacia Biotech, Inc, USA) following the adapted protocol. Plasma was subjected to centrifugation. Results There was a big difference between the first and the second value obtained by NanoVue Only two samples had no differences between duplicates. Maximum difference between duplicates was 38 μg/mL. Average variation between 51 samples was 10.29 μg/mL, although 21 samples had differences above this average. No correlation was observed between pDNA obtained by traditional spectrophotometry and by nanotechnology. Conclusion Determination of plasma DNA by nanotechnology was not reproducible. PMID:23311763

Prevalence and correlates of psychopathology in children and adolescents evaluated with the strengths and difficulties questionnaire dysregulation profile in a clinical setting.

PubMed

Carballo, Juan José; Serrano-Drozdowskyj, Elena; García Nieto, Rebeca; Díaz de Neira-Hernando, Mónica; Pérez-Fominaya, Margarita; Molina-Pizarro, Cristian Antonio; De León-Martínez, Victoria; Baca-García, Enrique

2014-01-01

The clinical presentation of children and adolescents referred to mental health services is frequently complicated by comorbid and severe affective and behavioral dysregulation. This dysregulation phenotype seems to be an indicator of overall psychopathology, symptom severity and functional impairment. Currently, this phenotype is assessed by the Child Behavior Checklist. However, the widely used Strengths and Difficulties Questionnaire (SDQ) has been recently validated to screen the Dysregulation Profile (SDQ-DP) in clinical settings. The objective of this study was to determine the prevalence and demographic, psychosocial and clinical correlates of the SDQ-DP phenotype in a Spanish clinical sample. In a clinical sample of 623 consecutively referred children and adolescents (4-17 years old), we compared clinical and sociodemographic correlates between subjects who met the SDQ-DP criteria (DP) and those who did not (NO_DP). Sociodemographic data, parent-rated SDQ, Children's Global Assessment Scale, Clinical Global Impression, family Apgar scale and clinical diagnoses were collected by experienced child and adolescent psychiatrists. Overall in our sample, 175 subjects (28.1%) met the SDQ-DP criteria (DP group). Compared with the NO_DP group, the DP subjects had significantly higher scores on internalizing and externalizing psychopathology, problems with peers and overall problems as well as significantly lower scores on prosocial behavior. Clinical diagnoses assigned revealed that DP subjects showed significantly greater psychiatric comorbidity. DP subjects also showed significantly worse family functioning and increased symptom severity and significantly lower scores on psychosocial functioning. A high prevalence of children and adolescents with the dysregulated profile, assessed by the SDQ-DP, was found in our clinical setting. The SDQ-DP may serve as an index of overall psychological severity and functional impairment. In addition, it may indicate family dysfunction. Further research is needed to validate the clinical value of SDQ-DP by examining longitudinal stability, heritability, adult outcome, risk factors and diagnostic correlates. © 2014 S. Karger AG, Basel.

Validation of the chronic respiratory questionnaire in the Colombian population with chronic obstructive pulmonary disease.

PubMed

Estrada Álvarez, Jorge M; Ossa García, Ximena; del Quijano del Gordo, Carmen I; Bustos, Luis; Urina, Diana P; Pérez, Celso F; Ossa, John E; Moreno Rojas, Edwin

2015-08-01

To assess the validity and reliability of the chronic respiratory questionnaire (CRQ) in the measurement of HRQL in the Colombian population with COPD. A cross-sectional study was conducted with a sample of 200 patients diagnosed with COPD according to GOLD criteria. Convergence validity was evaluated by correlating the questionnaire results with other clinical variables such as exercise tolerance, forced expiratory volume at the first second (FEV1), and depression levels. HRQL measured through the CRQ correlated significantly with the 6-min walk test (r = 0.34), just as the dimensions fatigue (r = 0.37) and dyspnoea correlated with the FEV1 test (r = 0.21) and the dimensions emotional function and disease management with depression levels (r = -0.79). The Generalized Structured Component Analysis (GSCA) with the prespecified model is showed, and the total variance explained by the items in the model was 61.5 % (FIT = 0.615), unweighted least squares (GFI = 0.998), and standardised root mean square (SRMR = 0.084), indicating that the model fits adequately. The CRQ presents evidence of adequate validity and reliability in the Colombian population. Its use is recommended to measure HRQL in patients with COPD, although future validations will be needed to identify the property of sensitivity to change.

Analysis of Phosphonic Acids: Validation of Semi-Volatile Analysis by HPLC-MS/MS by EPA Method MS999

DOE Office of Scientific and Technical Information (OSTI.GOV)

Owens, J; Vu, A; Koester, C

The Environmental Protection Agency's (EPA) Region 5 Chicago Regional Laboratory (CRL) developed a method titled Analysis of Diisopropyl Methylphosphonate, Ethyl Hydrogen Dimethylamidophosphate, Isopropyl Methylphosphonic Acid, Methylphosphonic Acid, and Pinacolyl Methylphosphonic Acid in Water by Multiple Reaction Monitoring Liquid Chromatography/Tandem Mass Spectrometry: EPA Version MS999. This draft standard operating procedure (SOP) was distributed to multiple EPA laboratories and to Lawrence Livermore National Laboratory, which was tasked to serve as a reference laboratory for EPA's Environmental Reference Laboratory Network (ERLN) and to develop and validate analytical procedures. The primary objective of this study was to validate and verify the analytical procedures describedmore » in EPA Method MS999 for analysis of the listed phosphonic acids and surrogates in aqueous samples. The gathered data from this validation study will be used to: (1) demonstrate analytical method performance; (2) generate quality control acceptance criteria; and (3) revise the SOP to provide a validated method that would be available for use during a homeland security event. The data contained in this report will be compiled, by EPA CRL, with data generated by other EPA Regional laboratories so that performance metrics of EPA Method MS999 can be determined.« less

Subarachnoid hemorrhage admissions retrospectively identified using a prediction model

PubMed Central

McIntyre, Lauralyn; Fergusson, Dean; Turgeon, Alexis; dos Santos, Marlise P.; Lum, Cheemun; Chassé, Michaël; Sinclair, John; Forster, Alan; van Walraven, Carl

2016-01-01

Objective: To create an accurate prediction model using variables collected in widely available health administrative data records to identify hospitalizations for primary subarachnoid hemorrhage (SAH). Methods: A previously established complete cohort of consecutive primary SAH patients was combined with a random sample of control hospitalizations. Chi-square recursive partitioning was used to derive and internally validate a model to predict the probability that a patient had primary SAH (due to aneurysm or arteriovenous malformation) using health administrative data. Results: A total of 10,322 hospitalizations with 631 having primary SAH (6.1%) were included in the study (5,122 derivation, 5,200 validation). In the validation patients, our recursive partitioning algorithm had a sensitivity of 96.5% (95% confidence interval [CI] 93.9–98.0), a specificity of 99.8% (95% CI 99.6–99.9), and a positive likelihood ratio of 483 (95% CI 254–879). In this population, patients meeting criteria for the algorithm had a probability of 45% of truly having primary SAH. Conclusions: Routinely collected health administrative data can be used to accurately identify hospitalized patients with a high probability of having a primary SAH. This algorithm may allow, upon validation, an easy and accurate method to create validated cohorts of primary SAH from either ruptured aneurysm or arteriovenous malformation. PMID:27629096

Differential validity of the Defense Mechanism Manual for the TAT between Asian Americans and Whites. Thematic Apperception Test.

PubMed

Hibbard, S; Tang, P C; Latko, R; Park, J H; Munn, S; Bolz, S; Somerville, A

2000-12-01

Thematic Apperception Test (Murray, 1943) responses of 69 Asian American (hereafter, Asian) and 83 White students were coded for defenses according to the Defense Mechanism Manual (Cramer, 1991b) and studied for differential validity in predicting paper-and-pencil measures of relevant constructs. Three tests for differential validity were used: (a) differences between validity coefficients, (b) interactions between predictor and ethnicity in criterion prediction, and (c) differences between groups in mean prediction errors using a common regression equation. Modest differential validity was found. It was surprising that the DMM scales were slightly stronger predictors of their criteria among Asians than among Whites and when a common predictor was used, desirable criteria were overpredicted for Asians, whereas undesirable ones were overpredicted for Whites. The results were not affected by acculturation level or English vocabulary among the Asians.

Validating SPICES as a Screening Tool for Frailty Risks among Hospitalized Older Adults

PubMed Central

Aronow, Harriet Udin; Borenstein, Jeff; Haus, Flora; Braunstein, Glenn D.; Bolton, Linda Burnes

2014-01-01

Older patients are vulnerable to adverse hospital events related to frailty. SPICES, a common screening protocol to identify risk factors in older patients, alerts nurses to initiate care plans to reduce the probability of patient harm. However, there is little published validating the association between SPICES and measures of frailty and adverse outcomes. This paper used data from a prospective cohort study on frailty among 174 older adult inpatients to validate SPICES. Almost all patients met one or more SPICES criteria. The sum of SPICES was significantly correlated with age and other well-validated assessments for vulnerability, comorbid conditions, and depression. Individuals meeting two or more SPICES criteria had a risk of adverse hospital events three times greater than individuals with either no or one criterion. Results suggest that as a screening tool used within 24 hours of admission, SPICES is both valid and predictive of adverse events. PMID:24876954

Validation of a Spanish Questionnaire on Mobile Phone Abuse

PubMed Central

Olivencia-Carrión, María A.; Ramírez-Uclés, Isabel; Holgado-Tello, Pablo; López-Torrecillas, Francisca

2018-01-01

Mobile phone addiction has attracted much attention recently and is showing similarity to other substance use disorders. Because no studies on mobile phone addiction had yet been conducted in Spain, we developed and validated a questionnaire (Cuestionario de Abuso del Teléfono Móvil, ATeMo) to measure mobile phone abuse among young adults in Spanish. The ATeMo questionnaire was designed based on relevant DSM-5 diagnostic criteria and included craving as a diagnostic symptom. Using stratified sampling, the ATeMo questionnaire was administered to 856 students (mean age 21, 62% women). The MULTICAGE questionnaire was administered to assess history of drug abuse and addiction. Using confirmatory factor analysis, we found evidence for the construct validity of the following factors: Craving, Loss of Control, Negative Life Consequences, and Withdrawal Syndrome, and their association with a second order factor related to mobile phone abuse. The four ATeMO factors were also associated with alcoholism, internet use, and compulsive buying. Important gender differences were found that should be considered when studying mobile phone addictions. The ATeMo is a valid and reliable instrument that can be used in further research on mobile phone abuse. PMID:29760674

Development and validation of rt-qpcr for vesicular stomatitis virus detection (Alagoas vesiculovirus).

PubMed

de Oliveira, Anapolino Macedo; Fonseca, Antônio Augusto; Camargos, Marcelo Fernandes; Orzil, Lívia Maria; Laguardia-Nascimento, Mateus; Oliveira, Anna Gabriella Guimarães; Rodrigues, Jacqueline Gomes; Sales, Mariana Lázaro; de Oliveira, Tatiana Flávia Pinheiro; de Melo, Cristiano Barros

2018-07-01

Vesicular stomatitis is an infectious disease that occurs mainly in countries of the Western Hemisphere and affects cattle, swine and horses. The clinical symptoms in cattle and swine are similar to foot-and-mouth disease and include vesicular ulceration of the tongue and mouth. The disease requires a rapid and accurate differential diagnosis, aiming for immediate implementation of control measures. The objective of the present study was to develop and perform validation tests of multiplex RT-qPCR(s) for the detection of RNA from Alagoas vesiculovirus, considering the parameters of sensitivity and analytical specificity, analytical performance (repeatability and reproducibility criteria) and the uncertainty of the measurement. The threshold cycle values obtained in triplicate from each sample were evaluated by considering the variations between days, analysts and equipment in an analysis of variance aimed at determining the variances of repeatability and reproducibility. The results showed that RT-qPCRs had excellent sensitivity and specificity in the detection of RNA of the Alagoas vesiculovirus. The validation parameters showed low coefficients of variation and were equivalent to those found in other validation studies, indicating that the tests presented excellent repeatability and reproducibility. Copyright © 2018 Elsevier B.V. All rights reserved.

Psychometric examination and factorial validity of the Exercise Dependence Scale-Revised in Italian exercisers.

PubMed

Costa, Sebastiano; Cuzzocrea, Francesca; Hausenblas, Heather A; Larcan, Rosalba; Oliva, Patrizia

2012-12-01

Background and aims The purpose of this study was to verify the factorial structure, internal validity, reliability, and criterion validity of the 21-item Exercise Dependence Scale-Revised (EDS-R) in an Italian sample. Methods Italian voluntary (N = 519) users of gyms who had a history of regular exercise for over a year completed the EDS-R and measures of exercise frequency. Results and conclusions Confirmatory factor analyses demonstrated a good fit to the hypothesized 7-factor model, and adequate internal consistency for the scale was evidenced. Criterion validity was evidenced by significant correlations among all the subscale of the EDS and exercise frequency. Finally, individuals at risk for exercise dependence reported more exercise behavior compared to the nondependent-symptomatic and nondependent-asymptomatic groups. These results suggest that the seven subscales of the Italian version of the EDS are measuring the construct of exercise dependence as defined by the DSM-IV criteria for substance dependence and also confirm previous research using the EDS-R in other languages. More research is needed to examine the psychometric properties of the EDS-R in diverse populations with various research designs.

Validation of a Spanish Questionnaire on Mobile Phone Abuse.

PubMed

Olivencia-Carrión, María A; Ramírez-Uclés, Isabel; Holgado-Tello, Pablo; López-Torrecillas, Francisca

2018-01-01

Mobile phone addiction has attracted much attention recently and is showing similarity to other substance use disorders. Because no studies on mobile phone addiction had yet been conducted in Spain, we developed and validated a questionnaire (Cuestionario de Abuso del Teléfono Móvil, ATeMo) to measure mobile phone abuse among young adults in Spanish. The ATeMo questionnaire was designed based on relevant DSM-5 diagnostic criteria and included craving as a diagnostic symptom. Using stratified sampling, the ATeMo questionnaire was administered to 856 students (mean age 21, 62% women). The MULTICAGE questionnaire was administered to assess history of drug abuse and addiction. Using confirmatory factor analysis, we found evidence for the construct validity of the following factors: Craving, Loss of Control, Negative Life Consequences, and Withdrawal Syndrome, and their association with a second order factor related to mobile phone abuse. The four ATeMO factors were also associated with alcoholism, internet use, and compulsive buying. Important gender differences were found that should be considered when studying mobile phone addictions. The ATeMo is a valid and reliable instrument that can be used in further research on mobile phone abuse.

The Internet Gaming Disorder Scale.

PubMed

Lemmens, Jeroen S; Valkenburg, Patti M; Gentile, Douglas A

2015-06-01

Recently, the American Psychiatric Association included Internet gaming disorder (IGD) in the appendix of the 5th edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-5). The main aim of the current study was to test the reliability and validity of 4 survey instruments to measure IGD on the basis of the 9 criteria from the DSM-5: a long (27-item) and short (9-item) polytomous scale and a long (27-item) and short (9-item) dichotomous scale. The psychometric properties of these scales were tested among a representative sample of 2,444 Dutch adolescents and adults, ages 13-40 years. Confirmatory factor analyses demonstrated that the structural validity (i.e., the dimensional structure) of all scales was satisfactory. Both types of assessment (polytomous and dichotomous) were also reliable (i.e., internally consistent) and showed good criterion-related validity, as indicated by positive correlations with time spent playing games, loneliness, and aggression and negative correlations with self-esteem, prosocial behavior, and life satisfaction. The dichotomous 9-item IGD scale showed solid psychometric properties and was the most practical scale for diagnostic purposes. Latent class analysis of this dichotomous scale indicated that 3 groups could be discerned: normal gamers, risky gamers, and disordered gamers. On the basis of the number of people in this last group, the prevalence of IGD among 13- through 40-year-olds in the Netherlands is approximately 4%. If the DSM-5 threshold for diagnosis (experiencing 5 or more criteria) is applied, the prevalence of disordered gamers is more than 5%. (c) 2015 APA, all rights reserved).

Steps to standardization and validation of hippocampal volumetry as a biomarker in clinical trials and diagnostic criteria for Alzheimer’s disease

PubMed Central

Jack, Clifford R; Barkhof, Frederik; Bernstein, Matt A; Cantillon, Marc; Cole, Patricia E; DeCarli, Charles; Dubois, Bruno; Duchesne, Simon; Fox, Nick C; Frisoni, Giovanni B; Hampel, Harald; Hill, Derek LG; Johnson, Keith; Mangin, Jean-François; Scheltens, Philip; Schwarz, Adam J; Sperling, Reisa; Suhy, Joyce; Thompson, Paul M; Weiner, Michael; Foster, Norman L

2012-01-01

Background The promise of Alzheimer’s disease (AD) biomarkers has led to their incorporation in new diagnostic criteria and in therapeutic trials; however, significant barriers exist to widespread use. Chief among these is the lack of internationally accepted standards for quantitative metrics. Hippocampal volumetry is the most widely studied quantitative magnetic resonance imaging (MRI) measure in AD and thus represents the most rational target for an initial effort at standardization. Methods and Results The authors of this position paper propose a path toward this goal. The steps include: 1) Establish and empower an oversight board to manage and assess the effort, 2) Adopt the standardized definition of anatomic hippocampal boundaries on MRI arising from the EADC-ADNI hippocampal harmonization effort as a Reference Standard, 3) Establish a scientifically appropriate, publicly available Reference Standard Dataset based on manual delineation of the hippocampus in an appropriate sample of subjects (ADNI), and 4) Define minimum technical and prognostic performance metrics for validation of new measurement techniques using the Reference Standard Dataset as a benchmark. Conclusions Although manual delineation of the hippocampus is the best available reference standard, practical application of hippocampal volumetry will require automated methods. Our intent is to establish a mechanism for credentialing automated software applications to achieve internationally recognized accuracy and prognostic performance standards that lead to the systematic evaluation and then widespread acceptance and use of hippocampal volumetry. The standardization and assay validation process outlined for hippocampal volumetry is envisioned as a template that could be applied to other imaging biomarkers. PMID:21784356

A systematic review of validated methods to capture stillbirth and spontaneous abortion using administrative or claims data.

PubMed

Likis, Frances E; Sathe, Nila A; Carnahan, Ryan; McPheeters, Melissa L

2013-12-30

To identify and assess diagnosis, procedure and pharmacy dispensing codes used to identify stillbirths and spontaneous abortion in administrative and claims databases from the United States or Canada. We searched the MEDLINE database from 1991 to September 2012 using controlled vocabulary and key terms related to stillbirth or spontaneous abortion. We also searched the reference lists of included studies. Two investigators independently assessed the full text of studies against pre-determined inclusion criteria. Two reviewers independently extracted data regarding participant and algorithm characteristics and assessed each study's methodological rigor using a pre-defined approach. Ten publications addressing stillbirth and four addressing spontaneous abortion met our inclusion criteria. The International Classification of Diseases, Ninth Revision (ICD-9) codes most commonly used in algorithms for stillbirth were those for intrauterine death (656.4) and stillborn outcomes of delivery (V27.1, V27.3-V27.4, and V27.6-V27.7). Papers identifying spontaneous abortion used codes for missed abortion and spontaneous abortion: 632, 634.x, as well as V27.0-V27.7. Only two studies identifying stillbirth reported validation of algorithms. The overall positive predictive value of the algorithms was high (99%-100%), and one study reported an algorithm with 86% sensitivity. However, the predictive value of individual codes was not assessed and study populations were limited to specific geographic areas. Additional validation studies with a nationally representative sample are needed to confirm the optimal algorithm to identify stillbirths or spontaneous abortion in administrative and claims databases.' Copyright © 2013 Elsevier Ltd. All rights reserved.

On Conducting Construct Validity Meta-Analyses for the Rorschach: A Reply to Tibon Czopp and Zeligman (2016).

PubMed

Mihura, Joni L; Meyer, Gregory J; Dumitrascu, Nicolae; Bombel, George

2016-01-01

We respond to Tibon Czopp and Zeligman's (2016) critique of our systematic reviews and meta-analyses of 65 Rorschach Comprehensive System (CS) variables published in Psychological Bulletin (2013). The authors endorsed our supportive findings but critiqued the same methodology when used for the 13 unsupported variables. Unfortunately, their commentary was based on significant misunderstandings of our meta-analytic method and results, such as thinking we used introspectively assessed criteria in classifying levels of support and reporting only a subset of our externally assessed criteria. We systematically address their arguments that our construct label and criterion variable choices were inaccurate and, therefore, meta-analytic validity for these 13 CS variables was artificially low. For example, the authors created new construct labels for these variables that they called "the customary CS interpretation," but did not describe their methodology nor provide evidence that their labels would result in better validity than ours. They cite studies they believe we should have included; we explain how these studies did not fit our inclusion criteria and that including them would have actually reduced the relevant CS variables' meta-analytic validity. Ultimately, criticisms alone cannot change meta-analytic support from negative to positive; Tibon Czopp and Zeligman would need to conduct their own construct validity meta-analyses.

Simultaneous Determination of 10 Ultratrace Elements in Infant Formula, Adult Nutritionals, and Milk Products by ICP/MS After Pressure Digestion: Single-Laboratory Validation.

PubMed

Dubascoux, Stephane; Nicolas, Marine; Rime, Celine Fragniere; Payot, Janique Richoz; Poitevin, Eric

2015-01-01

A single-laboratory validation (SLV) is presented for the simultaneous determination of 10 ultratrace elements (UTEs) including aluminum (Al), arsenic (As), cadmium (Cd), cobalt (Co), chromium (Cr), mercury (Hg), molybdenum (Mo), lead (Pb), selenium (Se), and tin (Sn) in infant formulas, adult nutritionals, and milk based products by inductively coupled plasma (ICP)/MS after acidic pressure digestion. This robust and routine multielemental method is based on several official methods with modifications of sample preparation using either microwave digestion or high pressure ashing and of analytical conditions using ICP/MS with collision cell technology. This SLV fulfills AOAC method performance criteria in terms of linearity, specificity, sensitivity, precision, and accuracy and fully answers most international regulation limits for trace contaminants and/or recommended nutrient levels established for 10 UTEs in targeted matrixes.

Organizational culture and organizational effectiveness: a meta-analytic investigation of the competing values framework's theoretical suppositions.

PubMed

Hartnell, Chad A; Ou, Amy Yi; Kinicki, Angelo

2011-07-01

We apply Quinn and Rohrbaugh's (1983) competing values framework (CVF) as an organizing taxonomy to meta-analytically test hypotheses about the relationship between 3 culture types and 3 major indices of organizational effectiveness (employee attitudes, operational performance [i.e., innovation and product and service quality], and financial performance). The paper also tests theoretical suppositions undergirding the CVF by investigating the framework's nomological validity and proposed internal structure (i.e., interrelationships among culture types). Results based on data from 84 empirical studies with 94 independent samples indicate that clan, adhocracy, and market cultures are differentially and positively associated with the effectiveness criteria, though not always as hypothesized. The findings provide mixed support for the CVF's nomological validity and fail to support aspects of the CVF's proposed internal structure. We propose an alternative theoretical approach to the CVF and delineate directions for future research.

[Method validation according to ISO 15189 and SH GTA 04: application for the extraction of DNA and its quantitative evaluation by a spectrophotometric assay].

PubMed

Harlé, Alexandre; Lion, Maëva; Husson, Marie; Dubois, Cindy; Merlin, Jean-Louis

2013-01-01

According to the French legislation on medical biology (January 16th, 2010), all biological laboratories must be accredited according to ISO 15189 for at least 50% of their activities before the end of 2016. The extraction of DNA from a sample of interest, whether solid or liquid is one of the critical steps in molecular biology and specifically in somatic or constitutional genetic. The extracted DNA must meet a number of criteria such quality and also be in sufficient concentration to allow molecular biology assays such as the detection of somatic mutations. This paper describes the validation of the extraction and purification of DNA using chromatographic column extraction and quantitative determination by spectrophotometric assay, according to ISO 15189 and the accreditation technical guide in Human Health SH-GTA-04.

Providing Data Quality Information for Remote Sensing Applications

NASA Astrophysics Data System (ADS)

Albrecht, F.; Blaschke, T.; Lang, S.; Abdulmutalib, H. M.; Szabó, G.; Barsi, Á.; Batini, C.; Bartsch, A.; Kugler, Zs.; Tiede, D.; Huang, G.

2018-04-01

The availability and accessibility of remote sensing (RS) data, cloud processing platforms and provided information products and services has increased the size and diversity of the RS user community. This development also generates a need for validation approaches to assess data quality. Validation approaches employ quality criteria in their assessment. Data Quality (DQ) dimensions as the basis for quality criteria have been deeply investigated in the database area and in the remote sensing domain. Several standards exist within the RS domain but a general classification - established for databases - has been adapted only recently. For an easier identification of research opportunities, a better understanding is required how quality criteria are employed in the RS lifecycle. Therefore, this research investigates how quality criteria support decisions that guide the RS lifecycle and how they relate to the measured DQ dimensions. Subsequently follows an overview of the relevant standards in the RS domain that is matched to the RS lifecycle. Conclusively, the required research needs are identified that would enable a complete understanding of the interrelationships between the RS lifecycle, the data sources and the DQ dimensions, an understanding that would be very valuable for designing validation approaches in RS.

Development and Validation of a Decision Tool for Early Identification of Adult Patients with Severe and Complex Eating Disorder Psychopathology in Need of Highly Specialized Care.

PubMed

Dingemans, Alexandra E; Goorden, Maartje; Lötters, Freek J B; Bouwmans, Clazien; Danner, Unna N; van Elburg, Annemarie A; van Furth, Eric F; Hakkaart-van Roijen, Leona

2017-09-01

Patients with complex and severe eating disorders often receive a number of ineffective or/and insufficient treatments. Direct referral of these patients to highly specialized tertiary treatment facilities in an earlier stage of the disorder is likely to be more (cost)-effective. The aim of the study was to develop a decision tool that aids clinicians in early identification of these patients. After identification of criteria that were indicative of severity and complexity of eating disorder psychopathology by means of a systematic review of literature and consultation of a focus group, a Delphi method was applied to obtain consensus from experts on the list of relevant criteria. Finally, the decision tool was validated in clinical practice, and cut-off criteria were established. The tool demonstrated good feasibility and validity to identify patients for highly specialized tertiary care. The final decision tool consisted of five criteria that can easily be implemented in clinical practice. Copyright © 2017 John Wiley & Sons, Ltd and Eating Disorders Association. Copyright © 2017 John Wiley & Sons, Ltd and Eating Disorders Association.

Comprehensive Evaluation Criteria for English Learning Websites Using Expert Validity Surveys

ERIC Educational Resources Information Center

Yang, Ya-Ting C.; Chan, Chia-Ying

2008-01-01

This study aimed to develop a set of evaluation criteria for English learning websites. These criteria can assist English teachers/web designers in designing effective websites for their English courses and can also guide English learners in screening for appropriate and reliable websites to use in increasing their English ability. To fulfill our…

International development and psychometric properties of the Child and Adolescent Trauma Screen (CATS).

PubMed

Sachser, Cedric; Berliner, Lucy; Holt, Tonje; Jensen, Tine K; Jungbluth, Nathaniel; Risch, Elizabeth; Rosner, Rita; Goldbeck, Lutz

2017-03-01

Systematic screening is a powerful means by which children and adolescents with posttraumatic stress symptoms (PTSS) can be detected. Reliable and valid measures based on current diagnostic criteria are needed. To investigate the internal consistency and construct validity of the Child and Adolescent Trauma Screen (CATS) in three samples of trauma-exposed children in the US (self-reports: n=249; caregiver reports: n=267; pre-school n=190), in Germany (self-reports: n=117; caregiver reports: n=95) and in Norway (self-reports: n=109; caregiver reports: n=62). Internal consistency was calculated using Cronbach's α. Convergent-discriminant validity was investigated using bivariate correlation coefficients with measures of depression, anxiety and externalizing symptoms. CFA was used to investigate the DSM-5 factor structure. In all three language samples the 20 item symptom score of the self-report and the caregiver report proved good to excellent reliability with α ranging between .88 and .94. The convergent-discriminant validity pattern showed medium to strong correlations with measures of depression (r =.62-.82) and anxiety (r =.40-.77) and low to medium correlations with externalizing symptoms (r =-.15-.43) within informants in all language versions. Using CFA the underlying DSM-5 factor structure with four symptom clusters (re-experiencing, avoidance, negative alterations in mood and cognitions, hyperarousal) was supported (n =475 for self-report; n =424 for caregiver reports). The external validation of the CATS with a DSM-5 based semi-structured clinical interview and corresponding determination of cut-points is pending. The CATS has satisfactory psychometric properties. Clinicians may consider the CATS as a screening tool and for symptom monitoring. Copyright © 2016 Elsevier B.V. All rights reserved.