Design Characteristics Influence Performance of Clinical Prediction Rules in Validation: A Meta-Epidemiological Study

PubMed Central

Ban, Jong-Wook; Emparanza, José Ignacio; Urreta, Iratxe; Burls, Amanda

2016-01-01

Background Many new clinical prediction rules are derived and validated. But the design and reporting quality of clinical prediction research has been less than optimal. We aimed to assess whether design characteristics of validation studies were associated with the overestimation of clinical prediction rules’ performance. We also aimed to evaluate whether validation studies clearly reported important methodological characteristics. Methods Electronic databases were searched for systematic reviews of clinical prediction rule studies published between 2006 and 2010. Data were extracted from the eligible validation studies included in the systematic reviews. A meta-analytic meta-epidemiological approach was used to assess the influence of design characteristics on predictive performance. From each validation study, it was assessed whether 7 design and 7 reporting characteristics were properly described. Results A total of 287 validation studies of clinical prediction rule were collected from 15 systematic reviews (31 meta-analyses). Validation studies using case-control design produced a summary diagnostic odds ratio (DOR) 2.2 times (95% CI: 1.2–4.3) larger than validation studies using cohort design and unclear design. When differential verification was used, the summary DOR was overestimated by twofold (95% CI: 1.2 -3.1) compared to complete, partial and unclear verification. The summary RDOR of validation studies with inadequate sample size was 1.9 (95% CI: 1.2 -3.1) compared to studies with adequate sample size. Study site, reliability, and clinical prediction rule was adequately described in 10.1%, 9.4%, and 7.0% of validation studies respectively. Conclusion Validation studies with design shortcomings may overestimate the performance of clinical prediction rules. The quality of reporting among studies validating clinical prediction rules needs to be improved. PMID:26730980

Validation of time to task performance assessment method in simulation: A comparative design study.

PubMed

Shinnick, Mary Ann; Woo, Mary A

2018-05-01

There is a lack of objective and valid measures for assessing nursing clinical competence which could adversely impact patient safety. Therefore, we evaluated an objective assessment of clinical competence, Time to Task (ability to perform specific, critical nursing care activities within 5 min), and compared it to two subjective measures, (Lasater Clinical Judgement Rubric [LCJR] and common "pass/fail" assessment). Using a prospective, "Known Groups" (Expert vs. Novice nurses) comparative design, Expert nurses (ICU nurses with >5 years of ICU experience) and Novice nurses (senior prelicensure nursing students) participated individually in a simulation of a patient in decompensated heart failure. Fourteen nursing instructors or preceptors, blinded to group assignment, reviewed 28 simulation videos (15 Expert and 13 Novice) and scored them using the LCJR and pass/fail assessments. Time to Task assessment was scored based on time thresholds for specific nursing actions prospectively set by an expert clinical panel. Statistical analysis consisted of Medians Test and sensitivity and specificity analyses. The LCJR total score was significantly different between Experts and Novices (p < 0.01) and revealed adequate sensitivity (ability to correctly identify "Expert" nurses; 0.72) but had a low specificity (ability to correctly identify "Novice" nurses; 0.40). For the subjective measure 'pass/fail', sensitivity was high (0.90) but specificity was low (0.47). The Time to Task measure had statistical significance between Expert and Novice groups (p < 0.01) and sensitivity (0.80) and specificity (0.85) were good. Commonly used subjective measures of clinical nursing competence have difficulties with achieving acceptable specificity. However, an objective measure, Time to Task, had good sensitivity and specificity in differentiating between groups. While more than one assessment instrument should be used to determine nurse competency, an objective measure, such as

Is Health-Related Quality of Life after Radical Cystectomy Using Validated Questionnaires Really Better in Patients with Ileal Orthotopic Neobladder Compared to Ileal Conduit: A Meta-Analysis of Retrospective Comparative Studies

PubMed Central

Cerruto, Maria A.; D'Elia, Carolina; Siracusano, Salvatore; Porcaro, Antonio B.; Cacciamani, Giovanni; De Marchi, Davide; Niero, Mauro; Lonardi, Cristina; Iafrate, Massimo; Bassi, Pierfrancesco; Belgrano, Emanuele; Imbimbo, Ciro; Racioppi, Marco; Talamini, Renato; Ciciliato, Stefano; Toffoli, Laura; Rizzo, Michele; Visalli, Francesco; Verze, Paolo; Artibani, Walter

2017-01-01

Introduction From the most recent systematic revision of the literature, an orthotopic neobladder would seem to show marginally better health related quality of life (HR-QoL) scores compared with an ileal conduit. The aim of this study was to review all relevant published studies about the comparison between ileal orthotopic neobladder (IONB) and ileal conduit using validated HR-QoL questionnaires. Materials and Methods Studies were identified by searching multiple literature databases. Data were synthesized using meta-analytic methods conformed to the PRISMA statement. Results The literature search identified 10 papers; pooled effect sizes of combined quality of life outcomes for ileal conduit versus IONB showed a significantly better HR-QoL in patients with IONB (Hedges' g = 0.278; p = 0.000);. The present study has an important limitation due to the type of the analyzed comparative studies, all retrospective and not randomized. Conclusion This meta-analysis of not-randomized, retrospective comparative studies on the impact of ileal conduit versus IONB on HR-QoL showed a significant advantage of IONB subgroups. PMID:28785189

Is Health-Related Quality of Life after Radical Cystectomy Using Validated Questionnaires Really Better in Patients with Ileal Orthotopic Neobladder Compared to Ileal Conduit: A Meta-Analysis of Retrospective Comparative Studies.

PubMed

Cerruto, Maria A; D'Elia, Carolina; Siracusano, Salvatore; Porcaro, Antonio B; Cacciamani, Giovanni; De Marchi, Davide; Niero, Mauro; Lonardi, Cristina; Iafrate, Massimo; Bassi, Pierfrancesco; Belgrano, Emanuele; Imbimbo, Ciro; Racioppi, Marco; Talamini, Renato; Ciciliato, Stefano; Toffoli, Laura; Rizzo, Michele; Visalli, Francesco; Verze, Paolo; Artibani, Walter

2017-07-01

From the most recent systematic revision of the literature, an orthotopic neobladder would seem to show marginally better health related quality of life (HR-QoL) scores compared with an ileal conduit. The aim of this study was to review all relevant published studies about the comparison between ileal orthotopic neobladder (IONB) and ileal conduit using validated HR-QoL questionnaires. Studies were identified by searching multiple literature databases. Data were synthesized using meta-analytic methods conformed to the PRISMA statement. The literature search identified 10 papers; pooled effect sizes of combined quality of life outcomes for ileal conduit versus IONB showed a significantly better HR-QoL in patients with IONB (Hedges' g = 0.278; p = 0.000);. The present study has an important limitation due to the type of the analyzed comparative studies, all retrospective and not randomized. This meta-analysis of not-randomized, retrospective comparative studies on the impact of ileal conduit versus IONB on HR-QoL showed a significant advantage of IONB subgroups.

Validity assessment of self-reported medication use by comparing to pharmacy insurance claims

PubMed Central

Fujita, Misuzu; Sato, Yasunori; Nagashima, Kengo; Takahashi, Sho; Hata, Akira

2015-01-01

Objectives In Japan, an annual health check-up and health promotion guidance programme was established in 2008 in accordance with the Act on Assurance of Medical Care for the Elderly. A self-reported questionnaire on medication use is a required item in this programme and has been used widely, but its validity has not been assessed. The aim of this study was to evaluate the validity of this questionnaire by comparing self-reported usage to pharmacy insurance claims. Setting This is a population-based validation study. Self-reported medication use for hypertension, diabetes and dyslipidaemia is the evaluated measurement. Data on pharmacy insurance claims are used as a reference standard. Participants Participants were 54 712 beneficiaries of the National Health Insurance of Chiba City. Primary and secondary outcome measures Sensitivity, specificity and κ statistics of the self-reported medication-use questionnaire for predicting actual prescriptions during 1 month (that of the check-up) and 3 months (that of the check-up and the previous 2 months) were calculated. Results Sensitivity and specificity scores of questionnaire data for predicting insurance claims covering 3 months were, respectively, 92.4% (95% CI 91.9 to 92.8) and 86.4% (95% CI 86.0 to 86.7) for hypertension, 82.6% (95% CI 81.1 to 84.0) and 98.5% (95% CI 98.4 to 98.6) for diabetes, and 86.2% (95% CI 85.5 to 86.8) and 91.0% (95% CI 90.8 to 91.3) for dyslipidaemia. Corresponding κ statistics were 70.9% (95% CI 70.1 to 71.7), 77.1% (95% CI 76.2 to 77.9) and 69.8% (95% CI 68.9 to 70.6). The specificity was significantly higher for questionnaire data covering 3 months compared with data covering 1 month for all 3 conditions. Conclusions Self-reported questionnaire data on medication use had sufficiently high validity for further analyses. Item responses showed close agreement with actual prescriptions, particularly those covering 3 months. PMID:26553839

Objectifying Content Validity: Conducting a Content Validity Study in Social Work Research.

ERIC Educational Resources Information Center

Rubio, Doris McGartland; Berg-Weger, Marla; Tebb, Susan S.; Lee, E. Suzanne; Rauch, Shannon

2003-01-01

The purpose of this article is to demonstrate how to conduct a content validity study. Instructions on how to calculate a content validity index, factorial validity index, and an interrater reliability index and guide for interpreting these indices are included. Implications regarding the value of conducting a content validity study for…

Validation sampling can reduce bias in health care database studies: an illustration using influenza vaccination effectiveness.

PubMed

Nelson, Jennifer Clark; Marsh, Tracey; Lumley, Thomas; Larson, Eric B; Jackson, Lisa A; Jackson, Michael L

2013-08-01

Estimates of treatment effectiveness in epidemiologic studies using large observational health care databases may be biased owing to inaccurate or incomplete information on important confounders. Study methods that collect and incorporate more comprehensive confounder data on a validation cohort may reduce confounding bias. We applied two such methods, namely imputation and reweighting, to Group Health administrative data (full sample) supplemented by more detailed confounder data from the Adult Changes in Thought study (validation sample). We used influenza vaccination effectiveness (with an unexposed comparator group) as an example and evaluated each method's ability to reduce bias using the control time period before influenza circulation. Both methods reduced, but did not completely eliminate, the bias compared with traditional effectiveness estimates that do not use the validation sample confounders. Although these results support the use of validation sampling methods to improve the accuracy of comparative effectiveness findings from health care database studies, they also illustrate that the success of such methods depends on many factors, including the ability to measure important confounders in a representative and large enough validation sample, the comparability of the full sample and validation sample, and the accuracy with which the data can be imputed or reweighted using the additional validation sample information. Copyright © 2013 Elsevier Inc. All rights reserved.

Study design elements for rigorous quasi-experimental comparative effectiveness research.

PubMed

Maciejewski, Matthew L; Curtis, Lesley H; Dowd, Bryan

2013-03-01

Quasi-experiments are likely to be the workhorse study design used to generate evidence about the comparative effectiveness of alternative treatments, because of their feasibility, timeliness, affordability and external validity compared with randomized trials. In this review, we outline potential sources of discordance in results between quasi-experiments and experiments, review study design choices that can improve the internal validity of quasi-experiments, and outline innovative data linkage strategies that may be particularly useful in quasi-experimental comparative effectiveness research. There is an urgent need to resolve the debate about the evidentiary value of quasi-experiments since equal consideration of rigorous quasi-experiments will broaden the base of evidence that can be brought to bear in clinical decision-making and governmental policy-making.

The CPT Reading Comprehension Test: A Validity Study.

ERIC Educational Resources Information Center

Napoli, Anthony R.; Raymond, Lanette A.; Coffey, Cheryl A.; Bosco, Diane M.

1998-01-01

Describes a study done at Suffolk County Community College (New York) that assessed the validity of the College Board's Computerized Placement Test in Reading Comprehension (CPT-R) by comparing test results of 1,154 freshmen with the results of the Degree of Power Reading Test. Results confirmed the CPT-R's reliability in identifying basic…

Validating MDS Data about Risk Factors for Perineal Dermatitis by Comparing With Nursing Home Records

PubMed Central

Toth, Anna M.; Bliss, Donna Z.; Savik, Kay; Wyman, Jean F.

2011-01-01

Perineal dermatitis is one of the main complications of incontinence and increases the cost of health care. The Minimum Data Set (MDS) contains data about factors associated with perineal dermatitis identified in a published conceptual model of perineal dermatitis. The purpose of this study was to determine the validity of MDS data related to perineal dermatitis risk factors by comparing them with data in nursing home chart records. Findings indicate that MDS items defining factors associated with perineal dermatitis were valid and supported use of the MDS in further investigation of a significant, costly, and understudied health problem of nursing home residents. PMID:18512629

Clinical Validation of Heart Rate Apps: Mixed-Methods Evaluation Study

PubMed Central

Stans, Jelle; Mortelmans, Christophe; Van Haelst, Ruth; Van Schelvergem, Gertjan; Pelckmans, Caroline; Smeets, Christophe JP; Lanssens, Dorien; De Cannière, Hélène; Storms, Valerie; Thijs, Inge M; Vaes, Bert; Vandervoort, Pieter M

2017-01-01

Background Photoplethysmography (PPG) is a proven way to measure heart rate (HR). This technology is already available in smartphones, which allows measuring HR only by using the smartphone. Given the widespread availability of smartphones, this creates a scalable way to enable mobile HR monitoring. An essential precondition is that these technologies are as reliable and accurate as the current clinical (gold) standards. At this moment, there is no consensus on a gold standard method for the validation of HR apps. This results in different validation processes that do not always reflect the veracious outcome of comparison. Objective The aim of this paper was to investigate and describe the necessary elements in validating and comparing HR apps versus standard technology. Methods The FibriCheck (Qompium) app was used in two separate prospective nonrandomized studies. In the first study, the HR of the FibriCheck app was consecutively compared with 2 different Food and Drug Administration (FDA)-cleared HR devices: the Nonin oximeter and the AliveCor Mobile ECG. In the second study, a next step in validation was performed by comparing the beat-to-beat intervals of the FibriCheck app to a synchronized ECG recording. Results In the first study, the HR (BPM, beats per minute) of 88 random subjects consecutively measured with the 3 devices showed a correlation coefficient of .834 between FibriCheck and Nonin, .88 between FibriCheck and AliveCor, and .897 between Nonin and AliveCor. A single way analysis of variance (ANOVA; P=.61 was executed to test the hypothesis that there were no significant differences between the HRs as measured by the 3 devices. In the second study, 20,298 (ms) R-R intervals (RRI)–peak-to-peak intervals (PPI) from 229 subjects were analyzed. This resulted in a positive correlation (rs=.993, root mean square deviation [RMSE]=23.04 ms, and normalized root mean square error [NRMSE]=0.012) between the PPI from FibriCheck and the RRI from the wearable

Validation: Codes to compare simulation data to various observations

NASA Astrophysics Data System (ADS)

Cohn, J. D.

2017-02-01

Validation provides codes to compare several observations to simulated data with stellar mass and star formation rate, simulated data stellar mass function with observed stellar mass function from PRIMUS or SDSS-GALEX in several redshift bins from 0.01-1.0, and simulated data B band luminosity function with observed stellar mass function, and to create plots for various attributes, including stellar mass functions, and stellar mass to halo mass. These codes can model predictions (in some cases alongside observational data) to test other mock catalogs.

Validation of cardiac output studies from the Mostcare compared to a pulmonary artery catheter in septic patients.

PubMed

Gopal, S; Do, T; Pooni, J S; Martinelli, G

2014-03-01

The Mostcare monitor is a non-invasive cardiac output monitor. It has been well validated in cardiac surgical patients but there is limited evidence on its use in patients with severe sepsis and septic shock. The study included the first 22 consecutive patients with severe sepsis and septic shock in whom the floatation of a pulmonary artery catheter was deemed necessary to guide clinical management. Cardiac output measurements including cardiac output, cardiac index and stroke volume were simultaneously calculated and recorded from a thermodilution pulmonary artery catheter and from the Mostcare monitor respectively. The two methods of measuring cardiac output were compared by Bland-Altman statistics and linear regression analysis. A percentage error of less than 30% was defined as acceptable for this study. Bland-Altman analysis for cardiac output showed a Bias of 0.31 L.min-1, precision (=SD) of 1.97 L.min-1 and a percentage error of 62.54%. For Cardiac Index the bias was 0.21 L.min-1.m-2, precision of 1.10 L.min-1.m-2 and a percentage error of 64%. For stroke volume the bias was 5 mL, precision of 24.46 mL and percentage error of 70.21%. Linear regression produced a correlation coefficient r2 for cardiac output, cardiac index, and stroke volume, of 0.403, 0.306, and 0.3 respectively. Compared to thermodilution cardiac output, cardiac output studies obtained from the Mostcare monitor have an unacceptably high error rate. The Mostcare monitor demonstrated to be an unreliable monitoring device to measure cardiac output in patients with severe sepsis and septic shock on an intensive care unit.

Discriminant validity study of Achilles enthesis ultrasound.

PubMed

Expósito Molinero, María Rosa; de Miguel Mendieta, Eugenio

2016-01-01

We want to know if the ultrasound examination of the Achilles tendon in spondyloarthritis is different compared to other rheumatic diseases. We studied 97 patients divided into five groups: rheumatoid arthritis, spondyloarthritis, gout, chondrocalcinosis and osteoarthritis, exploring six elementary lesions in 194 Achilles entheses examined. In our study the total index ultrasonographic Achilles is higher in spondyloarthritis with significant differences. The worst elementary spondyloarthritis lesions for discriminations against other pathologies were calcification. This study aims to demonstrate the discriminant validity of Achilles enthesitis observed by ultrasound in spondyloarthritis compared with other rheumatic diseases that may also have ultrasound abnormalities such enthesis level. Copyright © 2015 Elsevier España, S.L.U. and Sociedad Española de Reumatología y Colegio Mexicano de Reumatología. All rights reserved.

Bem Sex Role Inventory Validation in the International Mobility in Aging Study.

PubMed

Ahmed, Tamer; Vafaei, Afshin; Belanger, Emmanuelle; Phillips, Susan P; Zunzunegui, Maria-Victoria

2016-09-01

This study investigated the measurement structure of the Bem Sex Role Inventory (BSRI) with different factor analysis methods. Most previous studies on validity applied exploratory factor analysis (EFA) to examine the BSRI. We aimed to assess the psychometric properties and construct validity of the 12-item short-form BSRI in a sample administered to 1,995 older adults from wave 1 of the International Mobility in Aging Study (IMIAS). We used Cronbach's alpha to assess internal consistency reliability and confirmatory factor analysis (CFA) to assess psychometric properties. EFA revealed a three-factor model, further confirmed by CFA and compared with the original two-factor structure model. Results revealed that a two-factor solution (instrumentality-expressiveness) has satisfactory construct validity and superior fit to data compared to the three-factor solution. The two-factor solution confirms expected gender differences in older adults. The 12-item BSRI provides a brief, psychometrically sound, and reliable instrument in international samples of older adults.

Validity of self-reported solar UVR exposure compared with objectively measured UVR exposure.

PubMed

Glanz, Karen; Gies, Peter; O'Riordan, David L; Elliott, Tom; Nehl, Eric; McCarty, Frances; Davis, Erica

2010-12-01

Reliance on verbal self-report of solar exposure in skin cancer prevention and epidemiologic studies may be problematic if self-report data are not valid due to systematic errors in recall, social desirability bias, or other reasons. This study examines the validity of self-reports of exposure to ultraviolet radiation (UVR) compared to objectively measured exposure among children and adults in outdoor recreation settings in 4 regions of the United States. Objective UVR exposures of 515 participants were measured using polysulfone film badge UVR dosimeters on 2 days. The same subjects provided self-reported UVR exposure data on surveys and 4-day sun exposure diaries, for comparison to their objectively measured exposure. Dosimeter data showed that lifeguards had the greatest UVR exposure (24.5% of weekday ambient UVR), children the next highest exposures (10.3% ambient weekday UVR), and parents had the lowest (6.6% ambient weekday UVR). Similar patterns were observed in self-report data. Correlations between diary reports and dosimeter findings were fair to good and were highest for lifeguards (r = 0.38-0.57), followed by parents (r = 0.28-0.29) and children (r = 0.18-0.34). Correlations between survey and diary measures were moderate to good for lifeguards (r = 0.20-0.54) and children (r = 0.35-0.53). This is the largest study of its kind to date, and supports the utility of self-report measures of solar UVR exposure. Overall, self-reports of sun exposure produce valid measures of UVR exposure among parents, children, and lifeguards who work outdoors. ©2010 AACR.

[Comparative analysis of child development screening tools designed and validated in Mexico].

PubMed

Orcajo-Castelán, Rodrigo; Sidonio-Aguayo, Beatriz; Alcacio-Mendoza, Jorge Augusto; López-Díaz, Giovana Lucía

In recent years a number of child development screening tools have been developed in Mexico; however, their properties have not been compared. The objective of this review was to compare the report quality and risk bias of the screening tools developed and validated in Mexico in their published versions. A search was conducted in databases, gray literature and cross references. The resultant tests were compared and analyzed using STARD, QUADAS and QUADAS-2 criteria. "Valoración Neuroconductual del Desarrollo del Lactante" (VANEDELA), "Evaluación del Desarrollo Infantil or EDI" (CDE in English), "Prueba de Tamiz del Neurodesarrollo infantil" (PTNI), "Cartillas de Vigilancia para identificar alteraciones en el Desarrollo del Lactante" (CVDL) and "Indicadores de riesgo del Perfil de Conductas de Desarrollo" (INDIPCD-R) were included for the comparison. No test fulfilled all STARD items. The most complete in their methodological description were VANEDELA and EDI. The areas lacking more data on the reports were recruiting and patient selection (VANEDELA, PTNI, CVDL, INDIPCD-R). In QUADAS evaluation, all had some risk bias, but some serious concerns of risk bias were raised by patient sampling and by the choice of gold standard in two tests (PTNI, INDIPCD-R). Child development screening tests created and validated in Mexico have variable report quality and risk bias. The test with the best validation report quality is VANEDELA and the one with the lowest risk of bias is EDI. Copyright © 2015 Hospital Infantil de México Federico Gómez. Publicado por Masson Doyma México S.A. All rights reserved.

Criterion Validity of Measures of Perceived Relative Harm of E-Cigarettes and Smokeless Tobacco Compared to Cigarettes

PubMed Central

Persoskie, Alexander; Nguyen, Anh B.; Kaufman, Annette R.; Tworek, Cindy

2017-01-01

Beliefs about the relative harmfulness of one product compared to another (perceived relative harm) are central to research and regulation concerning tobacco and nicotine-containing products, but techniques for measuring such beliefs vary widely. We compared the validity of direct and indirect measures of perceived harm of e-cigarettes and smokeless tobacco (SLT) compared to cigarettes. On direct measures, participants explicitly compare the harmfulness of each product. On indirect measures, participants rate the harmfulness of each product separately, and ratings are compared. The U.S. Health Information National Trends Survey (HINTS-FDA-2015; N=3738) included direct measures of perceived harm of e-cigarettes and SLT compared to cigarettes. Indirect measures were created by comparing ratings of harm from e-cigarettes, SLT, and cigarettes on 3-point scales. Logistic regressions tested validity by assessing whether direct and indirect measures were associated with criterion variables including: ever-trying e-cigarettes, ever-trying snus, and SLT use status. Compared to the indirect measures, the direct measures of harm were more consistently associated with criterion variables. On direct measures, 26% of adults rated e-cigarettes as less harmful than cigarettes, and 11% rated SLT as less harmful than cigarettes. Direct measures appear to provide valid information about individuals’ harm beliefs, which may be used to inform research and tobacco control policy. Further validation research is encouraged. PMID:28073035

Clinical Validation of Heart Rate Apps: Mixed-Methods Evaluation Study.

PubMed

Vandenberk, Thijs; Stans, Jelle; Mortelmans, Christophe; Van Haelst, Ruth; Van Schelvergem, Gertjan; Pelckmans, Caroline; Smeets, Christophe Jp; Lanssens, Dorien; De Cannière, Hélène; Storms, Valerie; Thijs, Inge M; Vaes, Bert; Vandervoort, Pieter M

2017-08-25

Photoplethysmography (PPG) is a proven way to measure heart rate (HR). This technology is already available in smartphones, which allows measuring HR only by using the smartphone. Given the widespread availability of smartphones, this creates a scalable way to enable mobile HR monitoring. An essential precondition is that these technologies are as reliable and accurate as the current clinical (gold) standards. At this moment, there is no consensus on a gold standard method for the validation of HR apps. This results in different validation processes that do not always reflect the veracious outcome of comparison. The aim of this paper was to investigate and describe the necessary elements in validating and comparing HR apps versus standard technology. The FibriCheck (Qompium) app was used in two separate prospective nonrandomized studies. In the first study, the HR of the FibriCheck app was consecutively compared with 2 different Food and Drug Administration (FDA)-cleared HR devices: the Nonin oximeter and the AliveCor Mobile ECG. In the second study, a next step in validation was performed by comparing the beat-to-beat intervals of the FibriCheck app to a synchronized ECG recording. In the first study, the HR (BPM, beats per minute) of 88 random subjects consecutively measured with the 3 devices showed a correlation coefficient of .834 between FibriCheck and Nonin, .88 between FibriCheck and AliveCor, and .897 between Nonin and AliveCor. A single way analysis of variance (ANOVA; P=.61 was executed to test the hypothesis that there were no significant differences between the HRs as measured by the 3 devices. In the second study, 20,298 (ms) R-R intervals (RRI)-peak-to-peak intervals (PPI) from 229 subjects were analyzed. This resulted in a positive correlation (rs=.993, root mean square deviation [RMSE]=23.04 ms, and normalized root mean square error [NRMSE]=0.012) between the PPI from FibriCheck and the RRI from the wearable ECG. There was no significant difference

Concurrent validity and reliability of the Simple Goniometer iPhone app compared with the Universal Goniometer.

PubMed

Jones, Anne; Sealey, Rebecca; Crowe, Michael; Gordon, Susan

2014-10-01

The aim of this study was to assess the concurrent validity and reliability of the Simple Goniometer (SG) iPhone® app compared to the Universal Goniometer (UG). Within subject comparison design comparing the UG with the SG app. James Cook University, Townsville, Queensland, Australia. Thirty-six volunteer participants, with a mean age of 60.6 years (SD 6.2). Not applicable. Thirty-six participants performed three standing lunges during which the knee joint angle was measured with the SG app and the UG. There were no significant differences in the measures of individual knee joint angles between the UG and the SG app. Pearson correlations of 0.96-0.98 and intraclass correlation coefficients of 0.97-0.99 (95% confidence interval: 0.95-1.00) were recorded for all measures. Using the Bland-Altman method, the standard error of the mean of the differences and the standard deviation of the mean of the differences were low. The measurements from the SG iPhone® app were reliable and possessed concurrent validity for this sample and protocol when compared to the UG.

Validation of Digital Microscopy Compared With Light Microscopy for the Diagnosis of Canine Cutaneous Tumors.

PubMed

Bertram, Christof A; Gurtner, Corinne; Dettwiler, Martina; Kershaw, Olivia; Dietert, Kristina; Pieper, Laura; Pischon, Hannah; Gruber, Achim D; Klopfleisch, Robert

2018-07-01

Integration of new technologies, such as digital microscopy, into a highly standardized laboratory routine requires the validation of its performance in terms of reliability, specificity, and sensitivity. However, a validation study of digital microscopy is currently lacking in veterinary pathology. The aim of the current study was to validate the usability of digital microscopy in terms of diagnostic accuracy, speed, and confidence for diagnosing and differentiating common canine cutaneous tumor types and to compare it to classical light microscopy. Therefore, 80 histologic sections including 17 different skin tumor types were examined twice as glass slides and twice as digital whole-slide images by 6 pathologists with different levels of experience at 4 time points. Comparison of both methods found digital microscopy to be noninferior for differentiating individual tumor types within the category epithelial and mesenchymal tumors, but diagnostic concordance was slightly lower for differentiating individual round cell tumor types by digital microscopy. In addition, digital microscopy was associated with significantly shorter diagnostic time, but diagnostic confidence was lower and technical quality was considered inferior for whole-slide images compared with glass slides. Of note, diagnostic performance for whole-slide images scanned at 200× magnification was noninferior in diagnostic performance for slides scanned at 400×. In conclusion, digital microscopy differs only minimally from light microscopy in few aspects of diagnostic performance and overall appears adequate for the diagnosis of individual canine cutaneous tumors with minor limitations for differentiating individual round cell tumor types and grading of mast cell tumors.

External validity of post-stroke interventional gait rehabilitation studies.

PubMed

Kafri, Michal; Dickstein, Ruth

2017-01-01

Gait rehabilitation is a major component of stroke rehabilitation, and is supported by extensive research. The objective of this review was to examine the external validity of intervention studies aimed at improving gait in individuals post-stroke. To that end, two aspects of these studies were assessed: subjects' exclusion criteria and the ecological validity of the intervention, as manifested by the intervention's technological complexity and delivery setting. Additionally, we examined whether the target population as inferred from the titles/abstracts is broader than the population actually represented by the reported samples. We systematically researched PubMed for intervention studies to improve gait post-stroke, working backwards from the beginning of 2014. Exclusion criteria, the technological complexity of the intervention (defined as either elaborate or simple), setting, and description of the target population in the titles/abstracts were recorded. Fifty-two studies were reviewed. The samples were exclusive, with recurrent stroke, co-morbidities, cognitive status, walking level, and residency being major reasons for exclusion. In one half of the studies, the intervention was elaborate. Descriptions of participants in the title/abstract in almost one half of the studies included only the diagnosis (stroke or comparable terms) and its stage (acute, subacute, and chronic). The external validity of a substantial number of intervention studies about rehabilitation of gait post-stroke appears to be limited by exclusivity of the samples as well as by deficiencies in ecological validity of the interventions. These limitations are not accurately reflected in the titles or abstracts of the studies.

Validation studies and proficiency testing.

PubMed

Ankilam, Elke; Heinze, Petra; Kay, Simon; Van den Eede, Guy; Popping, Bert

2002-01-01

Genetically modified organisms (GMOs) entered the European food market in 1996. Current legislation demands the labeling of food products if they contain <1% GMO, as assessed for each ingredient of the product. To create confidence in the testing methods and to complement enforcement requirements, there is an urgent need for internationally validated methods, which could serve as reference methods. To date, several methods have been submitted to validation trials at an international level; approaches now exist that can be used in different circumstances and for different food matrixes. Moreover, the requirement for the formal validation of methods is clearly accepted; several national and international bodies are active in organizing studies. Further validation studies, especially on the quantitative polymerase chain reaction methods, need to be performed to cover the rising demand for new extraction methods and other background matrixes, as well as for novel GMO constructs.

The Validity of the Comparative Interrupted Time Series Design for Evaluating the Effect of School-Level Interventions.

PubMed

Jacob, Robin; Somers, Marie-Andree; Zhu, Pei; Bloom, Howard

2016-06-01

In this article, we examine whether a well-executed comparative interrupted time series (CITS) design can produce valid inferences about the effectiveness of a school-level intervention. This article also explores the trade-off between bias reduction and precision loss across different methods of selecting comparison groups for the CITS design and assesses whether choosing matched comparison schools based only on preintervention test scores is sufficient to produce internally valid impact estimates. We conduct a validation study of the CITS design based on the federal Reading First program as implemented in one state using results from a regression discontinuity design as a causal benchmark. Our results contribute to the growing base of evidence regarding the validity of nonexperimental designs. We demonstrate that the CITS design can, in our example, produce internally valid estimates of program impacts when multiple years of preintervention outcome data (test scores in the present case) are available and when a set of reasonable criteria are used to select comparison organizations (schools in the present case). © The Author(s) 2016.

40 CFR 761.395 - A validation study.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 40 Protection of Environment 31 2011-07-01 2011-07-01 false A validation study. 761.395 Section... PROHIBITIONS Comparison Study for Validating a New Performance-Based Decontamination Solvent Under § 761.79(d)(4) § 761.395 A validation study. (a) Decontaminate the following prepared sample surfaces using the...

40 CFR 761.395 - A validation study.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 40 Protection of Environment 30 2010-07-01 2010-07-01 false A validation study. 761.395 Section... PROHIBITIONS Comparison Study for Validating a New Performance-Based Decontamination Solvent Under § 761.79(d)(4) § 761.395 A validation study. (a) Decontaminate the following prepared sample surfaces using the...

Validity and reliability of the PowerTap mobile cycling powermeter when compared with the SRM Device.

PubMed

Bertucci, W; Duc, S; Villerius, V; Pernin, J N; Grappe, F

2005-12-01

The SRM power measuring crank system is nowadays a popular device for cycling power output (PO) measurements in the field and in laboratories. The PowerTap (CycleOps, Madison, USA) is a more recent and less well-known device that allows mobile PO measurements of cycling via the rear wheel hub. The aim of this study is to test the validity and reliability of the PowerTap by comparing it with the most accurate (i.e. the scientific model) of the SRM system. The validity of the PowerTap is tested during i) sub-maximal incremental intensities (ranging from 100 to 420 W) on a treadmill with different pedalling cadences (45 to 120 rpm) and cycling positions (standing and seated) on different grades, ii) a continuous sub-maximal intensity lasting 30 min, iii) a maximal intensity (8-s sprint), and iiii) real road cycling. The reliability is assessed by repeating ten times the sub-maximal incremental and continuous tests. The results show a good validity of the PowerTap during sub-maximal intensities between 100 and 450 W (mean PO difference -1.2 +/- 1.3 %) when it is compared to the scientific SRM model, but less validity for the maximal PO during sprint exercise, where the validity appears to depend on the gear ratio. The reliability of the PowerTap during the sub-maximal intensities is similar to the scientific SRM model (the coefficient of variation is respectively 0.9 to 2.9 % and 0.7 to 2.1 % for PowerTap and SRM). The PowerTap must be considered as a suitable device for PO measurements during sub-maximal real road cycling and in sub-maximal laboratory tests.

40 CFR 761.395 - A validation study.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 40 Protection of Environment 32 2013-07-01 2013-07-01 false A validation study. 761.395 Section...)(4) § 761.395 A validation study. (a) Decontaminate the following prepared sample surfaces using the... must be 10 µg/100 cm2, then the validation study failed and the solvent may not be used for...

40 CFR 761.395 - A validation study.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 40 Protection of Environment 31 2014-07-01 2014-07-01 false A validation study. 761.395 Section...)(4) § 761.395 A validation study. (a) Decontaminate the following prepared sample surfaces using the... must be 10 µg/100 cm2, then the validation study failed and the solvent may not be used for...

40 CFR 761.395 - A validation study.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 40 Protection of Environment 32 2012-07-01 2012-07-01 false A validation study. 761.395 Section...)(4) § 761.395 A validation study. (a) Decontaminate the following prepared sample surfaces using the... must be 10 µg/100 cm2, then the validation study failed and the solvent may not be used for...

Measurement of body temperature in adult patients: comparative study of accuracy, reliability and validity of different devices.

PubMed

Rubia-Rubia, J; Arias, A; Sierra, A; Aguirre-Jaime, A

2011-07-01

We compared a range of alternative devices with core body temperature measured at the pulmonary artery to identify the most valid and reliable instrument for measuring temperature in routine conditions in health services. 201 patients from the intensive care unit of the Candelaria University Hospital, Canary Islands, admitted to hospital between April 2006 and July 2007. All patients (or their families) gave informed consent. Readings from gallium-in-glass, reactive strip and digital in axilla, infra-red ear and frontal thermometers were compared with the pulmonary artery core temperature simultaneously. External factors suspected of having an influence on the differences were explored. The cut-off point readings for each thermometer were fixed for the maximum negative predictive value in comparison with the core temperature. The validity, reliability, accuracy, external influence, the waste they generated, ease of use, speed, durability, security, comfort and cost of each thermometer was evaluated. An ad hoc overall valuation score was obtained from these parameters for each instrument. For an error of ± 0.2°C and concordance with respect to fever, the gallium-in-glass thermometer gave the best results. The largest area under the receiver operating characteristic (ROC) curve is obtained by the digital axillar thermometer with probe (0.988 ± 0.007). The minimum difference between readings was given by the infrared ear thermometer, in comparison with the core temperature (-0.1 ± 0.3°C). Age, weight, level of conscience, male sex, environmental temperature and vaso-constrictor medication increases the difference in the readings and fever treatment reduces it, although this is not the same for all thermometers. The compact digital axillar thermometer and the digital thermometer with probe obtained the highest overall valuation score. If we only evaluate the aspects of validity, reliability, accuracy and external influence, the best thermometer would be the

Using standardised patients to measure physicians' practice: validation study using audio recordings

PubMed Central

Luck, Jeff; Peabody, John W

2002-01-01

Objective To assess the validity of standardised patients to measure the quality of physicians' practice. Design Validation study of standardised patients' assessments. Physicians saw unannounced standardised patients presenting with common outpatient conditions. The standardised patients covertly tape recorded their visit and completed a checklist of quality criteria immediately afterwards. Their assessments were compared against independent assessments of the recordings by a trained medical records abstractor. Setting Four general internal medicine primary care clinics in California. Participants 144 randomly selected consenting physicians. Main outcome measures Rates of agreement between the patients' assessments and independent assessment. Results 40 visits, one per standardised patient, were recorded. The overall rate of agreement between the standardised patients' checklists and the independent assessment of the audio transcripts was 91% (κ=0.81). Disaggregating the data by medical condition, site, level of physicians' training, and domain (stage of the consultation) gave similar rates of agreement. Sensitivity of the standardised patients' assessments was 95%, and specificity was 85%. The area under the receiver operator characteristic curve was 90%. Conclusions Standardised patients' assessments seem to be a valid measure of the quality of physicians' care for a variety of common medical conditions in actual outpatient settings. Properly trained standardised patients compare well with independent assessment of recordings of the consultations and may justify their use as a “gold standard” in comparing the quality of care across sites or evaluating data obtained from other sources, such as medical records and clinical vignettes. What is already known on this topicStandardised patients are valid and reliable reporters of physicians' practice in the medical education settingHowever, validating standardised patients' measurements of quality of care in

40 CFR 761.392 - Preparing validation study samples.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 40 Protection of Environment 30 2010-07-01 2010-07-01 false Preparing validation study samples..., AND USE PROHIBITIONS Comparison Study for Validating a New Performance-Based Decontamination Solvent Under § 761.79(d)(4) § 761.392 Preparing validation study samples. (a)(1) To validate a procedure to...

40 CFR 761.392 - Preparing validation study samples.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 40 Protection of Environment 31 2011-07-01 2011-07-01 false Preparing validation study samples..., AND USE PROHIBITIONS Comparison Study for Validating a New Performance-Based Decontamination Solvent Under § 761.79(d)(4) § 761.392 Preparing validation study samples. (a)(1) To validate a procedure to...

29 CFR 1607.5 - General standards for validity studies.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 29 Labor 4 2010-07-01 2010-07-01 false General standards for validity studies. 1607.5 Section 1607... studies. A. Acceptable types of validity studies. For the purposes of satisfying these guidelines, users may rely upon criterion-related validity studies, content validity studies or construct validity...

Comparative Study of Intramedullary Hammertoe Fixation.

PubMed

Obrador, Caterina; Losa-Iglesias, Marta; Becerro-de-Bengoa-Vallejo, Ricardo; Kabbash, Christina A

2018-04-01

Temporary Kirschner wire fixation (K-wire) is a widely used, low-cost fixation method for the correction of hammertoe deformity. Reported complications associated with K-wires prompted the development of new implants over the past decade. However, there is a lack of literature on comparative studies analyzing functional outcomes using validated questionnaires. The purpose of this study was to analyze functional outcomes in patients who had undergone proximal interphalangeal joint fusion using 2 types of intramedullary implant, the Smart Toe and the TenFuse, and to compare them with the outcomes in patients treated with standard K-wire fixation. A retrospective review of operative hammertoe correction by a single surgeon was performed in 96 patients followed for more than 12 months. Functional outcome was assessed using the Foot Function Index (FFI), the Short Form 36 (SF-36), and the 10-point visual analog scale (VAS) validated questionnaires. Complications and fusion rates were also evaluated. Several patients in the study underwent corrections in different toes; thus, a total of 186 toes were included in the study. From these, 65 toes (34.9%) were treated with K-wire fixation, 94 (50.5%) with Smart Toe titanium implant, and 27 (14.5%) with TenFuse allograft implant. No statistically significant differences in functional outcome and incidence of complications were observed among the 3 fixation groups, although the 2 intramedullary implants were associated with greater fusion rates and patient satisfaction. Breakage of the Smart Toe implant was significantly higher than that of the other fixations, with 10.6% of implants breaking within the first year postoperatively. SF-36 and VAS scores decreased 12 months after surgery for the 3 types of fixation, with no statistically significant differences observed. The use of Smart Toe and TenFuse implants provided operative outcomes comparable to those obtained using a K-wire fixation and slightly better patient

[Validation of the German version of the Oxford Elbow Score : A cross-sectional study].

PubMed

Marquardt, J; Schöttker-Königer, T; Schäfer, A

2016-08-01

Elbow complaints are complex problems leading to severe consequences for affected people and the healthcare system. The German version of the Oxford Elbow Score (OES) is the first German-speaking instrument that specifically measures elbow complaints from the patient's perspective and changes of their health status. The aim of this study is the validation of the German version of the OES. In this context the internal consistency and the construct validity were investigated. 59 patients with elbow complaints completed the German version of the OES, the DASH and the SF-36 in a cross-sectional study. The internal consistency was calculated with Cronbach's alpha coefficients. Spearman's correlation coefficients were used to confirm construct validity. Cronbach's alpha for pain, function and psychological subscales was 0.88, 0.81 and 0.90, respectively. The whole questionnaire presents a Cronbach's alpha value of 0.93. Convergent construct validity was confirmed with correlation coefficients containing values of -0.84, -0.77 and -0.82 compared to DASH and values ranging from 0.41 to 0.80 compared with the physical domains of the SF-36. The divergent construct validity presented values ranging from 0.07 to 0.20 with the SF-36 domains of "general health perception" and "mental health". The German OES is an internal consistent instrument with good convergent and divergent construct validity. Other aspects of the validity, the reliability and the responsiveness should be confirmed through further studies.

Measuring striving for understanding and learning value of geometry: a validity study

NASA Astrophysics Data System (ADS)

Ubuz, Behiye; Aydınyer, Yurdagül

2017-11-01

The current study aimed to construct a questionnaire that measures students' personality traits related to striving for understanding and learning value of geometry and then examine its psychometric properties. Through the use of multiple methods on two independent samples of 402 and 521 middle school students, two studies were performed to address this issue to provide support for its validity. In Study 1, exploratory factor analysis indicated the two-factor model. In Study 2, confirmatory factor analysis indicated the better fit of two-factor model compared to one or three-factor model. Convergent and discriminant validity evidence provided insight into the distinctiveness of the two factors. Subgroup validity evidence revealed gender differences for striving for understanding geometry trait favouring girls and grade level differences for learning value of geometry trait favouring the sixth- and seventh-grade students. Predictive validity evidence demonstrated that the striving for understanding geometry trait but not learning value of geometry trait was significantly correlated with prior mathematics achievement. In both studies, each factor and the entire questionnaire showed satisfactory reliability. In conclusion, the questionnaire was psychometrically sound.

Comparing Derived and Actual Upwelling Longwave Measurements at the CERES Ocean Validation Experiment (COVE)

NASA Astrophysics Data System (ADS)

Fabbri, B. E.; Schuster, G. L.; Denn, F. M.; Arduini, R. F.; Madigan, J. J.

2017-12-01

One of the parameters measured from the Clouds and the Earth's Radiant Energy System (CERES) satellite is Earth emitted or longwave (LW) radiation. One validation site to compare this quantity is the CERES Ocean Validation Experiment (COVE), located at Chesapeake Light Station, approximately 25 kilometers east of Virginia Beach, Virginia (coordinates: 36.90N, 75.71W). However, the upwelling measurement is complicated due to the Light Station tower being in the LW instruments field of view. A negative outcome of the tower being in the field of view is a tower radiating effect, especially noticeable on clear, sunny days. During these days, the tower tends to heat up and radiate extra heat energy that is measured by the LW instrument. To understand the extent of the problem, we derive upwelling longwave measurements at the surface using sea surface temperature, air temperature, and dewpoint to compare with the actual longwave measurement made with an Eppley Laboratory pyrgeometer. The data used in this study is over a four-year period (2009-2012). One result using only nighttime data (range: 15.0 =< sa <= 55.0) shows the relative error between actual versus derived being low. The resultant statistics produced a mean, median, standard deviation and standard error to be -0.378, -0.14, 1.906 and 0.005 respectively. This low error is not too surprising since there is no solar insolation creating the tower radiating effect. Other results comparing the diurnal scope are analyzed and presented.

Performing a Content Validation Study.

ERIC Educational Resources Information Center

Spool, Mark D.

Content validity is concerned with three components: (1) the job content; (2) the test content, and (3) the strength of the relationship between the two. A content validation study, to be considered adequate and defensible should include at least the following four procedures: (1) A thorough and accurate job analysis (to define the job content);…

Use of Daily Phone Diary to study religiosity and mood: Convergent validity

PubMed Central

Szczesniak, Rhonda D.; Zou, Yuanshu; Dimitriou, Sophia M.; Quittner, Alexandra L.; Grossoehme, Daniel H.

2017-01-01

Studies of religious/spiritual behavior frequently rely on self-reported questionnaire data, which is susceptible to bias. The Daily Phone Diary (DPD) was developed to minimize bias in reporting activities and behavior across a 24-hour period. A cross-sectional study of 126 parents of children with cystic fibrosis was used to establish the validity of the DPD to study religious/spiritual behaviors. Longitudinal models were used to determine the odds of improved mood during religious/spiritual activities. Convergent validity was found. Participants had increased odds of improved mood during religious/spiritual activities compared to non-religious/spiritual activities. Associations with gender and religious affiliations were found. The DPD is a valid tool for studying religious/spiritual activities and opens novel avenues for chaplaincy research and the development of chaplaincy interventions incorporating these findings. PMID:27869567

Measuring Students' Writing Ability on a Computer-Analytic Developmental Scale: An Exploratory Validity Study

ERIC Educational Resources Information Center

Burdick, Hal; Swartz, Carl W.; Stenner, A. Jackson; Fitzgerald, Jill; Burdick, Don; Hanlon, Sean T.

2013-01-01

The purpose of the study was to explore the validity of a novel computer-analytic developmental scale, the Writing Ability Developmental Scale. On the whole, collective results supported the validity of the scale. It was sensitive to writing ability differences across grades and sensitive to within-grade variability as compared to human-rated…

Validation of cone-beam computed tomography and magnetic resonance imaging of the porcine spine: a comparative study with multidetector computed tomography and anatomical specimens.

PubMed

de Freitas, Ricardo Miguel Costa; Andrade, Celi Santos; Caldas, José Guilherme Mendes Pereira; Kanas, Alexandre Fligelman; Cabral, Richard Halti; Tsunemi, Miriam Harumi; Rodríguez, Hernán Joel Cervantes; Rabbani, Said Rahnamaye

2015-05-01

New spinal interventions or implants have been tested on ex vivo or in vivo porcine spines, as they are readily available and have been accepted as a comparable model to human cadaver spines. Imaging-guided interventional procedures of the spine are mostly based on fluoroscopy or, still, on multidetector computed tomography (MDCT). Cone-beam computed tomography (CBCT) and magnetic resonance imaging (MRI) are also available methods to guide interventional procedures. Although some MDCT data from porcine spines are available in the literature, validation of the measurements on CBCT and MRI is lacking. To describe and compare the anatomical measurements accomplished with MDCT, CBCT, and MRI of lumbar porcine spines to determine if CBCT and MRI are also useful methods for experimental studies. An experimental descriptive-comparative study. Sixteen anatomical measurements of an individual vertebra from six lumbar porcine spines (n=36 vertebrae) were compared with their MDCT, CBCT, and MRI equivalents. Comparisons were made for the absolute values of the parameters. Similarities were found in all imaging methods. Significant correlation (p<.05) was observed with all variables except those that included cartilaginous tissue from the end plates when the anatomical study was compared with the imaging methods. The CBCT and MRI provided imaging measurements of the lumbar porcine spines that were similar to the anatomical and MDCT data, and they can be useful for specific experimental research studies. Copyright © 2015 Elsevier Inc. All rights reserved.

Rediscovery rate estimation for assessing the validation of significant findings in high-throughput studies.

PubMed

Ganna, Andrea; Lee, Donghwan; Ingelsson, Erik; Pawitan, Yudi

2015-07-01

It is common and advised practice in biomedical research to validate experimental or observational findings in a population different from the one where the findings were initially assessed. This practice increases the generalizability of the results and decreases the likelihood of reporting false-positive findings. Validation becomes critical when dealing with high-throughput experiments, where the large number of tests increases the chance to observe false-positive results. In this article, we review common approaches to determine statistical thresholds for validation and describe the factors influencing the proportion of significant findings from a 'training' sample that are replicated in a 'validation' sample. We refer to this proportion as rediscovery rate (RDR). In high-throughput studies, the RDR is a function of false-positive rate and power in both the training and validation samples. We illustrate the application of the RDR using simulated data and real data examples from metabolomics experiments. We further describe an online tool to calculate the RDR using t-statistics. We foresee two main applications. First, if the validation study has not yet been collected, the RDR can be used to decide the optimal combination between the proportion of findings taken to validation and the size of the validation study. Secondly, if a validation study has already been done, the RDR estimated using the training data can be compared with the observed RDR from the validation data; hence, the success of the validation study can be assessed. © The Author 2014. Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Comparative validation of self-report measures of negative attitudes towards Aboriginal Australians and Torres Strait Islanders.

PubMed

Skinner, Timothy C; Blick, Julie; Coffin, Juli; Dudgeon, Pat; Forrest, Simon; Morrison, David

2013-01-01

This study sought to determine the construct validity of two self-report measures of attitudes towards Aboriginal Australians and Torres Strait Islanders against an implicit measure of attitude. Total of 102 volunteer participants completed the three measures in a randomized order. The explicit measures of prejudice towards Aboriginal Australians were the Modern Racism Scale (MRS) and the Attitudes Towards Indigenous Australians Scale (ATIAS). The implicit attitudes measure was an adaptation of the Implicit Association Test (IAT) and utilised simple drawn head-and-shoulder images of Aboriginal Australians and White Australians as the stimuli. Both explicit measures and implicit measure varied in the extent to which negative prejudicial attitudes were held by participants, and the corresponding construct validities were unimpressive. The MRS was significantly correlated with the IAT, (r =.314;p<.05) where the ATIAS was not significantly correlated with IAT scores (r =.12). Of the two self-report measures of attitudes towards Aboriginal Australians, only the MRS evidenced validity when compared with the use of an implicit attitude measure.

The Utility and Comparative Incremental Validity of the MMPI-2 and Trauma Symptom Inventory Validity Scales in the Detection of Feigned PTSD

ERIC Educational Resources Information Center

Efendov, Adele A.; Sellbom, Martin; Bagby, R. Michael

2008-01-01

The authors examined the comparative predictive capacity of the Trauma Symptom Inventory (TSI) Atypical Response Scale (ATR) and the standard set of Minnesota Multiphasic Personality Inventory-2 (MMPI-2) fake-bad validity scales (i.e., F, F[subscript B[prime

A French validation study of the Coma Recovery Scale-Revised (CRS-R).

PubMed

Schnakers, Caroline; Majerus, Steve; Giacino, Joseph; Vanhaudenhuyse, Audrey; Bruno, Marie-Aurelie; Boly, Melanie; Moonen, Gustave; Damas, Pierre; Lambermont, Bernard; Lamy, Maurice; Damas, Francois; Ventura, Manfredi; Laureys, Steven

2008-09-01

The aim of the present study was to explore the concurrent validity, inter-rater agreement and diagnostic sensitivity of a French adaptation of the Coma Recovery Scale-Revised (CRS-R) as compared to other coma scales such as the Glasgow Coma Scale (GCS), the Full Outline of UnResponsiveness scale (FOUR) and the Wessex Head Injury Matrix (WHIM). Multi-centric prospective study. To test concurrent validity and diagnostic sensitivity, the four behavioural scales were administered in a randomized order in 77 vegetative and minimally conscious patients. Twenty-four clinicians with different professional backgrounds, levels of expertise and CRS-R experience were recruited to assess inter-rater agreement. Good concurrent validity was obtained between the CRS-R and the three other standardized behavioural scales. Inter-rater reliability for the CRS-R total score and sub-scores was good, indicating that the scale yields reproducible findings across examiners and does not appear to be systematically biased by profession, level of expertise or CRS-R experience. Finally, the CRS-R demonstrated a significantly higher sensitivity to detect MCS patients, as compared to the GCS, the FOUR and the WHIM. The results show that the French version of the CRS-R is a valid and sensitive scale which can be used in severely brain damaged patients by all members of the medical staff.

Comparative study between EDXRF and ASTM E572 methods using two-way ANOVA

NASA Astrophysics Data System (ADS)

Krummenauer, A.; Veit, H. M.; Zoppas-Ferreira, J.

2018-03-01

Comparison with reference method is one of the necessary requirements for the validation of non-standard methods. This comparison was made using the experiment planning technique with two-way ANOVA. In ANOVA, the results obtained using the EDXRF method, to be validated, were compared with the results obtained using the ASTM E572-13 standard test method. Fisher's tests (F-test) were used to comparative study between of the elements: molybdenum, niobium, copper, nickel, manganese, chromium and vanadium. All F-tests of the elements indicate that the null hypothesis (Ho) has not been rejected. As a result, there is no significant difference between the methods compared. Therefore, according to this study, it is concluded that the EDXRF method was approved in this method comparison requirement.

Practical Aspects of Designing and Conducting Validation Studies Involving Multi-study Trials.

PubMed

Coecke, Sandra; Bernasconi, Camilla; Bowe, Gerard; Bostroem, Ann-Charlotte; Burton, Julien; Cole, Thomas; Fortaner, Salvador; Gouliarmou, Varvara; Gray, Andrew; Griesinger, Claudius; Louhimies, Susanna; Gyves, Emilio Mendoza-de; Joossens, Elisabeth; Prinz, Maurits-Jan; Milcamps, Anne; Parissis, Nicholaos; Wilk-Zasadna, Iwona; Barroso, João; Desprez, Bertrand; Langezaal, Ingrid; Liska, Roman; Morath, Siegfried; Reina, Vittorio; Zorzoli, Chiara; Zuang, Valérie

This chapter focuses on practical aspects of conducting prospective in vitro validation studies, and in particular, by laboratories that are members of the European Union Network of Laboratories for the Validation of Alternative Methods (EU-NETVAL) that is coordinated by the EU Reference Laboratory for Alternatives to Animal Testing (EURL ECVAM). Prospective validation studies involving EU-NETVAL, comprising a multi-study trial involving several laboratories or "test facilities", typically consist of two main steps: (1) the design of the validation study by EURL ECVAM and (2) the execution of the multi-study trial by a number of qualified laboratories within EU-NETVAL, coordinated and supported by EURL ECVAM. The approach adopted in the conduct of these validation studies adheres to the principles described in the OECD Guidance Document on the Validation and International Acceptance of new or updated test methods for Hazard Assessment No. 34 (OECD 2005). The context and scope of conducting prospective in vitro validation studies is dealt with in Chap. 4 . Here we focus mainly on the processes followed to carry out a prospective validation of in vitro methods involving different laboratories with the ultimate aim of generating a dataset that can support a decision in relation to the possible development of an international test guideline (e.g. by the OECD) or the establishment of performance standards.

A Validation Study of the Impression Replica Technique.

PubMed

Segerström, Sofia; Wiking-Lima de Faria, Johanna; Braian, Michael; Ameri, Arman; Ahlgren, Camilla

2018-04-17

To validate the well-known and often-used impression replica technique for measuring fit between a preparation and a crown in vitro. The validation consisted of three steps. First, a measuring instrument was validated to elucidate its accuracy. Second, a specimen consisting of male and female counterparts was created and validated by the measuring instrument. Calculations were made for the exact values of three gaps between the male and female. Finally, impression replicas were produced of the specimen gaps and sectioned into four pieces. The replicas were then measured with the use of a light microscope. The values received from measuring the specimen were then compared with the values received from the impression replicas, and the technique was thereby validated. The impression replica technique overvalued all measured gaps. Depending on location of the three measuring sites, the difference between the specimen and the impression replicas varied from 47 to 130 μm. The impression replica technique overestimates gaps within the range of 2% to 11%. The validation of the replica technique enables the method to be used as a reference when testing other methods for evaluating fit in dentistry. © 2018 by the American College of Prosthodontists.

Validity Studies of the Filial Anxiety Scale.

ERIC Educational Resources Information Center

Murray, Paul D.; And Others

1996-01-01

Factor analytic and construct validity studies were conducted to explore the validity of Cicirelli's 13-item Filial Anxiety Scale (FAS). The State-Trait Anxiety Inventory and the Marlowe-Crowne Social Desirability Scale were a part of the investigation. Results offer support for the validity of the FAS subscales and the FAS' usefulness as an…

Simulators' validation study: Problem solution logic

NASA Technical Reports Server (NTRS)

Schoultz, M. B.

1974-01-01

A study was conducted to validate the ground based simulators used for aircraft environment in ride-quality research. The logic to the approach for solving this problem is developed. The overall problem solution flow chart is presented. The factors which could influence the human response to the environment on board the aircraft are analyzed. The mathematical models used in the study are explained. The steps which were followed in conducting the validation tests are outlined.

Ethinylestradiol and levonorgestrel preparations on the Belgian market: a comparative study.

PubMed

Vanheusden, V; De Braekeleer, K; Corthout, J

2012-03-01

Preparations formulated as coated or film-coated tablets, containing levonorgestrel and the combination ethinylestradiol/levonorgestrel, were evaluated in a comparative study. This study comprised in vitro dissolution, assay and content uniformity. The analytical methods were previously validated according to international guidelines. All examined products complied with the postulated requirements.

Comparative validity of brief to medium-length Big Five and Big Six Personality Questionnaires.

PubMed

Thalmayer, Amber Gayle; Saucier, Gerard; Eigenhuis, Annemarie

2011-12-01

A general consensus on the Big Five model of personality attributes has been highly generative for the field of personality psychology. Many important psychological and life outcome correlates with Big Five trait dimensions have been established. But researchers must choose between multiple Big Five inventories when conducting a study and are faced with a variety of options as to inventory length. Furthermore, a 6-factor model has been proposed to extend and update the Big Five model, in part by adding a dimension of Honesty/Humility or Honesty/Propriety. In this study, 3 popular brief to medium-length Big Five measures (NEO Five Factor Inventory, Big Five Inventory [BFI], and International Personality Item Pool), and 3 six-factor measures (HEXACO Personality Inventory, Questionnaire Big Six Scales, and a 6-factor version of the BFI) were placed in competition to best predict important student life outcomes. The effect of test length was investigated by comparing brief versions of most measures (subsets of items) with original versions. Personality questionnaires were administered to undergraduate students (N = 227). Participants' college transcripts and student conduct records were obtained 6-9 months after data was collected. Six-factor inventories demonstrated better predictive ability for life outcomes than did some Big Five inventories. Additional behavioral observations made on participants, including their Facebook profiles and cell-phone text usage, were predicted similarly by Big Five and 6-factor measures. A brief version of the BFI performed surprisingly well; across inventory platforms, increasing test length had little effect on predictive validity. Comparative validity of the models and measures in terms of outcome prediction and parsimony is discussed.

Validation of self-reported anthropometrics in the Adventist Health Study 2

PubMed Central

2011-01-01

Background Relying on self-reported anthropometric data is often the only feasible way of studying large populations. In this context, there are no studies assessing the validity of anthropometrics in a mostly vegetarian population. The objective of this study was to evaluate the validity of self-reported anthropometrics in the Adventist Health Study 2 (AHS-2). Methods We selected a representative sample of 911 participants of AHS-2, a cohort of over 96,000 adult Adventists in the USA and Canada. Then we compared their measured weight and height with those self-reported at baseline. We calculated the validity of the anthropometrics as continuous variables, and as categorical variables for the definition of obesity. Results On average, participants underestimated their weight by 0.20 kg, and overestimated their height by 1.57 cm resulting in underestimation of body mass index (BMI) by 0.61 kg/m2. The agreement between self-reported and measured BMI (as a continuous variable), as estimated by intraclass correlation coefficient, was 0.97. The sensitivity of self-reported BMI to detect obesity was 0.81, the specificity 0.97, the predictive positive value 0.93, the predictive negative value 0.92, and the Kappa index 0.81. The percentage of absolute agreement for each category of BMI (normoweight, overweight, and obese) was 83.4%. After multivariate analyses, predictors of differences between self-reported and measured BMI were obesity, soy consumption and the type of dietary pattern. Conclusions Self-reported anthropometric data showed high validity in a representative subsample of the AHS-2 being valid enough to be used in epidemiological studies, although it can lead to some underestimation of obesity. PMID:21466678

Validation of self-reported anthropometrics in the Adventist Health Study 2.

PubMed

Bes-Rastrollo, Maira; Sabaté, Joan; Jaceldo-Siegl, Karen; Fraser, Gary E

2011-04-05

Relying on self-reported anthropometric data is often the only feasible way of studying large populations. In this context, there are no studies assessing the validity of anthropometrics in a mostly vegetarian population. The objective of this study was to evaluate the validity of self-reported anthropometrics in the Adventist Health Study 2 (AHS-2). We selected a representative sample of 911 participants of AHS-2, a cohort of over 96,000 adult Adventists in the USA and Canada. Then we compared their measured weight and height with those self-reported at baseline. We calculated the validity of the anthropometrics as continuous variables, and as categorical variables for the definition of obesity. On average, participants underestimated their weight by 0.20 kg, and overestimated their height by 1.57 cm resulting in underestimation of body mass index (BMI) by 0.61 kg/m(2). The agreement between self-reported and measured BMI (as a continuous variable), as estimated by intraclass correlation coefficient, was 0.97. The sensitivity of self-reported BMI to detect obesity was 0.81, the specificity 0.97, the predictive positive value 0.93, the predictive negative value 0.92, and the Kappa index 0.81. The percentage of absolute agreement for each category of BMI (normoweight, overweight, and obese) was 83.4%. After multivariate analyses, predictors of differences between self-reported and measured BMI were obesity, soy consumption and the type of dietary pattern. Self-reported anthropometric data showed high validity in a representative subsample of the AHS-2 being valid enough to be used in epidemiological studies, although it can lead to some underestimation of obesity.

Validation of Sleep-Tracking Technology Compared with Polysomnography in Adolescents

PubMed Central

de Zambotti, Massimiliano; Baker, Fiona C.; Colrain, Ian M.

2015-01-01

Study Objectives: To evaluate the accuracy in measuring nighttime sleep of a fitness tracker (Jawbone UP) compared to polysomnography (PSG). Design: Jawbone UP and PSG data were simultaneously collected from adolescents during an overnight laboratory recording. Agreements between Jawbone UP and PSG sleep outcomes were analyzed using paired t tests and Bland-Altman plots. Multiple regressions were used to investigate which PSG sleep measures predicted Jawbone UP “Sound sleep” and “Light sleep.” Setting: SRI International Human Sleep Laboratory. Participants: Sixty-five healthy adolescents (28 females, mean age ± standard deviation [SD]: 15.8 ± 2.5 y). Interventions: N/A. Measurements and Results: Outcomes showed good agreements between Jawbone UP and PSG for total sleep time (mean differences ± SD: −10.0 ± 20.5 min), sleep efficiency (mean differences ± SD: −1.9 ± 4.2 %), and wake after sleep onset (WASO) (mean differences ± SD: 10.6 ± 14.7 min). Overall, Jawbone UP overestimated PSG total sleep time and sleep efficiency and underestimated WASO but differences were small and, on average, did not exceed clinically meaningful cutoffs of > 30 min for total sleep time and > 5% for sleep efficiency. Multiple regression models showed that Jawbone UP “Sound sleep” measure was predicted by PSG time in N2 (β = 0.25), time in rapid eye movement (β = 0.29), and arousal index (β = −0.34). Jawbone UP “Light sleep” measure was predicted by PSG time in N2 (β = 0.48), time in N3 (β = 0.49), arousal index (β = 0.38) and awakening index (β = 0.28). Jawbone UP showed a progression from slight overestimation to underestimation of total sleep time and sleep efficiency with advancing age. All relationships were similar in boys and girls. Conclusions: Jawbone UP shows good agreement with polysomnography in measures of total sleep time and wake after sleep onset in adolescent boys and girls. Further validation is needed in other age groups and clinical

Validation of verbal autopsy methods using hospital medical records: a case study in Vietnam.

PubMed

Tran, Hong Thi; Nguyen, Hoa Phuong; Walker, Sue M; Hill, Peter S; Rao, Chalapati

2018-05-18

Information on causes of death (COD) is crucial for measuring the health outcomes of populations and progress towards the Sustainable Development Goals. In many countries such as Vietnam where the civil registration and vital statistics (CRVS) system is dysfunctional, information on vital events will continue to rely on verbal autopsy (VA) methods. This study assesses the validity of VA methods used in Vietnam, and provides recommendations on methods for implementing VA validation studies in Vietnam. This validation study was conducted on a sample of 670 deaths from a recent VA study in Quang Ninh province. The study covered 116 cases from this sample, which met three inclusion criteria: a) the death occurred within 30 days of discharge after last hospitalisation, and b) medical records (MRs) for the deceased were available from respective hospitals, and c) the medical record mentioned that the patient was terminally ill at discharge. For each death, the underlying cause of death (UCOD) identified from MRs was compared to the UCOD from VA. The validity of VA diagnoses for major causes of death was measured using sensitivity, specificity and positive predictive value (PPV). The sensitivity of VA was at least 75% in identifying some leading CODs such as stroke, road traffic accidents and several site-specific cancers. However, sensitivity was less than 50% for other important causes including ischemic heart disease, chronic obstructive pulmonary diseases, and diabetes. Overall, there was 57% agreement between UCOD from VA and MR, which increased to 76% when multiple causes from VA were compared to UCOD from MR. Our findings suggest that VA is a valid method to ascertain UCOD in contexts such as Vietnam. Furthermore, within cultural contexts in which patients prefer to die at home instead of a healthcare facility, using the available MRs as the gold standard may be meaningful to the extent that recall bias from the interval between last hospital discharge and death

Comparative assessment of bioanalytical method validation guidelines for pharmaceutical industry.

PubMed

Kadian, Naveen; Raju, Kanumuri Siva Rama; Rashid, Mamunur; Malik, Mohd Yaseen; Taneja, Isha; Wahajuddin, Muhammad

2016-07-15

The concepts, importance, and application of bioanalytical method validation have been discussed for a long time and validation of bioanalytical methods is widely accepted as pivotal before they are taken into routine use. United States Food and Drug Administration (USFDA) guidelines issued in 2001 have been referred for every guideline released ever since; may it be European Medical Agency (EMA) Europe, National Health Surveillance Agency (ANVISA) Brazil, Ministry of Health and Labour Welfare (MHLW) Japan or any other guideline in reference to bioanalytical method validation. After 12 years, USFDA released its new draft guideline for comments in 2013, which covers the latest parameters or topics encountered in bioanalytical method validation and approached towards the harmonization of bioanalytical method validation across the globe. Even though the regulatory agencies have general agreement, significant variations exist in acceptance criteria and methodology. The present review highlights the variations, similarities and comparison between bioanalytical method validation guidelines issued by major regulatory authorities worldwide. Additionally, other evaluation parameters such as matrix effect, incurred sample reanalysis including other stability aspects have been discussed to provide an ease of access for designing a bioanalytical method and its validation complying with the majority of drug authority guidelines. Copyright © 2016. Published by Elsevier B.V.

Using wound care algorithms: a content validation study.

PubMed

Beitz, J M; van Rijswijk, L

1999-09-01

Valid and reliable heuristic devices facilitating optimal wound care are lacking. The objectives of this study were to establish content validation data for a set of wound care algorithms, to identify their associated strengths and weaknesses, and to gain insight into the wound care decision-making process. Forty-four registered nurse wound care experts were surveyed and interviewed at national and regional educational meetings. Using a cross-sectional study design and an 83-item, 4-point Likert-type scale, this purposive sample was asked to quantify the degree of validity of the algorithms' decisions and components. Participants' comments were tape-recorded, transcribed, and themes were derived. On a scale of 1 to 4, the mean score of the entire instrument was 3.47 (SD +/- 0.87), the instrument's Content Validity Index was 0.86, and the individual Content Validity Index of 34 of 44 participants was > 0.8. Item scores were lower for those related to packing deep wounds (P < .001). No other significant differences were observed. Qualitative data analysis revealed themes of difficulty associated with wound assessment and care issues, that is, the absence of valid and reliable definitions. The wound care algorithms studied proved valid. However, the lack of valid and reliable wound assessment and care definitions hinders optimal use of these instruments. Further research documenting their clinical use is warranted. Research-based practice recommendations should direct the development of future valid and reliable algorithms designed to help nurses provide optimal wound care.

Validating and comparing GNSS antenna calibrations

NASA Astrophysics Data System (ADS)

Kallio, Ulla; Koivula, Hannu; Lahtinen, Sonja; Nikkonen, Ville; Poutanen, Markku

2018-03-01

GNSS antennas have no fixed electrical reference point. The variation of the phase centre is modelled and tabulated in antenna calibration tables, which include the offset vector (PCO) and phase centre variation (PCV) for each frequency according to the elevations and azimuths of the incoming signal. Used together, PCV and PCO reduce the phase observations to the antenna reference point. The remaining biases, called the residual offsets, can be revealed by circulating and rotating the antennas on pillars. The residual offsets are estimated as additional parameters when combining the daily GNSS network solutions with full covariance matrix. We present a procedure for validating the antenna calibration tables. The dedicated test field, called Revolver, was constructed at Metsähovi. We used the procedure to validate the calibration tables of 17 antennas. Tables from the IGS and three different calibration institutions were used. The tests show that we were able to separate the residual offsets at the millimetre level. We also investigated the influence of the calibration tables from the different institutions on site coordinates by performing kinematic double-difference baseline processing of the data from one site with different antenna tables. We found small but significant differences between the tables.

Comparative validity of MMPI-2 and MCMI-II personality disorder classifications.

PubMed

Wise, E A

1996-06-01

Minnesota Multiphasic Personality Inventory-2 (MMPI-2) overlapping and nonoverlapping scales were demonstrated to perform comparably to their original MMPI forms. They were then evaluated for convergent and discriminant validity with the Million Clinical Multiaxial Inventory-II (MCMI-II) personality disorder scales. The MMPI-2 and MCMI-II personality disorder scales demonstrated convergent and discriminant coefficients similar to their original forms. However, the MMPI-2 personality scales classified significantly more of the sample as Dramatic, whereas the MCMI-II diagnosed more of the sample as Anxious. Furthermore, single-scale and 2-point code type classification rates were quite low, indicating that at the level of the individual, the personality disorder scales are not measuring comparable constructs. Hence, each instrument is providing similar and unique information, justifying their continued use together for the purpose of diagnosing personality disorders.

29 CFR 1607.7 - Use of other validity studies.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 29 Labor 4 2011-07-01 2011-07-01 false Use of other validity studies. 1607.7 Section 1607.7 Labor... EMPLOYEE SELECTION PROCEDURES (1978) General Principles § 1607.7 Use of other validity studies. A. Validity studies not conducted by the user. Users may, under certain circumstances, support the use of selection...

SAMICS Validation. SAMICS Support Study, Phase 3

NASA Technical Reports Server (NTRS)

1979-01-01

SAMICS provides a consistent basis for estimating array costs and compares production technology costs. A review and a validation of the SAMICS model are reported. The review had the following purposes: (1) to test the computational validity of the computer model by comparison with preliminary hand calculations based on conventional cost estimating techniques; (2) to review and improve the accuracy of the cost relationships being used by the model: and (3) to provide an independent verification to users of the model's value in decision making for allocation of research and developement funds and for investment in manufacturing capacity. It is concluded that the SAMICS model is a flexible, accurate, and useful tool for managerial decision making.

A new framework to enhance the interpretation of external validation studies of clinical prediction models.

PubMed

Debray, Thomas P A; Vergouwe, Yvonne; Koffijberg, Hendrik; Nieboer, Daan; Steyerberg, Ewout W; Moons, Karel G M

2015-03-01

It is widely acknowledged that the performance of diagnostic and prognostic prediction models should be assessed in external validation studies with independent data from "different but related" samples as compared with that of the development sample. We developed a framework of methodological steps and statistical methods for analyzing and enhancing the interpretation of results from external validation studies of prediction models. We propose to quantify the degree of relatedness between development and validation samples on a scale ranging from reproducibility to transportability by evaluating their corresponding case-mix differences. We subsequently assess the models' performance in the validation sample and interpret the performance in view of the case-mix differences. Finally, we may adjust the model to the validation setting. We illustrate this three-step framework with a prediction model for diagnosing deep venous thrombosis using three validation samples with varying case mix. While one external validation sample merely assessed the model's reproducibility, two other samples rather assessed model transportability. The performance in all validation samples was adequate, and the model did not require extensive updating to correct for miscalibration or poor fit to the validation settings. The proposed framework enhances the interpretation of findings at external validation of prediction models. Copyright © 2015 The Authors. Published by Elsevier Inc. All rights reserved.

Can hybrid hyaluronic acid represent a valid approach to treat rizoarthrosis? A retrospective comparative study.

PubMed

Tenti, Sara; Pascarelli, Nicola Antonio; Giannotti, Stefano; Galeazzi, Mauro; Giordano, Nicola; Fioravanti, Antonella

2017-11-13

Osteoarthritis (OA) of the trapeziometacarpal joint (TMJ) is a disabling condition with a significant impact on quality of life. The optimal management of hand OA requires a combination of non-pharmacological and pharmacological treatments that include intra-articular (i.a.) therapy. EULAR experts recommend corticosteroid injections in TMJ OA and underline the usefulness of hyaluronic acid (HA). The aim of this study was the assessment of the efficacy and tolerability of i.a. injections of a hybrid formulation of HA (Sinovial H-L®) in comparison to triamcinolone in patients with TMJ OA. This 6-months observational comparative study, retrospective analyzed the medical records of 100 patients with monolateral or bilateral TMJ OA, treated with two injections of Sinovial H-L® (Sinovial H-L Group) or of triamcinolone acetonide (Triamcinolone Group). Clinical assessments were recorded at the time of the first and second injection and after one, 3 and 6 months. The primary outcomes were the change in global pain on a Visual Analogue Scale (VAS) and in hand function evaluated by the Functional Index for Hand OA (FIHOA) from baseline to month 6. Secondary outcomes were the improvement of the duration of morning stiffness, Health Assessment Questionnaire (HAQ) and the Medical Outcomes Study 36-Item Short Form (SF-36). The comparison between the two groups of treatment were performed with the Wilcoxon rank-sum test for continuous variables and with chi-square or Fisher exact test for categorical variables. Statistical significance was set at p < 0.05. Both therapies provided effective pain relief and joint function improvement, but the benefits achieved were statistically significantly superior in the Sinovial H-L Group than the Triamcinolone Group after one month (p < 0.01) from the beginning of the therapy and during the 6-months follow-up (p < 0.001). Furthermore, Sinovial H-L® was associated with a significant decrease in the duration of morning stiffness

Comparing the nine-item Shared Decision-Making Questionnaire to the OPTION Scale - an attempt to establish convergent validity.

PubMed

Scholl, Isabelle; Kriston, Levente; Dirmaier, Jörg; Härter, Martin

2015-02-01

While there has been a clear move towards shared decision-making (SDM) in the last few years, the measurement of SDM-related constructs remains challenging. There has been a call for further psychometric testing of known scales, especially regarding validity aspects. To test convergent validity of the nine-item Shared Decision-Making Questionnaire (SDM-Q-9) by comparing it to the OPTION Scale. Cross-sectional study. Data were collected in outpatient care practices. Patients suffering from chronic diseases and facing a medical decision were included in the study. Consultations were evaluated using the OPTION Scale. Patients completed the SDM-Q-9 after the consultation. First, the internal consistency of both scales and the inter-rater reliability of the OPTION Scale were calculated. To analyse the convergent validity of the SDM-Q-9, correlation between the patient (SDM-Q-9) and expert ratings (OPTION Scale) was calculated. A total of 21 physicians provided analysable data of consultations with 63 patients. Analyses revealed good internal consistency of the SDM-Q-9 and limited internal consistency of the OPTION Scale. Inter-rater reliability of the latter was less than optimal. Association between the total scores of both instruments was weak with a Spearman correlation of r = 0.19 and did not reach statistical significance. By the use of the OPTION Scale convergent validity of the SDM-Q-9 could not be established. Several possible explanations for this result are discussed. This study shows that the measurement of SDM remains challenging. © 2012 John Wiley & Sons Ltd.

Validation study of an electronic method of condensed outcomes tools reporting in orthopaedics.

PubMed

Farr, Jack; Verma, Nikhil; Cole, Brian J

2013-12-01

Patient-reported outcomes (PRO) instruments are a vital source of data for evaluating the efficacy of medical treatments. Historically, outcomes instruments have been designed, validated, and implemented as paper-based questionnaires. The collection of paper-based outcomes information may result in patients becoming fatigued as they respond to redundant questions. This problem is exacerbated when multiple PRO measures are provided to a single patient. In addition, the management and analysis of data collected in paper format involves labor-intensive processes to score and render the data analyzable. Computer-based outcomes systems have the potential to mitigate these problems by reformatting multiple outcomes tools into a single, user-friendly tool.The study aimed to determine whether the electronic outcomes system presented produces results comparable with the test-retest correlations reported for the corresponding orthopedic paper-based outcomes instruments.The study is designed as a crossover study based on consecutive orthopaedic patients arriving at one of two designated orthopedic knee clinics.Patients were assigned to complete either a paper or a computer-administered questionnaire based on a similar set of questions (Knee injury and Osteoarthritis Outcome Score, International Knee Documentation Committee form, 36-Item Short Form survey, version 1, Lysholm Knee Scoring Scale). Each patient completed the same surveys using the other instrument, so that all patients had completed both paper and electronic versions. Correlations between the results from the two modes were studied and compared with test-retest data from the original validation studies.The original validation studies established test-retest reliability by computing correlation coefficients for two administrations of the paper instrument. Those correlation coefficients were all in the range of 0.7 to 0.9, which was deemed satisfactory. The present study computed correlation coefficients between

Validity of autorefractor based screening method for irregular astigmatism compared to the corneal topography- a cross sectional study.

PubMed

Galindo-Ferreiro, Alicia; De Miguel-Gutierrez, Julita; González-Sagrado, Manuel; Galvez-Ruiz, Alberto; Khandekar, Rajiv; Schellini, Silvana; Galindo-Alonso, Julio

2017-01-01

To present a method of screening for irregular astigmatism with an autorefractor and its determinants compared to corneal topography. This cross-sectional validity study was conducted in 2013 at an eye hospital in Spain. A tabletop autorefractor (test 1) was used to measure the refractive status of the anterior surface of the cornea at two corneal meridians of each eye. Then corneal topography (test 2) and Bogan's classification was used to group eyes into those with regular or no astigmatism (GRI) and irregular astigmatism (GRII). Test 1 provided a single absolute value for the greatest cylinder difference (Vr). The receiver operating characteristic (ROC) were plotted for the Vr values measured by test 1 for GRI and GRII eyes. On the basis a Vr value of 1.25 D as cut off, sensitivity, specificity were also calculated. The study sample was comprised of 260 eyes (135 patients). The prevalence of irregular astigmatism was 42% [95% confidence interval (CI): 36, 48]. Based on test 2, there were 151 eyes in GRI and 109 eyes in GRII. The median Vr was 0.75 D (25% quartile, 0.5 D) for GRI and 1.75 D (25% quartile, 1.25 D) for GRII. The area under curve was 0.171 for GRI and 0.83 for GRII. The sensitivity of test I was 78.1% and the specificity was 76.1%. A conventional autorefractor can be effective as a first level screening method to detect irregular corneal astigmatism in places where corneal topography facilities are not available.

CANFOR Portuguese version: validation study.

PubMed

Talina, Miguel; Thomas, Stuart; Cardoso, Ana; Aguiar, Pedro; Caldas de Almeida, Jose M; Xavier, Miguel

2013-05-30

The increase in prisoner population is a troublesome reality in several regions of the world. Along with this growth there is increasing evidence that prisoners have a higher proportion of mental illnesses and suicide than the general population. In order to implement strategies that address criminal recidivism and the health and social status of prisoners, particularly in mental disordered offenders, it is necessary to assess their care needs in a comprehensive, but individual perspective. This assessment must include potential harmful areas like comorbid personality disorder, substance misuse and offending behaviours. The Camberwell Assessment of Need - Forensic Version (CANFOR) has proved to be a reliable tool designed to accomplish such aims. The present study aimed to validate the CANFOR Portuguese version. The translation, adaptation to the Portuguese context, back-translation and revision followed the usual procedures. The sample comprised all detainees receiving psychiatric care in four forensic facilities, over a one year period. A total of 143 subjects, and respective case manager, were selected. The forensic facilities were chosen by convenience: one prison hospital psychiatric ward (n=68; 47.6%), one male (n=24; 16.8%) and one female (n=22; 15.4%) psychiatric clinic and one civil security ward (n=29; 20.3%), all located nearby Lisbon. Basic descriptive statistics and Kappa weighted coefficients were calculated for the inter-rater and the test-retest reliability studies. The convergent validity was evaluated using the Global Assessment of Functioning and the Brief Psychiatric Rating Scale scores. The majority of the participants were male and single, with short school attendance, and accused of a crime involving violence against persons. The most frequent diagnosis was major depression (56.1%) and almost half presented positive suicide risk. The reliability study showed average Kappa weighted coefficients of 0.884 and 0.445 for inter-rater and test

Evaluation of three different validation procedures regarding the accuracy of template-guided implant placement: an in vitro study.

PubMed

Vasak, Christoph; Strbac, Georg D; Huber, Christian D; Lettner, Stefan; Gahleitner, André; Zechner, Werner

2015-02-01

The study aims to evaluate the accuracy of the NobelGuide™ (Medicim/Nobel Biocare, Göteborg, Sweden) concept maximally reducing the influence of clinical and surgical parameters. Moreover, the study was to compare and validate two validation procedures versus a reference method. Overall, 60 implants were placed in 10 artificial edentulous mandibles according to the NobelGuide™ protocol. For merging the pre- and postoperative DICOM data sets, three different fusion methods (Triple Scan Technique, NobelGuide™ Validation software, and AMIRA® software [VSG - Visualization Sciences Group, Burlington, MA, USA] as reference) were applied. Discrepancies between the virtual and the actual implant positions were measured. The mean deviations measured with AMIRA® were 0.49 mm (implant shoulder), 0.69 mm (implant apex), and 1.98°mm (implant axis). The Triple Scan Technique as well as the NobelGuide™ Validation software revealed similar deviations compared with the reference method. A significant correlation between angular and apical deviations was seen (r = 0.53; p < .001). A greater implant diameter was associated with greater deviations (p = .03). The Triple Scan Technique as a system-independent validation procedure as well as the NobelGuide™ Validation software are in accordance with the AMIRA® software. The NobelGuide™ system showed similar or less spatial and angular deviations compared with others. © 2013 Wiley Periodicals, Inc.

Parental infant jaundice colour card design successfully validated by comparing it with total serum bilirubin.

PubMed

Xue, Guo-Chang; Ren, Ming-Xing; Shen, Lin-Na; Zhang, Li-Wen

2016-12-01

We designed a jaundice colour card that could be used by the parents of neonates and validated it by comparing it with total serum bilirubin levels. There were 106 term Chinese neonates in the study. The majority weighed between 2500 g and 3499 g (63%) and had a gestational age of 37-40 weeks (77%). The jaundice colour card and photometric determination were used to screen for neonatal jaundice and compared with serum bilirubin. The bilirubin levels were measured by mothers using the jaundice colour card, and 67% of the measurements were taken at 11-20 days (range 3-30). The measurements at the infant's forehead, cheek and sternum showed strong correlations with total serum bilirubin. The mean differences between the total serum bilirubin and the jaundice colour card measurements from the forehead, cheek and sternum were 1.9 mg/dL, 0.3 mg/dL and 1.5 mg/dL, respectively. When total serum bilirubin >13 mg/dL was used as the cut-off point, the areas under the receiver operating characteristics curves were 0.934 for the forehead, 0.985 for the cheek and 0.966 for the sternum. We established the validity of the jaundice colour card as a parental measurement tool for jaundice in Chinese neonates, and the cheek was the best measurement site. ©2016 Foundation Acta Paediatrica. Published by John Wiley & Sons Ltd.

A semi-automatic method for left ventricle volume estimate: an in vivo validation study

NASA Technical Reports Server (NTRS)

Corsi, C.; Lamberti, C.; Sarti, A.; Saracino, G.; Shiota, T.; Thomas, J. D.

2001-01-01

This study aims to the validation of the left ventricular (LV) volume estimates obtained by processing volumetric data utilizing a segmentation model based on level set technique. The validation has been performed by comparing real-time volumetric echo data (RT3DE) and magnetic resonance (MRI) data. A validation protocol has been defined. The validation protocol was applied to twenty-four estimates (range 61-467 ml) obtained from normal and pathologic subjects, which underwent both RT3DE and MRI. A statistical analysis was performed on each estimate and on clinical parameters as stroke volume (SV) and ejection fraction (EF). Assuming MRI estimates (x) as a reference, an excellent correlation was found with volume measured by utilizing the segmentation procedure (y) (y=0.89x + 13.78, r=0.98). The mean error on SV was 8 ml and the mean error on EF was 2%. This study demonstrated that the segmentation technique is reliably applicable on human hearts in clinical practice.

The Validity and Precision of the Comparative Interrupted Time Series Design and the Difference-in-Difference Design in Educational Evaluation

ERIC Educational Resources Information Center

Somers, Marie-Andrée; Zhu, Pei; Jacob, Robin; Bloom, Howard

2013-01-01

In this paper, we examine the validity and precision of two nonexperimental study designs (NXDs) that can be used in educational evaluation: the comparative interrupted time series (CITS) design and the difference-in-difference (DD) design. In a CITS design, program impacts are evaluated by looking at whether the treatment group deviates from its…

Critical validation studies of neurofeedback.

PubMed

Gruzelier, John; Egner, Tobias

2005-01-01

The field of neurofeedback training has proceeded largely without validation. In this article the authors review studies directed at validating sensory motor rhythm, beta and alpha-theta protocols for improving attention, memory, and music performance in healthy participants. Importantly, benefits were demonstrable with cognitive and neurophysiologic measures that were predicted on the basis of regression models of learning to enhance sensory motor rhythm and beta activity. The first evidence of operant control over the alpha-theta ratio is provided, together with remarkable improvements in artistic aspects of music performance equivalent to two class grades in conservatory students. These are initial steps in providing a much needed scientific basis to neurofeedback.

Assessing reliability and validity measures in managed care studies.

PubMed

Montoya, Isaac D

2003-01-01

To review the reliability and validity literature and develop an understanding of these concepts as applied to managed care studies. Reliability is a test of how well an instrument measures the same input at varying times and under varying conditions. Validity is a test of how accurately an instrument measures what one believes is being measured. A review of reliability and validity instructional material was conducted. Studies of managed care practices and programs abound. However, many of these studies utilize measurement instruments that were developed for other purposes or for a population other than the one being sampled. In other cases, instruments have been developed without any testing of the instrument's performance. The lack of reliability and validity information may limit the value of these studies. This is particularly true when data are collected for one purpose and used for another. The usefulness of certain studies without reliability and validity measures is questionable, especially in cases where the literature contradicts itself

40 CFR 761.392 - Preparing validation study samples.

Code of Federal Regulations, 2014 CFR

2014-07-01

... establish a surface concentration to be included in the standard operating procedure. The surface levels of... Under § 761.79(d)(4) § 761.392 Preparing validation study samples. (a)(1) To validate a procedure to... surfaces must be ≥20 µg/100 cm2. (2) To validate a procedure to decontaminate a specified surface...

40 CFR 761.392 - Preparing validation study samples.

Code of Federal Regulations, 2012 CFR

2012-07-01

... establish a surface concentration to be included in the standard operating procedure. The surface levels of... Under § 761.79(d)(4) § 761.392 Preparing validation study samples. (a)(1) To validate a procedure to... surfaces must be ≥20 µg/100 cm2. (2) To validate a procedure to decontaminate a specified surface...

40 CFR 761.392 - Preparing validation study samples.

Code of Federal Regulations, 2013 CFR

2013-07-01

... establish a surface concentration to be included in the standard operating procedure. The surface levels of... Under § 761.79(d)(4) § 761.392 Preparing validation study samples. (a)(1) To validate a procedure to... surfaces must be ≥20 µg/100 cm2. (2) To validate a procedure to decontaminate a specified surface...

41 CFR 60-3.7 - Use of other validity studies.

Code of Federal Regulations, 2010 CFR

2010-07-01

... studies. 60-3.7 Section 60-3.7 Public Contracts and Property Management Other Provisions Relating to... of other validity studies. A. Validity studies not conducted by the user. Users may, under certain circumstances, support the use of selection procedures by validity studies conducted by other users or conducted...

41 CFR 60-3.7 - Use of other validity studies.

Code of Federal Regulations, 2011 CFR

2011-07-01

... studies. 60-3.7 Section 60-3.7 Public Contracts and Property Management Other Provisions Relating to... of other validity studies. A. Validity studies not conducted by the user. Users may, under certain circumstances, support the use of selection procedures by validity studies conducted by other users or conducted...

Comparative Ratings of the Utility of Portfolio Requirements: Toward Content Validity.

ERIC Educational Resources Information Center

McFarland, Jacqueline; Wisniewski, Shirley; Vermette, Paul

While the value of portfolio learning and assessment has gained much support from the educational community, many questions arise as specific implementations are attempted. This study examined one aspect, namely, the content validity of specific requirements, and addressed the question "How do various constituencies (methods students, student…

Three-factor structure for Epistemic Belief Inventory: A cross-validation study

PubMed Central

2017-01-01

Research on epistemic beliefs has been hampered by lack of validated models and measurement instruments. The most widely used instrument is the Epistemological Questionnaire, which has been criticized for validity, and it has been proposed a new instrument based in the Epistemological Questionnaire: the Epistemic Belief Inventory. The Spanish-language version of Epistemic Belief Inventory was applied to 1,785 Chilean high school students. Exploratory and confirmatory factor analyses in independent subsamples were performed. A three factor structure emerged and was confirmed. Reliability was comparable to other studies, and the factor structure was invariant among randomized subsamples. The structure that was found does not replicate the one proposed originally, but results are interpreted in light of embedded systemic model of epistemological beliefs. PMID:28278258

Improving machine learning reproducibility in genetic association studies with proportional instance cross validation (PICV).

PubMed

Piette, Elizabeth R; Moore, Jason H

2018-01-01

Machine learning methods and conventions are increasingly employed for the analysis of large, complex biomedical data sets, including genome-wide association studies (GWAS). Reproducibility of machine learning analyses of GWAS can be hampered by biological and statistical factors, particularly so for the investigation of non-additive genetic interactions. Application of traditional cross validation to a GWAS data set may result in poor consistency between the training and testing data set splits due to an imbalance of the interaction genotypes relative to the data as a whole. We propose a new cross validation method, proportional instance cross validation (PICV), that preserves the original distribution of an independent variable when splitting the data set into training and testing partitions. We apply PICV to simulated GWAS data with epistatic interactions of varying minor allele frequencies and prevalences and compare performance to that of a traditional cross validation procedure in which individuals are randomly allocated to training and testing partitions. Sensitivity and positive predictive value are significantly improved across all tested scenarios for PICV compared to traditional cross validation. We also apply PICV to GWAS data from a study of primary open-angle glaucoma to investigate a previously-reported interaction, which fails to significantly replicate; PICV however improves the consistency of testing and training results. Application of traditional machine learning procedures to biomedical data may require modifications to better suit intrinsic characteristics of the data, such as the potential for highly imbalanced genotype distributions in the case of epistasis detection. The reproducibility of genetic interaction findings can be improved by considering this variable imbalance in cross validation implementation, such as with PICV. This approach may be extended to problems in other domains in which imbalanced variable distributions are a concern.

Active-comparator design and new-user design in observational studies

PubMed Central

Yoshida, Kazuki; Solomon, Daniel H.; Kim, Seoyoung C.

2015-01-01

SUMMARY Over the past decade, an increasing number of observational studies have examined the effectiveness or safety of rheumatoid arthritis treatments. However, unlike randomized controlled trials (RCTs), observational studies of drug effects face methodological challenges including confounding by indication. Two design principles - active comparator design and new user design can help mitigate such challenges in observational studies. To improve validity of study findings, observational studies should be designed in such a way that makes them more closely approximate RCTs. The active comparator design compares the drug of interest to another commonly used agent for the same indication, rather than a ‘non-user’ group. This principle helps select treatment groups similar in treatment indications (both measured and unmeasured characteristics). The new user design includes a cohort of patients from the time of treatment initiation, so that it can assess patients’ pretreatment characteristics and capture all events occurring anytime during follow-up. PMID:25800216

41 CFR 60-3.14 - Technical standards for validity studies.

Code of Federal Regulations, 2010 CFR

2010-07-01

... likely to affect validity differences; or that these factors are included in the design of the study and... construct validity is both an extensive and arduous effort involving a series of research studies, which... validity studies. 60-3.14 Section 60-3.14 Public Contracts and Property Management Other Provisions...

41 CFR 60-3.14 - Technical standards for validity studies.

Code of Federal Regulations, 2013 CFR

2013-07-01

... likely to affect validity differences; or that these factors are included in the design of the study and... construct validity is both an extensive and arduous effort involving a series of research studies, which... validity studies. 60-3.14 Section 60-3.14 Public Contracts and Property Management Other Provisions...

41 CFR 60-3.14 - Technical standards for validity studies.

Code of Federal Regulations, 2014 CFR

2014-07-01

... likely to affect validity differences; or that these factors are included in the design of the study and... construct validity is both an extensive and arduous effort involving a series of research studies, which... validity studies. 60-3.14 Section 60-3.14 Public Contracts and Property Management Other Provisions...

41 CFR 60-3.14 - Technical standards for validity studies.

Code of Federal Regulations, 2011 CFR

2011-07-01

... likely to affect validity differences; or that these factors are included in the design of the study and... construct validity is both an extensive and arduous effort involving a series of research studies, which... validity studies. 60-3.14 Section 60-3.14 Public Contracts and Property Management Other Provisions...

41 CFR 60-3.14 - Technical standards for validity studies.

Code of Federal Regulations, 2012 CFR

2012-07-01

... likely to affect validity differences; or that these factors are included in the design of the study and... construct validity is both an extensive and arduous effort involving a series of research studies, which... validity studies. 60-3.14 Section 60-3.14 Public Contracts and Property Management Other Provisions...

Development and validation of self-reported line drawings for assessment of knee malalignment and foot rotation: a cross-sectional comparative study

PubMed Central

2010-01-01

Background For large scale epidemiological studies clinical assessments and radiographs can be impractical and expensive to apply to more than just a sample of the population examined. The study objectives were to develop and validate two novel instruments for self-reported knee malalignment and foot rotation suitable for use in questionnaire studies of knee pain and osteoarthritis. Methods Two sets of line drawings were developed using similar methodology. Each instrument consisted of an explanatory question followed by a set of drawings showing straight alignment, then two each at 7.5° angulation and 15° angulation in the varus/valgus (knee) and inward/outward (foot) directions. Forty one participants undertaking a community study completed the instruments on two occasions. Participants were assessed once by a blinded expert clinical observer with demonstrated excellent reproducibility. Validity was assessed by sensitivity, specificity and likelihood ratio (LR) using the observer as the reference standard. Reliability was assessed using weighted kappa (κ). Knee malalignment was measured on 400 knee radiographs. General linear model was used to assess for the presence of a linear increase in knee alignment angle (measured medially) from self-reported severe varus to mild varus, straight, mild valgus and severe valgus deformity. Results Observer reproducibility (κ) was 0.89 and 0.81 for the knee malalignment and foot rotation instruments respectively. Self-reported participant reproducibility was also good for the knee (κ 0.73) and foot (κ 0.87) instruments. Validity was excellent for the knee malalignment instrument, with a sensitivity of 0.74 (95%CI 0.54, 0.93) and specificity of 0.97 (95%CI 0.94, 1.00). Similarly the foot rotation instrument was also found to have high sensitivity (0.92, 95%CI 0.83, 1.01) and specificity (0.96, 95%CI 0.93, 1.00). The knee alignment angle increased progressively from self reported severe varus to mild varus, straight, mild

Evaluating the Evaluators: Comparative Study of High School Newspaper Critique Services.

ERIC Educational Resources Information Center

Davis, Nancy

High school publication staffs depend on national critique services as a major means of evaluation and recognition, but most have no measure of how one critique service compares to the others, because they can afford the entry fee for only one evaluation. Thus, a study was conducted to test the validity of three major national critique…

Screening for cognitive impairment in older individuals. Validation study of a computer-based test.

PubMed

Green, R C; Green, J; Harrison, J M; Kutner, M H

1994-08-01

This study examined the validity of a computer-based cognitive test that was recently designed to screen the elderly for cognitive impairment. Criterion-related validity was examined by comparing test scores of impaired patients and normal control subjects. Construct-related validity was computed through correlations between computer-based subtests and related conventional neuropsychological subtests. University center for memory disorders. Fifty-two patients with mild cognitive impairment by strict clinical criteria and 50 unimpaired, age- and education-matched control subjects. Control subjects were rigorously screened by neurological, neuropsychological, imaging, and electrophysiological criteria to identify and exclude individuals with occult abnormalities. Using a cut-off total score of 126, this computer-based instrument had a sensitivity of 0.83 and a specificity of 0.96. Using a prevalence estimate of 10%, predictive values, positive and negative, were 0.70 and 0.96, respectively. Computer-based subtests correlated significantly with conventional neuropsychological tests measuring similar cognitive domains. Thirteen (17.8%) of 73 volunteers with normal medical histories were excluded from the control group, with unsuspected abnormalities on standard neuropsychological tests, electroencephalograms, or magnetic resonance imaging scans. Computer-based testing is a valid screening methodology for the detection of mild cognitive impairment in the elderly, although this particular test has important limitations. Broader applications of computer-based testing will require extensive population-based validation. Future studies should recognize that normal control subjects without a history of disease who are typically used in validation studies may have a high incidence of unsuspected abnormalities on neurodiagnostic studies.

Robotic suturing on the FLS model possesses construct validity, is less physically demanding, and is favored by more surgeons compared with laparoscopy.

PubMed

Stefanidis, Dimitrios; Hope, William W; Scott, Daniel J

2011-07-01

The value of robotic assistance for intracorporeal suturing is not well defined. We compared robotic suturing with laparoscopic suturing on the FLS model with a large cohort of surgeons. Attendees (n=117) at the SAGES 2006 Learning Center robotic station placed intracorporeal sutures on the FLS box-trainer model using conventional laparoscopic instruments and the da Vinci® robot. Participant performance was recorded using a validated objective scoring system, and a questionnaire regarding demographics, task workload, and suturing modality preference was completed. Construct validity for both tasks was assessed by comparing the performance scores of subjects with various levels of experience. A validated questionnaire was used for workload measurement. Of the participants, 84% had prior laparoscopic and 10% prior robotic suturing experience. Within the allotted time, 83% of participants completed the suturing task laparoscopically and 72% with the robot. Construct validity was demonstrated for both simulated tasks according to the participants' advanced laparoscopic experience, laparoscopic suturing experience, and self-reported laparoscopic suturing ability (p<0.001 for all) and according to prior robotic experience, robotic suturing experience, and self-reported robotic suturing ability (p<0.001 for all), respectively. While participants achieved higher suturing scores with standard laparoscopy compared with the robot (84±75 vs. 56±63, respectively; p<0.001), they found the laparoscopic task more physically demanding (NASA score 13±5 vs. 10±5, respectively; p<0.001) and favored the robot as their method of choice for intracorporeal suturing (62 vs. 38%, respectively; p<0.01). Construct validity was demonstrated for robotic suturing on the FLS model. Suturing scores were higher using standard laparoscopy likely as a result of the participants' greater experience with laparoscopic suturing versus robotic suturing. Robotic assistance decreases the physical

41 CFR 60-3.5 - General standards for validity studies.

Code of Federal Regulations, 2010 CFR

2010-07-01

... should avoid making employment decisions on the basis of measures of knowledges, skills, or abilities... General standards for validity studies. A. Acceptable types of validity studies. For the purposes of... of these guidelines, section 14 of this part. New strategies for showing the validity of selection...

The Clinical Impression of Severity Index for Parkinson's Disease: international validation study.

PubMed

Martínez-Martín, Pablo; Rodríguez-Blázquez, Carmen; Forjaz, Maria João; de Pedro, Jesús

2009-01-30

This study sought to provide further information about the psychometric properties of the Clinical Impression of Severity Index for Parkinson's Disease (CISI-PD), in a large, international, cross-culturally diverse sample. Six hundred and fourteen patients with PD participated in the study. Apart from the CISI-PD, assessments were based on Hoehn & Yahr (HY) staging, the Scales for Outcomes in PD-Motor (SCOPA-M), -Cognition (SCOPA-COG) and -Psychosocial (SCOPA-PS), the Cumulative Illness Rating Scale-Geriatrics, and the Hospital Anxiety and Depression Scale. The total CISI-PD score displayed no floor or ceiling effects. Internal consistency was 0.81, the test-retest intraclass correlation coefficient was 0.84, and item homogeneity was 0.52. Exploratory and confirmatory factor analysis (CFI = 0.99, RMSEA = 0.07) confirmed CISI-PD's unifactorial structure. The CISI-PD showed adequate convergent validity with SCOPA-COG and SCOPA-M (r(S) = 0.46-0.85, respectively) and discriminative validity for HY stages and disease duration (P < 0.0001). In a multiple regression model, main CISI-PD predictors were SCOPA-M, disease duration, and depression. The results obtained were not only comparable to but also extended those yielded by the preliminary validation study, thus showing that the CISI-PD is a valid instrument to measure clinical impression of severity in PD. Its simplicity and easy application make it an attractive and useful tool for clinical practice and research.

Rasch analysis and impact factor methods both yield valid and comparable measures of health status in interstitial lung disease.

PubMed

Patel, Amit S; Siegert, Richard J; Bajwah, Sabrina; Brignall, Kate; Gosker, Harry R; Moxham, John; Maher, Toby M; Renzoni, Elisabetta A; Wells, Athol U; Higginson, Irene J; Birring, Surinder S

2015-09-01

Rasch analysis has largely replaced impact factor methodology for developing health status measures. The aim of this study was to develop a health status questionnaire for patients with interstitial lung disease (ILD) using impact factor methodology and to compare its validity with that of another version developed using Rasch analysis. A preliminary 71-item questionnaire was developed and evaluated in 173 patients with ILD. Items were reduced by the impact factor method (King's Brief ILD questionnaire, KBILD-I) and Rasch analysis (KBILD-R). Both questionnaires were validated by assessing their relationship with forced vital capacity (FVC) and St Georges Respiratory Questionnaire (SGRQ) and by evaluating internal reliability, repeatability, and longitudinal responsiveness. The KBILD-R and KBILD-I comprised 15 items each. The content of eight items differed between the KBILD-R and KBILD-I. Internal and test-retest reliability was good for total scores of both questionnaires. There was a good relationship with SGRQ and moderate relationship with FVC for both questionnaires. Effect sizes were comparable. Both questionnaires discriminated patients with differing disease severity. Despite considerable differences in the content of retained items, both KBILD-R and KBILD-I questionnaires demonstrated acceptable measurement properties and performed comparably in a clinical setting. Copyright © 2015 Elsevier Inc. All rights reserved.

The validity of the 4-Skills Scan: A double validation study.

PubMed

van Kernebeek, W G; de Kroon, M L A; Savelsbergh, G J P; Toussaint, H M

2018-06-01

Adequate gross motor skills are an essential aspect of a child's healthy development. Where physical education (PE) is part of the primary school curriculum, a strong curriculum-based emphasis on evaluation and support of motor skill development in PE is apparent. Monitoring motor development is then a task for the PE teacher. In order to fulfil this task, teachers need adequate tools. The 4-Skills Scan is a quick and easily manageable gross motor skill instrument; however, its validity has never been assessed. Therefore, the purpose of this study is to assess the construct and concurrent validity of both 4-Skills Scans (version 2007 and version 2015). A total of 212 primary school children (6 - 12 years old), was requested to participate in both versions of the 4-Skills Scan. For assessing construct validity, children covered an obstacle course with video recordings for observation by an expert panel. For concurrent validity, a comparison was made with the MABC-2, by calculating Pearson correlations. Multivariable linear regression analyses were performed to determine the contribution of each subscale to the construct of gross motor skills, according to the MABC-2 and the expert panel. Correlations between the 4-Skills Scans and expert valuations were moderate, with coefficients of .47 (version 2007) and .46 (version 2015). Correlations between the 4-Skills Scans and the MABC-2 (gross) were moderate (.56) for version 2007 and high (.64) for version 2015. It is concluded that both versions of the 4-Skills Scans are satisfactory valid instruments for assessing gross motor skills during PE lessons. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

"Lies, damned lies ..." and observational studies in comparative effectiveness research.

PubMed

Albert, Richard K

2013-06-01

A new federal initiative has allocated $1.1 billion to comparative effectiveness research, and many have emphasized the importance of including observational studies in this effort. The rationale for using observational studies to assess comparative effectiveness is based on concerns that randomized controlled trials (RCTs) are not "real world" because they enroll homogeneous patient populations, measure study outcomes that are not important to patients, use protocols that are overly complex, are conducted in specialized centers, and use study treatments that are not consistent with usual care, and that RCTs are not always feasible because of a lack of equipoise, the need to assess delayed endpoints, and concerns that they take years to complete and are expensive. This essay questions the validity of each of these proposed limitations, summarizes concerns raised about the accuracy of results generated by observational studies, provides some examples of discrepancies between results of observational studies and RCTs that pertain to pulmonary and critical care, and suggests that using observational studies for comparative effectiveness research may increase rather than decrease the cost of health care and may harm patients.

Validation Study of Maternal Recall on Breastfeeding Duration 6 Years After Childbirth.

PubMed

Amissah, Emma Ayorkor; Kancherla, Vijaya; Ko, Yi-An; Li, Ruowei

2017-05-01

Breastfeeding duration is an important indicator commonly measured in maternal and child health and nutrition research. Maternal short-term recall for both initiation and duration of breastfeeding has been shown to be valid; however, validity of long-term recall is not well understood. Research aim: This study aims to assess the validity of maternal recall of breastfeeding duration 6 years after childbirth and its association with sociodemographic factors. Among 635 mother-child pairs, breastfeeding duration data collected monthly throughout the 1st year after childbirth in the Infant Feeding Practices Study II (IFPS II) were compared to recall data obtained 6 years later during the Year 6 Follow-Up. The intraclass correlation coefficient (ICC) and Bland-Altman plots were examined to study the agreement between the two data sets. Sociodemographic factors associated with accurate recall to within 1 month of the IFPS II breastfeeding duration were assessed using multivariable logistic regression modeling. Maternal recall of breastfeeding duration was found to be valid 6 years after childbirth with a small median overall bias (1 week) toward overestimation. The overall concordance was high (ICC = 0.84), except for high school graduates (ICC = 0.63) and smokers (ICC = 0.61). Smokers (adjusted odds ratio = 0.52; 95% confidence interval [0.4, 0.8]) and multiparous women (adjusted odds ratio = 0.57; 95% confidence interval [0.4, 0.9]) were also less likely to give an accurate recall of their breastfeeding duration to within 1 month. Our study found that maternal recall of breastfeeding duration varies by sociodemographic factors but is accurate 6 years after childbirth.

The validity of transverse intermaxillary analysis by traditional PA cephalometry compared with cone-beam computed tomography.

PubMed

Cheung, Gordon; Goonewardene, Mithran Suresh; Islam, Syed Mohammed Shamsul; Murray, Kevin; Koong, Bernard

2013-05-01

To assess the validity of using jugale (J) and Antegonion (Ag) on Posterior-Anterior cephalograms (PAC) as landmarks for transverse intermaxillary analysis when compared with Cone Beam Computed Tomography (CBCT). Conventional PAC and CBCT images were taken of 28 dry skulls. Craniometric measurements between the bilateral landmarks, Antegonion and Jugale, were obtained from the skulls using a microscribe and recorded as the base standard. The corresponding andmarks were identified and measured on CBCT and PAC and compared with the base standard measurements. The accuracy and reliability of the measurements were statistically evaluated and the validity was assessed by comparing the ability of the two image modalities to accurately diagnose an arbitrarily selected J-J/Ag-Ag ratio. All measurements were repeated at least 7 weeks apart. Intra-class correlations (ICC) and Bland-Altman plots were used to analyse the data. All three methods were shown to be reliable as all had a mean error of less than 0.5 mm between repeated measurements. When compared with the base standard, CBCT measurements were shown to have higher agreement (ICC: 0.861-0.964) compared with measurements taken from PAC (ICC: 0.794-0.796). When the arbitrary J-J/Ag-Ag ratio was assessed, 18 per cent of cases were incorrectly diagnosed with a transverse discrepancy on the PAC compared with the CBCT which incorrectly diagnosed 8.7 per cent. CBCT was shown to be more reliable in assessing intermaxillary transverse discrepancy compared with PAC when using J-J/Ag-Ag ratios.

Improving medical record retrieval for validation studies in Medicare data.

PubMed

Wright, Nicole C; Delzell, Elizabeth S; Smith, Wilson K; Xue, Fei; Auroa, Tarun; Curtis, Jeffrey R

2017-04-01

The purpose of the study is to describe medical record retrieval for a study validating claims-based algorithms used to identify seven adverse events of special interest (AESI) in a Medicare population. We analyzed 2010-2011 Medicare claims of women with postmenopausal osteoporosis and men ≥65 years of age in the Medicare 5% national sample. The final cohorts included beneficiaries covered continuously for 12+ months by Medicare parts A, B, and D and not enrolled in Medicare Advantage before starting follow-up. We identified beneficiaries using each AESI algorithm and randomly selected 400 women and 100 men with each AESI for medical record retrieval. The Centers for Medicare and Medicaid Services provided beneficiary contact information, and we requested medical records directly from providers, without patient contact. We selected 3331 beneficiaries (women: 2272; men: 559) for whom we requested 3625 medical records. Overall, we received 1738 [47.9% (95%CI 46.3%, 49.6%)] of the requested medical records. We observed small differences in the characteristics of the total population with AESIs compared with those randomly selected for retrieval; however, no differences were seen between those selected and those retrieved. We retrieved 54.7% of records requested from hospitals compared with 26.3% of records requested from physician offices (p < 0.001). Retrieval did not differ by sex or vital status of the beneficiaries. Our national medical record validation study of claims-based algorithms produced a modest retrieval rate. The medical record procedures outlined in this paper could have led to the improved retrieval from our previous medical record retrieval study. Copyright © 2016 John Wiley & Sons, Ltd. Copyright © 2016 John Wiley & Sons, Ltd.

Validation of self-reported cannabis dose and potency: an ecological study.

PubMed

van der Pol, Peggy; Liebregts, Nienke; de Graaf, Ron; Korf, Dirk J; van den Brink, Wim; van Laar, Margriet

2013-10-01

To assess the reliability and validity of self-reported cannabis dose and potency measures. Cross-sectional study comparing self-reports with objective measures of amount of cannabis and delta-9-tetrahydrocannabinol (THC) concentration. Ecological study with assessments at participants' homes or in a coffee shop. Young adult frequent cannabis users (n = 106) from the Dutch Cannabis Dependence (CanDep) study. The objectively measured amount of cannabis per joint (dose in grams) was compared with self-reported estimates using a prompt card and average number of joints made from 1 g of cannabis. In addition, objectively assessed THC concentration in the participant's cannabis was compared with self-reported level of intoxication, subjective estimate of cannabis potency and price per gram of cannabis. Objective estimates of doses per joint (0.07-0.88 g/joint) and cannabis potency (1.1-24.7%) varied widely. Self-reported measures of dose were imprecise, but at group level, average dose per joint was estimated accurately with the number of joints made from 1 g [limit of agreement (LOA) = -0.02 g, 95% confidence interval (CI) = -0.29; 0.26], whereas the prompt card resulted in serious underestimation (LOA = 0.14 g, 95% CI = -0.10; 0.37). THC concentration in cannabis was associated with subjective potency ['average' 3.77% (P = 0.002) and '(very) strong' 5.13% more THC (P < 0.001) than '(very) mild' cannabis] and with cannabis price (about 1% increase in THC concentration per euro spent on 1 g of cannabis, P < 0.001), but not with level of intoxication. Self-report measures relating to cannabis use appear at best to be associated weakly with objective measures. Of the self-report measures, number of joints per gram, cannabis price and subjective potency have at least some validity. © 2013 Society for the Study of Addiction.

Validation of computer simulation training for esophagogastroduodenoscopy: Pilot study.

PubMed

Sedlack, Robert E

2007-08-01

Little is known regarding the value of esophagogastroduodenoscopy (EGD) simulators in education. The purpose of the present paper was to validate the use of computer simulation in novice EGD training. In phase 1, expert endoscopists evaluated various aspects of simulation fidelity as compared to live endoscopy. Additionally, computer-recorded performance metrics were assessed by comparing the recorded scores from users of three different experience levels. In phase 2, the transfer of simulation-acquired skills to the clinical setting was assessed in a two-group, randomized pilot study. The setting was a large gastroenterology (GI) Fellowship training program; in phase 1, 21 subjects (seven expert, intermediate and novice endoscopist), made up the three experience groups. In phase 2, eight novice GI fellows were involved in the two-group, randomized portion of the study examining the transfer of simulation skills to the clinical setting. During the initial validation phase, each of the 21 subjects completed two standardized EDG scenarios on a computer simulator and their performance scores were recorded for seven parameters. Following this, staff participants completed a questionnaire evaluating various aspects of the simulator's fidelity. Finally, four novice GI fellows were randomly assigned to receive 6 h of simulator-augmented training (SAT group) in EGD prior to beginning 1 month of patient-based EGD training. The remaining fellows experienced 1 month of patient-based training alone (PBT group). Results of the seven measured performance parameters were compared between three groups of varying experience using a Wilcoxon ranked sum test. The staffs' simulator fidelity survey used a 7-point Likert scale (1, very unrealistic; 4, neutral; 7, very realistic) for each of the parameters examined. During the second phase of this study, supervising staff rated both SAT and PBT fellows' patient-based performance daily. Scoring in each skill was completed using a 7-point

The JaCVAM international validation study on the in vivo comet assay: Selection of test chemicals.

PubMed

Morita, Takeshi; Uno, Yoshifumi; Honma, Masamitsu; Kojima, Hajime; Hayashi, Makoto; Tice, Raymond R; Corvi, Raffaella; Schechtman, Leonard

2015-07-01

The Japanese Center for the Validation of Alternative Methods (JaCVAM) sponsored an international prevalidation and validation study of the in vivo rat alkaline pH comet assay. The main objective of the study was to assess the sensitivity and specificity of the assay for correctly identifying genotoxic carcinogens, as compared with the traditional rat liver unscheduled DNA synthesis assay. Based on existing carcinogenicity and genotoxicity data and chemical class information, 90 chemicals were identified as primary candidates for use in the validation study. From these 90 chemicals, 46 secondary candidates and then 40 final chemicals were selected based on a sufficiency of carcinogenic and genotoxic data, differences in chemical class or genotoxic or carcinogenic mode of action (MOA), availability, price, and ease of handling. These 40 chemicals included 19 genotoxic carcinogens, 6 genotoxic non-carcinogens, 7 non-genotoxic carcinogens and 8 non-genotoxic non-carcinogens. "Genotoxicity" was defined as positive in the Ames mutagenicity test or in one of the standard in vivo genotoxicity tests (primarily the erythrocyte micronucleus assay). These chemicals covered various chemicals classes, MOAs, and genotoxicity profiles and were considered to be suitable for the purpose of the validation study. General principles of chemical selection for validation studies are discussed. Copyright © 2015 Elsevier B.V. All rights reserved.

Validation of Spanish versions of the Pelvic Floor Distress Inventory (PFDI) and Pelvic Floor Impact Questionnaire (PFIQ): a multicenter validation randomized study.

PubMed

Omotosho, Tola B; Hardart, Anne; Rogers, Rebecca G; Schaffer, Joseph I; Kobak, William H; Romero, Audrey A

2009-06-01

The purpose of this study is to validate Spanish versions of the Pelvic Floor Distress Inventory (PFDI) and Pelvic Floor Impact Questionnaire (PFIQ). Spanish versions were developed using back translation and validation was performed by randomizing bilingual women to complete the Spanish or English versions of the questionnaires first. Weighted kappa statistics assessed agreement for individual questions; interclass correlation coefficients (ICC) compared primary and subscale scores. Cronbach's alpha assessed internal consistency of Spanish versions. To detect a 2.7 point difference in scores with 80% power and alpha of 0.05, 44 bilingual subjects were required. Individual questions showed good to excellent agreement (kappa > 0.6) for all but eight questions on the PFIQ. ICCs of primary and subscale scores for both questionnaires showed excellent agreement. (All ICC > 0.79). All Cronbach's alpha values were excellent (>0.84) for the primary scales of both questionnaires. Valid and reliable Spanish versions of the PFIQ and PFDI have been developed.

29 CFR 1607.7 - Use of other validity studies.

Code of Federal Regulations, 2012 CFR

2012-07-01

... EMPLOYEE SELECTION PROCEDURES (1978) General Principles § 1607.7 Use of other validity studies. A. Validity studies not conducted by the user. Users may, under certain circumstances, support the use of selection... described in test manuals. While publishers of selection procedures have a professional obligation to...

29 CFR 1607.7 - Use of other validity studies.

Code of Federal Regulations, 2014 CFR

2014-07-01

... EMPLOYEE SELECTION PROCEDURES (1978) General Principles § 1607.7 Use of other validity studies. A. Validity studies not conducted by the user. Users may, under certain circumstances, support the use of selection... described in test manuals. While publishers of selection procedures have a professional obligation to...

29 CFR 1607.7 - Use of other validity studies.

Code of Federal Regulations, 2013 CFR

2013-07-01

... EMPLOYEE SELECTION PROCEDURES (1978) General Principles § 1607.7 Use of other validity studies. A. Validity studies not conducted by the user. Users may, under certain circumstances, support the use of selection... described in test manuals. While publishers of selection procedures have a professional obligation to...

Measuring Long-Distance Romantic Relationships: A Validity Study

ERIC Educational Resources Information Center

Pistole, M. Carole; Roberts, Amber

2011-01-01

This study investigated aspects of construct validity for the scores of a new long-distance romantic relationship measure. A single-factor structure of the long-distance romantic relationship index emerged, with convergent and discriminant evidence of external validity, high internal consistency reliability, and applied utility of the scores.…

The Self-Consciousness Scale: A Discriminant Validity Study

ERIC Educational Resources Information Center

Carver, Charles S.; Glass, David C.

1976-01-01

A validity study is conducted of the Self-Consciousness Scale components with male undergraduates. The components, Private and Public Self Consciousness and Social Anxiety did not correlate with any other measures used to establish their validity and thus seem to be independent of other measures tested. (Author/DEP)

Validation of new psychosocial factors questionnaires: a Colombian national study.

PubMed

Villalobos, Gloria H; Vargas, Angélica M; Rondón, Martin A; Felknor, Sarah A

2013-01-01

The study of workers' health problems possibly associated with stressful conditions requires valid and reliable tools for monitoring risk factors. The present study validates two questionnaires to assess psychosocial risk factors for stress-related illnesses within a sample of Colombian workers. The validation process was based on a representative sample survey of 2,360 Colombian employees, aged 18-70 years. Worker response rate was 90%; 46% of the responders were women. Internal consistency was calculated, construct validity was tested with factor analysis and concurrent validity was tested with Spearman correlations. The questionnaires demonstrated adequate reliability (0.88-0.95). Factor analysis confirmed the dimensions proposed in the measurement model. Concurrent validity resulted in significant correlations with stress and health symptoms. "Work and Non-work Psychosocial Factors Questionnaires" were found to be valid and reliable for the assessment of workers' psychosocial factors, and they provide information for research and intervention. Copyright © 2012 Wiley Periodicals, Inc.

A Systematic Review Comparing the Acceptability, Validity and Concordance of Discrete Choice Experiments and Best-Worst Scaling for Eliciting Preferences in Healthcare.

PubMed

Whitty, Jennifer A; Oliveira Gonçalves, Ana Sofia

2018-06-01

The aim of this study was to compare the acceptability, validity and concordance of discrete choice experiment (DCE) and best-worst scaling (BWS) stated preference approaches in health. A systematic search of EMBASE, Medline, AMED, PubMed, CINAHL, Cochrane Library and EconLit databases was undertaken in October to December 2016 without date restriction. Studies were included if they were published in English, presented empirical data related to the administration or findings of traditional format DCE and object-, profile- or multiprofile-case BWS, and were related to health. Study quality was assessed using the PREFS checklist. Fourteen articles describing 12 studies were included, comparing DCE with profile-case BWS (9 studies), DCE and multiprofile-case BWS (1 study), and profile- and multiprofile-case BWS (2 studies). Although limited and inconsistent, the balance of evidence suggests that preferences derived from DCE and profile-case BWS may not be concordant, regardless of the decision context. Preferences estimated from DCE and multiprofile-case BWS may be concordant (single study). Profile- and multiprofile-case BWS appear more statistically efficient than DCE, but no evidence is available to suggest they have a greater response efficiency. Little evidence suggests superior validity for one format over another. Participant acceptability may favour DCE, which had a lower self-reported task difficulty and was preferred over profile-case BWS in a priority setting but not necessarily in other decision contexts. DCE and profile-case BWS may be of equal validity but give different preference estimates regardless of the health context; thus, they may be measuring different constructs. Therefore, choice between methods is likely to be based on normative considerations related to coherence with theoretical frameworks and on pragmatic considerations related to ease of data collection.

A Validation Study of the Compressible Rayleigh–Taylor Instability Comparing the Ares and Miranda Codes

DOE Office of Scientific and Technical Information (OSTI.GOV)

Rehagen, Thomas J.; Greenough, Jeffrey A.; Olson, Britton J.

In this paper, the compressible Rayleigh–Taylor (RT) instability is studied by performing a suite of large eddy simulations (LES) using the Miranda and Ares codes. A grid convergence study is carried out for each of these computational methods, and the convergence properties of integral mixing diagnostics and late-time spectra are established. A comparison between the methods is made using the data from the highest resolution simulations in order to validate the Ares hydro scheme. We find that the integral mixing measures, which capture the global properties of the RT instability, show good agreement between the two codes at this resolution.more » The late-time turbulent kinetic energy and mass fraction spectra roughly follow a Kolmogorov spectrum, and drop off as k approaches the Nyquist wave number of each simulation. The spectra from the highest resolution Miranda simulation follow a Kolmogorov spectrum for longer than the corresponding spectra from the Ares simulation, and have a more abrupt drop off at high wave numbers. The growth rate is determined to be between around 0.03 and 0.05 at late times; however, it has not fully converged by the end of the simulation. Finally, we study the transition from direct numerical simulation (DNS) to LES. The highest resolution simulations become LES at around t/τ ≃ 1.5. Finally, to have a fully resolved DNS through the end of our simulations, the grid spacing must be 3.6 (3.1) times finer than our highest resolution mesh when using Miranda (Ares).« less

A Validation Study of the Compressible Rayleigh–Taylor Instability Comparing the Ares and Miranda Codes

DOE PAGES

Rehagen, Thomas J.; Greenough, Jeffrey A.; Olson, Britton J.

2017-04-20

In this paper, the compressible Rayleigh–Taylor (RT) instability is studied by performing a suite of large eddy simulations (LES) using the Miranda and Ares codes. A grid convergence study is carried out for each of these computational methods, and the convergence properties of integral mixing diagnostics and late-time spectra are established. A comparison between the methods is made using the data from the highest resolution simulations in order to validate the Ares hydro scheme. We find that the integral mixing measures, which capture the global properties of the RT instability, show good agreement between the two codes at this resolution.more » The late-time turbulent kinetic energy and mass fraction spectra roughly follow a Kolmogorov spectrum, and drop off as k approaches the Nyquist wave number of each simulation. The spectra from the highest resolution Miranda simulation follow a Kolmogorov spectrum for longer than the corresponding spectra from the Ares simulation, and have a more abrupt drop off at high wave numbers. The growth rate is determined to be between around 0.03 and 0.05 at late times; however, it has not fully converged by the end of the simulation. Finally, we study the transition from direct numerical simulation (DNS) to LES. The highest resolution simulations become LES at around t/τ ≃ 1.5. Finally, to have a fully resolved DNS through the end of our simulations, the grid spacing must be 3.6 (3.1) times finer than our highest resolution mesh when using Miranda (Ares).« less

Helping Students Evaluate the Validity of a Research Study.

ERIC Educational Resources Information Center

Morgan, George A.; Gliner, Jeffrey A.

Students often have difficulty in evaluating the validity of a study. A conceptually and linguistically meaningful framework for evaluating research studies is proposed that is based on the discussion of internal and external validity of T. D. Cook and D. T. Campbell (1979). The proposal includes six key dimensions, three related to internal…

JaCVAM-organized international validation study of the in vivo rodent alkaline comet assay for the detection of genotoxic carcinogens: I. Summary of pre-validation study results.

PubMed

Uno, Yoshifumi; Kojima, Hajime; Omori, Takashi; Corvi, Raffaella; Honma, Masamistu; Schechtman, Leonard M; Tice, Raymond R; Burlinson, Brian; Escobar, Patricia A; Kraynak, Andrew R; Nakagawa, Yuzuki; Nakajima, Madoka; Pant, Kamala; Asano, Norihide; Lovell, David; Morita, Takeshi; Ohno, Yasuo; Hayashi, Makoto

2015-07-01

The in vivo rodent alkaline comet assay (comet assay) is used internationally to investigate the in vivo genotoxic potential of test chemicals. This assay, however, has not previously been formally validated. The Japanese Center for the Validation of Alternative Methods (JaCVAM), with the cooperation of the U.S. NTP Interagency Center for the Evaluation of Alternative Toxicological Methods (NICEATM)/the Interagency Coordinating Committee on the Validation of Alternative Methods (ICCVAM), the European Centre for the Validation of Alternative Methods (ECVAM), and the Japanese Environmental Mutagen Society/Mammalian Mutagenesis Study Group (JEMS/MMS), organized an international validation study to evaluate the reliability and relevance of the assay for identifying genotoxic carcinogens, using liver and stomach as target organs. The ultimate goal of this validation effort was to establish an Organisation for Economic Co-operation and Development (OECD) test guideline. The purpose of the pre-validation studies (i.e., Phase 1 through 3), conducted in four or five laboratories with extensive comet assay experience, was to optimize the protocol to be used during the definitive validation study. Copyright © 2015 Elsevier B.V. All rights reserved.

Validation of a track repeating algorithm for intensity modulated proton therapy: clinical cases study

NASA Astrophysics Data System (ADS)

Yepes, Pablo P.; Eley, John G.; Liu, Amy; Mirkovic, Dragan; Randeniya, Sharmalee; Titt, Uwe; Mohan, Radhe

2016-04-01

Monte Carlo (MC) methods are acknowledged as the most accurate technique to calculate dose distributions. However, due its lengthy calculation times, they are difficult to utilize in the clinic or for large retrospective studies. Track-repeating algorithms, based on MC-generated particle track data in water, accelerate dose calculations substantially, while essentially preserving the accuracy of MC. In this study, we present the validation of an efficient dose calculation algorithm for intensity modulated proton therapy, the fast dose calculator (FDC), based on a track-repeating technique. We validated the FDC algorithm for 23 patients, which included 7 brain, 6 head-and-neck, 5 lung, 1 spine, 1 pelvis and 3 prostate cases. For validation, we compared FDC-generated dose distributions with those from a full-fledged Monte Carlo based on GEANT4 (G4). We compared dose-volume-histograms, 3D-gamma-indices and analyzed a series of dosimetric indices. More than 99% of the voxels in the voxelized phantoms describing the patients have a gamma-index smaller than unity for the 2%/2 mm criteria. In addition the difference relative to the prescribed dose between the dosimetric indices calculated with FDC and G4 is less than 1%. FDC reduces the calculation times from 5 ms per proton to around 5 μs.

Absorption in Sport: A Cross-Validation Study

PubMed Central

Koehn, Stefan; Stavrou, Nektarios A. M.; Cogley, Jeremy; Morris, Tony; Mosek, Erez; Watt, Anthony P.

2017-01-01

Absorption has been identified as readiness for experiences of deep involvement in the task. Conceptually, absorption is a key psychological construct, incorporating experiential, cognitive, and motivational components. Although, no operationalization of the construct has been provided to facilitate research in this area, the purpose of this research was the development and examination of the psychometric properties of a sport-specific measure of absorption that evolved from the use of the modified Tellegen Absorption Scale (MODTAS; Jamieson, 2005) in mainstream psychology. The study aimed to provide evidence of the psychometric properties, reliability, and validity of the Measure of Absorption in Sport Contexts (MASCs). The psychometric examination included a calibration sample from Scotland and a cross-validation sample from Australia using a cross-sectional design. The item pool was developed based on existing items from the modified Tellegen Absorption Scale (Jamieson, 2005). The MODTAS items were reworded and translated into a sport context. The Scottish sample consisted of 292 participants and the Australian sample of 314 participants. Congeneric model testing and confirmatory factor analysis for both samples and multi-group invariance testing across samples was used. In the cross-validation sample the MASC subscales showed acceptable internal consistency and construct reliability (≥0.70). Excellent fit indices were found for the final 18-item, six-factor measure in the cross-validation sample, χ(120)2 = 197.486, p < 0.001; CFI = 0.957; TLI = 0.945; RMSEA = 0.045; SRMR = 0.044. Multi-group invariance testing revealed no differences in item meaning, except for two items. The MASC and the Dispositional Flow Scale-2 showed moderate-to-strong positive correlations in both samples, r = 0.38, p < 0.001 and r = 0.42, p < 0.001, supporting the external validity of the MASC. This article provides initial evidence in support of the psychometric properties

Comparative Predictive Validity of the New MCAT Using Different Admissions Criteria.

ERIC Educational Resources Information Center

Golmon, Melton E.; Berry, Charles A.

1981-01-01

New Medical College Admission Test (MCAT) scores and undergraduate academic achievement were examined for their validity in predicting the performance of two select student populations at Northwestern University Medical School. The data support the hypothesis that New MCAT scores possess substantial predictive validity. (Author/MLW)

Validation study of the Colorado Learning Attitudes about Science Survey at a Hispanic-serving institution

NASA Astrophysics Data System (ADS)

Sawtelle, Vashti; Brewe, Eric; Kramer, Laird

2009-12-01

The Colorado Learning Attitudes about Science Survey (CLASS) has been widely acknowledged as a useful measure of student cognitive attitudes about science and learning. The initial University of Colorado validation study included only 20% non-Caucasian student populations. In this Brief Report we extend their validation to include a predominately under-represented minority population. We validated the CLASS instrument at Florida International University, a Hispanic-serving institution, by interviewing students in introductory physics classes using a semistructured protocol, examining students’ responses on the CLASS item statements, and comparing them to the items’ intended meaning. We find that in our predominately Hispanic population, 94% of the students’ interview responses indicate that the students interpret the CLASS items correctly, and thus the CLASS is a valid instrument. We also identify one potentially problematic item in the instrument which one third of the students interviewed consistently misinterpreted.

Comparative study on direct burning of oil shale and coal

NASA Astrophysics Data System (ADS)

Hammad, Ahmad; Al Asfar, Jamil

2017-07-01

A comparative study of the direct burning processes of oil shale and coal in a circulating fluidized bed (CFB) was done in this study using ANSYS Fluent software to solve numerically the governing equations of continuity, momentum, energy and mass diffusion using finite volume method. The model was built based on an existing experimental combustion burner unit. The model was validated by comparing the theoretical results of oil shale with proved experimental results from the combustion unit. It was found that the temperature contours of the combustion process showed that the adiabatic flame temperature was 1080 K for oil shale compared with 2260 K for coal, while the obtained experimental results of temperatures at various locations of burner during the direct burning of oil shale showed that the maximum temperature reached 962 K for oil shale. These results were used in economic and environmental analysis which show that oil shale may be used as alternative fuel for coal in cement industry in Jordan.

Verification, Validation and Sensitivity Studies in Computational Biomechanics

PubMed Central

Anderson, Andrew E.; Ellis, Benjamin J.; Weiss, Jeffrey A.

2012-01-01

Computational techniques and software for the analysis of problems in mechanics have naturally moved from their origins in the traditional engineering disciplines to the study of cell, tissue and organ biomechanics. Increasingly complex models have been developed to describe and predict the mechanical behavior of such biological systems. While the availability of advanced computational tools has led to exciting research advances in the field, the utility of these models is often the subject of criticism due to inadequate model verification and validation. The objective of this review is to present the concepts of verification, validation and sensitivity studies with regard to the construction, analysis and interpretation of models in computational biomechanics. Specific examples from the field are discussed. It is hoped that this review will serve as a guide to the use of verification and validation principles in the field of computational biomechanics, thereby improving the peer acceptance of studies that use computational modeling techniques. PMID:17558646

Validation study of Polar V800 accelerometer.

PubMed

Hernández-Vicente, Adrián; Santos-Lozano, Alejandro; De Cocker, Katrien; Garatachea, Nuria

2016-08-01

The correct quantification of physical activity (PA) and energy expenditure (EE) in daily life is an important target for researchers and professionals. The objective of this paper is to study the validity of the Polar V800 for the quantification of PA and the estimation of EE against the ActiGraph (ActiTrainer) in healthy young adults. Eighteen Caucasian active people (50% women) aged between 19-23 years wore an ActiTrainer on the right hip and a Polar V800 on the preferred wrist during 7 days. Paired samples t-tests were used to analyze differences in outcomes between devices, and Pearson's correlation coefficients to examine the correlation between outcomes. The agreement was studied using the Bland-Altman method. Also, the association between the difference and the magnitude of the measurement (heteroscedasticity) was examined. Sensitivity, specificity and area under the receiver operating characteristic curve (ROC-AUC value) were calculated to evaluate the ability of the devices to accurately define a person who fulfills the recommendation of 10,000 daily steps. The devices significantly differed from each other on all outcomes (P<0.05), except for Polar V800's alerts vs. ActiTrainer's 1 hour sedentary bouts (P=0.595) and Polar V800's walking time vs. ActiTrainer's lifestyle time (P=0.484). Heteroscedasticity analyses were significant for all outcomes, except for Kcal and sitting time. The ROC-AUC value was fair (0.781±0.048) and the sensitivity and specificity was 98% and 58%, respectively. The Polar V800 accelerometer has a comparable validity to the accelerometer in free-living conditions, regarding "1 hour sedentary bouts" and "V800's walking time vs. ActiTrainer's lifestyle time" in young adults.

California Diploma Project Technical Report III: Validity Study--Validity Study of the Health Sciences and Medical Technology Standards

ERIC Educational Resources Information Center

McGaughy, Charis; Bryck, Rick; de Gonzalez, Alicia

2012-01-01

This study is a validity study of the recently revised version of the Health Science Standards. The purpose of this study is to understand how the Health Science Standards relate to college and career readiness, as represented by survey ratings submitted by entry-level college instructors of health science courses and industry representatives. For…

Standard Setting Methods for Pass/Fail Decisions on High-Stakes Objective Structured Clinical Examinations: A Validity Study.

PubMed

Yousuf, Naveed; Violato, Claudio; Zuberi, Rukhsana W

2015-01-01

CONSTRUCT: Authentic standard setting methods will demonstrate high convergent validity evidence of their outcomes, that is, cutoff scores and pass/fail decisions, with most other methods when compared with each other. The objective structured clinical examination (OSCE) was established for valid, reliable, and objective assessment of clinical skills in health professions education. Various standard setting methods have been proposed to identify objective, reliable, and valid cutoff scores on OSCEs. These methods may identify different cutoff scores for the same examinations. Identification of valid and reliable cutoff scores for OSCEs remains an important issue and a challenge. Thirty OSCE stations administered at least twice in the years 2010-2012 to 393 medical students in Years 2 and 3 at Aga Khan University are included. Psychometric properties of the scores are determined. Cutoff scores and pass/fail decisions of Wijnen, Cohen, Mean-1.5SD, Mean-1SD, Angoff, borderline group and borderline regression (BL-R) methods are compared with each other and with three variants of cluster analysis using repeated measures analysis of variance and Cohen's kappa. The mean psychometric indices on the 30 OSCE stations are reliability coefficient = 0.76 (SD = 0.12); standard error of measurement = 5.66 (SD = 1.38); coefficient of determination = 0.47 (SD = 0.19), and intergrade discrimination = 7.19 (SD = 1.89). BL-R and Wijnen methods show the highest convergent validity evidence among other methods on the defined criteria. Angoff and Mean-1.5SD demonstrated least convergent validity evidence. The three cluster variants showed substantial convergent validity with borderline methods. Although there was a high level of convergent validity of Wijnen method, it lacks the theoretical strength to be used for competency-based assessments. The BL-R method is found to show the highest convergent validity evidences for OSCEs with other standard setting methods used in the present study

Validity and reproducibility of the ErgomoPro power meter compared with the SRM and Powertap power meters.

PubMed

Duc, Sebastien; Villerius, Vincent; Bertucci, William; Grappe, Frederic

2007-09-01

The ErgomoPro (EP) is a power meter that measures power output (PO) during outdoor and indoor cycling via 2 optoelectronic sensors located in the bottom bracket axis. The aim of this study was to determine the validity and the reproducibility of the EP compared with the SRM crank set and Powertap hub (PT). The validity of the EP was tested in the laboratory during 8 submaximal incremental tests (PO: 100 to 400 W), eight 30-min submaximal constant-power tests (PO = 180 W), and 8 sprint tests (PO > 750 W) and in the field during 8 training sessions (time: 181 +/- 73 min; PO: approximately 140 to 160 W). The reproducibility was assessed by calculating the coefficient of PO variation (CV) during the submaximal incremental and constant tests. The EP provided a significantly higher PO than the SRM and PT during the submaximal incremental test: The mean PO differences were +6.3% +/- 2.5% and +11.1% +/- 2.1% respectively. The difference was greater during field training sessions (+12.0% +/- 5.7% and +16.5% +/- 5.9%) but lower during sprint tests (+1.6% +/- 2.5% and +3.2% +/- 2.7%). The reproducibility of the EP is lower than those of the SRM and PT (CV = 4.1% +/- 1.8%, 1.9% +/- 0.4%, and 2.1% +/- 0.8%, respectively). The EP power meter appears less valid and reliable than the SRM and PT systems.

Addressing Participant Validity in a Small Internet Health Survey (The Restore Study): Protocol and Recommendations for Survey Response Validation

PubMed Central

Dewitt, James; Capistrant, Benjamin; Kohli, Nidhi; Mitteldorf, Darryl; Merengwa, Enyinnaya; West, William

2018-01-01

Background While deduplication and cross-validation protocols have been recommended for large Web-based studies, protocols for survey response validation of smaller studies have not been published. Objective This paper reports the challenges of survey validation inherent in a small Web-based health survey research. Methods The subject population was North American, gay and bisexual, prostate cancer survivors, who represent an under-researched, hidden, difficult-to-recruit, minority-within-a-minority population. In 2015-2016, advertising on a large Web-based cancer survivor support network, using email and social media, yielded 478 completed surveys. Results Our manual deduplication and cross-validation protocol identified 289 survey submissions (289/478, 60.4%) as likely spam, most stemming from advertising on social media. The basic components of this deduplication and validation protocol are detailed. An unexpected challenge encountered was invalid survey responses evolving across the study period. This necessitated the static detection protocol be augmented with a dynamic one. Conclusions Five recommendations for validation of Web-based samples, especially with smaller difficult-to-recruit populations, are detailed. PMID:29691203

Simulated Driving Assessment (SDA) for Teen Drivers: Results from a Validation Study

PubMed Central

McDonald, Catherine C.; Kandadai, Venk; Loeb, Helen; Seacrist, Thomas S.; Lee, Yi-Ching; Winston, Zachary; Winston, Flaura K.

2015-01-01

Background Driver error and inadequate skill are common critical reasons for novice teen driver crashes, yet few validated, standardized assessments of teen driving skills exist. The purpose of this study was to evaluate the construct and criterion validity of a newly developed Simulated Driving Assessment (SDA) for novice teen drivers. Methods The SDA's 35-minute simulated drive incorporates 22 variations of the most common teen driver crash configurations. Driving performance was compared for 21 inexperienced teens (age 16–17 years, provisional license ≤90 days) and 17 experienced adults (age 25–50 years, license ≥5 years, drove ≥100 miles per week, no collisions or moving violations ≤3 years). SDA driving performance (Error Score) was based on driving safety measures derived from simulator and eye-tracking data. Negative driving outcomes included simulated collisions or run-off-the-road incidents. A professional driving evaluator/instructor reviewed videos of SDA performance (DEI Score). Results The SDA demonstrated construct validity: 1.) Teens had a higher Error Score than adults (30 vs. 13, p=0.02); 2.) For each additional error committed, the relative risk of a participant's propensity for a simulated negative driving outcome increased by 8% (95% CI: 1.05–1.10, p<0.01). The SDA demonstrated criterion validity: Error Score was correlated with DEI Score (r=−0.66, p<0.001). Conclusions This study supports the concept of validated simulated driving tests like the SDA to assess novice driver skill in complex and hazardous driving scenarios. The SDA, as a standard protocol to evaluate teen driver performance, has the potential to facilitate screening and assessment of teen driving readiness and could be used to guide targeted skill training. PMID:25740939

Simulated Driving Assessment (SDA) for teen drivers: results from a validation study.

PubMed

McDonald, Catherine C; Kandadai, Venk; Loeb, Helen; Seacrist, Thomas S; Lee, Yi-Ching; Winston, Zachary; Winston, Flaura K

2015-06-01

Driver error and inadequate skill are common critical reasons for novice teen driver crashes, yet few validated, standardised assessments of teen driving skills exist. The purpose of this study is to evaluate the construct and criterion validity of a newly developed Simulated Driving Assessment (SDA) for novice teen drivers. The SDA's 35 min simulated drive incorporates 22 variations of the most common teen driver crash configurations. Driving performance was compared for 21 inexperienced teens (age 16-17 years, provisional license ≤90 days) and 17 experienced adults (age 25-50 years, license ≥5 years, drove ≥100 miles per week, no collisions or moving violations ≤3 years). SDA driving performance (Error Score) was based on driving safety measures derived from simulator and eye-tracking data. Negative driving outcomes included simulated collisions or run-off-the-road incidents. A professional driving evaluator/instructor (DEI Score) reviewed videos of SDA performance. The SDA demonstrated construct validity: (1) teens had a higher Error Score than adults (30 vs. 13, p=0.02); (2) For each additional error committed, the RR of a participant's propensity for a simulated negative driving outcome increased by 8% (95% CI 1.05 to 1.10, p<0.01). The SDA-demonstrated criterion validity: Error Score was correlated with DEI Score (r=-0.66, p<0.001). This study supports the concept of validated simulated driving tests like the SDA to assess novice driver skill in complex and hazardous driving scenarios. The SDA, as a standard protocol to evaluate teen driver performance, has the potential to facilitate screening and assessment of teen driving readiness and could be used to guide targeted skill training. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Virtual faces expressing emotions: an initial concomitant and construct validity study.

PubMed

Joyal, Christian C; Jacob, Laurence; Cigna, Marie-Hélène; Guay, Jean-Pierre; Renaud, Patrice

2014-01-01

Facial expressions of emotions represent classic stimuli for the study of social cognition. Developing virtual dynamic facial expressions of emotions, however, would open-up possibilities, both for fundamental and clinical research. For instance, virtual faces allow real-time Human-Computer retroactions between physiological measures and the virtual agent. The goal of this study was to initially assess concomitants and construct validity of a newly developed set of virtual faces expressing six fundamental emotions (happiness, surprise, anger, sadness, fear, and disgust). Recognition rates, facial electromyography (zygomatic major and corrugator supercilii muscles), and regional gaze fixation latencies (eyes and mouth regions) were compared in 41 adult volunteers (20 ♂, 21 ♀) during the presentation of video clips depicting real vs. virtual adults expressing emotions. Emotions expressed by each set of stimuli were similarly recognized, both by men and women. Accordingly, both sets of stimuli elicited similar activation of facial muscles and similar ocular fixation times in eye regions from man and woman participants. Further validation studies can be performed with these virtual faces among clinical populations known to present social cognition difficulties. Brain-Computer Interface studies with feedback-feedforward interactions based on facial emotion expressions can also be conducted with these stimuli.

Measuring Nutrition Literacy in Spanish-Speaking Latinos: An Exploratory Validation Study.

PubMed

Gibbs, Heather D; Camargo, Juliana M T B; Owens, Sarah; Gajewski, Byron; Cupertino, Ana Paula

2017-11-21

Nutrition is important for preventing and treating chronic diseases highly prevalent among Latinos, yet no tool exists for measuring nutrition literacy among Spanish speakers. This study aimed to adapt the validated Nutrition Literacy Assessment Instrument for Spanish-speaking Latinos. This study was developed in two phases: adaptation and validity testing. Adaptation included translation, expert item content review, and interviews with Spanish speakers. For validity testing, 51 participants completed the Short Assessment of Health Literacy-Spanish (SAHL-S), the Nutrition Literacy Assessment Instrument in Spanish (NLit-S), and socio-demographic questionnaire. Validity and reliability statistics were analyzed. Content validity was confirmed with a Scale Content Validity Index of 0.96. Validity testing demonstrated NLit-S scores were strongly correlated with SAHL-S scores (r = 0.52, p < 0.001). Entire reliability was substantial at 0.994 (CI 0.992-0.996) and internal consistency was excellent (Cronbach's α = 0.92). The NLit-S demonstrates validity and reliability for measuring nutrition literacy among Spanish-speakers.

Comparing Thermal Process Validation Methods for Salmonella Inactivation on Almond Kernels.

PubMed

Jeong, Sanghyup; Marks, Bradley P; James, Michael K

2017-01-01

Ongoing regulatory changes are increasing the need for reliable process validation methods for pathogen reduction processes involving low-moisture products; however, the reliability of various validation methods has not been evaluated. Therefore, the objective was to quantify accuracy and repeatability of four validation methods (two biologically based and two based on time-temperature models) for thermal pasteurization of almonds. Almond kernels were inoculated with Salmonella Enteritidis phage type 30 or Enterococcus faecium (NRRL B-2354) at ~10 8 CFU/g, equilibrated to 0.24, 0.45, 0.58, or 0.78 water activity (a w ), and then heated in a pilot-scale, moist-air impingement oven (dry bulb 121, 149, or 177°C; dew point <33.0, 69.4, 81.6, or 90.6°C; v air = 2.7 m/s) to a target lethality of ~4 log. Almond surface temperatures were measured in two ways, and those temperatures were used to calculate Salmonella inactivation using a traditional (D, z) model and a modified model accounting for process humidity. Among the process validation methods, both methods based on time-temperature models had better repeatability, with replication errors approximately half those of the surrogate ( E. faecium ). Additionally, the modified model yielded the lowest root mean squared error in predicting Salmonella inactivation (1.1 to 1.5 log CFU/g); in contrast, E. faecium yielded a root mean squared error of 1.2 to 1.6 log CFU/g, and the traditional model yielded an unacceptably high error (3.4 to 4.4 log CFU/g). Importantly, the surrogate and modified model both yielded lethality predictions that were statistically equivalent (α = 0.05) to actual Salmonella lethality. The results demonstrate the importance of methodology, a w , and process humidity when validating thermal pasteurization processes for low-moisture foods, which should help processors select and interpret validation methods to ensure product safety.

Braden scale (ALB) for assessing pressure ulcer risk in hospital patients: A validity and reliability study.

PubMed

Chen, Hong-Lin; Cao, Ying-Juan; Zhang, Wei; Wang, Jing; Huai, Bao-Sha

2017-02-01

The inter-rater reliability of Braden Scale is not so good. We modified the Braden(ALB) scale by defining nutrition subscale based on serum albumin, then assessed it's the validity and reliability in hospital patients. We designed a retrospective study for validity analysis, and a prospective study for reliability analysis. Receiver operating curve (ROC) and area under the curve (AUC) were used to evaluate the predictive validity. Intra-class correlation coefficient (ICC) was used to investigate the inter-rater reliability. Two thousand five hundred twenty-five patients were included for validity analysis, 76 patients (3.0%) developed pressure ulcer. Positive correlation was found between serum albumin and nutrition score in Braden scale (Spearman's coefficient 0.2203, P<0.0001). The AUCs for Braden scale and Braden(ALB) scale predicting pressure ulcer risk were 0.813 (95% CI 0.797-0.828; P<0.0001), and 0.859 (95% CI 0.845-0.872; P<0.0001), respectively. The Braden(ALB) scale was even more valid than the Braden scale (z=1.860, P=0.0628). In different age subgroups, the Braden(ALB) scale seems also more valid than the original Braden scale, but no statistically significant differences were found (P>0.05). The inter-rater reliability study showed the ICC-value for nutrition increased 45.9%, and increased 4.3% for total score. The Braden(ALB) scale has similar validity compared with the original Braden scale for in hospital patients. However, the inter-rater reliability was significantly increased. Copyright © 2016 Elsevier Inc. All rights reserved.

Comparative Analysis of Two Industries for Validating Green Manufacturing (GM) Framework: An Indian Scenario

NASA Astrophysics Data System (ADS)

Rehman, Minhaj Ahemad Abdul; Shrivastava, Rakesh Lakshmikumar; Shrivastava, Rashmi Rakesh

2017-04-01

Green Manufacturing (GM) deals with manufacturing practices that reduces or eliminates the adverse environmental impact during any of its phases. It emphasizes the use of processes that do not contaminate the environment or hurt consumers, employees, or other stakeholders. This paper presents the comparative analysis of two Indian industries representing different sectors for validating GM framework. It also highlights the road map of the companies for achieving performance improvement through GM implementation and its impact on organisational performance. The case studies helps in evaluating the companies GM implementation and overall business performance. For this, a developed diagnostic instrument in the form of questionnaire was administered amongst employees in the companies respectively and their responses were analysed. In order to have a better understanding of the impact of GM implementation, the information about overall business performance was obtained over the last 3 years. The diagnostic instrument developed here may be used by manufacturing organisations to prioritise their management efforts to assess and implement GM.

Two-Tiered Violence Risk Estimates: a validation study of an integrated-actuarial risk assessment instrument.

PubMed

Mills, Jeremy F; Gray, Andrew L

2013-11-01

This study is an initial validation study of the Two-Tiered Violence Risk Estimates instrument (TTV), a violence risk appraisal instrument designed to support an integrated-actuarial approach to violence risk assessment. The TTV was scored retrospectively from file information on a sample of violent offenders. Construct validity was examined by comparing the TTV with instruments that have shown utility to predict violence that were prospectively scored: The Historical-Clinical-Risk Management-20 (HCR-20) and Lifestyle Criminality Screening Form (LCSF). Predictive validity was examined through a long-term follow-up of 12.4 years with a sample of 78 incarcerated offenders. Results show the TTV to be highly correlated with the HCR-20 and LCSF. The base rate for violence over the follow-up period was 47.4%, and the TTV was equally predictive of violent recidivism relative to the HCR-20 and LCSF. Discussion centers on the advantages of an integrated-actuarial approach to the assessment of violence risk.

Validation of motion correction techniques for liver CT perfusion studies

PubMed Central

Chandler, A; Wei, W; Anderson, E F; Herron, D H; Ye, Z; Ng, C S

2012-01-01

Objectives Motion in images potentially compromises the evaluation of temporally acquired CT perfusion (CTp) data; image registration should mitigate this, but first requires validation. Our objective was to compare the relative performance of manual, rigid and non-rigid registration techniques to correct anatomical misalignment in acquired liver CTp data sets. Methods 17 data sets in patients with liver tumours who had undergone a CTp protocol were evaluated. Each data set consisted of a cine acquisition during a breath-hold (Phase 1), followed by six further sets of cine scans (each containing 11 images) acquired during free breathing (Phase 2). Phase 2 images were registered to a reference image from Phase 1 cine using two semi-automated intensity-based registration techniques (rigid and non-rigid) and a manual technique (the only option available in the relevant vendor CTp software). The performance of each technique to align liver anatomy was assessed by four observers, independently and blindly, on two separate occasions, using a semi-quantitative visual validation study (employing a six-point score). The registration techniques were statistically compared using an ordinal probit regression model. Results 306 registrations (2448 observer scores) were evaluated. The three registration techniques were significantly different from each other (p=0.03). On pairwise comparison, the semi-automated techniques were significantly superior to the manual technique, with non-rigid significantly superior to rigid (p<0.0001), which in turn was significantly superior to manual registration (p=0.04). Conclusion Semi-automated registration techniques achieved superior alignment of liver anatomy compared with the manual technique. We hope this will translate into more reliable CTp analyses. PMID:22374283

Cyber Victim and Bullying Scale: A Study of Validity and Reliability

ERIC Educational Resources Information Center

Cetin, Bayram; Yaman, Erkan; Peker, Adem

2011-01-01

The purpose of this study is to develop a reliable and valid scale, which determines cyber victimization and bullying behaviors of high school students. Research group consisted of 404 students (250 male, 154 male) in Sakarya, in 2009-2010 academic years. In the study sample, mean age is 16.68. Content validity and face validity of the scale was…

Comparative Validity and Reproducibility Study of Various Landmark-Oriented Reference Planes in 3-Dimensional Computed Tomographic Analysis for Patients Receiving Orthognathic Surgery

PubMed Central

Lin, Hsiu-Hsia; Chuang, Ya-Fang; Weng, Jing-Ling; Lo, Lun-Jou

2015-01-01

Background Three-dimensional computed tomographic imaging has become popular in clinical evaluation, treatment planning, surgical simulation, and outcome assessment for maxillofacial intervention. The purposes of this study were to investigate whether there is any correlation among landmark-based horizontal reference planes and to validate the reproducibility and reliability of landmark identification. Materials and Methods Preoperative and postoperative cone-beam computed tomographic images of patients who had undergone orthognathic surgery were collected. Landmark-oriented reference planes including the Frankfort horizontal plane (FHP) and the lateral semicircular canal plane (LSP) were established. Four FHPs were defined by selecting 3 points from the orbitale, porion, or midpoint of paired points. The LSP passed through both the lateral semicircular canal points and nasion. The distances between the maxillary or mandibular teeth and the reference planes were measured, and the differences between the 2 sides were calculated and compared. The precision in locating the landmarks was evaluated by performing repeated tests, and the intraobserver reproducibility and interobserver reliability were assessed. Results A total of 30 patients with facial deformity and malocclusion—10 patients with facial symmetry, 10 patients with facial asymmetry, and 10 patients with cleft lip and palate—were recruited. Comparing the differences among the 5 reference planes showed no statistically significant difference among all patient groups. Regarding intraobserver reproducibility, the mean differences in the 3 coordinates varied from 0 to 0.35 mm, with correlation coefficients between 0.96 and 1.0, showing high correlation between repeated tests. Regarding interobserver reliability, the mean differences among the 3 coordinates varied from 0 to 0.47 mm, with correlation coefficients between 0.88 and 1.0, exhibiting high correlation between the different examiners. Conclusions The

Comparative validity and reproducibility study of various landmark-oriented reference planes in 3-dimensional computed tomographic analysis for patients receiving orthognathic surgery.

PubMed

Lin, Hsiu-Hsia; Chuang, Ya-Fang; Weng, Jing-Ling; Lo, Lun-Jou

2015-01-01

Three-dimensional computed tomographic imaging has become popular in clinical evaluation, treatment planning, surgical simulation, and outcome assessment for maxillofacial intervention. The purposes of this study were to investigate whether there is any correlation among landmark-based horizontal reference planes and to validate the reproducibility and reliability of landmark identification. Preoperative and postoperative cone-beam computed tomographic images of patients who had undergone orthognathic surgery were collected. Landmark-oriented reference planes including the Frankfort horizontal plane (FHP) and the lateral semicircular canal plane (LSP) were established. Four FHPs were defined by selecting 3 points from the orbitale, porion, or midpoint of paired points. The LSP passed through both the lateral semicircular canal points and nasion. The distances between the maxillary or mandibular teeth and the reference planes were measured, and the differences between the 2 sides were calculated and compared. The precision in locating the landmarks was evaluated by performing repeated tests, and the intraobserver reproducibility and interobserver reliability were assessed. A total of 30 patients with facial deformity and malocclusion--10 patients with facial symmetry, 10 patients with facial asymmetry, and 10 patients with cleft lip and palate--were recruited. Comparing the differences among the 5 reference planes showed no statistically significant difference among all patient groups. Regarding intraobserver reproducibility, the mean differences in the 3 coordinates varied from 0 to 0.35 mm, with correlation coefficients between 0.96 and 1.0, showing high correlation between repeated tests. Regarding interobserver reliability, the mean differences among the 3 coordinates varied from 0 to 0.47 mm, with correlation coefficients between 0.88 and 1.0, exhibiting high correlation between the different examiners. The 5 horizontal reference planes were reliable and

Quantifying Human Movement Using the Movn Smartphone App: Validation and Field Study

PubMed Central

2017-01-01

Background The use of embedded smartphone sensors offers opportunities to measure physical activity (PA) and human movement. Big data—which includes billions of digital traces—offers scientists a new lens to examine PA in fine-grained detail and allows us to track people’s geocoded movement patterns to determine their interaction with the environment. Objective The objective of this study was to examine the validity of the Movn smartphone app (Moving Analytics) for collecting PA and human movement data. Methods The criterion and convergent validity of the Movn smartphone app for estimating energy expenditure (EE) were assessed in both laboratory and free-living settings, compared with indirect calorimetry (criterion reference) and a stand-alone accelerometer that is commonly used in PA research (GT1m, ActiGraph Corp, convergent reference). A supporting cross-validation study assessed the consistency of activity data when collected across different smartphone devices. Global positioning system (GPS) and accelerometer data were integrated with geographical information software to demonstrate the feasibility of geospatial analysis of human movement. Results A total of 21 participants contributed to linear regression analysis to estimate EE from Movn activity counts (standard error of estimation [SEE]=1.94 kcal/min). The equation was cross-validated in an independent sample (N=42, SEE=1.10 kcal/min). During laboratory-based treadmill exercise, EE from Movn was comparable to calorimetry (bias=0.36 [−0.07 to 0.78] kcal/min, t82=1.66, P=.10) but overestimated as compared with the ActiGraph accelerometer (bias=0.93 [0.58-1.29] kcal/min, t89=5.27, P<.001). The absolute magnitude of criterion biases increased as a function of locomotive speed (F1,4=7.54, P<.001) but was relatively consistent for the convergent comparison (F1,4=1.26, P<.29). Furthermore, 95% limits of agreement were consistent for criterion and convergent biases, and EE from Movn was strongly

Concurrent validity of the Alberta Infant Motor Scale to detect delayed gross motor development in preterm infants: A comparative study with the Bayley III.

PubMed

Albuquerque, Plínio Luna de; Guerra, Miriam Queiroz de Farias; Lima, Marília de Carvalho; Eickmann, Sophie Helena

2017-05-24

To investigate the concurrent validity of AIMS in relation to the gross motor subtest of the Bayley Scale III/GM in preterm infants. A total of 159 gross motor development assessments were performed with the AIMS and Bayley-III/GM. Linear regression was used to assess the correlation between AIMS and Bayley-III/GM scores. The intra-class correlation coefficient (ICC) and the Bland-Altman plot were used to analyze intra- and inter-rater reliability. There was a prevalence of delayed gross motor development of 20.8% according to the Bayley-III/GM, and 11.9% for the 5th percentile and 21.4% for the 10th percentile of AIMS. A good correlation of AIMS with Bayley-III/GM scores and intra- and inter-rater reliability was encountered in this study. AIMS proved very capable of detecting delayed gross motor development in preterm infants when compared with the Bayley-III/GM. The 10th percentile of AIMS provided the best combination of indicators, with greater specificity.

Validation studies of the DOE-2 Building Energy Simulation Program. Final Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sullivan, R.; Winkelmann, F.

1998-06-01

This report documents many of the validation studies (Table 1) of the DOE-2 building energy analysis simulation program that have taken place since 1981. Results for several versions of the program are presented with the most recent study conducted in 1996 on version DOE-2.1E and the most distant study conducted in 1981 on version DOE-1.3. This work is part of an effort related to continued development of DOE-2, particularly in its use as a simulation engine for new specialized versions of the program such as the recently released RESFEN 3.1. RESFEN 3.1 is a program specifically dealing with analyzing themore » energy performance of windows in residential buildings. The intent in providing the results of these validation studies is to give potential users of the program a high degree of confidence in the calculated results. Validation studies in which calculated simulation data is compared to measured data have been conducted throughout the development of the DOE-2 program. Discrepancies discovered during the course of such work has resulted in improvements in the simulation algorithms. Table 2 provides a listing of additions and modifications that have been made to various versions of the program since version DOE-2.1A. One of the most significant recent changes in the program occurred with version DOE-2.1E. An improved algorithm for calculating the outside surface film coefficient was implemented. In addition, integration of the WINDOW 4 program was accomplished resulting in improved ability in analyzing window energy performance. Validation and verification of a program as sophisticated as DOE-2 must necessarily be limited because of the approximations inherent in the program. For example, the most accurate model of the heat transfer processes in a building would include a three-dimensional analysis. To justify such detailed algorithmic procedures would correspondingly require detailed information describing the building and/or HVAC system and energy plant

Addressing Participant Validity in a Small Internet Health Survey (The Restore Study): Protocol and Recommendations for Survey Response Validation.

PubMed

Dewitt, James; Capistrant, Benjamin; Kohli, Nidhi; Rosser, B R Simon; Mitteldorf, Darryl; Merengwa, Enyinnaya; West, William

2018-04-24

While deduplication and cross-validation protocols have been recommended for large Web-based studies, protocols for survey response validation of smaller studies have not been published. This paper reports the challenges of survey validation inherent in a small Web-based health survey research. The subject population was North American, gay and bisexual, prostate cancer survivors, who represent an under-researched, hidden, difficult-to-recruit, minority-within-a-minority population. In 2015-2016, advertising on a large Web-based cancer survivor support network, using email and social media, yielded 478 completed surveys. Our manual deduplication and cross-validation protocol identified 289 survey submissions (289/478, 60.4%) as likely spam, most stemming from advertising on social media. The basic components of this deduplication and validation protocol are detailed. An unexpected challenge encountered was invalid survey responses evolving across the study period. This necessitated the static detection protocol be augmented with a dynamic one. Five recommendations for validation of Web-based samples, especially with smaller difficult-to-recruit populations, are detailed. ©James Dewitt, Benjamin Capistrant, Nidhi Kohli, B R Simon Rosser, Darryl Mitteldorf, Enyinnaya Merengwa, William West. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 24.04.2018.

Validation of measures from the smartphone sway balance application: a pilot study.

PubMed

Patterson, Jeremy A; Amick, Ryan Z; Thummar, Tarunkumar; Rogers, Michael E

2014-04-01

A number of different balance assessment techniques are currently available and widely used. These include both subjective and objective assessments. The ability to provide quantitative measures of balance and posture is the benefit of objective tools, however these instruments are not generally utilized outside of research laboratory settings due to cost, complexity of operation, size, duration of assessment, and general practicality. The purpose of this pilot study was to assess the value and validity of using software developed to access the iPod and iPhone accelerometers output and translate that to the measurement of human balance. Thirty healthy college-aged individuals (13 male, 17 female; age = 26.1 ± 8.5 years) volunteered. Participants performed a static Athlete's Single Leg Test protocol for 10 sec, on a Biodex Balance System SD while concurrently utilizing a mobile device with balance software. Anterior/posterior stability was recorded using both devices, described as the displacement in degrees from level, and was termed the "balance score." There were no significant differences between the two reported balance scores (p = 0.818. Mean balance score on the balance platform was 1.41 ± 0.90, as compared to 1.38 ± 0.72 using the mobile device. There is a need for a valid, convenient, and cost-effective tool to objectively measure balance. Results of this study are promising, as balance score derived from the Smartphone accelerometers were consistent with balance scores obtained from a previously validated balance system. However, further investigation is necessary as this version of the mobile software only assessed balance in the anterior/posterior direction. Additionally, further testing is necessary on a healthy populations and as well as those with impairment of the motor control system. Level 2b (Observational study of validity)(1.)

JaCVAM-organized international validation study of the in vivo rodent alkaline comet assay for detection of genotoxic carcinogens: II. Summary of definitive validation study results.

PubMed

Uno, Yoshifumi; Kojima, Hajime; Omori, Takashi; Corvi, Raffaella; Honma, Masamistu; Schechtman, Leonard M; Tice, Raymond R; Beevers, Carol; De Boeck, Marlies; Burlinson, Brian; Hobbs, Cheryl A; Kitamoto, Sachiko; Kraynak, Andrew R; McNamee, James; Nakagawa, Yuzuki; Pant, Kamala; Plappert-Helbig, Ulla; Priestley, Catherine; Takasawa, Hironao; Wada, Kunio; Wirnitzer, Uta; Asano, Norihide; Escobar, Patricia A; Lovell, David; Morita, Takeshi; Nakajima, Madoka; Ohno, Yasuo; Hayashi, Makoto

2015-07-01

The in vivo rodent alkaline comet assay (comet assay) is used internationally to investigate the in vivo genotoxic potential of test chemicals. This assay, however, has not previously been formally validated. The Japanese Center for the Validation of Alternative Methods (JaCVAM), with the cooperation of the U.S. NTP Interagency Center for the Evaluation of Alternative Toxicological Methods (NICEATM)/the Interagency Coordinating Committee on the Validation of Alternative Methods (ICCVAM), the European Centre for the Validation of Alternative Methods (ECVAM), and the Japanese Environmental Mutagen Society/Mammalian Mutagenesis Study Group (JEMS/MMS), organized an international validation study to evaluate the reliability and relevance of the assay for identifying genotoxic carcinogens, using liver and stomach as target organs. The ultimate goal of this exercise was to establish an Organisation for Economic Co-operation and Development (OECD) test guideline. The study protocol was optimized in the pre-validation studies, and then the definitive (4th phase) validation study was conducted in two steps. In the 1st step, assay reproducibility was confirmed among laboratories using four coded reference chemicals and the positive control ethyl methanesulfonate. In the 2nd step, the predictive capability was investigated using 40 coded chemicals with known genotoxic and carcinogenic activity (i.e., genotoxic carcinogens, genotoxic non-carcinogens, non-genotoxic carcinogens, and non-genotoxic non-carcinogens). Based on the results obtained, the in vivo comet assay is concluded to be highly capable of identifying genotoxic chemicals and therefore can serve as a reliable predictor of rodent carcinogenicity. Copyright © 2015 Elsevier B.V. All rights reserved.

Construct Validation Theory Applied to the Study of Personality Dysfunction

PubMed Central

Zapolski, Tamika C. B.; Guller, Leila; Smith, Gregory T.

2013-01-01

The authors review theory validation and construct validation principles as related to the study of personality dysfunction. Historically, personality disorders have been understood to be syndromes of heterogeneous symptoms. The authors argue that the syndrome approach to description results in diagnoses of unclear meaning and constrained validity. The alternative approach of describing personality dysfunction in terms of homogeneous dimensions of functioning avoids the problems of the syndromal approach and has been shown to provide more valid description and diagnosis. The authors further argue that description based on homogeneous dimensions of personality function/dysfunction is more useful, because it provides direct connections to validated treatments. PMID:22321263

Fat-free mass prediction equations for bioelectric impedance analysis compared to dual energy X-ray absorptiometry in obese adolescents: a validation study.

PubMed

Hofsteenge, Geesje H; Chinapaw, Mai J M; Weijs, Peter J M

2015-10-15

In clinical practice, patient friendly methods to assess body composition in obese adolescents are needed. Therefore, the bioelectrical impedance analysis (BIA) related fat-free mass (FFM) prediction equations (FFM-BIA) were evaluated in obese adolescents (age 11-18 years) compared to FFM measured by dual-energy x-ray absorptiometry (FFM-DXA) and a new population specific FFM-BIA equation is developed. After an overnight fast, the subjects attended the outpatient clinic. After measuring height and weight, a full body scan by dual-energy x-ray absorptiometry (DXA) and a BIA measurement was performed. Thirteen predictive FFM-BIA equations based on weight, height, age, resistance, reactance and/or impedance were systematically selected and compared to FFM-DXA. Accuracy of FFM-BIA equations was evaluated by the percentage adolescents predicted within 5% of FFM-DXA measured, the mean percentage difference between predicted and measured values (bias) and the Root Mean Squared prediction Error (RMSE). Multiple linear regression was conducted to develop a new BIA equation. Validation was based on 103 adolescents (60% girls), age 14.5 (sd1.7) years, weight 94.1 (sd15.6) kg and FFM-DXA of 56.1 (sd9.8) kg. The percentage accurate estimations varied between equations from 0 to 68%; bias ranged from -29.3 to +36.3% and RMSE ranged from 2.8 to 12.4 kg. An alternative prediction equation was developed: FFM = 0.527 * H(cm)(2)/Imp + 0.306 * weight - 1.862 (R(2) = 0.92, SEE = 2.85 kg). Percentage accurate prediction was 76%. Compared to DXA, the Gray equation underestimated the FFM with 0.4 kg (55.7 ± 8.3), had an RMSE of 3.2 kg, 63% accurate prediction and the smallest bias of (-0.1%). When split by sex, the Gray equation had the narrowest range in accurate predictions, bias, and RMSE. For the assessment of FFM with BIA, the Gray-FFM equation appears to be the most accurate, but 63% is still not at an acceptable accuracy level for obese adolescents. The new equation appears to

Detecting Symptom Exaggeration in Combat Veterans Using the MMPI-2 Symptom Validity Scales: A Mixed Group Validation

ERIC Educational Resources Information Center

Tolin, David F.; Steenkamp, Maria M.; Marx, Brian P.; Litz, Brett T.

2010-01-01

Although validity scales of the Minnesota Multiphasic Personality Inventory-2 (MMPI-2; J. N. Butcher, W. G. Dahlstrom, J. R. Graham, A. Tellegen, & B. Kaemmer, 1989) have proven useful in the detection of symptom exaggeration in criterion-group validation (CGV) studies, usually comparing instructed feigners with known patient groups, the…

Reliable Digit Span: A Systematic Review and Cross-Validation Study

ERIC Educational Resources Information Center

Schroeder, Ryan W.; Twumasi-Ankrah, Philip; Baade, Lyle E.; Marshall, Paul S.

2012-01-01

Reliable Digit Span (RDS) is a heavily researched symptom validity test with a recent literature review yielding more than 20 studies ranging in dates from 1994 to 2011. Unfortunately, limitations within some of the research minimize clinical generalizability. This systematic review and cross-validation study was conducted to address these…

Comparing current definitions of return to work: a measurement approach.

PubMed

Steenstra, I A; Lee, H; de Vroome, E M M; Busse, J W; Hogg-Johnson, S J

2012-09-01

Return-to-work (RTW) status is an often used outcome in work and health research. In low back pain, work is regarded as a normal activity a worker should return to in order to fully recover. Comparing outcomes across studies and even jurisdictions using different definitions of RTW can be challenging for readers in general and when performing a systematic review in particular. In this study, the measurement properties of previously defined RTW outcomes were examined with data from two studies from two countries. Data on RTW in low back pain (LBP) from the Canadian Early Claimant Cohort (ECC); a workers' compensation based study, and the Dutch Amsterdam Sherbrooke Evaluation (ASE) study were analyzed. Correlations between outcomes, differences in predictive validity when using different outcomes and construct validity when comparing outcomes to a functional status outcome were analyzed. In the ECC all definitions were highly correlated and performed similarly in predictive validity. When compared to functional status, RTW definitions in the ECC study performed fair to good on all time points. In the ASE study all definitions were highly correlated and performed similarly in predictive validity. The RTW definitions, however, failed to compare or compared poorly with functional status. Only one definition compared fairly on one time point. Differently defined outcomes are highly correlated, give similar results in prediction, but seem to differ in construct validity when compared to functional status depending on societal context or possibly birth cohort. Comparison of studies using different RTW definitions appears valid as long as RTW status is not considered as a measure of functional status.

The Feasibility and Validity of a Remote Pulse Oximetry System for Pulmonary Rehabilitation: A Pilot Study

PubMed Central

Tang, Jonathan; Mandrusiak, Allison; Russell, Trevor

2012-01-01

Pulmonary rehabilitation is an effective treatment for people with chronic obstructive pulmonary disease. However, access to these services is limited especially in rural and remote areas. Telerehabilitation has the potential to deliver pulmonary rehabilitation programs to these communities. The aim of this study was threefold: to establish the technical feasibility of transmitting real-time pulse oximetry data, determine the validity of remote measurements compared to conventional face-to-face measures, and evaluate the participants' perception of the usability of the technology. Thirty-seven healthy individuals participated in a single remote pulmonary rehabilitation exercise session, conducted using the eHAB telerehabilitation system. Validity was assessed by comparing the participant's oxygen saturation and heart rate with the data set received at the therapist's remote location. There was an 80% exact agreement between participant and therapist data sets. The mean absolute difference and Bland and Altman's limits of agreement fell within the minimum clinically important difference for both oxygen saturation and heart rate values. Participants found the system easy to use and felt confident that they would be able to use it at home. Remote measurement of pulse oximetry data for a pulmonary rehabilitation exercise session was feasible and valid when compared to conventional face-to-face methods. PMID:23049549

Infrared Skin Thermometry: Validating and Comparing Techniques to Detect Periwound Skin Infection.

PubMed

Mufti, Asfandyar; Somayaji, Ranjani; Coutts, Patricia; Sibbald, R Gary

2018-01-01

Diagnosis of wound infection can be challenging because it relies on a combination of clinical signs and symptoms that are often nonspecific. Increased periwound cutaneous temperature is a classic sign of deep and surrounding wound infection, and its quantitative measurement is one of the most reliable and valid clinical signs of deep and surrounding skin infection at the bedside. Skin surface temperature differences may be detected using commercially available noncontact infrared thermometers. However, techniques to detect temperature using noncontact infrared thermometers vary, and no studies have evaluated these methods. Two such measurement techniques include the "4-point" and "whole-wound" scanning methods. This study assessed the ability of different infrared thermometers using the aforementioned techniques to detect clinically meaningful differences in periwound cutaneous temperatures used in the diagnosis of wound infection. A prospective cohort study was conducted from 2015 to 2016 of consenting adult patients 18 years or older with an open wound attending a regional wound care clinic. One hundred patients with wounds underwent surface temperature measurement. Infection was not a specific inclusion criterion as the primary objective was to conduct a comparative assessment of infrared thermometry devices. Demographic data (age, height, weight, gender, and ethnicity) were also collected. Each wound was measured using 4 different noncontact infrared thermometers: Exergen DermaTemp 1001 (Exergen Corporation, Watertown, Massachusetts), Mastercraft Digital Temperature Reader (Mastercraft, Toronto, Ontario, Canada), Mastercool MSC52224-A (Mastercool Inc, Randolph, New Jersey), and Etekcity ETC-8250 Temperature Heat Pen (Etekcity, Anaheim, California). Data analysis was based on a comparison of 4 periwound skin surface temperature measurement differences (ΔT in degrees Fahrenheit) between the wound site and an equivalent contralateral control site. The primary

Validation of a low-cost EEG device for mood induction studies.

PubMed

Rodríguez, Alejandro; Rey, Beatriz; Alcañiz, Mariano

2013-01-01

New electroencephalography (EEG) devices, more portable and cheaper, are appearing on the market. Studying the reliability of these EEG devices for emotional studies would be interesting, as these devices could be more economical and compatible with Virtual Reality (VR) settings. Therefore, the aim in this work was to validate a low-cost EEG device (Emotiv Epoc) to monitor brain activity during a positive emotional induction procedure. Emotional pictures (IAPS) were used to induce a positive mood in sixteen participants. Changes in the brain activity of subjects were compared between positive induction and neutral conditions. Obtained results were in accordance with previous scientific literature regarding frontal EEG asymmetry, which supports the possibility of using this low-cost EEG device in future mood induction studies combined with VR.

Iatrogenic Bone and Soft Tissue Trauma in Robotic-Arm Assisted Total Knee Arthroplasty Compared With Conventional Jig-Based Total Knee Arthroplasty: A Prospective Cohort Study and Validation of a New Classification System.

PubMed

Kayani, Babar; Konan, Sujith; Pietrzak, Jurek R T; Haddad, Fares S

2018-03-27

The objective of this study was to compare macroscopic bone and soft tissue injury between robotic-arm assisted total knee arthroplasty (RA-TKA) and conventional jig-based total knee arthroplasty (CJ-TKA) and create a validated classification system for reporting iatrogenic bone and periarticular soft tissue injury after TKA. This study included 30 consecutive CJ-TKAs followed by 30 consecutive RA-TKAs performed by a single surgeon. Intraoperative photographs of the femur, tibia, and periarticular soft tissues were taken before implantation of prostheses. Using these outcomes, the macroscopic soft tissue injury (MASTI) classification system was developed to grade iatrogenic bone and soft tissue injuries. Interobserver and Intraobserver validity of the proposed classification system was assessed. Patients undergoing RA-TKA had reduced medial soft tissue injury in both passively correctible (P < .05) and noncorrectible varus deformities (P < .05); more pristine femoral (P < .05) and tibial (P < .05) bone resection cuts; and improved MASTI scores compared to CJ-TKA (P < .05). There was high interobserver (intraclass correlation coefficient 0.92 [95% confidence interval: 0.88-0.96], P < .05) and intraobserver agreement (intraclass correlation coefficient 0.94 [95% confidence interval: 0.92-0.97], P < .05) of the proposed MASTI classification system. There is reduced bone and periarticular soft tissue injury in patients undergoing RA-TKA compared to CJ-TKA. The proposed MASTI classification system is a reproducible grading scheme for describing iatrogenic bone and soft tissue injury in TKA. RA-TKA is associated with reduced bone and soft tissue injury compared with conventional jig-based TKA. The proposed MASTI classification may facilitate further research correlating macroscopic soft tissue injury during TKA to long-term clinical and functional outcomes. Copyright © 2018 Elsevier Inc. All rights reserved.

Urdu translation of the Hamilton Rating Scale for Depression: Results of a validation study

PubMed Central

Hashmi, Ali M.; Naz, Shahana; Asif, Aftab; Khawaja, Imran S.

2016-01-01

Objective: To develop a standardized validated version of the Hamilton Rating Scale for Depression (HAM-D) in Urdu. Methods: After translation of the HAM-D into the Urdu language following standard guidelines, the final Urdu version (HAM-D-U) was administered to 160 depressed outpatients. Inter-item correlation was assessed by calculating Cronbach alpha. Correlation between HAM-D-U scores at baseline and after a 2-week interval was evaluated for test-retest reliability. Moreover, scores of two clinicians on HAM-D-U were compared for inter-rater reliability. For establishing concurrent validity, scores of HAM-D-U and BDI-U were compared by using Spearman correlation coefficient. The study was conducted at Mayo Hospital, Lahore, from May to December 2014. Results: The Cronbach alpha for HAM-D-U was 0.71. Composite scores for HAM-D-U at baseline and after a 2-week interval were also highly correlated with each other (Spearman correlation coefficient 0.83, p-value < 0.01) indicating good test-retest reliability. Composite scores for HAM-D-U and BDI-U were positively correlated with each other (Spearman correlation coefficient 0.85, p < 0.01) indicating good concurrent validity. Scores of two clinicians for HAM-D-U were also positively correlated (Spearman correlation coefficient 0.82, p-value < 0.01) indicated good inter-rater reliability. Conclusion: The HAM-D-U is a valid and reliable instrument for the assessment of Depression. It shows good inter-rater and test-retest reliability. The HAM-D-U can be a tool either for clinical management or research. PMID:28083049

Urdu translation of the Hamilton Rating Scale for Depression: Results of a validation study.

PubMed

Hashmi, Ali M; Naz, Shahana; Asif, Aftab; Khawaja, Imran S

2016-01-01

To develop a standardized validated version of the Hamilton Rating Scale for Depression (HAM-D) in Urdu. After translation of the HAM-D into the Urdu language following standard guidelines, the final Urdu version (HAM-D-U) was administered to 160 depressed outpatients. Inter-item correlation was assessed by calculating Cronbach alpha. Correlation between HAM-D-U scores at baseline and after a 2-week interval was evaluated for test-retest reliability. Moreover, scores of two clinicians on HAM-D-U were compared for inter-rater reliability. For establishing concurrent validity, scores of HAM-D-U and BDI-U were compared by using Spearman correlation coefficient. The study was conducted at Mayo Hospital, Lahore, from May to December 2014. The Cronbach alpha for HAM-D-U was 0.71. Composite scores for HAM-D-U at baseline and after a 2-week interval were also highly correlated with each other (Spearman correlation coefficient 0.83, p-value < 0.01) indicating good test-retest reliability. Composite scores for HAM-D-U and BDI-U were positively correlated with each other (Spearman correlation coefficient 0.85, p < 0.01) indicating good concurrent validity. Scores of two clinicians for HAM-D-U were also positively correlated (Spearman correlation coefficient 0.82, p-value < 0.01) indicated good inter-rater reliability. The HAM-D-U is a valid and reliable instrument for the assessment of Depression. It shows good inter-rater and test-retest reliability. The HAM-D-U can be a tool either for clinical management or research.

Psychometric properties of EURO-D, a geriatric depression scale: a cross-cultural validation study.

PubMed

Guerra, Mariella; Ferri, Cleusa; Llibre, Juan; Prina, A Matthew; Prince, Martin

2015-02-05

Many of the assessment tools used to study depression among older people are adaptations of instruments developed in other cultural setting. There is a need to validate those instruments in low and middle income countries (LMIC). A one-phase cross-sectional survey of people aged [greater than or equal to] 65 years from LMIC. EURO-D was checked for psychometric properties. Calibration with clinical diagnosis was made using ICD-10. Optimal cutpoint was determined. Concurrent validity was assessed measuring correlations with WHODAS 2.0. 17,852 interviews were completed in 13 sites from nine countries. EURO-D constituted a hierarchical scale in most sites. The most commonly endorsed symptom in Latin American sites was depression; in China was sleep disturbance and tearfulness; in India, irritability and fatigue and in Nigeria loss of enjoyment. Two factor structure (affective and motivation) were demonstrated. Measurement invariance was demonstrated among Latin American and Indian sites being less evident in China and Nigeria. At the 4/5 cutpoint, sensitivity for ICD-10 depressive episode was 86% or higher in all sites and specificity exceeded 84% in all Latin America and Chinese sites. Concurrent validity was supported, at least for Latin American and Indian sites. There is evidence for the cross-cultural validity of the EURO-D scale at Latin American and Indian settings and its potential applicability in comparative epidemiological studies.

[Turkish validity and reliability study of fear of pain questionnaire-III].

PubMed

Ünver, Seher; Turan, Fatma Nesrin

2018-01-01

This study aimed to develop a Turkish version of the Fear of Pain Questionnaire-III developed by McNeil and Rainwater (1998) and examine its validity and reliability indicators. The study was conducted with 459 university students studying in the nursing department. The Turkish translation of the scale was conducted by language experts and the original scale owner. Expert opinions were taken for language validity, and the Lawshe's content validity ratio formula was used to calculate the content validity. Exploratory factor analysis was used to assess the construct validity. The factors were rotated using the Varimax rotation (orthogonal) method. For reliability indicators of the questionnaire, the internal consistency coefficient and test re-test reliability were utilized. Explanatory factor analyses using the three-factor model (explaining 50.5% of the total variance) revealed that the item factor loads varied were above the limit value of 0.30 which indicated that the questionnaire had good construct validity. The Cronbach's alpha value for the total questionnaire was 0.938, and test re-test value was 0.846 for the total scale. The Turkish version of the Fear of Pain Questionnaire-III had sufficiently high reliability and validity to be used as a tool in evaluating the fear of pain among the young Turkish population.

Two- and three-dimensional CT measurements of urinary calculi length and width: a comparative study.

PubMed

Lidén, Mats; Thunberg, Per; Broxvall, Mathias; Geijer, Håkan

2015-04-01

The standard imaging procedure for a patient presenting with renal colic is unenhanced computed tomography (CT). The CT measured size has a close correlation to the estimated prognosis for spontaneous passage of a ureteral calculus. Size estimations of urinary calculi in CT images are still based on two-dimensional (2D) reformats. To develop and validate a calculus oriented three-dimensional (3D) method for measuring the length and width of urinary calculi and to compare the calculus oriented measurements of the length and width with corresponding 2D measurements obtained in axial and coronal reformats. Fifty unenhanced CT examinations demonstrating urinary calculi were included. A 3D symmetric segmentation algorithm was validated against reader size estimations. The calculus oriented size from the segmentation was then compared to the estimated size in axial and coronal 2D reformats. The validation showed 0.1 ± 0.7 mm agreement against reference measure. There was a 0.4 mm median bias for 3D estimated calculus length compared to 2D (P < 0.001), but no significant bias for 3D width compared to 2D. The length of a calculus in axial and coronal reformats becomes underestimated compared to 3D if its orientation is not aligned to the image planes. Future studies aiming to correlate calculus size with patient outcome should use a calculus oriented size estimation. © The Foundation Acta Radiologica 2014 Reprints and permissions: sagepub.co.uk/journalsPermissions.nav.

Training Objectives, Transfer, Validation and Evaluation: A Sri Lankan Study

ERIC Educational Resources Information Center

Wickramasinghe, Vathsala M.

2006-01-01

Using a stratified random sample, this paper examines the training practices of setting objectives, transfer, validation and evaluation in Sri Lanka. The paper further sets out to compare those practices across local, foreign and joint-venture companies based on the assumption that there may be significant differences across companies of different…

Test-retest reliability and validity of a web-based food-frequency questionnaire for adolescents aged 13-14 to be used in the Norwegian Mother and Child Cohort Study (MoBa).

PubMed

Overby, Nina Cecilie; Johannesen, Elisabeth; Jensen, Grete; Skjaevesland, Anne-Kirsti; Haugen, Margaretha

2014-01-01

The assessment of food intake is challenging and prone to errors; it is therefore important to consider the reliability and validity of the assessment methods. The aim of this study was to analyze the reproducibility and validity of a developed food-frequency questionnaire (FFQ) for use among adolescents. In total, 58 students (aged 13-14) from four different schools in the southern part of Norway participated in the reproducibility study of filling out the FFQ 4 weeks apart. In addition, 93 students participated in the relative validity study where the FFQ was compared to 2×24-hour dietary recalls, while 92 students participated in the absolute validity study where the intakes of fatty acids and vitamin D from the FFQ were compared to fatty acids and 25-hydroxy-vitamin D3 in whole blood. The median Spearman correlation coefficient for all nutrients in the test-retest reliability study was 0.57. The median Spearman correlation for all nutrients in the relative validity study was 0.26, while the correlations coefficients were low in the absolute validity study with n-3 fatty acid coefficients ranging from 0.05 to 0.25, and absent for vitamin D (r=0.000). The test-retest reproducibility was considered good, the relative validity was considered poor to good, and the absolute validity was considered poor. However, the results are comparable to other studies among adolescents.

Validation of GC and HPLC systems for residue studies

DOE Office of Scientific and Technical Information (OSTI.GOV)

Williams, M.

1995-12-01

For residue studies, GC and HPLC system performance must be validated prior to and during use. One excellent measure of system performance is the standard curve and associated chromatograms used to construct that curve. The standard curve is a model of system response to an analyte over a specific time period, and is prima facia evidence of system performance beginning at the auto sampler and proceeding through the injector, column, detector, electronics, data-capture device, and printer/plotter. This tool measures the performance of the entire chromatographic system; its power negates most of the benefits associated with costly and time-consuming validation ofmore » individual system components. Other measures of instrument and method validation will be discussed, including quality control charts and experimental designs for method validation.« less

Examining the Internal Validity and Statistical Precision of the Comparative Interrupted Time Series Design by Comparison with a Randomized Experiment

ERIC Educational Resources Information Center

St.Clair, Travis; Cook, Thomas D.; Hallberg, Kelly

2014-01-01

Although evaluators often use an interrupted time series (ITS) design to test hypotheses about program effects, there are few empirical tests of the design's validity. We take a randomized experiment on an educational topic and compare its effects to those from a comparative ITS (CITS) design that uses the same treatment group as the experiment…

40 CFR 152.93 - Citation of a previously submitted valid study.

Code of Federal Regulations, 2010 CFR

2010-07-01

... Data Submitters' Rights § 152.93 Citation of a previously submitted valid study. An applicant may demonstrate compliance for a data requirement by citing a valid study previously submitted to the Agency. The... the original data submitter, the applicant may cite the study only in accordance with paragraphs (b...

Turkish Version of Kolcaba's Immobilization Comfort Questionnaire: A Validity and Reliability Study.

PubMed

Tosun, Betül; Aslan, Özlem; Tunay, Servet; Akyüz, Aygül; Özkan, Hüseyin; Bek, Doğan; Açıksöz, Semra

2015-12-01

The purpose of this study was to determine the validity and reliability of the Turkish version of the Immobilization Comfort Questionnaire (ICQ). The sample used in this methodological study consisted of 121 patients undergoing lower extremity arthroscopy in a training and research hospital. The validity study of the questionnaire assessed language validity, structural validity and criterion validity. Structural validity was evaluated via exploratory factor analysis. Criterion validity was evaluated by assessing the correlation between the visual analog scale (VAS) scores (i.e., the comfort and pain VAS scores) and the ICQ scores using Spearman's correlation test. The Kaiser-Meyer-Olkin coefficient and Bartlett's test of sphericity were used to determine the suitability of the data for factor analysis. Internal consistency was evaluated to determine reliability. The data were analyzed with SPSS version 15.00 for Windows. Descriptive statistics were presented as frequencies, percentages, means and standard deviations. A p value ≤ .05 was considered statistically significant. A moderate positive correlation was found between the ICQ scores and the VAS comfort scores; a moderate negative correlation was found between the ICQ and the VAS pain measures in the criterion validity analysis. Cronbach α values of .75 and .82 were found for the first and second measurements, respectively. The findings of this study reveal that the ICQ is a valid and reliable tool for assessing the comfort of patients in Turkey who are immobilized because of lower extremity orthopedic problems. Copyright © 2015. Published by Elsevier B.V.

The UK Biobank sample handling and storage validation studies.

PubMed

Peakman, Tim C; Elliott, Paul

2008-04-01

and aims UK Biobank is a large prospective study in the United Kingdom to investigate the role of genetic factors, environmental exposures and lifestyle in the causes of major diseases of late and middle age. It involves the collection of blood and urine from 500 000 individuals aged between 40 and 69 years. How the samples are collected, processed and stored will have a major impact on the future scientific usefulness of the UK Biobank resource. A series of validation studies was recommended to test the robustness of the draft sample handling and storage protocol. Samples of blood and urine were collected from 40 healthy volunteers and either processed immediately according to the protocol or maintained at specified temperatures (4 degrees C for all tubes with the exception of vacutainers containing acid citrate dextrose that were maintained at 18 degrees C) for 12, 24 or 36 h prior to processing. A further sample was maintained for 24 h at 4 degrees C, processed and the aliquots frozen at -80 degrees C for 20 days and then thawed under controlled conditions. The stability of the samples was compared for the different times in a wide variety of assays. The samples maintained at 4 degrees C were stable for at least 24 h after collection for a wide range of assays. Small but significant changes were observed in metabonomic studies in samples maintained at 4 degrees C for 36 h. There was no degradation of the samples for a range of biochemical assays after short-term freezing and thawing under controlled conditions. Whole blood maintained at 18 degrees C for 24 h in vacutainers containing acid citrate dextrose is suitable for viral immortalization techniques. The validation studies reported in this supplement provide justification for the sample handling and storage procedures adopted in the UK Biobank project.

Validation of a Formula for Assigning Continuing Education Credit to Printed Home Study Courses

PubMed Central

Hanson, Alan L.

2007-01-01

Objectives To reevaluate and validate the use of a formula for calculating the amount of continuing education credit to be awarded for printed home study courses. Methods Ten home study courses were selected for inclusion in a study to validate the formula, which is based on the number of words, number of final examination questions, and estimated difficulty level of the course. The amount of estimated credit calculated using the a priori formula was compared to the average amount of time required to complete each article based on pharmacists' self-reporting. Results A strong positive relationship between the amount of time required to complete the home study courses based on the a priori calculation and the times reported by pharmacists completing the 10 courses was found (p < 0.001). The correlation accounted for 86.2% of the total variability in the average pharmacist reported completion times (p < 0.001). Conclusions The formula offers an efficient and accurate means of determining the amount of continuing education credit that should be assigned to printed home study courses. PMID:19503705

Preparing Electronic Clinical Data for Quality Improvement and Comparative Effectiveness Research: The SCOAP CERTAIN Automation and Validation Project

PubMed Central

Devine, Emily Beth; Capurro, Daniel; van Eaton, Erik; Alfonso-Cristancho, Rafael; Devlin, Allison; Yanez, N. David; Yetisgen-Yildiz, Meliha; Flum, David R.; Tarczy-Hornoch, Peter

2013-01-01

Background: The field of clinical research informatics includes creation of clinical data repositories (CDRs) used to conduct quality improvement (QI) activities and comparative effectiveness research (CER). Ideally, CDR data are accurately and directly abstracted from disparate electronic health records (EHRs), across diverse health-systems. Objective: Investigators from Washington State’s Surgical Care Outcomes and Assessment Program (SCOAP) Comparative Effectiveness Research Translation Network (CERTAIN) are creating such a CDR. This manuscript describes the automation and validation methods used to create this digital infrastructure. Methods: SCOAP is a QI benchmarking initiative. Data are manually abstracted from EHRs and entered into a data management system. CERTAIN investigators are now deploying Caradigm’s Amalga™ tool to facilitate automated abstraction of data from multiple, disparate EHRs. Concordance is calculated to compare data automatically to manually abstracted. Performance measures are calculated between Amalga and each parent EHR. Validation takes place in repeated loops, with improvements made over time. When automated abstraction reaches the current benchmark for abstraction accuracy - 95% - itwill ‘go-live’ at each site. Progress to Date: A technical analysis was completed at 14 sites. Five sites are contributing; the remaining sites prioritized meeting Meaningful Use criteria. Participating sites are contributing 15–18 unique data feeds, totaling 13 surgical registry use cases. Common feeds are registration, laboratory, transcription/dictation, radiology, and medications. Approximately 50% of 1,320 designated data elements are being automatically abstracted—25% from structured data; 25% from text mining. Conclusion: In semi-automating data abstraction and conducting a rigorous validation, CERTAIN investigators will semi-automate data collection to conduct QI and CER, while advancing the Learning Healthcare System. PMID:25848565

Self-reported eating rate is associated with weight status in a Dutch population: a validation study and a cross-sectional study.

PubMed

van den Boer, Janet H W; Kranendonk, Jentina; van de Wiel, Anne; Feskens, Edith J M; Geelen, Anouk; Mars, Monica

2017-09-08

Observational studies performed in Asian populations suggest that eating rate is related to BMI. This paper investigates the association between self-reported eating rate (SRER) and body mass index (BMI) in a Dutch population, after having validated SRER against actual eating rate. Two studies were performed; a validation and a cross-sectional study. In the validation study SRER (i.e., 'slow', 'average', or 'fast') was obtained from 57 participants (men/women = 16/41, age: mean ± SD = 22.6 ± 2.8 yrs., BMI: mean ± SD = 22.1 ± 2.8 kg/m 2 ) and in these participants actual eating rate was measured for three food products. Using analysis of variance the association between SRER and actual eating rate was studied. The association between SRER and BMI was investigated in cross-sectional data from the NQplus cohort (i.e., 1473 Dutch adults; men/women = 741/732, age: mean ± SD = 54.6 ± 11.7 yrs., BMI: mean ± SD = 25.9 ± 4.0 kg/m 2 ) using (multiple) linear regression analysis. In the validation study actual eating rate increased proportionally with SRER (for all three food products P < 0.01). In the cross-sectional study SRER was positively associated with BMI in both men and women (P = 0.03 and P < 0.001, respectively). Self-reported fast-eating women had a 1.13 kg/m 2 (95% CI 0.43, 1.84) higher BMI compared to average-speed-eating women, after adjusting for confounders. This was not the case in men; self-reported fast-eating men had a 0.29 kg/m 2 (95% CI -0.22, 0.80) higher BMI compared to average-speed-eating men, after adjusting for confounders. These studies show that self-reported eating rate reflects actual eating rate on a group-level, and that a high self-reported eating rate is associated with a higher BMI in this Dutch population.

Assessing validity by comparing transition and static measures of dyspnea in patients with acute decompensated heart failure.

PubMed

Smithline, Howard A; Caglar, Selin; Blank, Fidela S J

2010-01-01

This study assessed the convergent validity of 2 dyspnea measures, the transition measure and the change measure, by comparing them with each other in patients admitted to the hospital with acute decompensated heart failure. Static measures of dyspnea were obtained at baseline (pre-static measure) and at time 1 hour and 4 hour (post-static measures). The change measure was calculated as the difference between the pre-static and post-static measures. Transition measures were obtained at time 1 hour and 4 hour. Visual analog scales and Likert scales were used. Both physicians and patients measured the dyspnea independently. A total of 112 patients had complete data sets at time 0 and 1 hour and 86 patients had complete data sets at all 3 time points. Correlations were calculated between the transition measures and static measures (pre-static, post-static, and change measure). Bland-Altman plots were generated and the mean difference and limits of agreement between the transition measures and the change measures were calculated. In general, short-term dyspnea assessment using transition measures and serial static measures can not be used to validate each other in this population of patients being admitted with acute decompensated heart failure. © 2010 Wiley Periodicals, Inc.

Reproducibility and validity of the Shanghai Men's Health Study physical activity questionnaire.

PubMed

Jurj, Adriana L; Wen, Wanqing; Xiang, Yong-Bing; Matthews, Charles E; Liu, Dake; Zheng, Wei; Shu, Xiao-Ou

2007-05-15

Reproducibility and validity of the physical activity questionnaire (PAQ) used in the Shanghai Men's Health Study (2003-2006, People's Republic of China) was evaluated in a random sample of 196 participants aged 40-74 years. Participants completed a PAQ at baseline and again 1 year later, 12 monthly 7-day physical activity recalls, and four quarterly 1-week physical activity logs. Reproducibility was evaluated by using the two PAQs and validity by comparing the PAQs with 1-year averages of the two criterion measures: 7-day physical activity recall and physical activity log. The PAQ had moderate to high reproducibility for measuring adult exercise participation (kappa = 0.60) and energy expenditure (r(s) = 0.68), nonexercise activities (correlation coefficients = 0.42-0.68), and total daily energy expenditure (r(s) = 0.68, kappa(quartiles) = 0.47). Correlations between the PAQ and criterion measures of adult exercise were 0.45 (7-day physical activity recall) and 0.51 (physical activity log) for the first PAQ and 0.62 (7-day physical activity recall) and 0.71 (physical activity log) for the second PAQ. Correlations between PAQ nonexercise activities and the physical activity log and 7-day physical activity recall were 0.31-0.86. Correlations for total energy expenditure were high (0.62-0.77). Results indicate that the Shanghai Men's Health Study PAQ has reasonable reproducibility and validity for classifying men by their level of exercise and nonexercise activities in this cohort.

Assessing Discriminative Performance at External Validation of Clinical Prediction Models

PubMed Central

Nieboer, Daan; van der Ploeg, Tjeerd; Steyerberg, Ewout W.

2016-01-01

Introduction External validation studies are essential to study the generalizability of prediction models. Recently a permutation test, focusing on discrimination as quantified by the c-statistic, was proposed to judge whether a prediction model is transportable to a new setting. We aimed to evaluate this test and compare it to previously proposed procedures to judge any changes in c-statistic from development to external validation setting. Methods We compared the use of the permutation test to the use of benchmark values of the c-statistic following from a previously proposed framework to judge transportability of a prediction model. In a simulation study we developed a prediction model with logistic regression on a development set and validated them in the validation set. We concentrated on two scenarios: 1) the case-mix was more heterogeneous and predictor effects were weaker in the validation set compared to the development set, and 2) the case-mix was less heterogeneous in the validation set and predictor effects were identical in the validation and development set. Furthermore we illustrated the methods in a case study using 15 datasets of patients suffering from traumatic brain injury. Results The permutation test indicated that the validation and development set were homogenous in scenario 1 (in almost all simulated samples) and heterogeneous in scenario 2 (in 17%-39% of simulated samples). Previously proposed benchmark values of the c-statistic and the standard deviation of the linear predictors correctly pointed at the more heterogeneous case-mix in scenario 1 and the less heterogeneous case-mix in scenario 2. Conclusion The recently proposed permutation test may provide misleading results when externally validating prediction models in the presence of case-mix differences between the development and validation population. To correctly interpret the c-statistic found at external validation it is crucial to disentangle case-mix differences from incorrect

Assessing Discriminative Performance at External Validation of Clinical Prediction Models.

PubMed

Nieboer, Daan; van der Ploeg, Tjeerd; Steyerberg, Ewout W

2016-01-01

External validation studies are essential to study the generalizability of prediction models. Recently a permutation test, focusing on discrimination as quantified by the c-statistic, was proposed to judge whether a prediction model is transportable to a new setting. We aimed to evaluate this test and compare it to previously proposed procedures to judge any changes in c-statistic from development to external validation setting. We compared the use of the permutation test to the use of benchmark values of the c-statistic following from a previously proposed framework to judge transportability of a prediction model. In a simulation study we developed a prediction model with logistic regression on a development set and validated them in the validation set. We concentrated on two scenarios: 1) the case-mix was more heterogeneous and predictor effects were weaker in the validation set compared to the development set, and 2) the case-mix was less heterogeneous in the validation set and predictor effects were identical in the validation and development set. Furthermore we illustrated the methods in a case study using 15 datasets of patients suffering from traumatic brain injury. The permutation test indicated that the validation and development set were homogenous in scenario 1 (in almost all simulated samples) and heterogeneous in scenario 2 (in 17%-39% of simulated samples). Previously proposed benchmark values of the c-statistic and the standard deviation of the linear predictors correctly pointed at the more heterogeneous case-mix in scenario 1 and the less heterogeneous case-mix in scenario 2. The recently proposed permutation test may provide misleading results when externally validating prediction models in the presence of case-mix differences between the development and validation population. To correctly interpret the c-statistic found at external validation it is crucial to disentangle case-mix differences from incorrect regression coefficients.

Validation and Further Validation of a Measure of Creative Identity among USA and Finland Pre-Service Music Teachers

ERIC Educational Resources Information Center

Randles, Clint; Muhonen, Sari

2015-01-01

The purpose of this study was to validate a measure of creative identity with a population of pre-service teachers in the USA, to further validate the measure with a Finnish population, and to compare both populations regarding their perceptions of themselves as creative musicians. The researcher developed a tool, the "Creative Identity…

Estimation of low back moments from video analysis: a validation study.

PubMed

Coenen, Pieter; Kingma, Idsart; Boot, Cécile R L; Faber, Gert S; Xu, Xu; Bongers, Paulien M; van Dieën, Jaap H

2011-09-02

This study aimed to develop, compare and validate two versions of a video analysis method for assessment of low back moments during occupational lifting tasks since for epidemiological studies and ergonomic practice relatively cheap and easily applicable methods to assess low back loads are needed. Ten healthy subjects participated in a protocol comprising 12 lifting conditions. Low back moments were assessed using two variants of a video analysis method and a lab-based reference method. Repeated measures ANOVAs showed no overall differences in peak moments between the two versions of the video analysis method and the reference method. However, two conditions showed a minor overestimation of one of the video analysis method moments. Standard deviations were considerable suggesting that errors in the video analysis were random. Furthermore, there was a small underestimation of dynamic components and overestimation of the static components of the moments. Intraclass correlations coefficients for peak moments showed high correspondence (>0.85) of the video analyses with the reference method. It is concluded that, when a sufficient number of measurements can be taken, the video analysis method for assessment of low back loads during lifting tasks provides valid estimates of low back moments in ergonomic practice and epidemiological studies for lifts up to a moderate level of asymmetry. Copyright © 2011 Elsevier Ltd. All rights reserved.

Validation of the translation of an instrument to measure reliability of written information on treatment choices: a study on attention deficit/hyperactivity disorder (ADHD).

PubMed

Montoya, A; Llopis, N; Gilaberte, I

2011-12-01

DISCERN is an instrument designed to help patients assess the reliability of written information on treatment choices. Originally created in English, there is no validated Spanish version of this instrument. This study seeks to validate the Spanish translation of the DISCERN instrument used as a primary measure on a multicenter study aimed to assess the reliability of web-based information on treatment choices for attention deficit/hyperactivity disorder (ADHD). We used a modified version of a method for validating translated instruments in which the original source-language version is formally compared with the back-translated source-language version. Each item was ranked in terms of comparability of language, similarity of interpretability, and degree of understandability. Responses used Likert scales ranging from 1 to 7, where 1 indicates the best interpretability, language and understandability, and 7 indicates the worst. Assessments were performed by 20 raters fluent in the source language. The Spanish translation of DISCERN, based on ratings of comparability, interpretability and degree of understandability (mean score (SD): 1.8 (1.1), 1.4 (0.9) and 1.6 (1.1), respectively), was considered extremely comparable. All items received a score of less than three, therefore no further revision of the translation was needed. The validation process showed that the quality of DISCERN translation was high, validating the comparable language of the tool translated on assessing written information on treatment choices for ADHD.

The Impact of Health Literacy Status on the Comparative Validity and Sensitivity of an Interactive Multimedia Beverage Intake Questionnaire

PubMed Central

Hooper, Lucy P.; Myers, Emily A.; Zoellner, Jamie M.; Davy, Brenda M.; Hedrick, Valisa E.

2016-01-01

Self-reported dietary assessment methods can be challenging to validate, and reporting errors for those with lower health literacy (HL) may be augmented. Interactive multimedia (IMM) based questionnaires could help overcome these limitations. The objectives of this investigation are to assess the comparative validity and sensitivity to change of an IMM beverage intake questionnaire (IMM-BEVQ) as compared to dietary recalls and determine the impact of HL. Adults completed three 24-h dietary recalls and the IMM-BEVQ at baseline and after a six-month intervention targeting either sugar-sweetened beverages (SSB) or physical activity. Correlations and paired-samples t-tests are presented. For validity (n = 273), intake of SSB (mean difference = 10.6 fl oz) and total beverage consumption (mean difference = 16.0 fl oz) were significantly different (p ≤ 0.001) at baseline between the IMM-BEVQ and dietary recalls for all participants. However, the differences in intake were generally greater in low HL participants than in adequate HL participants. For sensitivity (n = 162), change in SSB intake (mean difference = 7.2 fl oz) was significantly different (p ≤ 0.01) between pre-/post-IMM-BEVQ and pre-/post-dietary recalls, but not total beverage intake (mean difference = 7.6 fl oz) for all participants. Changes in SSB and total beverage intake were not significantly different for those with adequate HL. The IMM-BEVQ is a valid dietary assessment tool that is as responsive to detecting changes in beverage intake as dietary recalls. However, adults with lower HL may need additional guidance when completing the IMM-BEVQ. PMID:28025538

The Impact of Health Literacy Status on the Comparative Validity and Sensitivity of an Interactive Multimedia Beverage Intake Questionnaire.

PubMed

Hooper, Lucy P; Myers, Emily A; Zoellner, Jamie M; Davy, Brenda M; Hedrick, Valisa E

2016-12-23

Self-reported dietary assessment methods can be challenging to validate, and reporting errors for those with lower health literacy (HL) may be augmented. Interactive multimedia (IMM) based questionnaires could help overcome these limitations. The objectives of this investigation are to assess the comparative validity and sensitivity to change of an IMM beverage intake questionnaire (IMM-BEVQ) as compared to dietary recalls and determine the impact of HL. Adults completed three 24-h dietary recalls and the IMM-BEVQ at baseline and after a six-month intervention targeting either sugar-sweetened beverages (SSB) or physical activity. Correlations and paired-samples t -tests are presented. For validity ( n = 273), intake of SSB (mean difference = 10.6 fl oz) and total beverage consumption (mean difference = 16.0 fl oz) were significantly different ( p ≤ 0.001) at baseline between the IMM-BEVQ and dietary recalls for all participants. However, the differences in intake were generally greater in low HL participants than in adequate HL participants. For sensitivity ( n = 162), change in SSB intake (mean difference = 7.2 fl oz) was significantly different ( p ≤ 0.01) between pre-/post-IMM-BEVQ and pre-/post-dietary recalls, but not total beverage intake (mean difference = 7.6 fl oz) for all participants. Changes in SSB and total beverage intake were not significantly different for those with adequate HL. The IMM-BEVQ is a valid dietary assessment tool that is as responsive to detecting changes in beverage intake as dietary recalls. However, adults with lower HL may need additional guidance when completing the IMM-BEVQ.

The 10/66 Dementia Research Group's fully operationalised DSM-IV dementia computerized diagnostic algorithm, compared with the 10/66 dementia algorithm and a clinician diagnosis: a population validation study

PubMed Central

Prince, Martin J; de Rodriguez, Juan Llibre; Noriega, L; Lopez, A; Acosta, Daisy; Albanese, Emiliano; Arizaga, Raul; Copeland, John RM; Dewey, Michael; Ferri, Cleusa P; Guerra, Mariella; Huang, Yueqin; Jacob, KS; Krishnamoorthy, ES; McKeigue, Paul; Sousa, Renata; Stewart, Robert J; Salas, Aquiles; Sosa, Ana Luisa; Uwakwa, Richard

2008-01-01

Background The criterion for dementia implicit in DSM-IV is widely used in research but not fully operationalised. The 10/66 Dementia Research Group sought to do this using assessments from their one phase dementia diagnostic research interview, and to validate the resulting algorithm in a population-based study in Cuba. Methods The criterion was operationalised as a computerised algorithm, applying clinical principles, based upon the 10/66 cognitive tests, clinical interview and informant reports; the Community Screening Instrument for Dementia, the CERAD 10 word list learning and animal naming tests, the Geriatric Mental State, and the History and Aetiology Schedule – Dementia Diagnosis and Subtype. This was validated in Cuba against a local clinician DSM-IV diagnosis and the 10/66 dementia diagnosis (originally calibrated probabilistically against clinician DSM-IV diagnoses in the 10/66 pilot study). Results The DSM-IV sub-criteria were plausibly distributed among clinically diagnosed dementia cases and controls. The clinician diagnoses agreed better with 10/66 dementia diagnosis than with the more conservative computerized DSM-IV algorithm. The DSM-IV algorithm was particularly likely to miss less severe dementia cases. Those with a 10/66 dementia diagnosis who did not meet the DSM-IV criterion were less cognitively and functionally impaired compared with the DSMIV confirmed cases, but still grossly impaired compared with those free of dementia. Conclusion The DSM-IV criterion, strictly applied, defines a narrow category of unambiguous dementia characterized by marked impairment. It may be specific but incompletely sensitive to clinically relevant cases. The 10/66 dementia diagnosis defines a broader category that may be more sensitive, identifying genuine cases beyond those defined by our DSM-IV algorithm, with relevance to the estimation of the population burden of this disorder. PMID:18577205

Introducing conjoint analysis method into delayed lotteries studies: its validity and time stability are higher than in adjusting.

PubMed

Białek, Michał; Markiewicz, Łukasz; Sawicki, Przemysław

2015-01-01

The delayed lotteries are much more common in everyday life than are pure lotteries. Usually, we need to wait to find out the outcome of the risky decision (e.g., investing in a stock market, engaging in a relationship). However, most research has studied the time discounting and probability discounting in isolation using the methodologies designed specifically to track changes in one parameter. Most commonly used method is adjusting, but its reported validity and time stability in research on discounting are suboptimal. The goal of this study was to introduce the novel method for analyzing delayed lotteries-conjoint analysis-which hypothetically is more suitable for analyzing individual preferences in this area. A set of two studies compared the conjoint analysis with adjusting. The results suggest that individual parameters of discounting strength estimated with conjoint have higher predictive value (Study 1 and 2), and they are more stable over time (Study 2) compared to adjusting. We discuss these findings, despite the exploratory character of reported studies, by suggesting that future research on delayed lotteries should be cross-validated using both methods.

Introducing conjoint analysis method into delayed lotteries studies: its validity and time stability are higher than in adjusting

PubMed Central

Białek, Michał; Markiewicz, Łukasz; Sawicki, Przemysław

2015-01-01

The delayed lotteries are much more common in everyday life than are pure lotteries. Usually, we need to wait to find out the outcome of the risky decision (e.g., investing in a stock market, engaging in a relationship). However, most research has studied the time discounting and probability discounting in isolation using the methodologies designed specifically to track changes in one parameter. Most commonly used method is adjusting, but its reported validity and time stability in research on discounting are suboptimal. The goal of this study was to introduce the novel method for analyzing delayed lotteries—conjoint analysis—which hypothetically is more suitable for analyzing individual preferences in this area. A set of two studies compared the conjoint analysis with adjusting. The results suggest that individual parameters of discounting strength estimated with conjoint have higher predictive value (Study 1 and 2), and they are more stable over time (Study 2) compared to adjusting. We discuss these findings, despite the exploratory character of reported studies, by suggesting that future research on delayed lotteries should be cross-validated using both methods. PMID:25674069

PLCO Ovarian Phase III Validation Study — EDRN Public Portal

Cancer.gov

Our preliminary data indicate that the performance of CA 125 as a screening test for ovarian cancer can be improved upon by additional biomarkers. With completion of one additional validation step, we will be ready to test the performance of a consensus marker panel in a phase III validation study. Given the original aims of the PLCO trial, we believe that the PLCO represents an ideal longitudinal cohort offering specimens for phase III validation of ovarian cancer biomarkers.

Validating a Fidelity Scale to Understand Intervention Effects in Classroom-Based Studies

ERIC Educational Resources Information Center

Buckley, Pamela; Moore, Brooke; Boardman, Alison G.; Arya, Diana J.; Maul, Andrew

2017-01-01

K-12 intervention studies often include fidelity of implementation (FOI) as a mediating variable, though most do not report the validity of fidelity measures. This article discusses the critical need for validated FOI scales. To illustrate our point, we describe the development and validation of the Implementation Validity Checklist (IVC-R), an…

Dimensions of Intuition: First-Round Validation Studies

ERIC Educational Resources Information Center

Vrugtman, Rosanne

2009-01-01

This study utilized confirmatory factor analysis (CFA), canonical correlation analysis (CCA), regression analysis (RA), and correlation analysis (CA) for first-round validation of the researcher's Dimensions of Intuition (DOI) instrument. The DOI examined 25 personal characteristics and situations purportedly predictive of intuition. Data was…

Comparing and Validating Machine Learning Models for Mycobacterium tuberculosis Drug Discovery.

PubMed

Lane, Thomas; Russo, Daniel P; Zorn, Kimberley M; Clark, Alex M; Korotcov, Alexandru; Tkachenko, Valery; Reynolds, Robert C; Perryman, Alexander L; Freundlich, Joel S; Ekins, Sean

2018-04-26

Tuberculosis is a global health dilemma. In 2016, the WHO reported 10.4 million incidences and 1.7 million deaths. The need to develop new treatments for those infected with Mycobacterium tuberculosis ( Mtb) has led to many large-scale phenotypic screens and many thousands of new active compounds identified in vitro. However, with limited funding, efforts to discover new active molecules against Mtb needs to be more efficient. Several computational machine learning approaches have been shown to have good enrichment and hit rates. We have curated small molecule Mtb data and developed new models with a total of 18,886 molecules with activity cutoffs of 10 μM, 1 μM, and 100 nM. These data sets were used to evaluate different machine learning methods (including deep learning) and metrics and to generate predictions for additional molecules published in 2017. One Mtb model, a combined in vitro and in vivo data Bayesian model at a 100 nM activity yielded the following metrics for 5-fold cross validation: accuracy = 0.88, precision = 0.22, recall = 0.91, specificity = 0.88, kappa = 0.31, and MCC = 0.41. We have also curated an evaluation set ( n = 153 compounds) published in 2017, and when used to test our model, it showed the comparable statistics (accuracy = 0.83, precision = 0.27, recall = 1.00, specificity = 0.81, kappa = 0.36, and MCC = 0.47). We have also compared these models with additional machine learning algorithms showing Bayesian machine learning models constructed with literature Mtb data generated by different laboratories generally were equivalent to or outperformed deep neural networks with external test sets. Finally, we have also compared our training and test sets to show they were suitably diverse and different in order to represent useful evaluation sets. Such Mtb machine learning models could help prioritize compounds for testing in vitro and in vivo.

Applicability of Monte Carlo cross validation technique for model development and validation using generalised least squares regression

NASA Astrophysics Data System (ADS)

Haddad, Khaled; Rahman, Ataur; A Zaman, Mohammad; Shrestha, Surendra

2013-03-01

SummaryIn regional hydrologic regression analysis, model selection and validation are regarded as important steps. Here, the model selection is usually based on some measurements of goodness-of-fit between the model prediction and observed data. In Regional Flood Frequency Analysis (RFFA), leave-one-out (LOO) validation or a fixed percentage leave out validation (e.g., 10%) is commonly adopted to assess the predictive ability of regression-based prediction equations. This paper develops a Monte Carlo Cross Validation (MCCV) technique (which has widely been adopted in Chemometrics and Econometrics) in RFFA using Generalised Least Squares Regression (GLSR) and compares it with the most commonly adopted LOO validation approach. The study uses simulated and regional flood data from the state of New South Wales in Australia. It is found that when developing hydrologic regression models, application of the MCCV is likely to result in a more parsimonious model than the LOO. It has also been found that the MCCV can provide a more realistic estimate of a model's predictive ability when compared with the LOO.

Automated Essay Scoring versus Human Scoring: A Comparative Study

ERIC Educational Resources Information Center

Wang, Jinhao; Brown, Michelle Stallone

2007-01-01

The current research was conducted to investigate the validity of automated essay scoring (AES) by comparing group mean scores assigned by an AES tool, IntelliMetric [TM] and human raters. Data collection included administering the Texas version of the WriterPlacer "Plus" test and obtaining scores assigned by IntelliMetric [TM] and by…

AOAC Official MethodSM Matrix Extension Validation Study of Assurance GDSTM for the Detection of Salmonella in Selected Spices.

PubMed

Feldsine, Philip; Kaur, Mandeep; Shah, Khyati; Immerman, Amy; Jucker, Markus; Lienau, Andrew

2015-01-01

Assurance GDSTM for Salmonella Tq has been validated according to the AOAC INTERNATIONAL Methods Committee Guidelines for Validation of Microbiological Methods for Food and Environmental Surfaces for the detection of selected foods and environmental surfaces (Official Method of AnalysisSM 2009.03, Performance Tested MethodSM No. 050602). The method also completed AFNOR validation (following the ISO 16140 standard) compared to the reference method EN ISO 6579. For AFNOR, GDS was given a scope covering all human food, animal feed stuff, and environmental surfaces (Certificate No. TRA02/12-01/09). Results showed that Assurance GDS for Salmonella (GDS) has high sensitivity and is equivalent to the reference culture methods for the detection of motile and non-motile Salmonella. As part of the aforementioned validations, inclusivity and exclusivity studies, stability, and ruggedness studies were also conducted. Assurance GDS has 100% inclusivity and exclusivity among the 100 Salmonella serovars and 35 non-Salmonella organisms analyzed. To add to the scope of the Assurance GDS for Salmonella method, a matrix extension study was conducted, following the AOAC guidelines, to validate the application of the method for selected spices, specifically curry powder, cumin powder, and chili powder, for the detection of Salmonella.

Validity of the modified RULA for computer workers and reliability of one observation compared to six.

PubMed

Levanon, Yafa; Lerman, Yehuda; Gefen, Amit; Ratzon, Navah Z

2014-01-01

Awkward body posture while typing is associated with musculoskeletal disorders (MSDs). Valid rapid assessment of computer workers' body posture is essential for the prevention of MSD among this large population. This study aimed to examine the validity of the modified rapid upper limb assessment (mRULA) which adjusted the rapid upper limb assessment (RULA) for computer workers. Moreover, this study examines whether one observation during a working day is sufficient or more observations are needed. A total of 29 right-handed computer workers were recruited. RULA and mRULA were conducted. The observations were then repeated six times at one-hour intervals. A significant moderate correlation (r = 0.6 and r = 0.7 for mouse and keyboard, respectively) was found between the assessments. No significant differences were found between one observation and six observations per working day. The mRULA was found to be valid for the assessment of computer workers, and one observation was sufficient to assess the work-related risk factor.

Reliability and Validity Study of a Tool to Measure Cancer Stigma: Patient Version.

PubMed

Yılmaz, Medine; Dişsiz, Gülçin; Demir, Filiz; Irız, Sibel; Alacacioglu, Ahmet

2017-01-01

The aim of this methodological study is to establish the validity and reliability of the Turkish version of "A Questionnaire for Measuring Attitudes toward Cancer (Cancer Stigma) - Patient version." The sample comprised oncology patients who had active cancer treatment. The construct validity was assessed using the confirmatory and exploratory factor analysis. The mean age of the participants was 54.9±12.3 years. In the confirmatory factor analysis, fit values were determined as comparative fit index = 0.93, goodness of fit index = 0.91, normed-fit index=0.91, and root mean square error of approximation RMSEA = 0.09 ( P <0.05) (Kaiser-Meyer-Olkin = 0.88, χ 2 = 1084.41, Df = 66, and Barletta's test P <0.000). The first factor was "impossibility of recovery and experience of social discrimination" and the second factor was "stereotypes of cancer patients." The two-factor structure accounted for 56.74% of the variance. The Cronbach's alpha value was determined as 0.88 for the two-factor scale. "A questionnaire for measuring attitudes toward cancer (cancer stigma) - Patient version" is a reliable and valid questionnaire to assess stigmatization of cancer in cancer patients.

A population based validation study of self-reported pensions and benefits: the Nord-Trøndelag health study (HUNT).

PubMed

Myrtveit, Solbjørg Makalani; Ariansen, Anja M S; Wilhelmsen, Ingvard; Krokstad, Steinar; Mykletun, Arnstein

2013-01-23

Measures of disability pensions, sickness certification and long-term health related benefits are often self-reported in epidemiological studies. Few studies have examined these measures, and the validity is yet to be established.We aimed to estimate the validity of self-reported disability pension, rehabilitation benefit and retirement pension and to explore the benefit status and basic characteristics of those not responding to these items.A large health survey (HUNT2) containing self-reported questionnaire data on sickness benefits and pensions was linked to a national registry of pensions and benefits, used as "gold standard" for the analysis. We investigated two main sources of bias in self-reported data; misclassification - due to participants answering questions incorrectly, and systematic missing/selection bias - when participants do not respond to the questions.Sensitivity, specificity, positive (PPV) and negative (NPV) predicative value, agreement and Cohen's Kappa were calculated for each benefit. Co-variables were compared between non-responders and responders. In the study-population of 40,633, 9.2% reported receiving disability pension, 1.4% rehabilitation benefits and 6.1% retirement pension. According to the registry, the corresponding numbers were 9.0%, 1.7% and 5.4%. Excluding non-responders, specificity, NPV and agreement were above 98% for all benefits. Sensitivity and PPV were lower. When including non-responders as non-receivers, specificity got higher, sensitivity dropped while the other measures changed less.Between 17.7% and 24.1% did not answer the questions on benefits. Non-responders were older and more likely to be female. They reported more anxiety, more depression, a higher number of somatic diagnoses, less physical activity and lower consumption of alcohol (p < 0.001 for all variables). For disability pension and retirement pension, non-responders were less likely to receive benefits than responders (p < 0.001). For each

Comparing a combination of validated questionnaires and level III portable monitor with polysomnography to diagnose and exclude sleep apnea.

PubMed

Pereira, Effie J; Driver, Helen S; Stewart, Steven C; Fitzpatrick, Michael F

2013-12-15

Questionnaires have been validated as screening tools in adult populations at risk for obstructive sleep apnea (OSA). Portable monitors (PM) have gained acceptance for confirmation of OSA in some patients with a high pretest probability of the disorder. We evaluated the combined diagnostic utility of 3 validated questionnaires and a Level III PM in the diagnosis and exclusion of OSA, as compared with in-laboratory polysomnography (PSG) derived apnea hypopnea index (AHI). Consecutive patients referred to the Sleep Disorders Clinic completed 3 testing components: (1) 3 questionnaires (Berlin, STOP-Bang, and Sleep Apnea Clinical Score [SACS]); (2) Level III at-home PM (MediByte) study; and (3) Level I in-laboratory PSG. The utility of individual questionnaires, the Level III device alone, and the combination of questionnaires and the Level III device were compared with the PSG. One hundred twenty-eight patients participated in the study (84M, 44F), mean ± SD age 50 ± 12.3years, BMI 31 ± 6.6 kg/m(2). At a PSG threshold AHI = 10, the PM derived respiratory disturbance index (RDI) had a sensitivity and specificity of 79% and 86%, respectively. The sensitivity and specificity for the other screening tools were: Berlin 88%, 25%; STOP-Bang 90%, 25%; SACS 33%, 75%. The sensitivity and specificity at a PSG AHI = 15 were: PM 77%, 95%; Berlin 91%, 28%; STOP-Bang 93%, 28%; SACS 35%, 78%. Questionnaires alone, possibly given a reliance on sleepiness as a symptom, cannot reliably rule out the presence of OSA. Objective physiological measurement is critical for the diagnosis and exclusion of OSA.

Measuring leprosy-related stigma - a pilot study to validate a toolkit of instruments.

PubMed

Rensen, Carin; Bandyopadhyay, Sudhakar; Gopal, Pala K; Van Brakel, Wim H

2011-01-01

Stigma negatively affects the quality of life of leprosy-affected people. Instruments are needed to assess levels of stigma and to monitor and evaluate stigma reduction interventions. We conducted a validation study of such instruments in Tamil Nadu and West Bengal, India. Four instruments were tested in a 'Community Based Rehabilitation' (CBR) setting, the Participation Scale, Internalised Scale of Mental Illness (ISMI) adapted for leprosy-affected persons, Explanatory Model Interview Catalogue (EMIC) for leprosy-affected and non-affected persons and the General Self-Efficacy (GSE) Scale. We evaluated the following components of validity, construct validity, internal consistency, test-retest reproducibility and reliability to distinguish between groups. Construct validity was tested by correlating instrument scores and by triangulating quantitative and qualitative findings. Reliability was evaluated by comparing levels of stigma among people affected by leprosy and community controls, and among affected people living in CBR project areas and those in non-CBR areas. For the Participation, ISMI and EMIC scores significant differences were observed between those affected by leprosy and those not affected (p = 0.0001), and between affected persons in the CBR and Control group (p < 0.05). The internal consistency of the instruments measured with Cronbach's α ranged from 0.83 to 0.96 and was very good for all instruments. Test-retest reproducibility coefficients were 0.80 for the Participation score, 0.70 for the EMIC score, 0.62 for the ISMI score and 0.50 for the GSE score. The construct validity of all instruments was confirmed. The Participation and EMIC Scales met all validity criteria, but test-retest reproducibility of the ISMI and GSE Scales needs further evaluation with a shorter test-retest interval and longer training and additional adaptations for the latter.

Assessment of sedentary behaviors and transport-related activities by questionnaire: a validation study.

PubMed

Mensah, Keitly; Maire, Aurélia; Oppert, Jean-Michel; Dugas, Julien; Charreire, Hélène; Weber, Christiane; Simon, Chantal; Nazare, Julie-Anne

2016-08-09

��= 0.19). Compared to contextualized logbook, STAQ estimates of TRA was higher for car (r = 0.65) than for active transport (r = 0.41). The questionnaire generally overestimated work- and leisure-related SB and sitting times, while it underestimated total and transport-related sitting times. The STAQ showed acceptable reliability and a good ranking validity for assessment of context-specific SB and TRA. This instrument appears as a useful tool to study SB, TRA and PA in context in adults.

Test of Creative Imagination: Validity and Reliability Study

ERIC Educational Resources Information Center

Gundogan, Aysun; Ari, Meziyet; Gonen, Mubeccel

2013-01-01

The purpose of this study was to investigate validity and reliability of the test of creative imagination. This study was conducted with the participation of 1000 children, aged between 9-14 and were studying in six primary schools in the city center of Denizli Province, chosen by cluster ratio sampling. In the study, it was revealed that the…

Validation of different instruments for caffeine measurement among premenopausal women in the BioCycle study.

PubMed

Schliep, Karen C; Schisterman, Enrique F; Mumford, Sunni L; Perkins, Neil J; Ye, Aijun; Pollack, Anna Z; Zhang, Cuilin; Porucznik, Christina A; VanDerslice, James A; Stanford, Joseph B; Wactawski-Wende, Jean

2013-04-01

Effects of caffeine on women's health are inconclusive, in part because of inadequate exposure assessment. In this study we determined 1) validity of a food frequency questionnaire compared with multiple 24-hour dietary recalls (24HDRs) for measuring monthly caffeine and caffeinated beverage intakes; and 2) validity of the 24HDR compared with the prior day's diary record for measuring daily caffeinated coffee intake. BioCycle Study (2005-2007) participants, women (n = 259) aged 18-44 years from western New York State, were followed for 2 menstrual cycles. Participants completed a food frequency questionnaire at the end of each cycle, four 24HDRs per cycle, and daily diaries. Caffeine intakes reported for the food frequency questionnaires were greater than those reported for the 24HDRs (mean = 114.1 vs. 92.6mg/day, P = 0.01) but showed high correlation (r = 0.73, P < 0.001) and moderate agreement (К = 0.51, 95% confidence interval: 0.43, 0.57). Women reported less caffeinated coffee intake in their 24HDRs compared with their corresponding diary days (mean = 0.51 vs. 0.80 cups/day, P < 0.001) (1 cup = 237 mL). Although caffeine and coffee exposures were highly correlated, absolute intakes differed significantly between measurement tools. These results highlight the importance of considering potential misclassification of caffeine exposure.

Validation of Different Instruments for Caffeine Measurement Among Premenopausal Women in the BioCycle Study

PubMed Central

Schliep, Karen C.; Schisterman, Enrique F.; Mumford, Sunni L.; Perkins, Neil J.; Ye, Aijun; Pollack, Anna Z.; Zhang, Cuilin; Porucznik, Christina A.; VanDerslice, James A.; Stanford, Joseph B.; Wactawski-Wende, Jean

2013-01-01

Effects of caffeine on women's health are inconclusive, in part because of inadequate exposure assessment. In this study we determined 1) validity of a food frequency questionnaire compared with multiple 24-hour dietary recalls (24HDRs) for measuring monthly caffeine and caffeinated beverage intakes; and 2) validity of the 24HDR compared with the prior day's diary record for measuring daily caffeinated coffee intake. BioCycle Study (2005–2007) participants, women (n = 259) aged 18–44 years from western New York State, were followed for 2 menstrual cycles. Participants completed a food frequency questionnaire at the end of each cycle, four 24HDRs per cycle, and daily diaries. Caffeine intakes reported for the food frequency questionnaires were greater than those reported for the 24HDRs (mean = 114.1 vs. 92.6mg/day, P = 0.01) but showed high correlation (r = 0.73, P < 0.001) and moderate agreement (К = 0.51, 95% confidence interval: 0.43, 0.57). Women reported less caffeinated coffee intake in their 24HDRs compared with their corresponding diary days (mean = 0.51 vs. 0.80 cups/day, P < 0.001) (1 cup = 237 mL). Although caffeine and coffee exposures were highly correlated, absolute intakes differed significantly between measurement tools. These results highlight the importance of considering potential misclassification of caffeine exposure. PMID:23462965

Comparing the Validity of Informant- and Self-reports of Personality Using Laboratory Indices of Emotional Responding as Criterion Variables

PubMed Central

Lieberman, Lynne; Liu, Huiting; Huggins, Ashley A.; Katz, Andrea C.; Zvolensky, Michael J.; Shankman, Stewart A.

2016-01-01

Personality traits relate to risk for psychopathology and can inform predictions about treatment outcome. In an effort to obtain a comprehensive index of personality, informant-reports of personality are sometimes obtained in addition to self-reports of personality. However, there is limited research comparing the validity of self- and informant-reports of personality, particularly among those with internalizing psychopathology. This is important given that informants may provide an additional (and perhaps different) perspective on individuals’ personality. The present study therefore compared how both reports of positive affectivity (PA) and negative affectivity (NA) relate to psychophysiological and subjective measures of emotional responding to positive and negative stimuli. Given that our sample (n = 117) included individuals with no history of psychopathology, as well as individuals with major depressive disorder (MDD) and/or panic disorder (PD), we were also able to explore whether these internalizing diagnoses moderated the association between personality reports and measures of emotional responding. Informant-reported PA predicted physiological responses to positive stimuli (but not negative). Informant reported NA predicted physiological responses to negative stimuli (but not positive). Self-reported personality did not predict physiological responding, but did predict subjectively measured emotional responding (NA for negative responding; PA for positive responding). Diagnoses of internalizing psychopathology (PD or MDD) did not moderate these associations. Results suggest self- and informant-reports of personality may each provide valid indices of an individual’s emotional response tendencies, but predict different aspects of those tendencies. PMID:27273802

Comparing the validity of informant and self-reports of personality using laboratory indices of emotional responding as criterion variables.

PubMed

Lieberman, Lynne; Liu, Huiting; Huggins, Ashley A; Katz, Andrea C; Zvolensky, Michael J; Shankman, Stewart A

2016-09-01

Personality traits relate to risk for psychopathology and can inform predictions about treatment outcome. In an effort to obtain a comprehensive index of personality, informant reports of personality are sometimes obtained in addition to self-reports of personality. However, there is limited research comparing the validity of self- and informant reports of personality, particularly among those with internalizing psychopathology. This is important given that informants may provide an additional (and perhaps different) perspective on individuals' personality. The present study therefore compared how both reports of positive affectivity (PA) and negative affectivity (NA) relate to psychophysiological and subjective measures of emotional responding to positive and negative stimuli. Given that our sample (n = 117) included individuals with no history of psychopathology, as well as individuals with major depressive disorder (MDD) and/or panic disorder (PD), we were also able to explore whether these internalizing diagnoses moderated the association between personality reports and measures of emotional responding. Informant-reported PA predicted physiological responses to positive stimuli (but not negative). Informant-reported NA predicted physiological responses to negative stimuli (but not positive). Self-reported personality did not predict physiological responding, but did predict subjectively measured emotional responding (NA for negative responding, PA for positive responding). Diagnoses of internalizing psychopathology (PD or MDD) did not moderate these associations. Results suggest self- and informant reports of personality may each provide valid indices of an individual's emotional response tendencies, but predict different aspects of those tendencies. © 2016 Society for Psychophysiological Research.

A reliability and validity study of the Palliative Performance Scale

PubMed Central

Ho, Francis; Lau, Francis; Downing, Michael G; Lesperance, Mary

2008-01-01

Background The Palliative Performance Scale (PPS) was first introduced in1996 as a new tool for measurement of performance status in palliative care. PPS has been used in many countries and has been translated into other languages. Methods This study evaluated the reliability and validity of PPS. A web-based, case scenarios study with a test-retest format was used to determine reliability. Fifty-three participants were recruited and randomly divided into two groups, each evaluating 11 cases at two time points. The validity study was based on the content validation of 15 palliative care experts conducted over telephone interviews, with discussion on five themes: PPS as clinical assessment tool, the usefulness of PPS, PPS scores affecting decision making, the problems in using PPS, and the adequacy of PPS instruction. Results The intraclass correlation coefficients for absolute agreement were 0.959 and 0.964 for Group 1, at Time-1 and Time-2; 0.951 and 0.931 for Group 2, at Time-1 and Time-2 respectively. Results showed that the participants were consistent in their scoring over the two times, with a mean Cohen's kappa of 0.67 for Group 1 and 0.71 for Group 2. In the validity study, all experts agreed that PPS is a valuable clinical assessment tool in palliative care. Many of them have already incorporated PPS as part of their practice standard. Conclusion The results of the reliability study demonstrated that PPS is a reliable tool. The validity study found that most experts did not feel a need to further modify PPS and, only two experts requested that some performance status measures be defined more clearly. Areas of PPS use include prognostication, disease monitoring, care planning, hospital resource allocation, clinical teaching and research. PPS is also a good communication tool between palliative care workers. PMID:18680590

Identifying Psoriasis and Psoriatic Arthritis Patients in Retrospective Databases When Diagnosis Codes Are Not Available: A Validation Study Comparing Medication/Prescriber Visit-Based Algorithms with Diagnosis Codes.

PubMed

Dobson-Belaire, Wendy; Goodfield, Jason; Borrelli, Richard; Liu, Fei Fei; Khan, Zeba M

2018-01-01

Using diagnosis code-based algorithms is the primary method of identifying patient cohorts for retrospective studies; nevertheless, many databases lack reliable diagnosis code information. To develop precise algorithms based on medication claims/prescriber visits (MCs/PVs) to identify psoriasis (PsO) patients and psoriatic patients with arthritic conditions (PsO-AC), a proxy for psoriatic arthritis, in Canadian databases lacking diagnosis codes. Algorithms were developed using medications with narrow indication profiles in combination with prescriber specialty to define PsO and PsO-AC. For a 3-year study period from July 1, 2009, algorithms were validated using the PharMetrics Plus database, which contains both adjudicated medication claims and diagnosis codes. Positive predictive value (PPV), negative predictive value (NPV), sensitivity, and specificity of the developed algorithms were assessed using diagnosis code as the reference standard. Chosen algorithms were then applied to Canadian drug databases to profile the algorithm-identified PsO and PsO-AC cohorts. In the selected database, 183,328 patients were identified for validation. The highest PPVs for PsO (85%) and PsO-AC (65%) occurred when a predictive algorithm of two or more MCs/PVs was compared with the reference standard of one or more diagnosis codes. NPV and specificity were high (99%-100%), whereas sensitivity was low (≤30%). Reducing the number of MCs/PVs or increasing diagnosis claims decreased the algorithms' PPVs. We have developed an MC/PV-based algorithm to identify PsO patients with a high degree of accuracy, but accuracy for PsO-AC requires further investigation. Such methods allow researchers to conduct retrospective studies in databases in which diagnosis codes are absent. Copyright © 2018 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Validating the Center for Epidemiological Studies Depression Scale for Children in Rwanda

PubMed Central

Betancourt, Theresa; Scorza, Pamela; Meyers-Ohki, Sarah; Mushashi, Christina; Kayiteshonga, Yvonne; Binagwaho, Agnes; Stulac, Sara; Beardslee, William R.

2017-01-01

Objective We assessed the validity of the Center for Epidemiological Studies Depression Scale for Children (CES-DC) as a screen for depression in Rwandan children and adolescents. Although the CES-DC is widely used for depression screening in high-income countries, its validity in low-income and culturally diverse settings, including sub-Saharan Africa, is unknown. Method The CES-DC was selected based on alignment with local expressions of depression-like problems in Rwandan children and adolescents. To examine criterion validity, we compared CES-DC scores to depression diagnoses on a structured diagnostic interview, the Mini International Neuropsychiatric Interview for Children (MINI KID), in a sample of 367 Rwandan children and adolescents aged 10 through 17 years. Caregiver and child or adolescent self-reports endorsing the presence of local depression-like problems agahinda kenshi (persistent sorrow) and kwiheba (severe hopelessness) were also examined for agreement with MINI KID diagnosis. Results The CES-DC exhibited good internal reliability (α = .86) and test-retest reliability (r = .85). The area under the receiver operating characteristic curve for the CES-DC was 0.825 when compared to MINI KID diagnoses, indicating a strong ability to distinguish between depressed and nondepressed children and adolescents in Rwanda. A cut point of ≥ 30 corresponded with a sensitivity of 81.9% and a specificity of 71.9% in this referred sample. MINI KID diagnosis was well aligned with local expressions of depression-like problems. Conclusion The CES-DC demonstrates good psychometric properties for clinical screening and evaluation in Rwanda, and should be considered for use in this and other low-resource settings. Population samples are needed to determine a generalizable cut point in nonreferred samples. PMID:23200285

Quality Assessment of Comparative Diagnostic Accuracy Studies: Our Experience Using a Modified Version of the QUADAS-2 Tool

ERIC Educational Resources Information Center

Wade, Ros; Corbett, Mark; Eastwood, Alison

2013-01-01

Assessing the quality of included studies is a vital step in undertaking a systematic review. The recently revised Quality Assessment of Diagnostic Accuracy Studies (QUADAS) tool (QUADAS-2), which is the only validated quality assessment tool for diagnostic accuracy studies, does not include specific criteria for assessing comparative studies. As…

Reproducibility and validity of the Shanghai Women's Health Study physical activity questionnaire.

PubMed

Matthews, Charles E; Shu, Xiao-Ou; Yang, Gong; Jin, Fan; Ainsworth, Barbara E; Liu, Dake; Gao, Yu-Tang; Zheng, Wei

2003-12-01

In this investigation, the authors evaluated the reproducibility and validity of the Shanghai Women's Health Study (SWHS) physical activity questionnaire (PAQ), which was administered in a cohort study of approximately 75,000 Chinese women aged 40-70 years. Reproducibility (2-year test-retest) was evaluated using kappa statistics and intraclass correlation coefficients (ICCs). Validity was evaluated by comparing Spearman correlations (r) for the SWHS PAQ with two criterion measures administered over a period of 12 months: four 7-day physical activity logs and up to 28 7-day PAQs. Women were recruited from the SWHS cohort (n = 200). Results indicated that the reproducibility of adolescent and adult exercise participation (kappa = 0.85 and kappa = 0.64, respectively) and years of adolescent exercise and adult exercise energy expenditure (ICC = 0.83 and ICC = 0.70, respectively) was reasonable. Reproducibility values for adult lifestyle activities were lower (ICC = 0.14-0.54). Significant correlations between the PAQ and criterion measures of adult exercise were observed for the first PAQ administration (physical activity log, r = 0.50; 7-day PAQ, r = 0.62) and the second PAQ administration (physical activity log, r = 0.74; 7-day PAQ, r = 0.80). Significant correlations between PAQ lifestyle activities and the 7-day PAQ were also noted (r = 0.33-0.88). These data indicate that the SWHS PAQ is a reproducible and valid measure of exercise behaviors and that it demonstrates utility in stratifying women by levels of important lifestyle activities (e.g., housework, walking, cycling).

Can We Study Autonomous Driving Comfort in Moving-Base Driving Simulators? A Validation Study.

PubMed

Bellem, Hanna; Klüver, Malte; Schrauf, Michael; Schöner, Hans-Peter; Hecht, Heiko; Krems, Josef F

2017-05-01

To lay the basis of studying autonomous driving comfort using driving simulators, we assessed the behavioral validity of two moving-base simulator configurations by contrasting them with a test-track setting. With increasing level of automation, driving comfort becomes increasingly important. Simulators provide a safe environment to study perceived comfort in autonomous driving. To date, however, no studies were conducted in relation to comfort in autonomous driving to determine the extent to which results from simulator studies can be transferred to on-road driving conditions. Participants ( N = 72) experienced six differently parameterized lane-change and deceleration maneuvers and subsequently rated the comfort of each scenario. One group of participants experienced the maneuvers on a test-track setting, whereas two other groups experienced them in one of two moving-base simulator configurations. We could demonstrate relative and absolute validity for one of the two simulator configurations. Subsequent analyses revealed that the validity of the simulator highly depends on the parameterization of the motion system. Moving-base simulation can be a useful research tool to study driving comfort in autonomous vehicles. However, our results point at a preference for subunity scaling factors for both lateral and longitudinal motion cues, which might be explained by an underestimation of speed in virtual environments. In line with previous studies, we recommend lateral- and longitudinal-motion scaling factors of approximately 50% to 60% in order to obtain valid results for both active and passive driving tasks.

Test–retest reliability and validity of a web-based food-frequency questionnaire for adolescents aged 13–14 to be used in the Norwegian Mother and Child Cohort Study (MoBa)

PubMed Central

Øverby, Nina Cecilie; Johannesen, Elisabeth; Jensen, Grete; Skjaevesland, Anne-Kirsti; Haugen, Margaretha

2014-01-01

Background The assessment of food intake is challenging and prone to errors; it is therefore important to consider the reliability and validity of the assessment methods. Objective The aim of this study was to analyze the reproducibility and validity of a developed food-frequency questionnaire (FFQ) for use among adolescents. Design In total, 58 students (aged 13–14) from four different schools in the southern part of Norway participated in the reproducibility study of filling out the FFQ 4 weeks apart. In addition, 93 students participated in the relative validity study where the FFQ was compared to 2×24-hour dietary recalls, while 92 students participated in the absolute validity study where the intakes of fatty acids and vitamin D from the FFQ were compared to fatty acids and 25-hydroxy-vitamin D3 in whole blood. Results The median Spearman correlation coefficient for all nutrients in the test–retest reliability study was 0.57. The median Spearman correlation for all nutrients in the relative validity study was 0.26, while the correlations coefficients were low in the absolute validity study with n-3 fatty acid coefficients ranging from 0.05 to 0.25, and absent for vitamin D (r=0.000). Conclusion The test–retest reproducibility was considered good, the relative validity was considered poor to good, and the absolute validity was considered poor. However, the results are comparable to other studies among adolescents. PMID:25371661

Fun and Games: The Validity of Games for the Study of Conflict

ERIC Educational Resources Information Center

Schlenker, Barry R.; Bonoma, Thomas V.

1978-01-01

Examines claimed advantages and criticisms of the use of games in the study of social conflict, differentiating the advantages and criticisms into questions of internal validity, external validity, and ecological validity. Available from: Sage Publications, Inc., 275 South Beverly Drive, Beverly Hills, California 90212. (JG)

[Validation of the IBS-SSS].

PubMed

Betz, C; Mannsdörfer, K; Bischoff, S C

2013-10-01

Irritable bowel syndrome (IBS) is a functional gastrointestinal disorder characterised by abdominal pain, associated with stool abnormalities and changes in stool consistency. Diagnosis of IBS is based on characteristic symptoms and exclusion of other gastrointestinal diseases. A number of questionnaires exist to assist diagnosis and assessment of severity of the disease. One of these is the irritable bowel syndrome - severity scoring system (IBS-SSS). The IBS-SSS was validated 1997 in its English version. In the present study, the IBS-SSS has been validated in German language. To do this, a cohort of 60 patients with IBS according to the Rome III criteria, was compared with a control group of healthy individuals (n = 38). We studied sensitivity and reproducibility of the score, as well as the sensitivity to detect changes of symptom severity. The results of the German validation largely reflect the results of the English validation. The German version of the IBS-SSS is also a valid, meaningful and reproducible questionnaire with a high sensitivity to assess changes in symptom severity, especially in IBS patients with moderate symptoms. It is unclear if the IBS-SSS is also a valid questionnaire in IBS patients with severe symptoms because this group of patients was not studied. © Georg Thieme Verlag KG Stuttgart · New York.

A validation study of the Keyboard Personal Computer Style instrument (K-PeCS) for use with children.

PubMed

Green, Dido; Meroz, Anat; Margalit, Adi Edit; Ratzon, Navah Z

2012-11-01

This study examines a potential instrument for measurement of typing postures of children. This paper describes inter-rater, test-retest reliability and concurrent validity of the Keyboard Personal Computer Style instrument (K-PeCS), an observational measurement of postures and movements during keyboarding, for use with children. Two trained raters independently rated videos of 24 children (aged 7-10 years). Six children returned one week later for identifying test-retest reliability. Concurrent validity was assessed by comparing ratings obtained using the K-PECS to scores from a 3D motion analysis system. Inter-rater reliability was moderate to high for 12 out of 16 items (Kappa: 0.46 to 1.00; correlation coefficients: 0.77-0.95) and test-retest reliability varied across items (Kappa: 0.25 to 0.67; correlation coefficients: r = 0.20 to r = 0.95). Concurrent validity compared favourably across arm pathlength, wrist extension and ulnar deviation. In light of the limitations of other tools the K-PeCS offers a fairly affordable, reliable and valid instrument to address the gap for measurement of typing styles of children, despite the shortcomings of some items. However further research is required to refine the instrument for use in evaluating typing among children. Copyright © 2012 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Implementation and Initial Validation of the APS English Test [and] The APS English-Writing Test at Golden West College: Evidence for Predictive Validity.

ERIC Educational Resources Information Center

Isonio, Steven

In May 1991, Golden West College (California) conducted a validation study of the English portion of the Assessment and Placement Services for Community Colleges (APS), followed by a predictive validity study in July 1991. The initial study was designed to aid in the implementation of the new test at GWC by comparing data on APS use at other…

Sensor data validation and reconstruction. Phase 1: System architecture study

NASA Technical Reports Server (NTRS)

1991-01-01

The sensor validation and data reconstruction task reviewed relevant literature and selected applicable validation and reconstruction techniques for further study; analyzed the selected techniques and emphasized those which could be used for both validation and reconstruction; analyzed Space Shuttle Main Engine (SSME) hot fire test data to determine statistical and physical relationships between various parameters; developed statistical and empirical correlations between parameters to perform validation and reconstruction tasks, using a computer aided engineering (CAE) package; and conceptually designed an expert system based knowledge fusion tool, which allows the user to relate diverse types of information when validating sensor data. The host hardware for the system is intended to be a Sun SPARCstation, but could be any RISC workstation with a UNIX operating system and a windowing/graphics system such as Motif or Dataviews. The information fusion tool is intended to be developed using the NEXPERT Object expert system shell, and the C programming language.

Initial transport validation studies using NSTX-U L-mode plasmas

NASA Astrophysics Data System (ADS)

Guttenfelder, Walter; Battaglia, D.; Bell, R. E.; Boyer, M. D.; Crocker, N.; Diallo, A.; Ferraro, N.; Gerhardt, S. P.; Kaye, S. M.; Leblanc, B. P.; Liu, D.; Menard, J. E.; Mueller, D.; Myer, C.; Podesta, M.; Raman, R.; Ren, Y.; Sabbagh, S.; Smith, D.

2016-10-01

A variety of stationary L-mode plasmas have been successfully developed in NSTX-U for physics validation studies. The plasmas span a range of density (1-4 ×1019 m-3) , plasma current (0.65-1.0 MA), and neutral beam heating power (<=4 MW), taking advantage of new, more tangential neutral beam sources to vary rotation profiles. Transport analysis (TRANSP) and turbulence measurements (BES, reflectometry) of these plasmas will be illustrated and compared with initial microstability and transport predictions. In particular, the normalized beta of these L-modes range between βN = 1-2, providing a valuable bridge in parameter space between (i) H-modes at comparable beta in conventional tokamaks (R/a 3, βN 2), where transport models have been largely developed and tested, and (ii) low-aspect-ratio H-modes at higher beta (R/a 1.5-1.7, βN 5), where transport models are less tested and challenged by stronger electromagnetic and equilibrium effects. This work is supported by US DOE contract DE-AC02-09CH11466.

The performance of seven QPrediction risk scores in an independent external sample of patients from general practice: a validation study

PubMed Central

Hippisley-Cox, Julia; Coupland, Carol; Brindle, Peter

2014-01-01

Objectives To validate the performance of a set of risk prediction algorithms developed using the QResearch database, in an independent sample from general practices contributing to the Clinical Research Data Link (CPRD). Setting Prospective open cohort study using practices contributing to the CPRD database and practices contributing to the QResearch database. Participants The CPRD validation cohort consisted of 3.3 million patients, aged 25–99 years registered at 357 general practices between 1 Jan 1998 and 31 July 2012. The validation statistics for QResearch were obtained from the original published papers which used a one-third sample of practices separate to those used to derive the score. A cohort from QResearch was used to compare incidence rates and baseline characteristics and consisted of 6.8 million patients from 753 practices registered between 1 Jan 1998 and until 31 July 2013. Outcome measures Incident events relating to seven different risk prediction scores: QRISK2 (cardiovascular disease); QStroke (ischaemic stroke); QDiabetes (type 2 diabetes); QFracture (osteoporotic fracture and hip fracture); QKidney (moderate and severe kidney failure); QThrombosis (venous thromboembolism); QBleed (intracranial bleed and upper gastrointestinal haemorrhage). Measures of discrimination and calibration were calculated. Results Overall, the baseline characteristics of the CPRD and QResearch cohorts were similar though QResearch had higher recording levels for ethnicity and family history. The validation statistics for each of the risk prediction scores were very similar in the CPRD cohort compared with the published results from QResearch validation cohorts. For example, in women, the QDiabetes algorithm explained 50% of the variation within CPRD compared with 51% on QResearch and the receiver operator curve value was 0.85 on both databases. The scores were well calibrated in CPRD. Conclusions Each of the algorithms performed practically as well in the

Comparing the validity of the K6 when assessing depression, anxiety, and PTSD among male and female jail detainees.

PubMed

Kubiak, Sheryl Pimlott; Beeble, Marisa; Bybee, Deborah

2012-12-01

A lack of a consistent and valid approach to screening within the jail often hinders identification and treatment. Furthermore, screening instruments developed for jail populations are often inadequate in detecting serious depression and anxiety disorders in women. While the remedy thus far has been the use of separate screening instruments for men and women, others have suggested that the K6, a six-item measure validated in large epidemiologic studies, may hold promise. Building on prior research, this study assesses the validity of the K6 in detecting depression, posttraumatic stress disorder, and anxiety disorders among 494 male and 515 female jail detainees. The authors found that 15% of males and 36% of females meet criteria for serious mental illness on the K6, with receiver operating characteristics--area under the curve scores of .84 and .93, respectively. This study not only establishes the validity and efficiency of using the K6 for screening within jails but also suggests a need for adjusting scale cut points.

The validity of the Satisfaction with Life Scale in adolescents and a comparison with single-item life satisfaction measures: a preliminary study.

PubMed

Jovanović, Veljko

2016-12-01

The validity of the life satisfaction measures commonly used among adults has been rarely examined in adolescent samples. The present research had two main goals: (1) to evaluate the structural validity of the Satisfaction with Life Scale (SWLS) among adolescents and to test measurement invariance across gender; (2) to compare the criterion and convergent validity of the SWLS and single-item life satisfaction measures among adolescents. Three samples of Serbian adolescents were recruited for the present research. Study 1 (N = 481, M age  = 17.01 years) examined the structure of the SWLS via confirmatory factor analysis (CFA) and evaluated measurement invariance of the SWLS across gender by a multi-group CFA. Study 2 (N = 283, M age  = 17.34 years) and Study 3 (N = 220, M age  = 16.73 years) compared the convergent validity of the SWLS and single-item life satisfaction measures. The results of Study 1 supported the original one-factor model of the SWLS among adolescents and provided evidence for strong measurement invariance of the SWLS across gender. The findings of Study 2 and Study 3 showed that the SWLS and single-item measures were equally valid and strongly associated (r = .734 in Study 2 and r = .668 in Study 3). No substantial differences in correlations with school success and well-being indicators were found between the SWLS and single-item measures. Our findings support the use of the SWLS among adolescents and indicate that single-item life satisfaction measures perform as well as the SWLS in adolescent samples.

Validation of a theoretically motivated approach to measuring childhood socioeconomic circumstances in the Health and Retirement Study.

PubMed

Vable, Anusha M; Gilsanz, Paola; Nguyen, Thu T; Kawachi, Ichiro; Glymour, M Maria

2017-01-01

Childhood socioeconomic status (cSES) is a powerful predictor of adult health, but its operationalization and measurement varies across studies. Using Health and Retirement Study data (HRS, which is nationally representative of community-residing United States adults aged 50+ years), we specified theoretically-motivated cSES measures, evaluated their reliability and validity, and compared their performance to other cSES indices. HRS respondent data (N = 31,169, interviewed 1992-2010) were used to construct a cSES index reflecting childhood social capital (cSC), childhood financial capital (cFC), and childhood human capital (cHC), using retrospective reports from when the respondent was <16 years (at least 34 years prior). We assessed internal consistency reliability (Cronbach's alpha) for the scales (cSC and cFC), and construct validity, and predictive validity for all measures. Validity was assessed with hypothesized correlates of cSES (educational attainment, measured adult height, self-reported childhood health, childhood learning problems, childhood drug and alcohol problems). We then compared the performance of our validated measures with other indices used in HRS in predicting self-rated health and number of depressive symptoms, measured in 2010. Internal consistency reliability was acceptable (cSC = 0.63, cFC = 0.61). Most measures were associated with hypothesized correlates (for example, the association between educational attainment and cSC was 0.01, p < 0.0001), with the exception that measured height was not associated with cFC (p = 0.19) and childhood drug and alcohol problems (p = 0.41), and childhood learning problems (p = 0.12) were not associated with cHC. Our measures explained slightly more variability in self-rated health (adjusted R2 = 0.07 vs. <0.06) and number of depressive symptoms (adjusted R2 > 0.05 vs. < 0.04) than alternative indices. Our cSES measures use latent variable models to handle item-missingness, thereby increasing the sample

Development and validation of a melanoma risk score based on pooled data from 16 case-control studies

PubMed Central

Davies, John R; Chang, Yu-mei; Bishop, D Timothy; Armstrong, Bruce K; Bataille, Veronique; Bergman, Wilma; Berwick, Marianne; Bracci, Paige M; Elwood, J Mark; Ernstoff, Marc S; Green, Adele; Gruis, Nelleke A; Holly, Elizabeth A; Ingvar, Christian; Kanetsky, Peter A; Karagas, Margaret R; Lee, Tim K; Le Marchand, Loïc; Mackie, Rona M; Olsson, Håkan; Østerlind, Anne; Rebbeck, Timothy R; Reich, Kristian; Sasieni, Peter; Siskind, Victor; Swerdlow, Anthony J; Titus, Linda; Zens, Michael S; Ziegler, Andreas; Gallagher, Richard P.; Barrett, Jennifer H; Newton-Bishop, Julia

2015-01-01

Background We report the development of a cutaneous melanoma risk algorithm based upon 7 factors; hair colour, skin type, family history, freckling, nevus count, number of large nevi and history of sunburn, intended to form the basis of a self-assessment webtool for the general public. Methods Predicted odds of melanoma were estimated by analysing a pooled dataset from 16 case-control studies using logistic random coefficients models. Risk categories were defined based on the distribution of the predicted odds in the controls from these studies. Imputation was used to estimate missing data in the pooled datasets. The 30th, 60th and 90th centiles were used to distribute individuals into four risk groups for their age, sex and geographic location. Cross-validation was used to test the robustness of the thresholds for each group by leaving out each study one by one. Performance of the model was assessed in an independent UK case-control study dataset. Results Cross-validation confirmed the robustness of the threshold estimates. Cases and controls were well discriminated in the independent dataset (area under the curve 0.75, 95% CI 0.73-0.78). 29% of cases were in the highest risk group compared with 7% of controls, and 43% of controls were in the lowest risk group compared with 13% of cases. Conclusion We have identified a composite score representing an estimate of relative risk and successfully validated this score in an independent dataset. Impact This score may be a useful tool to inform members of the public about their melanoma risk. PMID:25713022

Validity of hip-mounted uniaxial accelerometry with heart-rate monitoring vs. triaxial accelerometry in the assessment of free-living energy expenditure in young children: the IDEFICS Validation Study.

PubMed

Ojiambo, Robert; Konstabel, Kenn; Veidebaum, Toomas; Reilly, John; Verbestel, Vera; Huybrechts, Inge; Sioen, Isabelle; Casajús, José A; Moreno, Luis A; Vicente-Rodriguez, German; Bammann, Karin; Tubic, Bojan M; Marild, Staffan; Westerterp, Klaas; Pitsiladis, Yannis P

2012-11-01

One of the aims of Identification and Prevention of Dietary- and Lifestyle-Induced Health Effects in Children and Infants (IDEFICS) validation study is to validate field measures of physical activity (PA) and energy expenditure (EE) in young children. This study compared the validity of uniaxial accelerometry with heart-rate (HR) monitoring vs. triaxial accelerometry against doubly labeled water (DLW) criterion method for assessment of free-living EE in young children. Forty-nine European children (25 female, 24 male) aged 4-10 yr (mean age: 6.9 ± 1.5 yr) were assessed by uniaxial ActiTrainer with HR, uniaxial 3DNX, and triaxial 3DNX accelerometry. Total energy expenditure (TEE) was estimated using DLW over a 1-wk period. The longitudinal axis of both devices and triaxial 3DNX counts per minute (CPM) were significantly (P < 0.05) associated with physical activity level (PAL; r = 0.51 ActiTrainer, r = 0.49 uniaxial-3DNX, and r = 0.42 triaxial Σ3DNX). Eight-six percent of the variance in TEE could be predicted by a model combining body mass (partial r(2) = 71%; P < 0.05), CPM-ActiTrainer (partial r(2) = 11%; P < 0.05), and difference between HR at moderate and sedentary activities (ModHR - SedHR) (partial r(2) = 4%; P < 0.05). The SE of TEE estimate for ActiTrainer and 3DNX models ranged from 0.44 to 0.74 MJ/days or ∼7-11% of the average TEE. The SE of activity-induced energy expenditure (AEE) model estimates ranged from 0.38 to 0.57 MJ/day or 24-26% of the average AEE. It is concluded that the comparative validity of hip-mounted uniaxial and triaxial accelerometers for assessing PA and EE is similar.

The Jackson Career Explorer: Two Further Validity Studies

ERIC Educational Resources Information Center

Schermer, Julie Aitken

2012-01-01

The present report consists of two further validity studies using the Jackson Career Explorer (JCE), a short form and continuous version of the Jackson Vocational Interest Survey, measuring 34 interests. The first study examined the relationships between the JCE and five personality factors, from a sample of 528 individuals. The correlations found…

Reliability and Validity of the Spanish Adaptation of EOSS, Comparing Normal and Clinical Samples

ERIC Educational Resources Information Center

Valero-Aguayo, Luis; Ferro-Garcia, Rafael; Lopez-Bermudez, Miguel Angel; de Huralde, Ma. Angeles Selva-Lopez

2012-01-01

The Experiencing of Self Scale (EOSS) was created for the evaluation of Functional Analytic Psychotherapy (Kohlenberg & Tsai, 1991, 2001, 2008) in relation to the concept of the experience of personal self as socially and verbally constructed. This paper presents a reliability and validity study of the EOSS with a Spanish sample (582…

Using a 3D Virtual Supermarket to Measure Food Purchase Behavior: A Validation Study

PubMed Central

Jiang, Yannan; Steenhuis, Ingrid Hendrika Margaretha; Ni Mhurchu, Cliona

2015-01-01

Background There is increasing recognition that supermarkets are an important environment for health-promoting interventions such as fiscal food policies or front-of-pack nutrition labeling. However, due to the complexities of undertaking such research in the real world, well-designed randomized controlled trials on these kinds of interventions are lacking. The Virtual Supermarket is a 3-dimensional computerized research environment designed to enable experimental studies in a supermarket setting without the complexity or costs normally associated with undertaking such research. Objective The primary objective was to validate the Virtual Supermarket by comparing virtual and real-life food purchasing behavior. A secondary objective was to obtain participant feedback on perceived sense of “presence” (the subjective experience of being in one place or environment even if physically located in another) in the Virtual Supermarket. Methods Eligible main household shoppers (New Zealand adults aged ≥18 years) were asked to conduct 3 shopping occasions in the Virtual Supermarket over 3 consecutive weeks, complete the validated Presence Questionnaire Items Stems, and collect their real supermarket grocery till receipts for that same period. Proportional expenditure (NZ$) and the proportion of products purchased over 18 major food groups were compared between the virtual and real supermarkets. Data were analyzed using repeated measures mixed models. Results A total of 123 participants consented to take part in the study. In total, 69.9% (86/123) completed 1 shop in the Virtual Supermarket, 64.2% (79/123) completed 2 shops, 60.2% (74/123) completed 3 shops, and 48.8% (60/123) returned their real supermarket till receipts. The 4 food groups with the highest relative expenditures were the same for the virtual and real supermarkets: fresh fruit and vegetables (virtual estimate: 14.3%; real: 17.4%), bread and bakery (virtual: 10.0%; real: 8.2%), dairy (virtual: 19.1%; real

Using a 3D virtual supermarket to measure food purchase behavior: a validation study.

PubMed

Waterlander, Wilma Elzeline; Jiang, Yannan; Steenhuis, Ingrid Hendrika Margaretha; Ni Mhurchu, Cliona

2015-04-28

There is increasing recognition that supermarkets are an important environment for health-promoting interventions such as fiscal food policies or front-of-pack nutrition labeling. However, due to the complexities of undertaking such research in the real world, well-designed randomized controlled trials on these kinds of interventions are lacking. The Virtual Supermarket is a 3-dimensional computerized research environment designed to enable experimental studies in a supermarket setting without the complexity or costs normally associated with undertaking such research. The primary objective was to validate the Virtual Supermarket by comparing virtual and real-life food purchasing behavior. A secondary objective was to obtain participant feedback on perceived sense of "presence" (the subjective experience of being in one place or environment even if physically located in another) in the Virtual Supermarket. Eligible main household shoppers (New Zealand adults aged ≥18 years) were asked to conduct 3 shopping occasions in the Virtual Supermarket over 3 consecutive weeks, complete the validated Presence Questionnaire Items Stems, and collect their real supermarket grocery till receipts for that same period. Proportional expenditure (NZ$) and the proportion of products purchased over 18 major food groups were compared between the virtual and real supermarkets. Data were analyzed using repeated measures mixed models. A total of 123 participants consented to take part in the study. In total, 69.9% (86/123) completed 1 shop in the Virtual Supermarket, 64.2% (79/123) completed 2 shops, 60.2% (74/123) completed 3 shops, and 48.8% (60/123) returned their real supermarket till receipts. The 4 food groups with the highest relative expenditures were the same for the virtual and real supermarkets: fresh fruit and vegetables (virtual estimate: 14.3%; real: 17.4%), bread and bakery (virtual: 10.0%; real: 8.2%), dairy (virtual: 19.1%; real: 12.6%), and meat and fish (virtual: 16

29 CFR 1607.14 - Technical standards for validity studies.

Code of Federal Regulations, 2011 CFR

2011-07-01

... in the design of the study and their effects identified. (5) Statistical relationships. The degree of...; or such factors should be included in the design of the study and their effects identified. (f... arduous effort involving a series of research studies, which include criterion related validity studies...

29 CFR 1607.14 - Technical standards for validity studies.

Code of Federal Regulations, 2013 CFR

2013-07-01

... in the design of the study and their effects identified. (5) Statistical relationships. The degree of...; or such factors should be included in the design of the study and their effects identified. (f... arduous effort involving a series of research studies, which include criterion related validity studies...

29 CFR 1607.14 - Technical standards for validity studies.

Code of Federal Regulations, 2014 CFR

2014-07-01

... in the design of the study and their effects identified. (5) Statistical relationships. The degree of...; or such factors should be included in the design of the study and their effects identified. (f... arduous effort involving a series of research studies, which include criterion related validity studies...

29 CFR 1607.14 - Technical standards for validity studies.

Code of Federal Regulations, 2012 CFR

2012-07-01

... in the design of the study and their effects identified. (5) Statistical relationships. The degree of...; or such factors should be included in the design of the study and their effects identified. (f... arduous effort involving a series of research studies, which include criterion related validity studies...

29 CFR 1607.14 - Technical standards for validity studies.

Code of Federal Regulations, 2010 CFR

2010-07-01

... in the design of the study and their effects identified. (5) Statistical relationships. The degree of...; or such factors should be included in the design of the study and their effects identified. (f... arduous effort involving a series of research studies, which include criterion related validity studies...

Reliability and Validity Study of a Tool to Measure Cancer Stigma: Patient Version

PubMed Central

Yılmaz, Medine; Dişsiz, Gülçin; Demir, Filiz; Irız, Sibel; Alacacioglu, Ahmet

2017-01-01

Objective: The aim of this methodological study is to establish the validity and reliability of the Turkish version of “A Questionnaire for Measuring Attitudes toward Cancer (Cancer Stigma) - Patient version.” Methods: The sample comprised oncology patients who had active cancer treatment. The construct validity was assessed using the confirmatory and exploratory factor analysis. Results: The mean age of the participants was 54.9±12.3 years. In the confirmatory factor analysis, fit values were determined as comparative fit index = 0.93, goodness of fit index = 0.91, normed-fit index=0.91, and root mean square error of approximation RMSEA = 0.09 (P <0.05) (Kaiser–Meyer–Olkin = 0.88, χ2 = 1084.41, Df = 66, and Barletta's test P <0.000). The first factor was “impossibility of recovery and experience of social discrimination” and the second factor was “stereotypes of cancer patients.” The two-factor structure accounted for 56.74% of the variance. The Cronbach's alpha value was determined as 0.88 for the two-factor scale. Conclusions: “A questionnaire for measuring attitudes toward cancer (cancer stigma) - Patient version” is a reliable and valid questionnaire to assess stigmatization of cancer in cancer patients. PMID:28503649

The HealthNuts population-based study of paediatric food allergy: validity, safety and acceptability.

PubMed

Osborne, N J; Koplin, J J; Martin, P E; Gurrin, L C; Thiele, L; Tang, M L; Ponsonby, A-L; Dharmage, S C; Allen, K J

2010-10-01

The incidence of hospital admissions for food allergy-related anaphylaxis in Australia has increased, in line with world-wide trends. However, a valid measure of food allergy prevalence and risk factor data from a population-based study is still lacking. To describe the study design and methods used to recruit infants from a population for skin prick testing and oral food challenges, and the use of preliminary data to investigate the extent to which the study sample is representative of the target population. The study sampling frame design comprises 12-month-old infants presenting for routine scheduled vaccination at immunization clinics in Melbourne, Australia. We compared demographic features of participating families to population summary statistics from the Victorian Perinatal census database, and administered a survey to those non-responders who chose not to participate in the study. Study design proved acceptable to the community with good uptake (response rate 73.4%), with 2171 participants recruited. Demographic information on the study population mirrored the Victorian population with most the population parameters measured falling within our confidence intervals (CI). Use of a non-responder questionnaire revealed that a higher proportion of infants who declined to participate (non-responders) were already eating and tolerating peanuts, than those agreeing to participate (54.4%; 95% CI 50.8, 58.0 vs. 27.4%; 95% CI 25.5, 29.3 among participants). A high proportion of individuals approached in a community setting participated in a food allergy study. The study population differed from the eligible sample in relation to family history of allergy and prior consumption and peanut tolerance, providing some insights into the internal validity of the sample. The study exhibited external validity on general demographics to all births in Victoria. © 2010 Blackwell Publishing Ltd.

Cross-cultural construct validity study of professionalism of Vietnamese medical students.

PubMed

Nhan, Vo Thanh; Violato, Claudio; Le An, Pham; Beran, Tanya N

2014-01-01

Although many studies have made efforts to define and assess medical professionalism, few have addressed issues of construct validity. The purpose of this article is to explore further construct validity of medical professionalism employing exploratory and confirmatory factor analysis. The 32-item instrument by the American Board of Internal Medicine (ABIM) was adapted to assess the perceptions on medical professionalism of Vietnamese medical students. A sample of 1,196 (487 first-year, 341 third-year, 368 sixth-year) medical students participated voluntarily in the completion of the instrument. The data were randomly divided into three samples to assess the construct validity of medical professionalism by empirically deriving and confirming a model of professionalism. Exploratory and confirmatory factor analytic techniques resulted in a six-factor well-fitting model with a comparative fit index of .963 and root mean square error approximation of .029, 90% confidence interval [016, .039]: integrity, social responsibility, professional practice habits, ensuring quality care, altruism, and self-awareness. Social responsibility was perceived least important, and self-awareness was perceived most important by Vietnamese medical students. These constructs of medical professionalism were relatively similar with those found in Taiwanese medical students and the ABIM definitions but with some Vietnamese cultural differences. Although the results confirm that medical professionalism is a somewhat culturally sensitive construct, it nonetheless has many elements of medical professionalism that are universal. Future research should be conducted to test the generalizability of our six-factor model of professionalism with various samples (e.g., residents, physicians), cultures, and language groups.

An empirical assessment of validation practices for molecular classifiers

PubMed Central

Castaldi, Peter J.; Dahabreh, Issa J.

2011-01-01

Proposed molecular classifiers may be overfit to idiosyncrasies of noisy genomic and proteomic data. Cross-validation methods are often used to obtain estimates of classification accuracy, but both simulations and case studies suggest that, when inappropriate methods are used, bias may ensue. Bias can be bypassed and generalizability can be tested by external (independent) validation. We evaluated 35 studies that have reported on external validation of a molecular classifier. We extracted information on study design and methodological features, and compared the performance of molecular classifiers in internal cross-validation versus external validation for 28 studies where both had been performed. We demonstrate that the majority of studies pursued cross-validation practices that are likely to overestimate classifier performance. Most studies were markedly underpowered to detect a 20% decrease in sensitivity or specificity between internal cross-validation and external validation [median power was 36% (IQR, 21–61%) and 29% (IQR, 15–65%), respectively]. The median reported classification performance for sensitivity and specificity was 94% and 98%, respectively, in cross-validation and 88% and 81% for independent validation. The relative diagnostic odds ratio was 3.26 (95% CI 2.04–5.21) for cross-validation versus independent validation. Finally, we reviewed all studies (n = 758) which cited those in our study sample, and identified only one instance of additional subsequent independent validation of these classifiers. In conclusion, these results document that many cross-validation practices employed in the literature are potentially biased and genuine progress in this field will require adoption of routine external validation of molecular classifiers, preferably in much larger studies than in current practice. PMID:21300697

A clinical prognostic model compared to the newly adopted UICC staging in an independent validation cohort of P16 negative/positive head and neck cancer patients.

PubMed

Rasmussen, Jacob H; Håkansson, Katrin; Rasmussen, Gregers B; Vogelius, Ivan R; Friborg, Jeppe; Fischer, Barbara M; Bentzen, Søren M; Specht, Lena

2018-06-01

A previously published prognostic model in patients with head and neck squamous cell carcinoma (HNSCC) was validated in both a p16-negative and a p16-positive independent patient cohort and the performance was compared with the newly adopted 8th edition of the UICC staging system. Consecutive patients with HNSCC treated at a single institution from 2005 to 2012 were included. The cohort was divided in three. 1.) Training cohort, patients treated from 2005 to 2009 excluding patients with p16-positive oropharyngeal squamous cell carcinomas (OPSCC); 2.) A p16-negative validation cohort and 3.) A p16-positive validation cohort. A previously published prognostic model (clinical model) with the significant covariates (smoking status, FDG uptake, and tumor volume) was refitted in the training cohort and validated in the two validation cohorts. The clinical model was used to generate four risk groups based on the predicted risk of disease recurrence after 2 years and the performance was compared with UICC staging 8th edition using concordance index. Overall 568 patients were included. Compared to UICC the clinical model had a significantly better concordance index in the p16-negative validation cohort (AUC = 0.63 for UICC and AUC = 0.73 for the clinical model; p = 0.003) and a borderline significantly better concordance index in the p16-positive cohort (AUC = 0.63 for UICC and 0.72 for the clinical model; p = 0.088). The validated clinical model provided a better prognostication of risk of disease recurrence than UICC stage in the p16-negative validation cohort, and similar prognostication as the newly adopted 8th edition of the UICC staging in the p16-positive patient cohort. Copyright © 2018 Elsevier Ltd. All rights reserved.

Validating fatty acid intake as estimated by an FFQ: how does the 24 h recall perform as reference method compared with the duplicate portion?

PubMed

Trijsburg, Laura; de Vries, Jeanne Hm; Hollman, Peter Ch; Hulshof, Paul Jm; van 't Veer, Pieter; Boshuizen, Hendriek C; Geelen, Anouk

2018-05-08

To compare the performance of the commonly used 24 h recall (24hR) with the more distinct duplicate portion (DP) as reference method for validation of fatty acid intake estimated with an FFQ. Intakes of SFA, MUFA, n-3 fatty acids and linoleic acid (LA) were estimated by chemical analysis of two DP and by on average five 24hR and two FFQ. Plasma n-3 fatty acids and LA were used to objectively compare ranking of individuals based on DP and 24hR. Multivariate measurement error models were used to estimate validity coefficients and attenuation factors for the FFQ with the DP and 24hR as reference methods. Wageningen, the Netherlands. Ninety-two men and 106 women (aged 20-70 years). Validity coefficients for the fatty acid estimates by the FFQ tended to be lower when using the DP as reference method compared with the 24hR. Attenuation factors for the FFQ tended to be slightly higher based on the DP than those based on the 24hR as reference method. Furthermore, when using plasma fatty acids as reference, the DP showed comparable to slightly better ranking of participants according to their intake of n-3 fatty acids (0·33) and n-3:LA (0·34) than the 24hR (0·22 and 0·24, respectively). The 24hR gives only slightly different results compared with the distinctive but less feasible DP, therefore use of the 24hR seems appropriate as the reference method for FFQ validation of fatty acid intake.

Comparative validity of physical activity measures in older adults.

PubMed

Colbert, Lisa H; Matthews, Charles E; Havighurst, Thomas C; Kim, Kyungmann; Schoeller, Dale A

2011-05-01

To compare the validity of various physical activity measures with doubly labeled water (DLW)-measured physical activity energy expenditure (PAEE) in free-living older adults. Fifty-six adults aged ≥65 yr wore three activity monitors (New Lifestyles pedometer, ActiGraph accelerometer, and a SenseWear (SW) armband) during a 10-d free-living period and completed three different surveys (Yale Physical Activity Survey (YPAS), Community Health Activities Model Program for Seniors (CHAMPS), and a modified Physical Activity Scale for the Elderly (modPASE)). Total energy expenditure was measured using DLW, resting metabolic rate was measured with indirect calorimetry, the thermic effect of food was estimated, and from these, estimates of PAEE were calculated. The degree of linear association between the various measures and PAEE was assessed, as were differences in group PAEE, when estimable by a given measure. All three monitors were significantly correlated with PAEE (r=0.48-0.60, P<0.001). Of the questionnaires, only CHAMPS was significantly correlated with PAEE (r=0.28, P=0.04). Statistical comparison of the correlations suggested that the monitors were superior to YPAS and modPASE. Mean squared errors for all correlations were high, and the median PAEE from the different tools was significantly different from DLW for all but the YPAS and regression-estimated PAEE from the ActiGraph. Objective devices more appropriately rank PAEE than self-reported instruments in older adults, but absolute estimates of PAEE are not accurate. Given the cost differential and ease of use, pedometers seem most useful in this population when ranking by physical activity level is adequate. © 2011 by the American College of Sports Medicine

Identification of STAT1 and STAT3 Specific Inhibitors Using Comparative Virtual Screening and Docking Validation

PubMed Central

Szelag, Malgorzata; Czerwoniec, Anna; Wesoly, Joanna; Bluyssen, Hans A. R.

2015-01-01

Signal transducers and activators of transcription (STATs) facilitate action of cytokines, growth factors and pathogens. STAT activation is mediated by a highly conserved SH2 domain, which interacts with phosphotyrosine motifs for specific STAT-receptor contacts and STAT dimerization. The active dimers induce gene transcription in the nucleus by binding to a specific DNA-response element in the promoter of target genes. Abnormal activation of STAT signaling pathways is implicated in many human diseases, like cancer, inflammation and auto-immunity. Searches for STAT-targeting compounds, exploring the phosphotyrosine (pTyr)-SH2 interaction site, yielded many small molecules for STAT3 but sparsely for other STATs. However, many of these inhibitors seem not STAT3-specific, thereby questioning the present modeling and selection strategies of SH2 domain-based STAT inhibitors. We generated new 3D structure models for all human (h)STATs and developed a comparative in silico docking strategy to obtain further insight into STAT-SH2 cross-binding specificity of a selection of previously identified STAT3 inhibitors. Indeed, by primarily targeting the highly conserved pTyr-SH2 binding pocket the majority of these compounds exhibited similar binding affinity and tendency scores for all STATs. By comparative screening of a natural product library we provided initial proof for the possibility to identify STAT1 as well as STAT3-specific inhibitors, introducing the ‘STAT-comparative binding affinity value’ and ‘ligand binding pose variation’ as selection criteria. In silico screening of a multi-million clean leads (CL) compound library for binding of all STATs, likewise identified potential specific inhibitors for STAT1 and STAT3 after docking validation. Based on comparative virtual screening and docking validation, we developed a novel STAT inhibitor screening tool that allows identification of specific STAT1 and STAT3 inhibitory compounds. This could increase our

Study of the validity of a job-exposure matrix for the job strain model factors: an update and a study of changes over time.

PubMed

Niedhammer, Isabelle; Milner, Allison; LaMontagne, Anthony D; Chastang, Jean-François

2018-03-08

The objectives of the study were to construct a job-exposure matrix (JEM) for psychosocial work factors of the job strain model, to evaluate its validity, and to compare the results over time. The study was based on national representative data of the French working population with samples of 46,962 employees (2010 SUMER survey) and 24,486 employees (2003 SUMER survey). Psychosocial work factors included the job strain model factors (Job Content Questionnaire): psychological demands, decision latitude, social support, job strain and iso-strain. Job title was defined by three variables: occupation and economic activity coded using standard classifications, and company size. A JEM was constructed using a segmentation method (Classification and Regression Tree-CART) and cross-validation. The best quality JEM was found using occupation and company size for social support. For decision latitude and psychological demands, there was not much difference using occupation and company size with or without economic activity. The validity of the JEM estimates was higher for decision latitude, job strain and iso-strain, and lower for social support and psychological demands. Differential changes over time were observed for psychosocial work factors according to occupation, economic activity and company size. This study demonstrated that company size in addition to occupation may improve the validity of JEMs for psychosocial work factors. These matrices may be time-dependent and may need to be updated over time. More research is needed to assess the validity of JEMs given that these matrices may be able to provide exposure assessments to study a range of health outcomes.

Long-Term Prognostic Validity of Talent Selections: Comparing National and Regional Coaches, Laypersons and Novices

PubMed Central

Schorer, Jörg; Rienhoff, Rebecca; Fischer, Lennart; Baker, Joseph

2017-01-01

In most sports, the development of elite athletes is a long-term process of talent identification and support. Typically, talent selection systems administer a multi-faceted strategy including national coach observations and varying physical and psychological tests when deciding who is chosen for talent development. The aim of this exploratory study was to evaluate the prognostic validity of talent selections by varying groups 10 years after they had been conducted. This study used a unique, multi-phased approach. Phase 1 involved players (n = 68) in 2001 completing a battery of general and sport-specific tests of handball ‘talent’ and performance. In Phase 2, national and regional coaches (n = 7) in 2001 who attended training camps identified the most talented players. In Phase 3, current novice and advanced handball players (n = 12 in each group) selected the most talented from short videos of matches played during the talent camp. Analyses compared predictions among all groups with a best model-fit derived from the motor tests. Results revealed little difference between regional and national coaches in the prediction of future performance and little difference in forecasting performance between novices and players. The best model-fit regression by the motor-tests outperformed all predictions. While several limitations are discussed, this study is a useful starting point for future investigations considering athlete selection decisions in talent identification in sport. PMID:28744238

Long-Term Prognostic Validity of Talent Selections: Comparing National and Regional Coaches, Laypersons and Novices.

PubMed

Schorer, Jörg; Rienhoff, Rebecca; Fischer, Lennart; Baker, Joseph

2017-01-01

In most sports, the development of elite athletes is a long-term process of talent identification and support. Typically, talent selection systems administer a multi-faceted strategy including national coach observations and varying physical and psychological tests when deciding who is chosen for talent development. The aim of this exploratory study was to evaluate the prognostic validity of talent selections by varying groups 10 years after they had been conducted. This study used a unique, multi-phased approach. Phase 1 involved players ( n = 68) in 2001 completing a battery of general and sport-specific tests of handball 'talent' and performance. In Phase 2, national and regional coaches ( n = 7) in 2001 who attended training camps identified the most talented players. In Phase 3, current novice and advanced handball players ( n = 12 in each group) selected the most talented from short videos of matches played during the talent camp. Analyses compared predictions among all groups with a best model-fit derived from the motor tests. Results revealed little difference between regional and national coaches in the prediction of future performance and little difference in forecasting performance between novices and players. The best model-fit regression by the motor-tests outperformed all predictions. While several limitations are discussed, this study is a useful starting point for future investigations considering athlete selection decisions in talent identification in sport.

Aircraft Wake Vortex Spacing System (AVOSS) Performance Update and Validation Study

NASA Technical Reports Server (NTRS)

Rutishauser, David K.; OConnor, Cornelius J.

2001-01-01

An analysis has been performed on data generated from the two most recent field deployments of the Aircraft Wake VOrtex Spacing System (AVOSS). The AVOSS provides reduced aircraft spacing criteria for wake vortex avoidance as compared to the FAA spacing applied under Instrument Flight Rules (IFR). Several field deployments culminating in a system demonstration at Dallas Fort Worth (DFW) International Airport in the summer of 2000 were successful in showing a sound operational concept and the system's potential to provide a significant benefit to airport operations. For DFW, a predicted average throughput increase of 6% was observed. This increase implies 6 or 7 more aircraft on the ground in a one-hour period for DFW operations. Several studies of performance correlations to system configuration options, design options, and system inputs are also reported. The studies focus on the validation performance of the system.

Design and validation of a comprehensive fecal incontinence questionnaire.

PubMed

Macmillan, Alexandra K; Merrie, Arend E H; Marshall, Roger J; Parry, Bryan R

2008-10-01

Fecal incontinence can have a profound effect on quality of life. Its prevalence remains uncertain because of stigma, lack of consistent definition, and dearth of validated measures. This study was designed to develop a valid clinical and epidemiologic questionnaire, building on current literature and expertise. Patients and experts undertook face validity testing. Construct validity, criterion validity, and test-retest reliability was undertaken. Construct validity comprised factor analysis and internal consistency of the quality of life scale. The validity of known groups was tested against 77 control subjects by using regression models. Questionnaire results were compared with a stool diary for criterion validity. Test-retest reliability was calculated from repeated questionnaire completion. The questionnaire achieved good face validity. It was completed by 104 patients. The quality of life scale had four underlying traits (factor analysis) and high internal consistency (overall Cronbach alpha = 0.97). Patients and control subjects answered the questionnaire significantly differently (P < 0.01) in known-groups validity testing. Criterion validity assessment found mean differences close to zero. Median reliability for the whole questionnaire was 0.79 (range, 0.35-1). This questionnaire compares favorably with other available instruments, although the interpretation of stool consistency requires further research. Its sensitivity to treatment still needs to be investigated.

A population based validation study of self-reported pensions and benefits: the Nord-Trøndelag health study (HUNT)

PubMed Central

2013-01-01

Background Measures of disability pensions, sickness certification and long-term health related benefits are often self-reported in epidemiological studies. Few studies have examined these measures, and the validity is yet to be established. We aimed to estimate the validity of self-reported disability pension, rehabilitation benefit and retirement pension and to explore the benefit status and basic characteristics of those not responding to these items. A large health survey (HUNT2) containing self-reported questionnaire data on sickness benefits and pensions was linked to a national registry of pensions and benefits, used as “gold standard” for the analysis. We investigated two main sources of bias in self-reported data; misclassification - due to participants answering questions incorrectly, and systematic missing/selection bias - when participants do not respond to the questions. Sensitivity, specificity, positive (PPV) and negative (NPV) predicative value, agreement and Cohen’s Kappa were calculated for each benefit. Co-variables were compared between non-responders and responders. Results In the study-population of 40,633, 9.2% reported receiving disability pension, 1.4% rehabilitation benefits and 6.1% retirement pension. According to the registry, the corresponding numbers were 9.0%, 1.7% and 5.4%. Excluding non-responders, specificity, NPV and agreement were above 98% for all benefits. Sensitivity and PPV were lower. When including non-responders as non-receivers, specificity got higher, sensitivity dropped while the other measures changed less. Between 17.7% and 24.1% did not answer the questions on benefits. Non-responders were older and more likely to be female. They reported more anxiety, more depression, a higher number of somatic diagnoses, less physical activity and lower consumption of alcohol (p < 0.001 for all variables). For disability pension and retirement pension, non-responders were less likely to receive benefits than responders

Validity of Highlighting on Text Comprehension

NASA Astrophysics Data System (ADS)

So, Joey C. Y.; Chan, Alan H. S.

2009-10-01

In this study, 38 university students were tested with a Chinese reading task on an LED display under different task conditions for determining the effects of the highlighting and its validity on comprehension performance on light-emitting diodes (LED) display for Chinese reading. Four levels of validity (0%, 33%, 67% and 100%) and a control condition with no highlighting were tested. Each subject was required to perform the five experimental conditions in which different passages were read and comprehended. The results showed that the condition with 100% validity of highlighting was found to have better comprehension performance than other validity levels and conditions with no highlighting. The comprehension score of the condition without highlighting effect was comparatively lower than those highlighting conditions with distracters, though not significant.

A Comparative study on sexual dysfunctions before and after menopause

PubMed Central

Beigi, Marjan; Fahami, Fariba

2012-01-01

Background: Sexual instinct which is the cause of numerous changes in an individual’s life could be influenced by different factors such as menopause and ageing. This study was designed to compare sexual dysfunction before and after menopause. Materials and Methods: This was a cross-sectional study. Participants were 174 menopausal women who referred to medical health centers of Isfahan, Iran. Data were collected through self constructed sexual dysfunctions questionnaire in relation to their sexual activities before and after menopause. The reliability and validity of this questionnaire was determined by content validity and Cronbach’s alpha coefficient. Findings: Findings showed that the relative frequency of sexual dysfunctions was 38% in the productive period and 72.4% in the menopause period. There was a significant association between sexual dysfunctions before and after the menopause period (p < 0.001). Sexual dysfunctions in these women in the productive and menopause period were 49.2% and 62.6% in desire disorder, 34.3% and 34.9% in dyspareunia, 26.8% and 75.3% in arousal disorder, 23.5% and 56.3% in orgasmic disorder and 16.4% and 15.6% in vaginismus, respectively. Conclusions: A considerable percentage of women experienced sexual dysfunctions in productive and menopause periods, and menopause could be a factor to maintain or intensify sexual dysfunctions. PMID:23833604

Indicators of the relative availability of healthy versus unhealthy foods in supermarkets: a validation study.

PubMed

Vandevijvere, Stefanie; Mackenzie, Tara; Mhurchu, Cliona Ni

2017-04-26

In-store availability of healthy and unhealthy foods may influence consumer purchases. Methods used to measure food availability, however, vary widely. A simple, valid, and reliable indicator to collect comparable data on in-store food availability is needed. Cumulative linear shelf length of and variety within 22 healthy and 28 unhealthy food groups, determined based on a comparison of three nutrient profiling systems, were measured in 15 New Zealand supermarkets. Inter-rater reliability was tested in one supermarket by a second researcher. The construct validity of five simple indicators of relative availability of healthy versus unhealthy foods was assessed against this 'gold standard'. Cumulative linear shelf length was a more sensitive and feasible measure of food availability than variety. Four out of five shelf length ratio indicators were significantly associated with the gold standard (ρ = 0.70-0.75). Based on a non-significant difference from the 'gold standard' (d = 0.053 ± 0.040) and feasibility, the ratio of cumulative linear shelf length of fresh and frozen fruits and vegetables versus soft and energy drinks, crisps and snacks, sweet biscuits and confectionery performed best for use in New Zealand supermarkets. Four out of the five shelf length ratio indicators of the relative availability of healthy versus unhealthy foods in-store tested could be used for future research and monitoring, but additional validation studies in other settings and countries are recommended. Consistent use of those shelf length ratio indicators could enhance comparability of supermarket food availability between studies, and help inform policies to create healthy consumer food retail environments.

Toddler physical activity study: laboratory and community studies to evaluate accelerometer validity and correlates.

PubMed

Hager, Erin R; Gormley, Candice E; Latta, Laura W; Treuth, Margarita S; Caulfield, Laura E; Black, Maureen M

2016-09-06

Toddlerhood is an important age for physical activity (PA) promotion to prevent obesity and support a physically active lifestyle throughout childhood. Accurate assessment of PA is needed to determine trends/correlates of PA, time spent in sedentary, light, or moderate-vigorous PA (MVPA), and the effectiveness of PA promotion programs. Due to the limited availability of objective measures that have been validated and evaluated for feasibility in community studies, it is unclear which subgroups of toddlers are at the highest risk for inactivity. Using Actical ankle accelerometry, the objectives of this study are to develop valid thresholds, examine feasibility, and examine demographic/ anthropometric PA correlates of MVPA among toddlers from low-income families. Two studies were conducted with toddlers (12-36 months). Laboratory Study (n = 24)- Two Actical accelerometers were placed on the ankle. PA was observed using the Child Activity Rating Scale (CARS, prescribed activities). Analyses included device equivalence reliability (correlation: activity counts of two Acticals), criterion-related validity (correlation: activity counts and CARS ratings), and sensitivity/specificity for thresholds. Community Study (n = 277, low-income mother-toddler dyads recruited)- An Actical was worn on the ankle for > 7 days (goal >5, 24-h days). Height/weight was measured. Mothers reported demographics. Analyses included frequencies (feasibility) and stepwise multiple linear regression (sMLR). Laboratory Study- Acticals demonstrated reliability (r = 0.980) and validity (r = 0.75). Thresholds demonstrated sensitivity (86 %) and specificity (88 %). Community Study- 86 % wore accelerometer, 69 % had valid data (mean = 5.2 days). Primary reasons for missing/invalid data: refusal (14 %) and wear-time ≤2 days (11 %). The MVPA threshold (>2200 cpm) yielded 54 min/day. In sMLR, MVPA was associated with age (older > younger, β = 32.8, p < 0

The global status of freshwater fish age validation studies and a prioritization framework for future research

USGS Publications Warehouse

Pope, Kevin L.; Hamel, Martin J.; Pegg, Mark A.; Spurgeon, Jonathan J.

2016-01-01

Age information derived from calcified structures is commonly used to estimate recruitment, growth, and mortality for fish populations. Validation of daily or annual marks on age structures is often assumed, presumably due to a lack of general knowledge concerning the status of age validation studies. Therefore, the current status of freshwater fish age validation studies was summarized to show where additional effort is needed, and increase the accessibility of validation studies to researchers. In total, 1351 original peer-reviewed articles were reviewed from freshwater systems that studied age in fish. Periodicity and age validation studies were found for 88 freshwater species comprising 21 fish families. The number of age validation studies has increased over the last 30 years following previous calls for more research; however, few species have validated structures spanning all life stages. In addition, few fishes of conservation concern have validated ageing structures. A prioritization framework, using a combination of eight characteristics, is offered to direct future age validation studies and close the validation information gap. Additional study, using the offered prioritization framework, and increased availability of published studies that incorporate uncertainty when presenting research results dealing with age information are needed.

Development and validation study of the Smartphone Overuse Screening Questionnaire.

PubMed

Lee, Han-Kyeong; Kim, Ji-Hae; Fava, Maurizio; Mischoulon, David; Park, Jae-Hyun; Shim, Eun-Jung; Lee, Eun-Ho; Lee, Ji Hyeon; Jeon, Hong Jin

2017-11-01

The aim of this study was to develop a screening questionnaire that could distinguish individuals at high risk of smartphone overuse from casual users. The reliability, validity, and diagnostic ability of the Smartphone Overuse Screening Questionnaire (SOS-Q) were evaluated. Preliminary items were assessed by 50 addiction experts on-line, and 28 questions were selected. A total of 158 subjects recruited from six community centers for internet addiction participated in this study. The SOS-Q, Young's internet addiction scale, Korean scale for internet addiction, and Smartphone Scale for Smartphone Addiction (S-Scale) were used to assess the concurrent validity. Construct validity was supported by a six-factor model using an exploratory factor analysis. The internal consistency and the item-total correlations were favorable (α = 0.95, r = 0.35-0.81). The test-retest reliability was moderate (r = 0.70). The SOS-Q showed superior concurrent validity with the highest correlation between the S-Scale (r = 0.76). Receiver operating characteristic curve analysis revealed an area under the curve of 0.877. A cut-off point of 49 effectively categorized addiction high-risk group with a sensitivity of 0.81 and specificity of 0.86. Overall, the current study supports the use of SOS-Q as both a primary and supplementary measurement tool in a variety of settings. Copyright © 2017 Elsevier B.V. All rights reserved.

Predictive Validity Study of the APS Writing and Reading Tests [and] Validating Placement Rules for the APS Writing Test.

ERIC Educational Resources Information Center

College of the Canyons, Valencia, CA. Office of Institutional Development.

California's College of the Canyons has used the College Board Assessment and Placement Services (APS) test to assess students' abilities in basic and college English since spring 1993. These two reports summarize data from a May 1994 study of the predictive validity of the APS writing and reading tests and a June 1994 effort to validate the cut…

A Validation Study of Student Differentiation between Computing Disciplines

ERIC Educational Resources Information Center

Battig, Michael; Shariq, Muhammad

2011-01-01

Using a previously published study of how students differentiate between computing disciplines, this study attempts to validate the original research and add additional hypotheses regarding the type of institution that the student resides. Using the identical survey instrument from the original study, students in smaller colleges and in different…

Instrument validation process: a case study using the Paediatric Pain Knowledge and Attitudes Questionnaire.

PubMed

Peirce, Deborah; Brown, Janie; Corkish, Victoria; Lane, Marguerite; Wilson, Sally

2016-06-01

To compare two methods of calculating interrater agreement while determining content validity of the Paediatric Pain Knowledge and Attitudes Questionnaire for use with Australian nurses. Paediatric pain assessment and management documentation was found to be suboptimal revealing a need to assess paediatric nurses' knowledge and attitude to pain. The Paediatric Pain Knowledge and Attitudes Questionnaire was selected as it had been reported as valid and reliable in the United Kingdom with student nurses. The questionnaire required content validity determination prior to use in the Australian context. A two phase process of expert review. Ten paediatric nurses completed a relevancy rating of all 68 questionnaire items. In phase two, five pain experts reviewed the items of the questionnaire that scored an unacceptable item level content validity. Item and scale level content validity indices and intraclass correlation coefficients were calculated. In phase one, 31 items received an item level content validity index <0·78 and the scale level content validity index average was 0·80 which were below levels required for acceptable validity. The intraclass correlation coefficient was 0·47. In phase two, 10 items were amended and four items deleted. The revised questionnaire provided a scale level content validity index average >0·90 and an intraclass correlation coefficient of 0·94 demonstrating excellent agreement between raters therefore acceptable content validity. Equivalent outcomes were achieved using the content validity index and the intraclass correlation coefficient. To assess content validity the content validity index has the advantage of providing an item level score and is a simple calculation. The intraclass correlation coefficient requires statistical knowledge, or support, and has the advantage of accounting for the possibility of chance agreement. © 2016 John Wiley & Sons Ltd.

Theoretical Issues of Validity in the Measurement of Aided Speech Reception Threshold in Noise for Comparing Nonlinear Hearing Aid Systems.

PubMed

Naylor, Graham

2016-07-01

Adaptive Speech Reception Threshold in noise (SRTn) measurements are often used to make comparisons between alternative hearing aid (HA) systems. Such measurements usually do not constrain the signal-to-noise ratio (SNR) at which testing takes place. Meanwhile, HA systems increasingly include nonlinear features that operate differently in different SNRs, and listeners differ in their inherent SNR requirements. To show that SRTn measurements, as commonly used in comparisons of alternative HA systems, suffer from threats to their validity, to illustrate these threats with examples of potentially invalid conclusions in the research literature, and to propose ways to tackle these threats. An examination of the nature of SRTn measurements in the context of test theory, modern nonlinear HAs, and listener diversity. Examples from the audiological research literature were used to estimate typical interparticipant variation in SRTn and to illustrate cases where validity may have been compromised. There can be no doubt that SRTn measurements, when used to compare nonlinear HA systems, in principle, suffer from threats to their internal and external/ecological validity. Interactions between HA nonlinearities and SNR, and interparticipant differences in inherent SNR requirements, can act to generate misleading results. In addition, SRTn may lie at an SNR outside the range for which the HA system is designed or expected to operate in. Although the extent of invalid conclusions in the literature is difficult to evaluate, examples of studies were nevertheless identified where the risk of each form of invalidity is significant. Reliable data on ecological SNRs is becoming available, so that ecological validity can be assessed. Methodological developments that can reduce the risk of invalid conclusions include variations on the SRTn measurement procedure itself, manipulations of stimulus or scoring conditions to place SRTn in an ecologically relevant range, and design and analysis

The comparative capacity of the Minnesota Multiphasic Personality Inventory-2 (MMPI-2) and MMPI-2 Restructured Form (MMPI-2-RF) validity scales to detect suspected malingering in a disability claimant sample.

PubMed

Chmielewski, Michael; Zhu, Jiani; Burchett, Danielle; Bury, Alison S; Bagby, R Michael

2017-02-01

The current study expands on past research examining the comparative capacity of the Minnesota Multiphasic Personality Inventory-2 (MMPI-2; Butcher et al., 2001) and MMPI-2 Restructured Form (MMPI-2-RF; Ben-Porath & Tellegen, 2008/2011) overreporting validity scales to detect suspected malingering, as assessed by the Miller Forensic Assessment of Symptoms Test (M-FAST; Miller, 2001), in a sample of public insurance disability claimants (N = 742) who were considered to have potential incentives to malinger. Results provide support for the capacity of both the MMPI-2 and the MMPI-2-RF overreporting validity scales to predict suspected malingering of psychopathology. The MMPI-2-RF overreporting validity scales proved to be modestly better predictors of suspected psychopathology malingering-compared with the MMPI-2 overreporting scales-in dimensional predictive models and categorical classification accuracy analyses. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Clinical audit project in undergraduate medical education curriculum: an assessment validation study

PubMed Central

Steketee, Carole; Mak, Donna

2016-01-01

Objectives To evaluate the merit of the Clinical Audit Project (CAP) in an assessment program for undergraduate medical education using a systematic assessment validation framework. Methods A cross-sectional assessment validation study at one medical school in Western Australia, with retrospective qualitative analysis of the design, development, implementation and outcomes of the CAP, and quantitative analysis of assessment data from four cohorts of medical students (2011- 2014). Results The CAP is fit for purpose with clear external and internal alignment to expected medical graduate outcomes.  Substantive validity in students’ and examiners’ response processes is ensured through relevant methodological and cognitive processes. Multiple validity features are built-in to the design, planning and implementation process of the CAP.  There is evidence of high internal consistency reliability of CAP scores (Cronbach’s alpha > 0.8) and inter-examiner consistency reliability (intra-class correlation>0.7). Aggregation of CAP scores is psychometrically sound, with high internal consistency indicating one common underlying construct.  Significant but moderate correlations between CAP scores and scores from other assessment modalities indicate validity of extrapolation and alignment between the CAP and the overall target outcomes of medical graduates.  Standard setting, score equating and fair decision rules justify consequential validity of CAP scores interpretation and use. Conclusions This study provides evidence demonstrating that the CAP is a meaningful and valid component in the assessment program. This systematic framework of validation can be adopted for all levels of assessment in medical education, from individual assessment modality, to the validation of an assessment program as a whole.  PMID:27716612

Clinical audit project in undergraduate medical education curriculum: an assessment validation study.

PubMed

Tor, Elina; Steketee, Carole; Mak, Donna

2016-09-24

To evaluate the merit of the Clinical Audit Project (CAP) in an assessment program for undergraduate medical education using a systematic assessment validation framework. A cross-sectional assessment validation study at one medical school in Western Australia, with retrospective qualitative analysis of the design, development, implementation and outcomes of the CAP, and quantitative analysis of assessment data from four cohorts of medical students (2011- 2014). The CAP is fit for purpose with clear external and internal alignment to expected medical graduate outcomes.  Substantive validity in students' and examiners' response processes is ensured through relevant methodological and cognitive processes. Multiple validity features are built-in to the design, planning and implementation process of the CAP.  There is evidence of high internal consistency reliability of CAP scores (Cronbach's alpha > 0.8) and inter-examiner consistency reliability (intra-class correlation>0.7). Aggregation of CAP scores is psychometrically sound, with high internal consistency indicating one common underlying construct.  Significant but moderate correlations between CAP scores and scores from other assessment modalities indicate validity of extrapolation and alignment between the CAP and the overall target outcomes of medical graduates.  Standard setting, score equating and fair decision rules justify consequential validity of CAP scores interpretation and use. This study provides evidence demonstrating that the CAP is a meaningful and valid component in the assessment program. This systematic framework of validation can be adopted for all levels of assessment in medical education, from individual assessment modality, to the validation of an assessment program as a whole.

Validating the Why/How Contrast for Functional MRI Studies of Theory of Mind

PubMed Central

Spunt, Robert P.; Adolphs, Ralph

2014-01-01

The ability to impute mental states to others, or Theory of Mind (ToM), has been the subject of hundreds of neuroimaging studies. Although reviews and meta-analyses of these studies have concluded that ToM recruits a coherent brain network, mounting evidence suggests that this network is an abstraction based on pooling data from numerous studies, most of which use different behavioral tasks to investigate ToM. Problematically, this means that no single behavioral task can be used to reliably measure ToM Network function as currently conceived. To make ToM Network function scientifically tractable, we need standardized tasks capable of reliably measuring specific aspects of its functioning. Here, our goal is to validate the Why/How Task for this purpose. Several prior studies have found that when compared to answering how-questions about another person's behavior, answering why-questions about that same behavior activates a network that is anatomically consistent with meta-analytic definitions of the ToM Network. In the version of the Why/How Task presented here, participants answer yes/no Why (e.g., Is the person helping someone?) and How (e.g., Is the person lifting something?) questions about pretested photographs of naturalistic human behaviors. Across three fMRI studies, we show that the task elicits reliable performance measurements and modulates a left-lateralized network that is consistently localized across studies. While this network is convergent with meta-analyses of ToM studies, it is largely distinct from the network identified by the widely used False-Belief Localizer, the most common ToM task. Our new task is publicly available, and can be used as an efficient functional localizer to provide reliable identification of single-subject responses in most regions of the network. Our results validate the Why/How Task, both as a standardized protocol capable of producing maximally comparable data across studies, and as a flexible foundation for programmatic

Comparative Validation of Realtime Solar Wind Forecasting Using the UCSD Heliospheric Tomography Model

NASA Technical Reports Server (NTRS)

MacNeice, Peter; Taktakishvili, Alexandra; Jackson, Bernard; Clover, John; Bisi, Mario; Odstrcil, Dusan

2011-01-01

The University of California, San Diego 3D Heliospheric Tomography Model reconstructs the evolution of heliospheric structures, and can make forecasts of solar wind density and velocity up to 72 hours in the future. The latest model version, installed and running in realtime at the Community Coordinated Modeling Center(CCMC), analyzes scintillations of meter wavelength radio point sources recorded by the Solar-Terrestrial Environment Laboratory(STELab) together with realtime measurements of solar wind speed and density recorded by the Advanced Composition Explorer(ACE) Solar Wind Electron Proton Alpha Monitor(SWEPAM).The solution is reconstructed using tomographic techniques and a simple kinematic wind model. Since installation, the CCMC has been recording the model forecasts and comparing them with ACE measurements, and with forecasts made using other heliospheric models hosted by the CCMC. We report the preliminary results of this validation work and comparison with alternative models.

Turkish Adaptation of the Mentorship Effectiveness Scale: A Validity and Reliability Study

ERIC Educational Resources Information Center

Yirci, Ramazan; Karakose, Turgut; Uygun, Harun; Ozdemir, Tuncay Yavuz

2016-01-01

The purpose of this study is to adapt the Mentoring Relationship Effectiveness Scale to Turkish, and to conduct validity and reliability tests regarding the scale. The study group consisted of 156 university science students receiving graduate education. Construct validity and factor structure of the scale was analyzed first through exploratory…

Validation study of human figure drawing test in a Colombian school children population.

PubMed

Vélez van Meerbeke, Alberto; Sandoval-Garcia, Carolina; Ibáñez, Milciades; Talero-Gutiérrez, Claudia; Fiallo, Dolly; Halliday, Karen

2011-05-01

The aim of this article was to assess the validity of the emotional and developmental components of the Koppitz human figure drawing test. 2420 children's drawings available in a database resulting from a previous cross sectional study designed to determine the prevalence of neurological diseases in children between 0 and 12 years old in Bogota schools were evaluated. They were scored using the criteria proposed by Koppitz, and classified into 16 groups according to age, gender, and presence/absence of learning or attention problems. The overall results were then compared with the normative study to assess whether descriptive parameters of the two populations were significantly different. There were no significant differences associated with presence/absence of learning and attention disorders or school attended within the overall sample. An Interrater reliability test has been made to assure the homogeneity of scoring by the evaluator team. There were significant differences between this population and that of the original study. New scoring tables contextualized for our population based on the frequency of appearance in this sample are presented. We can conclude that various ethnic, social, and cultural factors can influence the way children draw the human figure. It is thus important to establish local reference values to adequately distinguish between normality and abnormality. The new scoring tables proposed here should be followed up with a clinical study to corroborate their validity.

Screening for Posttraumatic Stress Disorder among Somali ex-combatants: A validation study

PubMed Central

Odenwald, Michael; Lingenfelder, Birke; Schauer, Maggie; Neuner, Frank; Rockstroh, Brigitte; Hinkel, Harald; Elbert, Thomas

2007-01-01

Background In Somalia, a large number of active and former combatants are affected by psychological problems such as Posttraumatic Stress Disorder (PTSD). This disorder impairs their ability to re-integrate into civilian life. However, many screening instruments for Posttraumatic Stress Disorder used in post-conflict settings have limited validity. Here we report on development and validation of a screening tool for PTSD in Somali language with a sample of ex-combatants. Methods We adapted the Posttraumatic Diagnostic Scale (PDS) to reflect linguistic and cultural differences within the Somali community so that local interviewers could be trained to administer the scale. For validation purposes, a randomly selected group of 135 Somali ex-combatants was screened by trained local interviewers; 64 of them were then re-assessed by trained clinical psychologists using the Composite International Diagnostic Interview (CIDI) and the Self-Report Questionnaire (SRQ-20). Results The screening instrument showed good internal consistency (Cronbach's α = .86), convergent validity with the CIDI (sensitivity = .90; specificity = .90) as well as concurrent validity: positive cases showed higher SRQ-20 scores, higher prevalence of psychotic symptoms, and higher levels of intake of the local stimulant drug khat. Compared to a single cut-off score, the multi-criteria scoring, in keeping with the DSM-IV, produced more diagnostic specificity. Conclusion The results provide evidence that our screening instrument is a reliable and valid method to detect PTSD among Somali ex-combatants. A future Disarmament, Demobilization and Reintegration Program in Somalia is recommended to screen for PTSD in order to identify ex-combatants with special psycho-social needs. PMID:17822562

Validation of Photoplethysmography-Based Sleep Staging Compared With Polysomnography in Healthy Middle-Aged Adults.

PubMed

Fonseca, Pedro; Weysen, Tim; Goelema, Maaike S; Møst, Els I S; Radha, Mustafa; Lunsingh Scheurleer, Charlotte; van den Heuvel, Leonie; Aarts, Ronald M

2017-07-01

To compare the accuracy of automatic sleep staging based on heart rate variability measured from photoplethysmography (PPG) combined with body movements measured with an accelerometer, with polysomnography (PSG) and actigraphy. Using wrist-worn PPG to analyze heart rate variability and an accelerometer to measure body movements, sleep stages and sleep statistics were automatically computed from overnight recordings. Sleep-wake, 4-class (wake/N1 + N2/N3/REM) and 3-class (wake/NREM/REM) classifiers were trained on 135 simultaneously recorded PSG and PPG recordings of 101 healthy participants and validated on 80 recordings of 51 healthy middle-aged adults. Epoch-by-epoch agreement and sleep statistics were compared with actigraphy for a subset of the validation set. The sleep-wake classifier obtained an epoch-by-epoch Cohen's κ between PPG and PSG sleep stages of 0.55 ± 0.14, sensitivity to wake of 58.2 ± 17.3%, and accuracy of 91.5 ± 5.1%. κ and sensitivity were significantly higher than with actigraphy (0.40 ± 0.15 and 45.5 ± 19.3%, respectively). The 3-class classifier achieved a κ of 0.46 ± 0.15 and accuracy of 72.9 ± 8.3%, and the 4-class classifier, a κ of 0.42 ± 0.12 and accuracy of 59.3 ± 8.5%. The moderate epoch-by-epoch agreement and, in particular, the good agreement in terms of sleep statistics suggest that this technique is promising for long-term sleep monitoring, although more evidence is needed to understand whether it can complement PSG in clinical practice. It also offers an improvement in sleep/wake detection over actigraphy for healthy individuals, although this must be confirmed on a larger, clinical population. © Sleep Research Society 2017. Published by Oxford University Press on behalf of the Sleep Research Society. All rights reserved. For permissions, please e-mail journals.permissions@oup.com.

A prospective study of the validity of self-reported use of specific types of dental services.

PubMed

Gilbert, Gregg H; Rose, John S; Shelton, Brent J

2003-01-01

The purpose of this study was to quantify the validity of self-reported receipt of dental services in 10 categories, using information from dental charts as the "gold standard." The Florida Dental Care Study was a prospective cohort study of a diverse sample of adults. In-person interviews were conducted at baseline and at 24 and 48 months following baseline, with telephone interviews at six-month intervals in between. Participants reported new dental visits, reason(s) for the visit(s), and specific service(s) received. For the present study, self-reported data were compared with data from patients' dental charts. Percent concordance between self-report and dental charts ranged from 82% to 100%, while Kappa values ranged from 0.33 to 0.91. Bivariate multiple logistic regressions were performed for each of the service categories, with two outcomes: self-reported service receipt and service receipt determined from the dental chart. Parameter estimate intervals overlapped for each of the four hypothesized predictors of service receipt (age group, sex, "race" defined as non-Hispanic African American vs. non-Hispanic white, and annual household income < 20,000 US dollars vs. > or = 20,000 US dollars), although for five of the 10 service categories, there were differences in conclusions about statistical significance for certain predictors. The validity of self-reported use of dental services ranged from poor to excellent, depending upon the service type. Regression estimates using either the self-reported or chart-validated measure yielded similar results overall, but conclusions about key predictors of service use differed in some instances. Self-reported dental service use is valid for some, but not all, service types.

A Morbidity Screening Tool for identifying fatigue, pain, upper limb dysfunction and lymphedema after breast cancer treatment: a validity study.

PubMed

Bulley, Catherine; Coutts, Fiona; Blyth, Christine; Jack, Wilma; Chetty, Udi; Barber, Matthew; Tan, Chee Wee

2014-04-01

This study aimed to investigate validity of a newly developed Morbidity Screening Tool (MST) to screen for fatigue, pain, swelling (lymphedema) and arm function after breast cancer treatment. A cross-sectional study included women attending reviews after completing treatment (surgery, chemotherapy and radiotherapy), without recurrence, who could read English. They completed the MST and comparator questionnaires: Disability of the Arm, Shoulder and Hand questionnaire (DASH), Chronic Pain Grade Questionnaire (CPGQ), Lymphedema and Breast Cancer Questionnaire (LBCQ) and Functional Assessment of Cancer Therapy questionnaire with subscales for fatigue (FACT F) and breast cancer (FACT B + 4). Bilateral combined shoulder ranges of motion were compared (upward reach; hand behind back) and percentage upper limb volume difference (%LVD =/>10% diagnosed as lymphedema) measured with the vertical perometer (400T). 613 of 617 participants completed questionnaires (mean age 62.3 years, SD 10.0; mean time since treatment 63.0 months, SD 46.6) and 417 completed objective testing. Morbidity prevalence was estimated as 35.8%, 21.9%, 19.8% and 34.4% for fatigue, impaired upper limb function, lymphedema and pain respectively. Comparing those self-reporting the presence or absence of each type of morbidity, statistically significant differences in comparator variables supported validity of the MST. Statistically significant correlations resulted between MST scores focussing on impact of morbidity, and comparator variables that reflect function and quality of life. Analysis supports the validity of all four short-forms of the MST as providing indications of both presence of morbidity and impacts on participants' lives. This may facilitate early and appropriate referral for intervention. Copyright © 2013 Elsevier Ltd. All rights reserved.

Assessing validity of observational intervention studies - the Benchmarking Controlled Trials.

PubMed

Malmivaara, Antti

2016-09-01

Benchmarking Controlled Trial (BCT) is a concept which covers all observational studies aiming to assess impact of interventions or health care system features to patients and populations. To create and pilot test a checklist for appraising methodological validity of a BCT. The checklist was created by extracting the most essential elements from the comprehensive set of criteria in the previous paper on BCTs. Also checklists and scientific papers on observational studies and respective systematic reviews were utilized. Ten BCTs published in the Lancet and in the New England Journal of Medicine were used to assess feasibility of the created checklist. The appraised studies seem to have several methodological limitations, some of which could be avoided in planning, conducting and reporting phases of the studies. The checklist can be used for planning, conducting, reporting, reviewing, and critical reading of observational intervention studies. However, the piloted checklist should be validated in further studies. Key messages Benchmarking Controlled Trial (BCT) is a concept which covers all observational studies aiming to assess impact of interventions or health care system features to patients and populations. This paper presents a checklist for appraising methodological validity of BCTs and pilot-tests the checklist with ten BCTs published in leading medical journals. The appraised studies seem to have several methodological limitations, some of which could be avoided in planning, conducting and reporting phases of the studies. The checklist can be used for planning, conducting, reporting, reviewing, and critical reading of observational intervention studies.

Predictive validity of the UK clinical aptitude test in the final years of medical school: a prospective cohort study.

PubMed

Husbands, Adrian; Mathieson, Alistair; Dowell, Jonathan; Cleland, Jennifer; MacKenzie, Rhoda

2014-04-23

The UK Clinical Aptitude Test (UKCAT) was designed to address issues identified with traditional methods of selection. This study aims to examine the predictive validity of the UKCAT and compare this to traditional selection methods in the senior years of medical school. This was a follow-up study of two cohorts of students from two medical schools who had previously taken part in a study examining the predictive validity of the UKCAT in first year. The sample consisted of 4th and 5th Year students who commenced their studies at the University of Aberdeen or University of Dundee medical schools in 2007. Data collected were: demographics (gender and age group), UKCAT scores; Universities and Colleges Admissions Service (UCAS) form scores; admission interview scores; Year 4 and 5 degree examination scores. Pearson's correlations were used to examine the relationships between admissions variables, examination scores, gender and age group, and to select variables for multiple linear regression analysis to predict examination scores. Ninety-nine and 89 students at Aberdeen medical school from Years 4 and 5 respectively, and 51 Year 4 students in Dundee, were included in the analysis. Neither UCAS form nor interview scores were statistically significant predictors of examination performance. Conversely, the UKCAT yielded statistically significant validity coefficients between .24 and .36 in four of five assessments investigated. Multiple regression analysis showed the UKCAT made a statistically significant unique contribution to variance in examination performance in the senior years. Results suggest the UKCAT appears to predict performance better in the later years of medical school compared to earlier years and provides modest supportive evidence for the UKCAT's role in student selection within these institutions. Further research is needed to assess the predictive validity of the UKCAT against professional and behavioural outcomes as the cohort commences working life.

Predictive validity of the UK clinical aptitude test in the final years of medical school: a prospective cohort study

PubMed Central

2014-01-01

Background The UK Clinical Aptitude Test (UKCAT) was designed to address issues identified with traditional methods of selection. This study aims to examine the predictive validity of the UKCAT and compare this to traditional selection methods in the senior years of medical school. This was a follow-up study of two cohorts of students from two medical schools who had previously taken part in a study examining the predictive validity of the UKCAT in first year. Methods The sample consisted of 4th and 5th Year students who commenced their studies at the University of Aberdeen or University of Dundee medical schools in 2007. Data collected were: demographics (gender and age group), UKCAT scores; Universities and Colleges Admissions Service (UCAS) form scores; admission interview scores; Year 4 and 5 degree examination scores. Pearson’s correlations were used to examine the relationships between admissions variables, examination scores, gender and age group, and to select variables for multiple linear regression analysis to predict examination scores. Results Ninety-nine and 89 students at Aberdeen medical school from Years 4 and 5 respectively, and 51 Year 4 students in Dundee, were included in the analysis. Neither UCAS form nor interview scores were statistically significant predictors of examination performance. Conversely, the UKCAT yielded statistically significant validity coefficients between .24 and .36 in four of five assessments investigated. Multiple regression analysis showed the UKCAT made a statistically significant unique contribution to variance in examination performance in the senior years. Conclusions Results suggest the UKCAT appears to predict performance better in the later years of medical school compared to earlier years and provides modest supportive evidence for the UKCAT’s role in student selection within these institutions. Further research is needed to assess the predictive validity of the UKCAT against professional and behavioural

The English and Chinese versions of the five-level EuroQoL Group's five-dimension questionnaire (EQ-5D) were valid and reliable and provided comparable scores in Asian breast cancer patients.

PubMed

Lee, Chun Fan; Ng, Raymond; Luo, Nan; Wong, Nan Soon; Yap, Yoon Sim; Lo, Soo Kien; Chia, Whay Kuang; Yee, Alethea; Krishna, Lalit; Wong, Celest; Goh, Cynthia; Cheung, Yin Bun

2013-01-01

To examine the measurement properties of and comparability between the English and Chinese versions of the five-level EuroQoL Group's five-dimension questionnaire (EQ-5D) in breast cancer patients in Singapore. This is an observational study of 269 patients. Known-group validity and responsiveness of the EQ-5D utility index and visual analog scale (VAS) were assessed in relation to various clinical characteristics and longitudinal change in performance status, respectively. Convergent and divergent validity was examined by correlation coefficients between the EQ-5D and a breast cancer-specific instrument. Test-retest reliability was evaluated. The two language versions were compared by multiple regression analyses. For both English and Chinese versions, the EQ-5D utility index and VAS demonstrated known-group validity and convergent and divergent validity, and presented sufficient test-retest reliability (intraclass correlation = 0.72 to 0.83). The English version was responsive to changes in performance status. The Chinese version was responsive to decline in performance status, but there was no conclusive evidence about its responsiveness to improvement in performance status. In the comparison analyses of the utility index and VAS between the two language versions, borderline results were obtained, and equivalence cannot be definitely confirmed. The five-level EQ-5D is valid, responsive, and reliable in assessing health outcome of breast cancer patients. The English and Chinese versions provide comparable measurement results.

Academic and Nonacademic Validating Agents on Latinas Mathematics and Science Self Concept A Quantitative Study Utilizing the High School Longitudinal Study of 2009

NASA Astrophysics Data System (ADS)

Garza, Jennifer M.

The purpose of this study is to inform and further the discussion of academic (i.e. teachers and school counselors) and non-academic (i.e. parents, family, friends, etc.) validating agents on Latina students' mathematics and science self-concepts. This study found a relationship between Latina students' interactions with academic and non-academic validating agents and their math and science self-concept at the K-12 level. Through the review of the literature the researcher addresses identifiable factors and strategies that inform the field of education in the areas of validation theory, family characteristics, and access to STEM fields for Latina students. The researcher used an established instrument designed, administered, and validated through the National Center for Education Statistics (NCES). For purposes of this study, a categorical subset of participants who self-identified as being a Latina student was used. As a result, the total subset number in this study was N=1,882. To determine if academic and non-academic validating agents had an observable statistically significant relationship with Latina students' math and science self-concept, a series of one-way ANOVAs were calculated to compare differences in students' math and science self-concept based on academic and non-academic validating agents for the weighted sample of Latinas for the HLS:09 survey. A path analysis was also employed to assess the factors involved in Latina students' math and science self-concepts. The findings are consistent with previous research involving the influence that academic and non-academic validating agents have on the math and science self-concept of Latina students. The results indicated that students who had teachers that believed in the students, regardless of family background, social economic status or home environment influences had higher math and science self concepts than those who did not. Similarly, it was found that students who had counselors that set high

Empirical Assessment of Effect of Publication Bias on a Meta-Analysis of Validity Studies on University Matriculation Examinations in Nigeria

ERIC Educational Resources Information Center

Adeyemo, Emily Oluseyi

2012-01-01

This study examined the impact of publication bias on a meta-analysis of empirical studies on validity of University Matriculation Examinations in Nigeria with a view to determine the level of difference between published and unpublished articles. Specifically, the design was an ex-post facto, a causal comparative design. The sample size consisted…

Validating an Elicited Imitation Task as a Measure of Implicit Knowledge: Comparisons with Other Validation Studies

ERIC Educational Resources Information Center

Spada, Nina; Shiu, Julie Li-Ju; Tomita, Yasuyo

2015-01-01

This study builds on research investigating the construct validity of elicited imitation (EI) as a measure of implicit second language (L2) grammatical knowledge. It differs from previous studies in that the EI task focuses on a single grammatical feature and time on task is strictly controlled. Seventy-three EFL learners and 20 native English…

A comparative study and validation of upwind and central-difference Navier-Stokes codes for high-speed flows

NASA Technical Reports Server (NTRS)

Rudy, David H.; Kumar, Ajay; Thomas, James L.; Gnoffo, Peter A.; Chakravarthy, Sukumar R.

1988-01-01

A comparative study was made using 4 different computer codes for solving the compressible Navier-Stokes equations. Three different test problems were used, each of which has features typical of high speed internal flow problems of practical importance in the design and analysis of propulsion systems for advanced hypersonic vehicles. These problems are the supersonic flow between two walls, one of which contains a 10 deg compression ramp, the flow through a hypersonic inlet, and the flow in a 3-D corner formed by the intersection of two symmetric wedges. Three of the computer codes use similar recently developed implicit upwind differencing technology, while the fourth uses a well established explicit method. The computed results were compared with experimental data where available.

A newly developed tool for classifying study designs in systematic reviews of interventions and exposures showed substantial reliability and validity.

PubMed

Seo, Hyun-Ju; Kim, Soo Young; Lee, Yoon Jae; Jang, Bo-Hyoung; Park, Ji-Eun; Sheen, Seung-Soo; Hahn, Seo Kyung

2016-02-01

To develop a study Design Algorithm for Medical Literature on Intervention (DAMI) and test its interrater reliability, construct validity, and ease of use. We developed and then revised the DAMI to include detailed instructions. To test the DAMI's reliability, we used a purposive sample of 134 primary, mainly nonrandomized studies. We then compared the study designs as classified by the original authors and through the DAMI. Unweighted kappa statistics were computed to test interrater reliability and construct validity based on the level of agreement between the original and DAMI classifications. Assessment time was also recorded to evaluate ease of use. The DAMI includes 13 study designs, including experimental and observational studies of interventions and exposure. Both the interrater reliability (unweighted kappa = 0.67; 95% CI [0.64-0.75]) and construct validity (unweighted kappa = 0.63, 95% CI [0.52-0.67]) were substantial. Mean classification time using the DAMI was 4.08 ± 2.44 minutes (range, 0.51-10.92). The DAMI showed substantial interrater reliability and construct validity. Furthermore, given its ease of use, it could be used to accurately classify medical literature for systematic reviews of interventions although minimizing disagreement between authors of such reviews. Copyright © 2016 Elsevier Inc. All rights reserved.

Development of Creative Behavior Observation Form: A Study on Validity and Reliability

ERIC Educational Resources Information Center

Dere, Zeynep; Ömeroglu, Esra

2018-01-01

This study, Creative Behavior Observation Form was developed to assess creativity of the children. While the study group on the reliability and validity of Creative Behavior Observation Form was being developed, 257 children in total who were at the ages of 5-6 were used as samples with stratified sampling method. Content Validity Index (CVI) and…

Assessing Meritorious Teacher Performance: A Differential Validity Study.

ERIC Educational Resources Information Center

Ellett, Chad D; Capie, William

The Teacher Assessment and Development System (TADS) - Meritorious Teacher Program (MTP) FORM instrument is used in the Dade County Public Schools, Miami, Florida, to evaluate teachers. Its validity for decisions concerning merit pay for master teachers was examined in this study. Specifically, its ability to discriminate between high performing…

Environmental education curriculum evaluation questionnaire: A reliability and validity study

NASA Astrophysics Data System (ADS)

Minner, Daphne Diane

that the questionnaire can discriminate differences in quality of environmental education curricula. Of the 35 curricula evaluated, 6 were high quality, 14 were medium quality and 15 were low quality. The criterion-related validity of the instrument is at current time unable to be established due to the lack of comparable measures or a concretely usable set of multidisciplinary standards. Face and content validity were sufficiently demonstrated.

A Comparative Study Of Dust Devils

NASA Astrophysics Data System (ADS)

Lange, C. F.; Prieto, L. E.

2005-12-01

computational models. This was accomplished by examining features of the dust devils in the form of three main flow parameters: the ratio of the inflow layer height h to the updraft radius r_0 (aspect ratio), the radial Reynolds number characterizing the updraft zone, and the ratio of the tangential velocity to the mean radial velocity (swirl ratio) at the radius of the updraft zone, r_0. The detailed analysis of the numerical flow solutions led to a simple definition of h and r_0, valid for the types of model flows analyzed. This study is a necessary part of a larger effort to examine and compare both numerical and laboratory simulations of atmospheric vortices in terrestrial and Martian conditions. References [1] R. Greeley et al., XXXII Lunar and Planetary Science, 2001. [2] D. E. Lund and J. T. Snow, The Tornado: Its Structure, Dynamics, Prediction, and Hazards, 1993, p. 297--306. [3] N. B. Ward, J. Atmos. Sci., 1972, 1194--1204.

Study on the Validity and Reliability of Melbourne Decision Making Scale in Turkey

ERIC Educational Resources Information Center

Çolakkadioglu, Oguzhan; Deniz, M. Engin

2015-01-01

This study is to analyze the validity and reliability of Melbourne Decision Making Questionnaire (MDMQ). The sample consisted of 650 university students. The structural validity of the MDMQ, as well as correlations among its sub-scales, measure-bound validity, internal consistency, item total correlations and test-retest reliability coefficients…

Validation of the Social Appearance Anxiety Scale in Patients with Systemic Sclerosis: A Scleroderma Patient-centered Intervention Network Cohort Study.

PubMed

Mills, Sarah D; Kwakkenbos, Linda; Carrier, Marie-Eve; Gholizadeh, Shadi; Fox, Rina S; Jewett, Lisa R; Gottesman, Karen; Roesch, Scott C; Thombs, Brett D; Malcarne, Vanessa L

2018-01-17

Systemic sclerosis (SSc) is an autoimmune disease that can cause disfiguring changes in appearance. This study examined the structural validity, internal consistency reliability, convergent validity, and measurement equivalence of the Social Appearance Anxiety Scale (SAAS) across SSc disease subtypes. Patients enrolled in the Scleroderma Patient-centered Intervention Network Cohort completed the SAAS and measures of appearance-related concerns and psychological distress. Confirmatory factor analysis (CFA) was used to examine the structural validity of the SAAS. Multiple-group CFA was used to determine if SAAS scores can be compared across patients with limited and diffuse disease subtypes. Cronbach's alpha was used to examine internal consistency reliability. Correlations of SAAS scores with measures of body image dissatisfaction, fear of negative evaluation, social anxiety, and depression were used to examine convergent validity. SAAS scores were hypothesized to be positively associated with all convergent validity measures, with correlations significant and moderate to large in size. A total of 938 patients with SSc were included. CFA supported a one-factor structure (CFI: .92; SRMR: .04; RMSEA: .08), and multiple-group CFA indicated that the scalar invariance model best fit the data. Internal consistency reliability was good in the total sample (α = .96) and in disease subgroups. Overall, evidence of convergent validity was found with measures of body image dissatisfaction, fear of negative evaluation, social anxiety, and depression. The SAAS can be reliably and validly used to assess fear of appearance evaluation in patients with SSc, and SAAS scores can be meaningfully compared across disease subtypes. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

The Abbott RealTime High Risk HPV test is a clinically validated human papillomavirus assay for triage in the referral population and use in primary cervical cancer screening in women 30 years and older: a review of validation studies.

PubMed

Poljak, Mario; Oštrbenk, Anja

2013-01-01

Human papillomavirus (HPV) testing has become an essential part of current clinical practice in the management of cervical cancer and precancerous lesions. We reviewed the most important validation studies of a next-generation real-time polymerase chain reaction-based assay, the RealTime High Risk HPV test (RealTime)(Abbott Molecular, Des Plaines, IL, USA), for triage in referral population settings and for use in primary cervical cancer screening in women 30 years and older published in peer-reviewed journals from 2009 to 2013. RealTime is designed to detect 14 high-risk HPV genotypes with concurrent distinction of HPV-16 and HPV-18 from 12 other HPV genotypes. The test was launched on the European market in January 2009 and is currently used in many laboratories worldwide for routine detection of HPV. We concisely reviewed validation studies of a next-generation real-time polymerase chain reaction (PCR)-based assay: the Abbott RealTime High Risk HPV test. Eight validation studies of RealTime in referral settings showed its consistently high absolute clinical sensitivity for both CIN2+ (range 88.3-100%) and CIN3+ (range 93.0-100%), as well as comparative clinical sensitivity relative to the currently most widely used HPV test: the Qiagen/Digene Hybrid Capture 2 HPV DNA Test (HC2). Due to the significantly different composition of the referral populations, RealTime absolute clinical specificity for CIN2+ and CIN3+ varied greatly across studies, but was comparable relative to HC2. Four validation studies of RealTime performance in cervical cancer screening settings showed its consistently high absolute clinical sensitivity for both CIN2+ and CIN3+, as well as comparative clinical sensitivity and specificity relative to HC2 and GP5+/6+ PCR. RealTime has been extensively evaluated in the last 4 years. RealTime can be considered clinically validated for triage in referral population settings and for use in primary cervical cancer screening in women 30 years and older.

Human Rights Attitude Scale: A Validity and Reliability Study

ERIC Educational Resources Information Center

Ercan, Recep; Yaman, Tugba; Demir, Selcuk Besir

2015-01-01

The objective of this study is to develop a valid and reliable attitude scale having quality psychometric features that can measure secondary school students' attitudes towards human rights. The study group of the research is comprised by 710 6th, 7th and 8th grade students who study at 4 secondary schools in the centre of Sivas. The study group…

A Comparative Study of Student Math Skills: Perceptions, Validation, and Recommendations

ERIC Educational Resources Information Center

Jones, Thomas W.; Price, Barbara A.; Randall, Cindy H.

2011-01-01

A study was conducted at a southern university in sophomore level production classes to assess skills such as the order of arithmetic operations, decimal and percent conversion, solving of algebraic expressions, and evaluation of formulas. The study was replicated using business statistics and quantitative analysis classes at a southeastern…

A Validation Study of the Japanese Version of the Addenbrooke's Cognitive Examination-Revised

PubMed Central

dos Santos Kawata, Kelssy Hitomi; Hashimoto, Ryusaku; Nishio, Yoshiyuki; Hayashi, Atsuko; Ogawa, Nanayo; Kanno, Shigenori; Hiraoka, Kotaro; Yokoi, Kayoko; Iizuka, Osamu; Mori, Etsuro

2012-01-01

The aim of this study was to validate the Japanese version of the Addenbrooke's Cognitive Examination-Revised (ACE-R) [Mori: Japanese Edition of Hodges JR's Cognitive Assessment for Clinicians, 2010] designed to detect dementia, and to compare its diagnostic accuracy with that of the Mini-Mental State Examination. The ACE-R was administered to 85 healthy individuals and 126 patients with dementia. The reliability assessment revealed a strong correlation in both groups. The internal consistency was excellent (α-coefficient = 0.88). Correlation with the Clinical Dementia Rating sum of boxes score was significant (rs = −0.61, p < 0.001). The area under the curve was 0.98 for the ACE-R and 0.96 for the Mini-Mental State Examination. The cut-off score of 80 showed a sensitivity of 94% and a specificity of 94%. Like the original ACE-R and the versions designed for other languages, the Japanese version of the ACE-R is a reliable and valid test for the detection of dementia. PMID:22619659

29 CFR 1607.5 - General standards for validity studies.

Code of Federal Regulations, 2014 CFR

2014-07-01

... experience on the job. J. Interim use of selection procedures. Users may continue the use of a selection... studies. A. Acceptable types of validity studies. For the purposes of satisfying these guidelines, users... which has an adverse impact and which selection procedure has an adverse impact, each user should...

29 CFR 1607.5 - General standards for validity studies.

Code of Federal Regulations, 2013 CFR

2013-07-01

... experience on the job. J. Interim use of selection procedures. Users may continue the use of a selection... studies. A. Acceptable types of validity studies. For the purposes of satisfying these guidelines, users... which has an adverse impact and which selection procedure has an adverse impact, each user should...

29 CFR 1607.5 - General standards for validity studies.

Code of Federal Regulations, 2012 CFR

2012-07-01

... experience on the job. J. Interim use of selection procedures. Users may continue the use of a selection... studies. A. Acceptable types of validity studies. For the purposes of satisfying these guidelines, users... which has an adverse impact and which selection procedure has an adverse impact, each user should...

Validation of a scenario-based assessment of critical thinking using an externally validated tool.

PubMed

Buur, Jennifer L; Schmidt, Peggy; Smylie, Dean; Irizarry, Kris; Crocker, Carlos; Tyler, John; Barr, Margaret

2012-01-01

With medical education transitioning from knowledge-based curricula to competency-based curricula, critical thinking skills have emerged as a major competency. While there are validated external instruments for assessing critical thinking, many educators have created their own custom assessments of critical thinking. However, the face validity of these assessments has not been challenged. The purpose of this study was to compare results from a custom assessment of critical thinking with the results from a validated external instrument of critical thinking. Students from the College of Veterinary Medicine at Western University of Health Sciences were administered a custom assessment of critical thinking (ACT) examination and the externally validated instrument, California Critical Thinking Skills Test (CCTST), in the spring of 2011. Total scores and sub-scores from each exam were analyzed for significant correlations using Pearson correlation coefficients. Significant correlations between ACT Blooms 2 and deductive reasoning and total ACT score and deductive reasoning were demonstrated with correlation coefficients of 0.24 and 0.22, respectively. No other statistically significant correlations were found. The lack of significant correlation between the two examinations illustrates the need in medical education to externally validate internal custom assessments. Ultimately, the development and validation of custom assessments of non-knowledge-based competencies will produce higher quality medical professionals.

Urogenital function in robotic vs laparoscopic rectal cancer surgery: a comparative study.

PubMed

Panteleimonitis, Sofoklis; Ahmed, Jamil; Ramachandra, Meghana; Farooq, Muhammad; Harper, Mick; Parvaiz, Amjad

2017-02-01

Urological and sexual dysfunction are recognised risks of rectal cancer surgery; however, there is limited evidence regarding urogenital function comparing robotic to laparoscopic techniques. The aim of this study was to assess the urogenital functional outcomes of patients undergoing laparoscopic and robotic rectal cancer surgery. Urological and sexual functions were assessed using gender-specific validated standardised questionnaires. Questionnaires were sent a minimum of 6 months after surgery, and patients were asked to report their urogenital function pre- and post-operatively, allowing changes in urogenital function to be identified. Questionnaires were sent to 158 patients (89 laparoscopy, 69 robotic) of whom 126 (80 %) responded. Seventy-eight (49 male, 29 female) of the responders underwent laparoscopic and 48 (35 male, 13 female) robotic surgery. Male patients in the robotic group deteriorated less across all components of sexual function and in five components of urological function. Composite male urological and sexual function score changes from baseline were better in the robotic cohort (p < 0.001). In females, there was no difference between the two groups in any of the components of urological or sexual function. However, composite female urological function score change from baseline was better in the robotic group (p = 0.003). Robotic rectal cancer surgery might offer better post-operative urological and sexual outcomes compared to laparoscopic surgery in male patients and better urological outcomes in females. Larger scale, prospective randomised control studies including urodynamic assessment of urogenital function are required to validate these results.

Understanding Foreign Language Learning Strategies: A Validation Study

ERIC Educational Resources Information Center

Tragant, Elsa; Thompson, Marilyn S.; Victori, Mia

2013-01-01

The present work aims to contribute to our understanding of the underlying dimensions of language learning strategies in foreign language contexts. The study analyzes alternative factor structures underlying a recently developed instrument (Tragant and Victori, 2012) and it includes the age factor in the examination of its construct validity. The…

Teachers' Engagement at Work: An International Validation Study

ERIC Educational Resources Information Center

Klassen, Robert M.; Aldhafri, Said; Mansfield, Caroline F.; Purwanto, Edy; Siu, Angela F. Y.; Wong, Marina W.; Woods-McConney, Amanda

2012-01-01

This study explored the validity of the Utrecht Work Engagement Scale in a sample of 853 practicing teachers from Australia, Canada, China (Hong Kong), Indonesia, and Oman. The authors used multigroup confirmatory factor analysis to test the factor structure and measurement invariance across settings, after which they examined the relationships…

A Validation Study of the Existential Anxiety Scale.

ERIC Educational Resources Information Center

Hullett, Michael A.

Logotherapy is a meaning-centered psychotherapy which focuses on both the meaning of human existence and the personal search for meaning. If the will to search for meaning is frustrated, "existential frustration" may result. This study validates the Existential Anxiety Scale (EAS) developed by Good and Good (1974). Basic principles of…

Validation Study of a Gatekeeping Attitude Index for Social Work Education

ERIC Educational Resources Information Center

Tam, Dora M. Y.; Coleman, Heather

2011-01-01

This article reports on a study designed to validate the Gatekeeping Attitude Index, a 14-item Likert scaling index. The authors collected data from a convenience sample of social work field instructors (N = 188) with a response rate of 74.0%. Construct validation by exploratory factor analysis identified a 2-factor solution on the index after…

40 CFR 152.92 - Submission of a new valid study.

Code of Federal Regulations, 2010 CFR

2010-07-01

... Submitters' Rights § 152.92 Submission of a new valid study. An applicant may demonstrate compliance for a... study previously submitted to the Agency should not be resubmitted but should be cited in accordance...

Comparative divertor-transport study for helical devices

NASA Astrophysics Data System (ADS)

Feng, Y.; Kobayashi, M.; Sardei, F.; Masuzaki, S.; Kisslinger, J.; Morisaki, T.; Grigull, P.; Yamada, H.; McCormick, K.; Ohyabu, N.; König, R.; Yamada, I.; Giannone, L.; Narihara, K.; Wenzel, U.; Morita, S.; Thomsen, H.; Miyazawa, J.; Hildebrandt, D.; Watanabe, T.; Wagner, F.; Ashikawa, N.; Ida, K.; Komori, A.; Motojima, O.; Nakamura, Y.; Peterson, B. J.; Sato, K.; Shoji, M.; Tamura, N.; Tokitani, M.; LHD experimental Group

2009-09-01

Using the island divertors (IDs) of W7-AS and W7-X and the helical divertor (HD) of LHD as examples, the paper presents a comparative divertor transport study for three typical helical devices of different machine sizes following two distinct divertor concepts, aiming at identifying common physics issues/effects for mutual validation and combined studies. Based on EMC3/EIRENE simulations supported by experimental results, the paper first reviews and compares the essential transport features of the W7-AS ID and the LHD HD in order to build a base and framework for a predictive study of W7-X. The fundamental role of low-order magnetic islands in both divertor concepts is emphasized. Preliminary EMC3/EIRENE simulation results for W7-X are presented and discussed with respect to W7-AS and LHD in order to show how the individual field and divertor topologies affect the divertor transport and performance. For instance, a high recycling regime, which is absent from W7-AS and LHD, is predicted to exist for W7-X. The paper focuses on identifying and understanding the role of divertors for high density plasma operations in helical devices. In this regard, special attention is paid to investigating the divertor function for controlling intrinsic impurities. Impurity transport behaviour and wall-sputtering processes of CX-neutrals are studied under different divertor plasma conditions. A divertor retention effect on intrinsic impurities at high SOL collisonalities is predicted for all the three devices. The required SOL plasma conditions and the underlying mechanisms are analysed in detail. Numerical results are discussed in conjunction with the experimental observations for high density divertor plasmas in W7-AS and LHD. Different SOL transport regimes are numerically identified for the standard divertor configuration of W7-X and the possible consequences on high density plasmas are assessed. All the EMC3-EIRENE simulations presented in this paper are based on vacuum fields

A comparative study of ICH validated novel spectrophotometric techniques for resolving completely overlapping spectra of quaternary mixtures

NASA Astrophysics Data System (ADS)

Ali, Nouruddin W.; Abdelwahab, Nada S.; Abdelkawy, M.; Emam, Aml A.

2016-02-01

A pharmaceutically marketed mixture of Yohimbine, Alpha-tocopheryl acetate, Niacin, and Caffeine co-formulated as a promising therapy for erectile dysfunction. Simultaneous determination of the aforementioned pharmaceutical formulation without prior separation steps was applied using mean centering of ratio spectra and triple divisor spectrophotometric methods. Mean centering of ratio spectra method depended on using the mean centered ratio spectra in three successive steps which eliminated the derivative steps and so the signal to noise ratio was improved. The absorption spectra of the prepared solutions were measured in the wavelength range of 215-300 nm in the concentration ranges of 1-15, 3-15, 1-20, and 3-15 μg mL- 1 for Yohimbine, Alpha-tocopheryl acetate, Niacin, and Caffeine, respectively. The amplitudes of the mean centered third ratio spectra were measured at 250 nm and 268 nm for Yohimbine and Alpha-tocopheryl acetate, respectively and at peak to peak 272-273 and 262-263 nm for Niacin and Caffeine, respectively. In triple divisor method each drug in the quaternary mixture was determined by dividing the spectrum of the quaternary mixture by a standard spectrum of a mixture containing equal concentrations of the other three drugs. First derivative of these ratio spectra was obtained where determination could be achieved without any interference from the other three drugs. Amplitudes of 1-15, 3-15, 1-15, and 3-15 μg mL- 1 were used for selective determination of Yohimbine, Alpha-tocopheryl acetate, Niacin, and Caffeine, respectively. Laboratory prepared mixtures were analyzed by the developed novel methods to investigate their selectivity also, Super Act® capsules were successfully analyzed to ensure absence of interference from additives. The developed methods were validated according to the ICH guidelines. The proposed methods were statistically compared with each other and with the reported methods; using student t-test, F-test, and one way ANOVA

A comparative study of ICH validated novel spectrophotometric techniques for resolving completely overlapping spectra of quaternary mixtures.

PubMed

Ali, Nouruddin W; Abdelwahab, Nada S; Abdelkawy, M; Emam, Aml A

2016-02-05

A pharmaceutically marketed mixture of Yohimbine, Alpha-tocopheryl acetate, Niacin, and Caffeine co-formulated as a promising therapy for erectile dysfunction. Simultaneous determination of the aforementioned pharmaceutical formulation without prior separation steps was applied using mean centering of ratio spectra and triple divisor spectrophotometric methods. Mean centering of ratio spectra method depended on using the mean centered ratio spectra in three successive steps which eliminated the derivative steps and so the signal to noise ratio was improved. The absorption spectra of the prepared solutions were measured in the wavelength range of 215-300 nm in the concentration ranges of 1-15, 3-15, 1-20, and 3-15 μg mL(-1) for Yohimbine, Alpha-tocopheryl acetate, Niacin, and Caffeine, respectively. The amplitudes of the mean centered third ratio spectra were measured at 250 nm and 268 nm for Yohimbine and Alpha-tocopheryl acetate, respectively and at peak to peak 272-273 and 262-263 nm for Niacin and Caffeine, respectively. In triple divisor method each drug in the quaternary mixture was determined by dividing the spectrum of the quaternary mixture by a standard spectrum of a mixture containing equal concentrations of the other three drugs. First derivative of these ratio spectra was obtained where determination could be achieved without any interference from the other three drugs. Amplitudes of 1-15, 3-15, 1-15, and 3-15 μg mL(-1) were used for selective determination of Yohimbine, Alpha-tocopheryl acetate, Niacin, and Caffeine, respectively. Laboratory prepared mixtures were analyzed by the developed novel methods to investigate their selectivity also, Super Act® capsules were successfully analyzed to ensure absence of interference from additives. The developed methods were validated according to the ICH guidelines. The proposed methods were statistically compared with each other and with the reported methods; using student t-test, F-test, and one way ANOVA

Self-Disclosure Between Friends: A Validity Study

ERIC Educational Resources Information Center

Panyard, Christine Marie

1973-01-01

Subjects reported that they had disclosed approximately the same amount of information as they had received. The consensual validation of the amount of personal information exchanged between friends suggested that the Self-Disclosure Questionnaire is a valid measure of self-disclosure to a specific target person. (Author)

Validation of the Vanderbilt Holistic Face Processing Test.

PubMed

Wang, Chao-Chih; Ross, David A; Gauthier, Isabel; Richler, Jennifer J

2016-01-01

The Vanderbilt Holistic Face Processing Test (VHPT-F) is a new measure of holistic face processing with better psychometric properties relative to prior measures developed for group studies (Richler et al., 2014). In fields where psychologists study individual differences, validation studies are commonplace and the concurrent validity of a new measure is established by comparing it to an older measure with established validity. We follow this approach and test whether the VHPT-F measures the same construct as the composite task, which is group-based measure at the center of the large literature on holistic face processing. In Experiment 1, we found a significant correlation between holistic processing measured in the VHPT-F and the composite task. Although this correlation was small, it was comparable to the correlation between holistic processing measured in the composite task with the same faces, but different target parts (top or bottom), which represents a reasonable upper limit for correlations between the composite task and another measure of holistic processing. These results confirm the validity of the VHPT-F by demonstrating shared variance with another measure of holistic processing based on the same operational definition. These results were replicated in Experiment 2, but only when the demographic profile of our sample matched that of Experiment 1.

Validation of the Vanderbilt Holistic Face Processing Test

PubMed Central

Wang, Chao-Chih; Ross, David A.; Gauthier, Isabel; Richler, Jennifer J.

2016-01-01

The Vanderbilt Holistic Face Processing Test (VHPT-F) is a new measure of holistic face processing with better psychometric properties relative to prior measures developed for group studies (Richler et al., 2014). In fields where psychologists study individual differences, validation studies are commonplace and the concurrent validity of a new measure is established by comparing it to an older measure with established validity. We follow this approach and test whether the VHPT-F measures the same construct as the composite task, which is group-based measure at the center of the large literature on holistic face processing. In Experiment 1, we found a significant correlation between holistic processing measured in the VHPT-F and the composite task. Although this correlation was small, it was comparable to the correlation between holistic processing measured in the composite task with the same faces, but different target parts (top or bottom), which represents a reasonable upper limit for correlations between the composite task and another measure of holistic processing. These results confirm the validity of the VHPT-F by demonstrating shared variance with another measure of holistic processing based on the same operational definition. These results were replicated in Experiment 2, but only when the demographic profile of our sample matched that of Experiment 1. PMID:27933014

Measuring family needs of people living with cancer. Portuguese validation and descriptive studies of the Family Inventory of Needs.

PubMed

Areia, Neide P; Major, Sofia; Relvas, Ana P

2017-10-01

The aim of this study was to validate the Portuguese version of the Family Inventory of Needs (FIN). The FIN aims to measure important family needs and their fulfilment by a healthcare team. This cross-sectional study involved a sample of 364 family members of cancer patients, recruited from three medical institutions and through online recruitment. Three instruments were used: a socio-demographic questionnaire, the FIN and the Brief Symptom Inventory - 18 (BSI-18). Construct validity and reliability were considered regarding the FIN's psychometric properties. The method used to determine construct validity was factor structure analysis (confirmatory factor analysis), inter-factor correlations (Spearman's rank correlation) and convergent validity (Spearman's rank correlation). To assess scale reliability, the FIN's internal consistency was evaluated (Cronbach's alpha coefficient). Descriptive and frequency statistics and tests to compare means were used to assess important needs and to what extent they were met. The four-factor structure of the FIN was confirmed. Thus, the FIN has four domains: Basic Information, Information on treatment and care, Support and Patient Comfort. Convergent validity with the BSI-18 was verified. Both subscales of the FIN and each domain exceeded the minimum reliability standard of 0.70. Family members also reported important needs that were not adequately met by healthcare professionals. The Portuguese version of the FIN seems to be a reliable and valid tool for identifying cancer patients' important family needs and to what extent these are met. Copyright © 2017 Elsevier Ltd. All rights reserved.

Reanalysis of the Harvard Six Cities Study, part I: validation and replication.

PubMed

Krewski, D; Burnett, R T; Goldberg, M; Hoover, K; Siemiatycki, J; Abrahamowicz, M; White, W

2005-01-01

Because the results of the Harvard Six Cities Study played a critical role in the establishment of the current U.S. ambient air quality objective for fine particles (PM(2.5)), the U.S. Environmental Protection Agency, industry, and nongovernmental organizations called for an independent reanalysis of this study to validate the original findings reported by Dockery and colleagues in the New England Journal of Medicine (vol. 329, pp. 1753-1759) in 1993. Validation of the original findings was accomplished by a detailed statistical audit and replication of original results. With the exception of occupational exposure to dust (14 discrepancies of 249 questionnaires located for evaluation) and fumes (15/249), date of death (2/250), and cause of death (2/250), the audit identified no discrepancies between the original questionnaires and death certificates in the audit sample and the analytic file used by the original investigators. The data quality audit identified a computer programming problem that had resulted in early censorship in 5 of the 6 cities, which resulted in the loss of approximately 1% of the reported person-years of follow-up; the reanalysis team updated the Six Cities cohort to include the missing person-years of observation, resulting in the addition of 928 person-years of observation and 14 deaths. The reanalysis team was able to reproduce virtually all of the original numerical results, including the 26% increase in all-cause mortality in the most polluted city (Stubenville, OH) as compared to the least polluted city (Portage, WI). The audit and validation of the Harvard Six Cities Study conducted by the reanalysis team generally confirmed the quality of the data and the numerical results reported by the original investigators. The discrepancies noted during the audit were not of epidemiologic importance, and did not substantively alter the original risk estimates associated with particulate air pollution, nor the main conclusions reached by the

Use of Comparative Case Study Methodology for US Public Health Policy Analysis: A Review.

PubMed

Dinour, Lauren M; Kwan, Amy; Freudenberg, Nicholas

There is growing recognition that policies influence population health, highlighting the need for evidence to inform future policy development and reform. This review describes how comparative case study methodology has been applied to public health policy research and discusses the methodology's potential to contribute to this evidence. English-language, peer-reviewed articles published between 1995 and 2012 were sought from 4 databases. Articles were included if they described comparative case studies addressing US public health policy. Two researchers independently assessed the 20 articles meeting review criteria. Case-related characteristics and research design tactics utilized to minimize threats to reliability and validity, such as the use of multiple sources of evidence and a case study protocol, were extracted from each article. Although comparative case study methodology has been used to analyze a range of public health policies at all stages and levels, articles reported an average use of only 3.65 (out of 10) research design tactics. By expanding the use of accepted research design tactics, public health policy researchers can contribute to expanding the evidence needed to advance health-promoting policies.

A Validity Study of the Self-Esteem Inventory.

ERIC Educational Resources Information Center

Landis, H. John

Results of this validation study of a slightly modified version of the Coppersmith Self-Esteem Inventory substantiate its use with seventh graders to assess Goal I (concerning self-understanding and appreciation of self-worth) of the Educational Quality Assessment Program in Pennsylvania. Appendixes include the definition and rationale for Goal I,…

41 CFR 60-3.7 - Use of other validity studies.

Code of Federal Regulations, 2014 CFR

2014-07-01

... study was conducted perform substantially the same major work behaviors, as shown by appropriate job analyses both on the job or group of jobs on which the validity study was performed and on the job for...

41 CFR 60-3.7 - Use of other validity studies.

Code of Federal Regulations, 2013 CFR

2013-07-01

... study was conducted perform substantially the same major work behaviors, as shown by appropriate job analyses both on the job or group of jobs on which the validity study was performed and on the job for...

Face Validity of Test and Acceptance of Generalized Personality Interpretations

ERIC Educational Resources Information Center

Delprato, Dennis J.

1975-01-01

The degree to which variations in the face validity of psychological tests affected students' willingness to accept personality interpretations was studied. Acceptance of personality interpretations was compared for four types of tests which varied in face validity. The relationship between judged accuracy and rated likability of the…

Data quality at the Singapore Cancer Registry: An overview of comparability, completeness, validity and timeliness.

PubMed

Fung, Janice Wing Mei; Lim, Sandra Bee Lay; Zheng, Huili; Ho, William Ying Tat; Lee, Bee Guat; Chow, Khuan Yew; Lee, Hin Peng

2016-08-01

To provide a comprehensive evaluation of the quality of the data at the Singapore Cancer Registry (SCR). Quantitative and semi-quantitative methods were used to assess the comparability, completeness, accuracy and timeliness of data for the period of 1968-2013, with focus on the period 2008-2012. The SCR coding and classification systems follow international standards. The overall completeness was estimated at 98.1% using the flow method and 97.5% using the capture-recapture method, for the period of 2008-2012. For the same period, 91.9% of the cases were morphologically verified (site-specific range: 40.4-100%) with 1.1% DCO cases. The under-reporting in 2011 and 2012 due to timely publication was estimated at 0.03% and 0.51% respectively. This review shows that the processes in place at the SCR yields data which are internationally comparable, relatively complete, valid, and timely, allowing for greater confidence in the use of quality data in the areas of cancer prevention, treatment and control. Copyright © 2016 Elsevier Ltd. All rights reserved.

Developing the Irrational Beliefs in Mathematics Scale (IBIMS): A Validity and Reliability Study

ERIC Educational Resources Information Center

Kaya, Deniz

2017-01-01

The purpose of this study is developing a valid and reliable scale intended to determine the irrational beliefs of students in mathematics. The study was conducted with a study group consisting of 700 students in 2015-2016 academic year. Expert opinions were received for the content and face validity of the scale, and the Exploratory Factor…

Reflective Thinking Scale: A Validity and Reliability Study

ERIC Educational Resources Information Center

Basol, Gulsah; Evin Gencel, Ilke

2013-01-01

The purpose of this study was to adapt Reflective Thinking Scale to Turkish and investigate its validity and reliability over a Turkish university students' sample. Reflective Thinking Scale (RTS) is a 5 point Likert scale (ranging from 1 corresponding Agree Completely, 3 to Neutral, and 5 to Not Agree Completely), purposed to measure reflective…

Toward quantitative estimation of material properties with dynamic mode atomic force microscopy: a comparative study.

PubMed

Ghosal, Sayan; Gannepalli, Anil; Salapaka, Murti

2017-08-11

In this article, we explore methods that enable estimation of material properties with the dynamic mode atomic force microscopy suitable for soft matter investigation. The article presents the viewpoint of casting the system, comprising of a flexure probe interacting with the sample, as an equivalent cantilever system and compares a steady-state analysis based method with a recursive estimation technique for determining the parameters of the equivalent cantilever system in real time. The steady-state analysis of the equivalent cantilever model, which has been implicitly assumed in studies on material property determination, is validated analytically and experimentally. We show that the steady-state based technique yields results that quantitatively agree with the recursive method in the domain of its validity. The steady-state technique is considerably simpler to implement, however, slower compared to the recursive technique. The parameters of the equivalent system are utilized to interpret storage and dissipative properties of the sample. Finally, the article identifies key pitfalls that need to be avoided toward the quantitative estimation of material properties.

Validation of an in vitro digestive system for studying macronutrient decomposition in humans.

PubMed

Kopf-Bolanz, Katrin A; Schwander, Flurina; Gijs, Martin; Vergères, Guy; Portmann, Reto; Egger, Lotti

2012-02-01

The digestive process transforms nutrients and bioactive compounds contained in food to physiologically active compounds. In vitro digestion systems have proven to be powerful tools for understanding and monitoring the complex transformation processes that take place during digestion. Moreover, the investigation of the physiological effects of certain nutrients demands an in vitro digestive process that is close to human physiology. In this study, human digestion was simulated with a 3-step in vitro process that was validated in depth by choosing pasteurized milk as an example of a complex food matrix. The evolution and decomposition of the macronutrients was followed over the entire digestive process to the level of intestinal enterocyte action, using protein and peptide analysis by SDS-PAGE, reversed-phase HPLC, size exclusion HPLC, and liquid chromatography-MS. The mean peptide size after in vitro digestion of pasteurized milk was 5-6 amino acids (AA). Interestingly, mostly essential AA (93.6%) were released during in vitro milk digestion, a significantly different relative distribution compared to the total essential AA concentration of bovine milk (44.5%). All TG were degraded to FFA and monoacylglycerols. Herein, we present a human in vitro digestion model validated for its ability to degrade the macronutrients of dairy products comparable to physiological ranges. It is suited to be used in combination with a human intestinal cell culture system, allowing ex vivo bioavailability measurements and assessment of the bioactive properties of food components.

Validation of NOViSE.

PubMed

Korzeniowski, Przemyslaw; Brown, Daniel C; Sodergren, Mikael H; Barrow, Alastair; Bello, Fernando

2017-02-01

The goal of this study was to establish face, content, and construct validity of NOViSE-the first force-feedback enabled virtual reality (VR) simulator for natural orifice transluminal endoscopic surgery (NOTES). Fourteen surgeons and surgical trainees performed 3 simulated hybrid transgastric cholecystectomies using a flexible endoscope on NOViSE. Four of them were classified as "NOTES experts" who had independently performed 10 or more simulated or human NOTES procedures. Seven participants were classified as "Novices" and 3 as "Gastroenterologists" with no or minimal NOTES experience. A standardized 5-point Likert-type scale questionnaire was administered to assess the face and content validity. NOViSE showed good overall face and content validity. In 14 out of 15 statements pertaining to face validity (graphical appearance, endoscope and tissue behavior, overall realism), ≥50% of responses were "agree" or "strongly agree." In terms of content validity, 85.7% of participants agreed or strongly agreed that NOViSE is a useful training tool for NOTES and 71.4% that they would recommend it to others. Construct validity was established by comparing a number of performance metrics such as task completion times, path lengths, applied forces, and so on. NOViSE demonstrated early signs of construct validity. Experts were faster and used a shorter endoscopic path length than novices in all but one task. The results indicate that NOViSE authentically recreates a transgastric hybrid cholecystectomy and sets promising foundations for the further development of a VR training curriculum for NOTES without compromising patient safety or requiring expensive animal facilities.

Validation of questionnaire-reported hearing with medical records: A report from the Swiss Childhood Cancer Survivor Study

PubMed Central

Scheinemann, Katrin; Grotzer, Michael; Kompis, Martin; Kuehni, Claudia E.

2017-01-01

Background Hearing loss is a potential late effect after childhood cancer. Questionnaires are often used to assess hearing in large cohorts of childhood cancer survivors and it is important to know if they can provide valid measures of hearing loss. We therefore assessed agreement and validity of questionnaire-reported hearing in childhood cancer survivors using medical records as reference. Procedure In this validation study, we studied 361 survivors of childhood cancer from the Swiss Childhood Cancer Survivor Study (SCCSS) who had been diagnosed after 1989 and had been exposed to ototoxic cancer treatment. Questionnaire-reported hearing was compared to the information in medical records. Hearing loss was defined as ≥ grade 1 according to the SIOP Boston Ototoxicity Scale. We assessed agreement and validity of questionnaire-reported hearing overall and stratified by questionnaire respondents (survivor or parent), sociodemographic characteristics, time between follow-up and questionnaire and severity of hearing loss. Results Questionnaire reports agreed with medical records in 85% of respondents (kappa 0.62), normal hearing was correctly assessed in 92% of those with normal hearing (n = 249), and hearing loss was correctly assessed in 69% of those with hearing loss (n = 112). Sensitivity of the questionnaires was 92%, 74%, and 39% for assessment of severe, moderate and mild bilateral hearing loss; and 50%, 33% and 10% for severe, moderate and mild unilateral hearing loss, respectively. Results did not differ by sociodemographic characteristics of the respondents, and survivor- and parent-reports were equally valid. Conclusions Questionnaires are a useful tool to assess hearing in large cohorts of childhood cancer survivors, but underestimate mild and unilateral hearing loss. Further research should investigate whether the addition of questions with higher sensitivity for mild degrees of hearing loss could improve the results. PMID:28333999

Development and validation of a clinical prediction rule to identify suspected breast cancer: a prospective cohort study.

PubMed

Galvin, Rose; Joyce, Doireann; Downey, Eithne; Boland, Fiona; Fahey, Tom; Hill, Arnold K

2014-10-03

The number of primary care referrals of women with breast symptoms to symptomatic breast units (SBUs) has increased exponentially in the past decade in Ireland. The aim of this study is to develop and validate a clinical prediction rule (CPR) to identify women with breast cancer so that a more evidence based approach to referral from primary care to these SBUs can be developed. We analysed routine data from a prospective cohort of consecutive women reviewed at a SBU with breast symptoms. The dataset was split into a derivation and validation cohort. Regression analysis was used to derive a CPR from the patient's history and clinical findings. Validation of the CPR consisted of estimating the number of breast cancers predicted to occur compared with the actual number of observed breast cancers across deciles of risk. A total of 6,590 patients were included in the derivation study and 4.9% were diagnosed with breast cancer. Independent clinical predictors for breast cancer were: increasing age by year (adjusted odds ratio 1.08, 95% CI 1.07-1.09); presence of a lump (5.63, 95% CI 4.2-7.56); nipple change (2.77, 95% CI 1.68-4.58) and nipple discharge (2.09, 95% CI 1.1-3.97). Validation of the rule (n = 911) demonstrated that the probability of breast cancer was higher with an increasing number of these independent variables. The Hosmer-Lemeshow goodness of fit showed no overall significant difference between the expected and the observed numbers of breast cancer (χ(2)HL: 6.74, p-value: 0.56). This study derived and validated a CPR for breast cancer in women attending an Irish national SBU. We found that increasing age, presence of a lump, nipple discharge and nipple change are all associated with increased risk of breast cancer. Further validation of the rule is necessary as well as an assessment of its impact on referral practice.

A comparative analysis of high-throughput platforms for validation of a circulating microRNA signature in diabetic retinopathy.

PubMed

Farr, Ryan J; Januszewski, Andrzej S; Joglekar, Mugdha V; Liang, Helena; McAulley, Annie K; Hewitt, Alex W; Thomas, Helen E; Loudovaris, Tom; Kay, Thomas W H; Jenkins, Alicia; Hardikar, Anandwardhan A

2015-06-02

MicroRNAs are now increasingly recognized as biomarkers of disease progression. Several quantitative real-time PCR (qPCR) platforms have been developed to determine the relative levels of microRNAs in biological fluids. We systematically compared the detection of cellular and circulating microRNA using a standard 96-well platform, a high-content microfluidics platform and two ultra-high content platforms. We used extensive analytical tools to compute inter- and intra-run variability and concordance measured using fidelity scoring, coefficient of variation and cluster analysis. We carried out unprejudiced next generation sequencing to identify a microRNA signature for Diabetic Retinopathy (DR) and systematically assessed the validation of this signature on clinical samples using each of the above four qPCR platforms. The results indicate that sensitivity to measure low copy number microRNAs is inversely related to qPCR reaction volume and that the choice of platform for microRNA biomarker validation should be made based on the abundance of miRNAs of interest.

Collaborative study for the validation of alternative in vitro potency assays for human tetanus immunoglobulin.

PubMed

Gross, S; Janssen, S W J; de Vries, B; Terao, E; Daas, A; Buchheit, K-H

2009-10-01

The European Pharmacopoeia (Ph. Eur.) monograph Human tetanus immunoglobulin (0398) gives a clear outline of the in vivo assay to be performed to determine the potency of human tetanus immunoglobulins during their development. Furthermore, it states that an in vitro method shall be validated for the batch potency estimation. Since no further guidance is given on the in vitro assay, every control laboratory concerned is free to design and validate an in-house method. At the moment there is no agreed in vitro method available. The aim of this study was to validate and compare 2 alternative in vitro assays, i.e. an enzyme-linked immunoassay (EIA) and a toxoid inhibition assay (TIA), through an international collaborative study, in view of their eventual inclusion into the Ph. Eur.. The study was run in the framework of the Biological Standardisation Programme (BSP), under the aegis of the European Commission and the Council of Europe. The collaborative study reported here involved 21 laboratories (public and industry) from 15 countries. Initially, 3 samples with low, medium and high potencies were tested by EIA and TIA. Results showed good reproducibility and repeatability of the 2 in vitro methods. The correlation of the data with the in vivo potency assigned by the manufacturers however appeared initially poor for high potency samples. Thorough re-examination of the data showed that the in vivo potencies assigned by the manufacturers had to be corrected: one for potency loss at the time of in vitro testing and one because of a reporting error. After these corrections the values obtained by in vivo and in vitro methods were in close agreement. A supplementary collaborative work was carried out to validate the 2 methods for immunoglobulin products with high potencies. Eight laboratories (public and industry) took part in this additional study to test 3 samples with medium and high potencies by EIA and TIA. Results confirmed that the 2 alternative methods are

Validation of the 10-item Centre for Epidemiological Studies Depression Scale (CES-D-10) in Zulu, Xhosa and Afrikaans populations in South Africa.

PubMed

Baron, Emily Claire; Davies, Thandi; Lund, Crick

2017-01-09

The 10-item Centre for Epidemiological Studies Depression Scale (CES-D-10) is a depression screening tool that has been used in the South African National Income Dynamics Study (NIDS), a national household panel study. This screening tool has not yet been validated in South Africa. This study aimed to establish the reliability and validity of the CES-D-10 in Zulu, Xhosa and Afrikaans. The CES-D-10's psychometric properties were also compared to the Patient Health Questionnaire (PHQ-9), a depression screening tool already validated in South Africa. Stratified random samples of Xhosa, Afrikaans and Zulu-speaking participants aged 15 years or older (N = 944) were recruited from Cape Town Metro and Ethekwini districts. Face-to-face interviews included socio-demographic questions, the CES-D-10, Patient Health Questionnaire (PHQ-9), and WHO Disability Assessment Schedule 2.0 (WHODAS). Major depression was determined using the Mini International Neuropsychiatric Interview. All instruments were translated and back-translated to English. Construct validity was examined using exploratory factor analysis with varimax rotation. Receiver Operating Characteristics (ROC) curves were used to investigate the CES-D-10 and PHQ-9's criterion validity, and compared using the DeLong method. Overall, 6.6, 18.0 and 6.9% of the Zulu, Afrikaans and Xhosa samples were diagnosed with depression, respectively. The CES-D-10 had acceptable internal consistency across samples (α = 0.69-0.89), and adequate concurrent validity, when compared to the PHQ-9 and WHODAS. The CES-D-10 area under the Receiver Operator Characteristic curve was good to excellent: 0.81 (95% CI 0.71-0.90) for Zulu, 0.93 (95% CI 0.90-0.96) for Afrikaans, and 0.94 (95% CI 0.89-0.99) for Xhosa. A cut-off of 12, 11 and 13 for Zulu, Afrikaans and Xhosa, respectively, generated the most balanced sensitivity, specificity and positive predictive value (Zulu: 71.4, 72.6% and 16.1%; Afrikaans: 84.6%, 84.0%, 53.7%; Xhosa: 81

Validity Evidence in Scale Development: The Application of Cross Validation and Classification-Sequencing Validation

ERIC Educational Resources Information Center

Acar, Tu¨lin

2014-01-01

In literature, it has been observed that many enhanced criteria are limited by factor analysis techniques. Besides examinations of statistical structure and/or psychological structure, such validity studies as cross validation and classification-sequencing studies should be performed frequently. The purpose of this study is to examine cross…

An Italian multicentre validation study of the coma recovery scale-revised.

PubMed

Estraneo, A; Moretta, P; De Tanti, A; Gatta, G; Giacino, J T; Trojano, L

2015-10-01

Rate of misdiagnosis of disorders of consciousness (DoC) can be reduced by employing validated clinical diagnostic tools, such as the Coma Recovery Scale-Revised (CRS-R). An Italian version of the CRS-R has been recently developed, but its applicability across different clinical settings, and its concurrent validity and diagnostic sensitivity have not been estimated yet. To perform a multicentre validation study of the Italian version of the Coma Recovery Scale-Revised (CRS-R). Analysis of inter-rater reliability, concurrent validity and diagnostic sensitivity of the scale. One Intensive Care Unit, 8 Post-acute rehabilitation centres and 2 Long-term facilities Twenty-seven professionals (physicians, N.=11; psychologists, N.=5; physiotherapists, N.=3; speech therapists, N.=6; nurses, N.=2) from 11 Italian Centres. CRS-R and Disability Rating Scale (DRS) applied to 122 patients with clinical diagnosis of Vegetative State (VS) or Minimally Conscious State (MCS). CRS-R has good-to-excellent inter-rater reliability for all subscales, particularly for the communication subscale. The Italian version of the CRS-R showed a high sensitivity and specificity in detecting MCS with reference to clinical consensus diagnosis. The CRS-R showed good concurrent validity with the Disability Rating Scale, which had very low specificity with reference to clinical consensus diagnosis. The Italian version of the CRS-R is a valid scale for use from the sub-acute to chronic stages of DoC. It can be administered reliably by all members of the rehabilitation team with different specialties, levels of experience and settings. The present study promote use of the Italian version of the CRS-R to improve diagnosis of DoC patients, and plan tailored rehabilitation treatment.

Reliability and Validity Study of the Finnish Adaptation of Scoliosis Research Society Questionnaire Version SRS-30.

PubMed

Kyrölä, Kati; Järvenpää, Salme; Ylinen, Jari; Mecklin, Jukka-Pekka; Repo, Jussi Petteri; Häkkinen, Arja

2017-06-15

A prospective clinical study to test and adapt a Finnish version of the Scoliosis Research Society 30 (SRS-30) questionnaire. The aim of this study was to perform cross-cultural adaptation and evaluate the validity of the adapted Finnish version of the SRS-30 questionnaire. The SRS-30 questionnaire has proved to be a valid instrument in evaluating health-related quality of life (HRQoL) in adolescent and adult population with spine deformities in the United States. Multinational availability requires cross-cultural and linguistic adaptation and validation of the instrument. The SRS-30 was translated into Finnish using accepted methods for translation of quality-of-life questionnaires. A total of 274 adult patients with degenerative radiographic sagittal spinal disorder answered the questionnaire with sociodemographic data, RAND 36-item health survey questionnaire (RAND Corp. Health, Santa Monica, CA, US), Oswestry disability index, DEPS depression scale, and Visual Analog Scale (VAS) back and leg pain scales within 2 weeks' interval. The cohort included patients with and without previous spine surgery. Internal consistency and validity were tested with Cronbach α, intraclass correlation (ICC), standard error of measurement, and Spearman correlation coefficient with 95% confidence intervals (CIs). The internal consistency of SRS-30 was good in both surgery and nonsurgery groups, with Cronbach α 0.853 (95% CI, 0.670 to 0.960) and 0.885 (95% CI, 0.854 to 0.911), respectively. The test-retest reproducibility ICC of the SRS-30 total and subscore domains of patients with stable symptoms was 0.905 (95% CI, 0.870-0.930) and 0.904 (95% CI, 0.871-0.929), respectively. The questionnaire had discriminative validity in the pain, self-image, and satisfaction with management domains compared with other questionnaires. The SRS-30 questionnaire proved to be valid and applicable in evaluating HRQoL in Finnish adult spinal deformity patients. It has two domains related to deformity

Parametric analyses of summative scores may lead to conflicting inferences when comparing groups: A simulation study.

PubMed

Khan, Asaduzzaman; Chien, Chi-Wen; Bagraith, Karl S

2015-04-01

To investigate whether using a parametric statistic in comparing groups leads to different conclusions when using summative scores from rating scales compared with using their corresponding Rasch-based measures. A Monte Carlo simulation study was designed to examine between-group differences in the change scores derived from summative scores from rating scales, and those derived from their corresponding Rasch-based measures, using 1-way analysis of variance. The degree of inconsistency between the 2 scoring approaches (i.e. summative and Rasch-based) was examined, using varying sample sizes, scale difficulties and person ability conditions. This simulation study revealed scaling artefacts that could arise from using summative scores rather than Rasch-based measures for determining the changes between groups. The group differences in the change scores were statistically significant for summative scores under all test conditions and sample size scenarios. However, none of the group differences in the change scores were significant when using the corresponding Rasch-based measures. This study raises questions about the validity of the inference on group differences of summative score changes in parametric analyses. Moreover, it provides a rationale for the use of Rasch-based measures, which can allow valid parametric analyses of rating scale data.

A Validation Study of the Adolescent Dissociative Experiences Scale

ERIC Educational Resources Information Center

Keck Seeley, Susan. M.; Perosa, Sandra, L.; Perosa, Linda, M.

2004-01-01

Objective: The purpose of this study was to further the validation process of the Adolescent Dissociative Experiences Scale (A-DES). In this study, a 6-item Likert response format with descriptors was used when responding to the A-DES rather than the 11-item response format used in the original A-DES. Method: The internal reliability and construct…

Basic School Skills Inventory-3: Validity and Reliability Study

ERIC Educational Resources Information Center

Yildiz, F. Ülkü; Çagdas, Aysel; Kayili, Gökhan

2017-01-01

The purpose of this study is to perform the validity-reliability analysis of the three subtests of Basic School Skills Inventory 3--Mathematics, Classroom Behavior and Daily Life skills--and do its adaptation for four to six year-old Turkish children. The sample of the study included 595 four to six year-old Turkish children attending public and…

40 CFR 761.386 - Required experimental conditions for the validation study and subsequent use during decontamination.

Code of Federal Regulations, 2014 CFR

2014-07-01

... the validation study and subsequent use during decontamination. 761.386 Section 761.386 Protection of... experimental conditions for the validation study and subsequent use during decontamination. The following experimental conditions apply for any solvent: (a) Temperature and pressure. Conduct the validation study and...

40 CFR 761.386 - Required experimental conditions for the validation study and subsequent use during decontamination.

Code of Federal Regulations, 2012 CFR

2012-07-01

... the validation study and subsequent use during decontamination. 761.386 Section 761.386 Protection of... experimental conditions for the validation study and subsequent use during decontamination. The following experimental conditions apply for any solvent: (a) Temperature and pressure. Conduct the validation study and...

40 CFR 761.386 - Required experimental conditions for the validation study and subsequent use during decontamination.

Code of Federal Regulations, 2013 CFR

2013-07-01

... the validation study and subsequent use during decontamination. 761.386 Section 761.386 Protection of... experimental conditions for the validation study and subsequent use during decontamination. The following experimental conditions apply for any solvent: (a) Temperature and pressure. Conduct the validation study and...

Methodology used in comparative studies assessing programmes of transition from paediatrics to adult care programmes: a systematic review

PubMed Central

Le Roux, E; Mellerio, H; Guilmin-Crépon, S; Gottot, S; Jacquin, P; Boulkedid, R; Alberti, C

2017-01-01

Objective To explore the methodologies employed in studies assessing transition of care interventions, with the aim of defining goals for the improvement of future studies. Design Systematic review of comparative studies assessing transition to adult care interventions for young people with chronic conditions. Data sources MEDLINE, EMBASE, ClinicalTrial.gov. Eligibility criteria for selecting studies 2 reviewers screened comparative studies with experimental and quasi-experimental designs, published or registered before July 2015. Eligible studies evaluate transition interventions at least in part after transfer to adult care of young people with chronic conditions with at least one outcome assessed quantitatively. Results 39 studies were reviewed, 26/39 (67%) published their final results and 13/39 (33%) were in progress. In 9 studies (9/39, 23%) comparisons were made between preintervention and postintervention in a single group. Randomised control groups were used in 9/39 (23%) studies. 2 (2/39, 5%) reported blinding strategies. Use of validated questionnaires was reported in 28% (11/39) of studies. In terms of reporting in published studies 15/26 (58%) did not report age at transfer, and 6/26 (23%) did not report the time of collection of each outcome. Conclusions Few evaluative studies exist and their level of methodological quality is variable. The complexity of interventions, multiplicity of outcomes, difficulty of blinding and the small groups of patients have consequences on concluding on the effectiveness of interventions. The evaluation of the transition interventions requires an appropriate and common methodology which will provide access to a better level of evidence. We identified areas for improvement in terms of randomisation, recruitment and external validity, blinding, measurement validity, standardised assessment and reporting. Improvements will increase our capacity to determine effective interventions for transition care. PMID:28131998

Fracture mechanics validity limits

NASA Technical Reports Server (NTRS)

Lambert, Dennis M.; Ernst, Hugo A.

1994-01-01

Fracture behavior is characteristics of a dramatic loss of strength compared to elastic deformation behavior. Fracture parameters have been developed and exhibit a range within which each is valid for predicting growth. Each is limited by the assumptions made in its development: all are defined within a specific context. For example, the stress intensity parameters, K, and the crack driving force, G, are derived using an assumption of linear elasticity. To use K or G, the zone of plasticity must be small as compared to the physical dimensions of the object being loaded. This insures an elastic response, and in this context, K and G will work well. Rice's J-integral has been used beyond the limits imposed on K and G. J requires an assumption of nonlinear elasticity, which is not characteristic of real material behavior, but is thought to be a reasonable approximation if unloading is kept to a minimum. As well, the constraint cannot change dramatically (typically, the crack extension is limited to ten-percent of the initial remaining ligament length). Rice, et al investigated the properties required of J-type parameters, J(sub x), and showed that the time rate, dJ(sub x)/dt, must not be a function of the crack extension rate, da/dt. Ernst devised the modified-J parameter, J(sub M), that meets this criterion. J(sub M) correlates fracture data to much higher crack growth than does J. Ultimately, a limit of the validity of J(sub M) is anticipated, and this has been estimated to be at a crack extension of about 40-percent of the initial remaining ligament length. None of the various parameters can be expected to describe fracture in an environment of gross plasticity, in which case the process is better described by deformation parameters, e.g., stress and strain. In the current study, various schemes to identify the onset of the plasticity-dominated behavior, i.e., the end of fracture mechanics validity, are presented. Each validity limit parameter is developed in

Methodology used in comparative studies assessing programmes of transition from paediatrics to adult care programmes: a systematic review.

PubMed

Le Roux, E; Mellerio, H; Guilmin-Crépon, S; Gottot, S; Jacquin, P; Boulkedid, R; Alberti, C

2017-01-27

To explore the methodologies employed in studies assessing transition of care interventions, with the aim of defining goals for the improvement of future studies. Systematic review of comparative studies assessing transition to adult care interventions for young people with chronic conditions. MEDLINE, EMBASE, ClinicalTrial.gov. 2 reviewers screened comparative studies with experimental and quasi-experimental designs, published or registered before July 2015. Eligible studies evaluate transition interventions at least in part after transfer to adult care of young people with chronic conditions with at least one outcome assessed quantitatively. 39 studies were reviewed, 26/39 (67%) published their final results and 13/39 (33%) were in progress. In 9 studies (9/39, 23%) comparisons were made between preintervention and postintervention in a single group. Randomised control groups were used in 9/39 (23%) studies. 2 (2/39, 5%) reported blinding strategies. Use of validated questionnaires was reported in 28% (11/39) of studies. In terms of reporting in published studies 15/26 (58%) did not report age at transfer, and 6/26 (23%) did not report the time of collection of each outcome. Few evaluative studies exist and their level of methodological quality is variable. The complexity of interventions, multiplicity of outcomes, difficulty of blinding and the small groups of patients have consequences on concluding on the effectiveness of interventions. The evaluation of the transition interventions requires an appropriate and common methodology which will provide access to a better level of evidence. We identified areas for improvement in terms of randomisation, recruitment and external validity, blinding, measurement validity, standardised assessment and reporting. Improvements will increase our capacity to determine effective interventions for transition care. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence

Validation of energy intake estimated from a food frequency questionnaire: a doubly labelled water study.

PubMed

Andersen, L Frost; Tomten, H; Haggarty, P; Løvø, A; Hustvedt, B-E

2003-02-01

The validation of dietary assessment methods is critical in the evaluation of the relation between dietary intake and health. The aim of this study was to assess the validity of a food frequency questionnaire by comparing energy intake with energy expenditure measured with the doubly labelled water method. Total energy expenditure was measured with the doubly labelled water (DLW) method during a 10 day period. Furthermore, the subjects filled in the food frequency questionnaire about 18-35 days after the DLW phase of the study was completed. Twenty-one healthy, non-pregnant females volunteered to participate in the study; only 17 subjects completed the study. The group energy intake was on average 10% lower than the energy expenditure, but the difference was not statistically significant. However, there was a wide range in reporting accuracy: seven subjects were identified as acceptable reporters, eight as under-reporters and two were identified as over-reporters. The width of the 95% confidence limits of agreement in a Bland and Altman plot for energy intake and energy expenditure varied from -5 to 3 MJ. The data showed that there was substantial variability in the accuracy of the food frequency questionnaire at the individual level. Furthermore, the results showed that the questionnaire was more accurate for groups than individuals.

A validation study on the traditional Chinese version of Spinal Appearance Questionnaire for adolescent idiopathic scoliosis.

PubMed

Guo, Jing; Lau, Ajax Hong Yin; Chau, Jack; Ng, Bobby Kin Wah; Lee, Kwong Man; Qiu, Yong; Cheng, Jack Chun Yiu; Lam, Tsz Ping

2016-10-01

"Simplified Chinese" version of Spinal Appearance Questionnaire (SC-SAQ) for patients with adolescent idiopathic scoliosis (AIS) was available but did not fit for communities using "Traditional Chinese" as their primary language. We developed a traditional Chinese version of SAQ (TC-SAQ) and evaluated its reliability and validity. TC-SAQ was administered to 112 AIS patients, of which 101 bilingual (English and Chinese) patients completed E-SAQ and the traditional Chinese version of Scoliosis Research Society-22 questionnaire (TC-SRS-22). Internal consistency and test-retest reliability were evaluated. Concurrent validity was evaluated by comparing TC-SAQ score with E-SAQ score, and convergent validity by comparing TC-SAQ score with TC-SRS-22 self-image domain score, and discriminant validity by analyzing the relationship between TC-SAQ score and patients' characteristics. Internal consistency of individual TC-SAQ domain was high (Cronbach's α = 0.785 to 0.940), except for general (Cronbach's α = 0.665) and shoulders (Cronbach's α = 0.421) domain. Test-retest reliability of TC-SAQ was good (ICCs of each domain from 0.798 to 0.865). Concurrent validity demonstrated an excellent correlation between TC-SAQ and E-SAQ scores (r = 0.820 to 0.954, P < 0.0001 for all domains). Correlation between TC-SAQ domains and TC-SRS-22 self-image domain was weak to moderate. TC-SAQ total score and individual domain scores (except waist and chest domains) were positively correlated to major curve magnitude. TC-SAQ had good internal consistency and test-retest reliability. Concurrent validity evaluated against the original English version was excellent. TC-SAQ was both reliable and valid for clinical use for AIS patients using traditional Chinese as their primary language.

The Chinese version of the Outcome Expectations for Exercise scale: validation study.

PubMed

Lee, Ling-Ling; Chiu, Yu-Yun; Ho, Chin-Chih; Wu, Shu-Chen; Watson, Roger

2011-06-01

Estimates of the reliability and validity of the English nine-item Outcome Expectations for Exercise (OEE) scale have been tested and found to be valid for use in various settings, particularly among older people, with good internal consistency and validity. Data on the use of the OEE scale among older Chinese people living in the community and how cultural differences might affect the administration of the OEE scale are limited. To test the validity and reliability of the Chinese version of the Outcome Expectations for Exercise scale among older people. A cross-sectional validation study was designed to test the Chinese version of the OEE scale (OEE-C). Reliability was examined by testing both the internal consistency for the overall scale and the squared multiple correlation coefficient for the single item measure. The validity of the scale was tested on the basis of both a traditional psychometric test and a confirmatory factor analysis using structural equation modelling. The Mokken Scaling Procedure (MSP) was used to investigate if there were any hierarchical, cumulative sets of items in the measure. The OEE-C scale was tested in a group of older people in Taiwan (n=108, mean age=77.1). There was acceptable internal consistency (alpha=.85) and model fit in the scale. Evidence of the validity of the measure was demonstrated by the tests for criterion-related validity and construct validity. There was a statistically significant correlation between exercise outcome expectations and exercise self-efficacy (r=.34, p<.01). An analysis of the Mokken Scaling Procedure found that nine items of the scale were all retained in the analysis and the resulting scale was reliable and statistically significant (p=.0008). The results obtained in the present study provided acceptable levels of reliability and validity evidence for the Chinese Outcome Expectations for Exercise scale when used with older people in Taiwan. Future testing of the OEE-C scale needs to be carried out

A Comparative Discourse Study of Simulated Clinical Roleplays in Two Assessment Contexts: Validating a Specific-Purpose Language Test

ERIC Educational Resources Information Center

Woodward-Kron, Robyn; Elder, Catherine

2016-01-01

The aim of this paper is to investigate from a discourse analytic perspective task authenticity in the speaking component of the Occupational English Test (OET), an English language screening test for clinicians designed to reflect the language demands of health professional-patient communication. The study compares the OET speaking sub-test…

Reliability and validity of abbreviated surveys derived from the National Eye Institute Visual Function Questionnaire: The Study of Osteoporotic Fractures

PubMed Central

Gergana, Kodjebacheva; Coleman, Anne L.; Ensrud, Kristine E.; Cauley, Jane A.; Yu, Fei; Stone, Katie L.; Pedula, Kathryn L.; Hochberg, Marc C.; Mangione, Carol M.

2010-01-01

Purpose To test the reliability and validity of questionnaires shortened from the National Eye Institute 25-item Vision Function Questionnaire (NEI VFQ-9 and NEI VFQ-8). Design A cross-sectional multi-center cohort study. Methods Reliability was assessed by Cronbach alpha coefficients. Validity was evaluated by studying the association of vision-targeted quality-of-life composite scores with objective visual function measurements. Study population: A total of 5,482 women between the ages of 65 and 100 years participated in the Year-10 clinic visit in the Study of Osteoporotic Fractures (SOF). A total of 3,631 women with complete data were included in the visual acuity (VA) and visual field (VF) analysis of the NEI VFQ-9, which is defined for those who care to drive. and 5,311 in the analysis of the NEI VFQ-8. To assess differences in prevalent eye diseases, which were ascertained for a random sample of SOF participants, 853 and 1,237 women were included in the NEI VFQ-9 and the NEI VFQ-8 analyses, respectively. Results Cronbach alpha coefficient for the NEI VFQ-9 scale was 0.83 and that of the NEI VFQ-8 was 0.84. Using both questionnaires, women with VA worse than 20/40 had lower composite scores compared to those with VA 20/40 or better (p<0.001). Participants with mild, moderate, and severe binocular VF loss had lower composite scores compared to those with no binocular VF loss (p<0.001).Compared to women without chronic eye diseases in both eyes, women with at least one chronic eye disease in at least one eye had lower composite scores. Conclusions Both questionnaires showed high reliability across items and validity with respect to clinical markers of eye disease Future research should compare the properties of these shortened surveys to those of the NEI VFQ-25. PMID:20103058

Rating of Perceived Exertion During Circuit Weight Training: A Concurrent Validation Study.

PubMed

Aniceto, Rodrigo R; Ritti-Dias, Raphael M; Dos Prazeres, Thaliane M P; Farah, Breno Q; de Lima, Fábio F M; do Prado, Wagner L

2015-12-01

The aim of this study was to determine whether rating of perceived exertion (RPE) is a valid method to control the effort during the circuit weight training (CWT) in trained men. Ten men (21.3 ± 3.3 years) with previous experience in resistance training (13.1 ± 6.3 months) performed 3 sessions: 1 orientation session and 2 experimental sessions. The subjects were randomly counterbalanced to 2 experimental sessions: CWT or multiple-set resistance training (control). In both sessions, 8 exercises (bench press, leg press 45°, seated row, leg curl, triceps pulley, leg extension, biceps curl, and adductor chair) were performed with the same work: 60% of 1 repetition maximum, 24 stations (3 circuits) or 24 sets (3 sets/exercise), 10 repetitions, 1 second in the concentric and eccentric phases, and rest intervals between sets and exercise of 60 seconds. Active muscle RPEs were measured after each 3 station/sets using the OMNI-Resistance Exercise Scale (OMNI-RES). In this same time, blood lactate was collected. Compared with baseline, both levels of blood lactate and RPE increased during whole workout in both sessions, the RPE at third, 23rd, and 27th minute and the blood lactate at third, seventh, 11th, 15th, 27th, and 31st minute were higher in multiple set compared with CWT. Positive correlation between blood lactate and RPE was observed in both experimental sessions. The results indicated that the RPE is a valid method to control the effort during the CWT in trained men and can be used to manipulate the intensity without the need to perform invasive assessments.

Scatterometry or imaging overlay: a comparative study

NASA Astrophysics Data System (ADS)

Hsu, Simon C. C.; Pai, Yuan Chi; Chen, Charlie; Yu, Chun Chi; Hsing, Henry; Wu, Hsing-Chien; Kuo, Kelly T. L.; Amir, Nuriel

2015-03-01

Most fabrication facilities today use imaging overlay measurement methods, as it has been the industry's reliable workhorse for decades. In the last few years, third-generation Scatterometry Overlay (SCOL™) or Diffraction Based Overlay (DBO-1) technology was developed, along another DBO technology (DBO-2). This development led to the question of where the DBO technology should be implemented for overlay measurements. Scatterometry has been adopted for high volume production in only few cases, always with imaging as a backup, but scatterometry overlay is considered by many as the technology of the future. In this paper we compare imaging overlay and DBO technologies by means of measurements and simulations. We outline issues and sensitivities for both technologies, providing guidelines for the best implementation of each. For several of the presented cases, data from two different DBO technologies are compared as well, the first with Pupil data access (DBO-1) and the other without pupil data access (DBO-2). Key indicators of overlay measurement quality include: layer coverage, accuracy, TMU, process robustness and robustness to process changes. Measurement data from real cases across the industry are compared and the conclusions are also backed by simulations. Accuracy is benchmarked with reference OVL, and self-consistency, showing good results for Imaging and DBO-1 technology. Process sensitivity and metrology robustness are mostly simulated with MTD (Metrology Target Designer) comparing the same process variations for both technologies. The experimental data presented in this study was done on ten advanced node layers and three production node layers, for all phases of the IC fabrication process (FEOL, MEOL and BEOL). The metrology tool used for most of the study is KLA-Tencor's Archer 500LCM system (scatterometry-based and imaging-based measurement technologies on the same tool) another type of tool is used for DBO-2 measurements. Finally, we conclude that

Reliability and validity of the Adolescent Stress Questionnaire in a sample of European adolescents - the HELENA study

PubMed Central

2011-01-01

Background Since stress is hypothesized to play a role in the etiology of obesity during adolescence, research on associations between adolescent stress and obesity-related parameters and behaviours is essential. Due to lack of a well-established recent stress checklist for use in European adolescents, the study investigated the reliability and validity of the Adolescent Stress Questionnaire (ASQ) for assessing perceived stress in European adolescents. Methods The ASQ was translated into the languages of the participating cities (Ghent, Stockholm, Vienna, Zaragoza, Pecs and Athens) and was implemented within the HELENA cross-sectional study. A total of 1140 European adolescents provided a valid ASQ, comprising 10 component scales, used for internal reliability (Cronbach α) and construct validity (confirmatory factor analysis or CFA). Contributions of socio-demographic (gender, age, pubertal stage, socio-economic status) characteristics to the ASQ score variances were investigated. Two-hundred adolescents also provided valid saliva samples for cortisol analysis to compare with the ASQ scores (criterion validity). Test-retest reliability was investigated using two ASQ assessments from 37 adolescents. Results Cronbach α-values of the ASQ scales (0.57 to 0.88) demonstrated a moderate internal reliability of the ASQ, and intraclass correlation coefficients (0.45 to 0.84) established an insufficient test-retest reliability of the ASQ. The adolescents' gender (girls had higher stress scores than boys) and pubertal stage (those in a post-pubertal development had higher stress scores than others) significantly contributed to the variance in ASQ scores, while their age and socio-economic status did not. CFA results showed that the original scale construct fitted moderately with the data in our European adolescent population. Only in boys, four out of 10 ASQ scale scores were a significant positive predictor for baseline wake-up salivary cortisol, suggesting a rather poor

Validation of Student and Parent Reported Data on the Basic Grant Application Form: Pre-Award Validation Analysis Study. Revised Final Report.

ERIC Educational Resources Information Center

Applied Management Sciences, Inc., Silver Spring, MD.

The 1978-1979 pre-award institution validation process for the Basic Educational Opportunity Grant (BEOG) program was studied, based on applicant and grant recipient files as of the end of February 1979. The objective was to assess the impact of the validation process on the proper award of BEOGs, and to determine whether the criteria for…

[French validation study of the levels of emotional awareness scale].

PubMed

Bydlowski, S; Corcos, M; Paterniti, S; Guilbaud, O; Jeammet, P; Consoli, S M

2002-01-01

According to a thesis based on the idea of an influence of cognitions in the structuring of internal reality, emotional awareness, ie the capacity of representing your own emotional experience and that of others, is a cognitive process that goes into maturation. Defining this concept, Lane and Schwartz present a cognitivo-developmental model in five stages of the processes of symbolization, accounting for the differences in levels of emotional awareness observed in individuals. The organization of these cognitive processes would thus be structured in well differentiated stages, in which the development of the emotions would be inseparable from the development of ego and of the relation to others. These authors focus on the capacity of representing in a conscious way the emotional experience and consider that verbal representations used to describe the contents of what is experience constitute a good reflection of the organization structural of the emotional awareness. Therefore, they worked out an instrument of evaluation: the Levels of Emotional Awareness Scale (LEAS), which measures the capacity to describe your own emotional experience and the one you allow to others, in an emotional situation. The system of quotation of this scale is based on the analysis of the verbal contents of the provided answers, in direct reference to the authors' theory of the levels of differentiation and integration of the emotional experience. It is therefore an empirical measurement which is centered specifically on the structural organization of the emotional experience. The various studies of validation of this instrument show that it presents solid metrological properties. This work presents the validation of the French version of Lane and Schwartz's LEAS. Validity and fidelity were studied in a group of 121 healthy subjects. This setting is part of a larger clinical evaluation, also including a collection of socio-demographic and clinical data, and other instruments of self

[Validation study of the Depressive Experience Questionnaire].

PubMed

Atger, F; Frasson, G; Loas, G; Guibourgé, S; Corcos, M; Perez Diaz, F; Speranza, M; Venisse, J-L; Lang, F; Stephan, Ph; Bizouard, P; Flament, M; Jeammet, Ph

2003-01-01

-reliant and as sociotropic and autonomous . Our work presents the results of a validation study of both forms of Blatt's questionnaire (for adults--DEQ--and for adolescents--DEQA) translated in French in a large population of normal subjects, aged 15 to 45 years. DEQ and DEQ-A were compared by inspection of items loading strongly on each factor and by correlation of the three factors of adults and adolescents. The exploratory factor analysis of DEQ and DEQA revealed three orthogonal factors, corresponding with Blatt's original dimensions. Consistency and external validity were adequate for all 3 factors of DEQ and DEQ-A. Anaclitism and self-criticism dimensions of DEQ and DEQ-A correlate positively with measures of depression (DSM-IV, Beck Depression Inventory), consistently with the results obtained by Blatt. Differently from this author, anaclitism appears to be less differentiated in males than in females, suggesting that the concept of dependence could assume different relevance for men and women.

Sources of Self-Efficacy in Mathematics: A Validation Study

ERIC Educational Resources Information Center

Usher, Ellen L.; Pajares, Frank

2009-01-01

The purpose of this study was to develop and validate items with which to assess A. Bandura's (1997) theorized sources of self-efficacy among middle school mathematics students. Results from Phase 1 (N=1111) were used to develop and refine items for subsequent use. In Phase 2 of the study (N=824), a 39-item, four-factor exploratory model fit best.…

Quality standards for real-world research. Focus on observational database studies of comparative effectiveness.

PubMed

Roche, Nicolas; Reddel, Helen; Martin, Richard; Brusselle, Guy; Papi, Alberto; Thomas, Mike; Postma, Dirjke; Thomas, Vicky; Rand, Cynthia; Chisholm, Alison; Price, David

2014-02-01

Real-world research can use observational or clinical trial designs, in both cases putting emphasis on high external validity, to complement the classical efficacy randomized controlled trials (RCTs) with high internal validity. Real-world research is made necessary by the variety of factors that can play an important a role in modulating effectiveness in real life but are often tightly controlled in RCTs, such as comorbidities and concomitant treatments, adherence, inhalation technique, access to care, strength of doctor-caregiver communication, and socio-economic and other organizational factors. Real-world studies belong to two main categories: pragmatic trials and observational studies, which can be prospective or retrospective. Focusing on comparative database observational studies, the process aimed at ensuring high-quality research can be divided into three parts: preparation of research, analyses and reporting, and discussion of results. Key points include a priori planning of data collection and analyses, identification of appropriate database(s), proper outcomes definition, study registration with commitment to publish, bias minimization through matching and adjustment processes accounting for potential confounders, and sensitivity analyses testing the robustness of results. When these conditions are met, observational database studies can reach a sufficient level of evidence to help create guidelines (i.e., clinical and regulatory decision-making).

Reliability and relative validity of three physical activity questionnaires in Taizhou population of China: the Taizhou Longitudinal Study.

PubMed

Hu, B; Lin, L F; Zhuang, M Q; Yuan, Z Y; Li, S Y; Yang, Y J; Lu, M; Yu, S Z; Jin, L; Ye, W M; Wang, X F

2015-09-01

To examine the test-retest reliabilities and relative validities of the Chinese version of short International Physical Activity Questionnaire (IPAQ-S-C), the Global Physical Activity Questionnaire (GPAQ-C), and the Total Energy Expenditure Questionnaire (TEEQ-C) in a population-based prospective study, the Taizhou Longitudinal Study (TZLS). A longitudinal comparative study. A total of 205 participants (male: 38.54%) aged 30-70 years completed three questionnaires twice (day one and day nine) and physical activity log (PA-log) over seven consecutive days. The test-retest reliabilities were evaluated using intra-class correlation coefficients (ICCs) and the relative validities were estimated by comparing the data from physical activity questionnaires (PAQs) and PA-log. Good reliabilities were observed between the repeated PAQs. The ICCs ranged from 0.51 to 0.80 for IPAQ-C, 0.67 to 0.85 for GPAQ-C, and 0.74 to 0.94 for TEEQ-C, respectively. Energy expenditure of most PA domains estimated by the three PAQs correlated moderately with the results recorded by PA-log except the walking domain of IPAQ-S-C. The partial correlation coefficients between the PAQs and PA-log ranged from 0.44 to 0.58 for IPAQ-S-C, 0.26 to 0.52 for GPAQ-C, and 0.41 to 0.72 for TEEQ-C, respectively. Bland-Altman plots showed acceptable agreement between the three PAQs and PA-log. The three PAQs, especially TEEQ-C, were relatively reliable and valid for assessment of physical activity and could be used in TZLS. Copyright © 2015 The Royal Society for Public Health. Published by Elsevier Ltd. All rights reserved.

Research Measures for Dyscalculia: A Validity and Reliability Study.

ERIC Educational Resources Information Center

Geiman, R. M.

1986-01-01

This study sought to evaluate a measure of dyscalculia to determine its validity and reliability. It also tested use of the instrument with seventh graders and ascertained where errors attributed to dyscalculia were also present in an average sample of seventh graders. Results varied. (MNS)

A critical analysis of test-retest reliability in instrument validation studies of cancer patients under palliative care: a systematic review

PubMed Central

2014-01-01

Background Patient-reported outcome validation needs to achieve validity and reliability standards. Among reliability analysis parameters, test-retest reliability is an important psychometric property. Retested patients must be in a clinically stable condition. This is particularly problematic in palliative care (PC) settings because advanced cancer patients are prone to a faster rate of clinical deterioration. The aim of this study was to evaluate the methods by which multi-symptom and health-related qualities of life (HRQoL) based on patient-reported outcomes (PROs) have been validated in oncological PC settings with regards to test-retest reliability. Methods A systematic search of PubMed (1966 to June 2013), EMBASE (1980 to June 2013), PsychInfo (1806 to June 2013), CINAHL (1980 to June 2013), and SCIELO (1998 to June 2013), and specific PRO databases was performed. Studies were included if they described a set of validation studies. Studies were included if they described a set of validation studies for an instrument developed to measure multi-symptom or multidimensional HRQoL in advanced cancer patients under PC. The COSMIN checklist was used to rate the methodological quality of the study designs. Results We identified 89 validation studies from 746 potentially relevant articles. From those 89 articles, 31 measured test-retest reliability and were included in this review. Upon critical analysis of the overall quality of the criteria used to determine the test-retest reliability, 6 (19.4%), 17 (54.8%), and 8 (25.8%) of these articles were rated as good, fair, or poor, respectively, and no article was classified as excellent. Multi-symptom instruments were retested over a shortened interval when compared to the HRQoL instruments (median values 24 hours and 168 hours, respectively; p = 0.001). Validation studies that included objective confirmation of clinical stability in their design yielded better results for the test-retest analysis with regard to both

Validity of the Children's Orientation to Book Reading Rating Scale

ERIC Educational Resources Information Center

Kaderavek, Joan N.; Guo, Ying; Justice, Laura M.

2014-01-01

The present study investigates the validity of a 4-point rating scale used to measure the level of preschool children's orientation to literacy during shared book reading. Validity was explored by (a) comparing the children's level of literacy orientation as measured with the "Children's Orientation to Book Reading Rating Scale" (COB)…

Validity and reliability of a questionnaire to assess social skills in traumatic brain injury: A preliminary study.

PubMed

Francis, Heather M; Osborne-Crowley, Katherine; McDonald, Skye

2017-01-01

To describe the reliability and validity of a new measure, the Social Skills Questionnaire for Traumatic Brain Injury (SSQ-TBI). Fifty-one adults with severe TBI completed the SSQ-TBI questionnaire. Scores were compared to informant- and self-report on questionnaires addressing frontal lobe mediated behaviour, as well as performance on an objective measure of social cognition and neuropsychological tasks, in order to provide evidence of concurrent, divergent and predictive validity. Internal consistency was excellent at α = 0.90. Convergent validity was good, with informant ratings on the SSQ-TBI significantly correlated with Neuropsychiatric Inventory Disinhibition sub-scales (r = 0.50-63), the Current Behaviour Scale (r = 0.39-0.48) and Frontal Systems Behaviour Scale (r = 0.60-0.83). However, no relationship was seen with an objective measure of social skills or neuropsychological tasks of disinhibition. There was a significant relationship with real-world psychosocial outcomes on the Sydney Psychosocial Reintegration Scale-2 (r = -0.38--0.69) Conclusions: This study provides preliminary findings of good internal consistency and convergent and predictive validity of a social skills questionnaire adapted to be appropriate for individuals with TBI. Further assessment of psychometric properties such as test-re-test reliability and factor structure is warranted.

Validating the Center for Epidemiological Studies Depression Scale for Children in Rwanda

ERIC Educational Resources Information Center

Betancourt, Theresa; Scorza, Pamela; Meyers-Ohki, Sarah; Mushashi, Christina; Kayiteshonga, Yvonne; Binagwaho, Agnes; Stulac, Sara; Beardslee, William R.

2012-01-01

Objective: We assessed the validity of the Center for Epidemiological Studies Depression Scale for Children (CES-DC) as a screen for depression in Rwandan children and adolescents. Although the CES-DC is widely used for depression screening in high-income countries, its validity in low-income and culturally diverse settings, including sub-Saharan…

Validity and reliability of the Rosenberg Self-Esteem Scale-Thai version as compared to the Self-Esteem Visual Analog Scale.

PubMed

Piyavhatkul, Nawanant; Aroonpongpaisal, Suwanna; Patjanasoontorn, Niramol; Rongbutsri, Somchit; Maneeganondh, Somchit; Pimpanit, Wijitra

2011-07-01

To compare the validity and reliability of the Thai version of the Rosenberg Self-Esteem Scale with the Self-Esteem Visual Analog Scale. The Rosenberg Self-Esteem Scale was translated into Thai and its content-validity checked by bacA translation. The reliability of the Rosenberg Self-Esteem Scale compared with the Self-Esteem Visual Analog Scale was ther tested between February and March 2008 on 270 volunteers, including 135 patients with psychiatric illness and 135 normal volunteers. The authors analyzed the internal consistency and factor structure of the Rosenberg Self-Esteem Scale-Thai version and the correlation between it and the Visual Analog Scale. The Cronbach's Alpha for the Rosenberg Self-Esteem scale-Thai version was 0.849 and the Pearson's correlation between it and the Self-Esteem Visual Analog Scale 0.618 (p = 0.01). Two factors, viz, the positively and negatively framea items, from the Rosenberg Self-Esteem Scale-Thai version accounted for 44.04% and 12.10% of the variance, respectively. The Rosenberg Self-Esteem Scale-Thai version has acceptable reliability. The Self-Esteem Visual Analog Scale provides an effective measure of self-esteem.

Face validity, construct validity and training benefits of a virtual reality TURP simulator.

PubMed

Bright, Elizabeth; Vine, Samuel; Wilson, Mark R; Masters, Rich S W; McGrath, John S

2012-01-01

To assess face validity, construct validity and the training benefits of a virtual reality TURP simulator. 11 novices (no TURP experience) and 7 experts (>200 TURP's) completed a virtual reality median lobe prostate resection task on the TURPsim™ (Simbionix USA Corp., Cleveland, OH). Performance indicators (percentage of prostate resected (PR), percentage of capsular resection (CR) and time diathermy loop active without tissue contact (TAWC) were recorded via the TURPsim™ and compared between novices and experts to assess construct validity. Verbal comments provided by experts following task completion were used to assess face validity. Repeated attempts of the task by the novices were analysed to assess the training benefits of the TURPsim™. Experts resected a significantly greater percentage of prostate per minute (p < 0.01) and had significantly less active diathermy time without tissue contact (p < 0.01) than novices. After practice, novices were able to perform the simulation more effectively, with significant improvement in all measured parameters. Improvement in performance was noted in novices following repetitive training, as evidenced by improved TAWC scores that were not significantly different from the expert group (p = 0.18). This study has established face and construct validity for the TURPsim™. The potential benefit in using this tool to train novices has also been demonstrated. Copyright © 2012 Surgical Associates Ltd. Published by Elsevier Ltd. All rights reserved.

A quantitative method to evaluate the donor corneal tissue quality used in a comparative study between two hypothermic preservation media.

PubMed

Parekh, Mohit; Salvalaio, Gianni; Ferrari, Stefano; Amoureux, Marie-Claude; Albrecht, Cecile; Fortier, Denis; Ponzin, Diego

2014-12-01

To standardize a new evaluation technique for calculating the overall quality (OQ) of the donor cornea and validate it using a comparative study of corneas preserved in Optisol-GS and Cornea Cold®. Thirty pairs of donor corneas were selected for a 4 week in vitro comparative study using masked observers. Physiological parameters like thickness, transparency, viable endothelial cell density (VECD) and morphology were transformed to numerical range (0-4) to obtain the OQ. Microbiological examination was performed using Bactec instrument. Students t test showed statistically better results (p < 0.05) from week 3 for thickness, week 2 for transparency and week 1 for morphology and VECD; statistical significance (p < 0.05) was found for OQ from week 2 for the corneas preserved in Cornea Cold® compared to Optisol-GS. Epithelial quality was similar regardless of the medium. Microbiological examination showed absence of aerobic and anaerobic microorganisms in both media. OQ method is efficient, consistent and easy, now validated for comparative studies. Further refinement is necessary for its use at eye-banks, bio-banks and research or transplantation purposes. Cornea Cold® is a promising hypothermic corneal storage medium with preservation time ≤21 days. This permits higher flexibility, evaluation accuracy, longer duration for surgical preparation and ease of transportation.

External Validation Study of First Trimester Obstetric Prediction Models (Expect Study I): Research Protocol and Population Characteristics.

PubMed

Meertens, Linda Jacqueline Elisabeth; Scheepers, Hubertina Cj; De Vries, Raymond G; Dirksen, Carmen D; Korstjens, Irene; Mulder, Antonius Lm; Nieuwenhuijze, Marianne J; Nijhuis, Jan G; Spaanderman, Marc Ea; Smits, Luc Jm

2017-10-26

A number of first-trimester prediction models addressing important obstetric outcomes have been published. However, most models have not been externally validated. External validation is essential before implementing a prediction model in clinical practice. The objective of this paper is to describe the design of a study to externally validate existing first trimester obstetric prediction models, based upon maternal characteristics and standard measurements (eg, blood pressure), for the risk of pre-eclampsia (PE), gestational diabetes mellitus (GDM), spontaneous preterm birth (PTB), small-for-gestational-age (SGA) infants, and large-for-gestational-age (LGA) infants among Dutch pregnant women (Expect Study I). The results of a pilot study on the feasibility and acceptability of the recruitment process and the comprehensibility of the Pregnancy Questionnaire 1 are also reported. A multicenter prospective cohort study was performed in The Netherlands between July 1, 2013 and December 31, 2015. First trimester obstetric prediction models were systematically selected from the literature. Predictor variables were measured by the Web-based Pregnancy Questionnaire 1 and pregnancy outcomes were established using the Postpartum Questionnaire 1 and medical records. Information about maternal health-related quality of life, costs, and satisfaction with Dutch obstetric care was collected from a subsample of women. A pilot study was carried out before the official start of inclusion. External validity of the models will be evaluated by assessing discrimination and calibration. Based on the pilot study, minor improvements were made to the recruitment process and online Pregnancy Questionnaire 1. The validation cohort consists of 2614 women. Data analysis of the external validation study is in progress. This study will offer insight into the generalizability of existing, non-invasive first trimester prediction models for various obstetric outcomes in a Dutch obstetric population

Development and validation of the Salzburg COPD-screening questionnaire (SCSQ): a questionnaire development and validation study.

PubMed

Weiss, Gertraud; Steinacher, Ina; Lamprecht, Bernd; Kaiser, Bernhard; Mikes, Romana; Sator, Lea; Hartl, Sylvia; Wagner, Helga; Studnicka, M

2017-01-26

Chronic obstructive pulmonary disease prevalence rates are still high. However, the majority of subjects are not diagnosed. Strategies have to be implemented to overcome the problem of under-diagnosis. Questionnaires could be used to pre-select subjects for spirometry and thereby help reducing under-diagnosis. We report a brief, simple, self-administrable and validated chronic obstructive pulmonary disease questionnaire to increase the pre-test probability for chronic obstructive pulmonary disease diagnosis in subjects undergoing confirmatory spirometry. In 2005, we completed the Austrian Burden of Obstructive Lung Disease-study in 1258 subjects aged >40 years. Post-bronchodilator spirometry was performed, and non-reversible airflow limitation defined by FEV 1 /FVC ratio below the lower limit of normal. Questions from the Salzburg chronic obstructive pulmonary disease screening-questionnaire were selected using a logistic regression model, and risk scores were based on regression-coefficients. A training sub-sample (n = 800) was used to create the score, and a test sub-sample (n = 458) was used to test it. In 2008, an external validation study was done, using the same protocol in 775 patients from primary care. The Salzburg chronic obstructive pulmonary disease screening questionnaire was composed of items related to "breathing problems", "wheeze", "cough", "limitation of physical activity", and "smoking". At the >=2 points cut-off of the Salzburg chronic obstructive pulmonary disease screening questionnaire, sensitivity was 69.1% [95%CI: 56.6%; 79.5%], specificity 60.0% [95%CI: 54.9%; 64.9%], the positive predictive value 23.2% [95%CI: 17.7%; 29.7%] and the negative predictive value 91.8% [95%CI: 87.5%; 95.7%] to detect post bronchodilator airflow limitation. The external validation study in primary care confirmed these findings. The Salzburg chronic obstructive pulmonary disease screening questionnaire was derived from the highly standardized Burden of

Assessing the Validity of an Annual Survey for Measuring the Enacted Literacy Curriculum

ERIC Educational Resources Information Center

Camburn, Eric M.; Han, Seong Won; Sebastian, James

2017-01-01

Surveys are frequently used to inform consequential decisions about teachers, policies, and programs. Consequently, it is important to understand the validity of these instruments. This study assesses the validity of measures of instruction captured by an annual survey by comparing survey data with those of a validated daily log. The two…

Community validation of the IDEA study cognitive screen in rural Tanzania.

PubMed

Gray, William K; Paddick, Stella Maria; Collingwood, Cecilia; Kisoli, Aloyce; Mbowe, Godfrey; Mkenda, Sarah; Lissu, Carolyn; Rogathi, Jane; Kissima, John; Walker, Richard W; Mushi, Declare; Chaote, Paul; Ogunniyi, Adesola; Dotchin, Catherine L

2016-11-01

The dementia diagnosis gap in sub-Saharan Africa (SSA) is large, partly because of difficulties in screening for cognitive impairment in the community. As part of the Identification and Intervention for Dementia in Elderly Africans (IDEA) study, we aimed to validate the IDEA cognitive screen in a community-based sample in rural Tanzania METHODS: Study participants were recruited from people who attended screening days held in villages within the rural Hai district of Tanzania. Criterion validity was assessed against the gold standard clinical dementia diagnosis using DSM-IV criteria. Construct validity was assessed against, age, education, sex and grip strength and instrumental activities of daily living (IADLs). Internal consistency and floor and ceiling effects were also examined. During community screening, the IDEA cognitive screen had high criterion validity, with an area under the receiver operating characteristic curve of 0.855 (95% CI 0.794 to 0.915). Higher scores on the screen were significantly correlated with lower age, male sex, having attended school, better grip strength and improved performance in activities of daily living. Factor analysis revealed a single factor with an eigenvalue greater than one, although internal consistency was only moderate (Cronbach's alpha = 0.534). The IDEA cognitive screen had high criterion and construct validity and is suitable for use as a cognitive screening instrument in a community setting in SSA. Only moderate internal consistency may partly reflect the multi-domain nature of dementia as diagnosed clinically. Copyright © 2016 John Wiley & Sons, Ltd. Copyright © 2016 John Wiley & Sons, Ltd.

The GRACE checklist for rating the quality of observational studies of comparative effectiveness: a tale of hope and caution.

PubMed

Dreyer, Nancy A; Velentgas, Priscilla; Westrich, Kimberly; Dubois, Robert

2014-03-01

While there is growing demand for information about comparative effectiveness (CE), there is substantial debate about whether and when observational studies have sufficient quality to support decision making. To develop and test an item checklist that can be used to qualify those observational CE studies sufficiently rigorous in design and execution to contribute meaningfully to the evidence base for decision support. An 11-item checklist about data and methods (the GRACE checklist) was developed through literature review and consultation with experts from professional societies, payer groups, the private sector, and academia. Since no single gold standard exists for validation, checklist item responses were compared with 3 different types of external quality ratings (N=88 articles). The articles compared treatment effectiveness and/or safety of drugs, medical devices, and medical procedures. We validated checklist item responses 3 ways against external quality ratings, using published articles of observational CE or safety studies: (a) Systematic Review-quality assessment from a published systematic review; (b) Single Expert Review-quality assessment made according to the solicited "expert opinion" of a senior researcher; and (c) Concordant Expert Review-quality assessments from 2 experts for which there was concordance. Volunteers (N=113) from 5 continents completed 280 article assessments using the checklist. Positive and negative predictive values (PPV, NPV, respectively) of individual items were estimated to compare testers' assessments with those of experts. Taken as a whole, the scale had better NPV than PPV, for both data and methods. The most consistent predictor of quality relates to the validity of the primary outcomes measurement for the study purpose. Other consistent markers of quality relate to using concurrent comparators, minimizing the effects of bias by prudent choice of covariates, and using sensitivity analysis to test robustness of results

Validation of maternal cardiac output assessed by transthoracic echocardiography against pulmonary artery catheterization in severely ill pregnant women: prospective comparative study and systematic review.

PubMed

Cornette, J; Laker, S; Jeffery, B; Lombaard, H; Alberts, A; Rizopoulos, D; Roos-Hesselink, J W; Pattinson, R C

2017-01-01

Most severe pregnancy complications are characterized by profound hemodynamic disturbances, thus there is a need for validated hemodynamic monitoring systems for pregnant women. Pulmonary artery catheterization (PAC) using thermodilution is the clinical gold standard for the measurement of cardiac output (CO), however this reference method is rarely performed owing to its invasive nature. Transthoracic echocardiography (TTE) allows non-invasive determination of CO. We aimed to validate TTE against PAC for the determination of CO in severely ill pregnant women. This study consisted of a meta-analysis combining data from a prospective study and a systematic review. The prospective arm was conducted in Pretoria, South Africa, in 2003. Women with severe pregnancy complications requiring invasive monitoring with PAC according to contemporary guidelines were included. TTE was performed within 15 min of PAC and the investigator was blinded to the PAC measurements. Comparative measurements were extracted from similar studies retrieved from a systematic review of the literature and added to a database. Simultaneous CO measurements by TTE and PAC were compared. Agreement between methods was assessed using Bland-Altman statistics and intraclass correlation coefficients (ICC). Thirty-four comparative measurements were included in the meta-analysis. Mean CO values obtained by PAC and TTE were 7.39 L/min and 7.18 L/min, respectively. The bias was 0.21 L/min with lower and upper limits of agreement of -1.18 L/min and 1.60 L/min, percentage error was 19.1%, and ICC between the two methods was 0.94. CO measurements by TTE show excellent agreement with those obtained by PAC in pregnant women. Given its non-invasive nature and availability, TTE could be considered as a reference for the validation of other CO techniques in pregnant women. Copyright © 2016 ISUOG. Published by John Wiley & Sons Ltd. Las complicaciones del embarazo más graves se caracterizan por trastornos hemodin

Quality Rating and Improvement System (QRIS) Validation Study Designs. CEELO FastFacts

ERIC Educational Resources Information Center

Schilder, D.

2013-01-01

In this "Fast Facts," a state has received Race to the Top Early Learning Challenge funds and is seeking information to inform the design of the Quality Rating and Improvement System (QRIS) validation study. The Center on Enhancing Early Learning Outcomes (CEELO) responds that according to Resnick (2012), validation of a QRIS is an…

Comparative Validation of the Determination of Sofosbuvir in Pharmaceuticals by Several Inexpensive Ecofriendly Chromatographic, Electrophoretic, and Spectrophotometric Methods.

PubMed

El-Yazbi, Amira F

2017-07-01

Sofosbuvir (SOFO) was approved by the U.S. Food and Drug Administration in 2013 for the treatment of hepatitis C virus infection with enhanced antiviral potency compared with earlier analogs. Notwithstanding, all current editions of the pharmacopeias still do not present any analytical methods for the quantification of SOFO. Thus, rapid, simple, and ecofriendly methods for the routine analysis of commercial formulations of SOFO are desirable. In this study, five accurate methods for the determination of SOFO in pharmaceutical tablets were developed and validated. These methods include HPLC, capillary zone electrophoresis, HPTLC, and UV spectrophotometric and derivative spectrometry methods. The proposed methods proved to be rapid, simple, sensitive, selective, and accurate analytical procedures that were suitable for the reliable determination of SOFO in pharmaceutical tablets. An analysis of variance test with P-value > 0.05 confirmed that there were no significant differences between the proposed assays. Thus, any of these methods can be used for the routine analysis of SOFO in commercial tablets.

Insights into the use of thermography to assess burn wound healing potential: a reliable and valid technique when compared to laser Doppler imaging

NASA Astrophysics Data System (ADS)

Jaspers, Mariëlle E. H.; Maltha, Ilse; Klaessens, John H. G. M.; de Vet, Henrica C. W.; Verdaasdonk, Rudolf M.; van Zuijlen, Paul P. M.

2016-09-01

Adequate assessment of burn wounds is crucial in the management of burn patients. Thermography, as a noninvasive measurement tool, can be utilized to detect the remaining perfusion over large burn wound areas by measuring temperature, thereby reflecting the healing potential (HP) (i.e., number of days that burns require to heal). The objective of this study was to evaluate the clinimetric properties (i.e., reliability and validity) of thermography for measuring burn wound HP. To evaluate reliability, two independent observers performed a thermography measurement of 50 burns. The intraclass correlation coefficient (ICC), the standard error of measurement (SEM), and the limits of agreement (LoA) were calculated. To assess validity, temperature differences between burned and nonburned skin (ΔT) were compared to the HP found by laser Doppler imaging (serving as the reference standard). By applying a visual method, one ΔT cutoff point was identified to differentiate between burns requiring conservative versus surgical treatment. The ICC was 0.99, expressing an excellent correlation between two measurements. The SEM was calculated at 0.22°C, the LoA at -0.58°C and 0.64°C. The ΔT cutoff point was -0.07°C (sensitivity 80% specificity 80%). These results show that thermography is a reliable and valid technique in the assessment of burn wound HP.

Initial Interpretation and Evaluation of a Profile-Based Classification System for the Anxiety and Mood Disorders: Incremental Validity Compared to DSM-IV Categories

PubMed Central

Rosellini, Anthony J.; Brown, Timothy A.

2014-01-01

Limitations in anxiety and mood disorder diagnostic reliability and validity due to the categorical approach to classification used by the Diagnostic and Statistical Manual of Mental Disorders (DSM) have been long recognized. Although these limitations have led researchers to forward alternative classification schemes, few have been empirically evaluated. In a sample of 1,218 outpatients with anxiety and mood disorders, the present study examined the validity of Brown and Barlow's (2009) proposal to classify the anxiety and mood disorders using an integrated dimensional-categorical approach based on transdiagnostic emotional disorder vulnerabilities and phenotypes. Latent class analyses of seven transdiagnostic dimensional indicators suggested that a six-class (i.e., profile) solution provided the best model fit and was the most conceptually interpretable. Interpretation of the classes was further supported when compared with DSM-IV diagnoses (i.e., within-class prevalence of diagnoses, using diagnoses to predict class membership). In addition, hierarchical multiple regression models were used to demonstrate the incremental validity of the profiles; class probabilities consistently accounted for unique variance in anxiety and mood disorder outcomes above and beyond DSM diagnoses. These results provide support for the potential development and utility of a hybrid dimensional-categorical profile approach to anxiety and mood disorder classification. In particular, the availability of dimensional indicators and corresponding profiles may serve as a useful complement to DSM diagnoses for both researchers and clinicians. PMID:25265416

Hazard Screening Methods for Nanomaterials: A Comparative Study

PubMed Central

Murphy, Finbarr; Mullins, Martin; Furxhi, Irini; Costa, Anna L.; Simeone, Felice C.

2018-01-01

Hazard identification is the key step in risk assessment and management of manufactured nanomaterials (NM). However, the rapid commercialisation of nano-enabled products continues to out-pace the development of a prudent risk management mechanism that is widely accepted by the scientific community and enforced by regulators. However, a growing body of academic literature is developing promising quantitative methods. Two approaches have gained significant currency. Bayesian networks (BN) are a probabilistic, machine learning approach while the weight of evidence (WoE) statistical framework is based on expert elicitation. This comparative study investigates the efficacy of quantitative WoE and Bayesian methodologies in ranking the potential hazard of metal and metal-oxide NMs—TiO2, Ag, and ZnO. This research finds that hazard ranking is consistent for both risk assessment approaches. The BN and WoE models both utilize physico-chemical, toxicological, and study type data to infer the hazard potential. The BN exhibits more stability when the models are perturbed with new data. The BN has the significant advantage of self-learning with new data; however, this assumes all input data is equally valid. This research finds that a combination of WoE that would rank input data along with the BN is the optimal hazard assessment framework. PMID:29495342

Validation study of the Japanese version of the Obsessive-Compulsive Drinking Scale.

PubMed

Tatsuzawa, Yasutaka; Yoshimasu, Haruo; Moriyama, Yasushi; Furusawa, Teruyuki; Yoshino, Aihide

2002-02-01

The Obsessive-Compulsive Drinking Scale (OCDS) is a self-rating questionnaire that measures cognitive and behavioral aspects of craving for alcohol. The OCDS consists of two subscales: the obsessive thoughts of drinking subscale (OS) and the compulsive drinking subscale (CS). This study aims to validate the Japanese version of the OCDS. First, internal consistency and discriminant validity were evaluated. Second, a prospective longitudinal 3-month outcome study of 67 patients with alcohol dependence who participated in a relapse prevention program was designed to assess the concurrent and predictive validity of the OCDS. The OCDS demonstrated high internal consistency. The OS had high discriminant validity, while the CS did not. Twenty-three patients (34.3%) dropped out of treatment. These patients had significantly higher OS scores than those who completed the program. At 3 months, the relapse group had significantly higher OCDS scores than the no relapse group. Also, the OCDS score was higher in subjects who had early-onset alcohol dependence than late-onset dependence. The OCDS is useful for evaluating cognitive aspect of craving and predicts dropout and relapse.

Comparative study of predicted and experimentally detected interplanetary shocks

NASA Astrophysics Data System (ADS)

Kartalev, M. D.; Grigorov, K. G.; Smith, Z.; Dryer, M.; Fry, C. D.; Sun, Wei; Deehr, C. S.

2002-03-01

We compare the real time space weather prediction shock arrival times at 1 AU made by the USAF/NOAA Shock Time of Arrival (STOA) and Interplanetary Shock Propagation Model (ISPM) models, and the Exploration Physics International/University of Alaska Hakamada-Akasofu-Fry Solar Wind Model (HAF-v2) to a real time analysis analysis of plasma and field ACE data. The comparison is made using an algorithm that was developed on the basis of wavelet data analysis and MHD identification procedure. The shock parameters are estimated for selected "candidate events". An appropriate automatically performing Web-based interface periodically utilizes solar wind observations made by the ACE at L1. Near real time results as well an archive of the registered interesting events are available on a specially developed web site. A number of events are considered. These studies are essential for the validation of real time space weather forecasts made from solar data.

Dietary Assessment in the MetaCardis Study: Development and Relative Validity of an Online Food Frequency Questionnaire.

PubMed

Verger, Eric O; Armstrong, Patrice; Nielsen, Trine; Chakaroun, Rima; Aron-Wisnewsky, Judith; Gøbel, Rikke Juul; Schütz, Tatjana; Delaere, Fabien; Gausseres, Nicolas; Clément, Karine; Holmes, Bridget A

2017-06-01

The European study MetaCardis aims to investigate the role of the gut microbiota in health and cardiometabolic diseases in France, Germany, and Denmark. To evaluate long-term diet-disease relationships, a food frequency questionnaire (FFQ) was found to be the most relevant dietary assessment method for the MetaCardis study. The objectives of this study were to describe the development of three semiquantitative online FFQs used in the MetaCardis study-one FFQ per country-and to assess the relative validity of the French MetaCardis FFQ. The layout and format of the MetaCardis FFQ was based on the European Prospective Investigation of Cancer (EPIC)-Norfolk FFQ and the content was based on relevant European FFQs. Portion size and nutrient composition were derived from national food consumption surveys and food composition databases. To assess the validity of the French MetaCardis FFQ, a cross-sectional study design was utilized. The validation study included 324 adults recruited between September 2013 and June 2015 from different hospitals in Paris, France. Food intakes were measured with both the French MetaCardis FFQ and 3 consecutive self-administered web-based 24-hour dietary recalls (DRs). Several measures of validity of the French MetaCardis FFQ were evaluated: estimations of food groups, energy, and nutrient intakes from the DRs and the FFQ, Spearman and Pearson correlations, cross-classification, and Bland-Altman analyses. The French MetaCardis FFQ tended to report higher food, energy, and nutrient intakes compared with the DRs. Mean correlation coefficient was 0.429 for food, 0.460 for energy, 0.544 for macronutrients, 0.640 for alcohol, and 0.503 for micronutrient intakes. Almost half of participants (44.4%) were correctly classified within tertiles of consumption, whereas 12.9% were misclassified in the opposite tertile. Performance of the FFQ was relatively similar after stratification by sex. The French MetaCardis FFQ was found to have an acceptable level

COSMOS - a study comparing peripheral intravenous systems.

PubMed

López, Juan Luis González; Del Palacio, Encarnación Ferenández; Marti, Carmen Benedicto; Corral, Javier Olivares; Portal, Pilar Herrera; Vilela, Ana Arribi

In many areas of the world, safety peripheral intravenous systems have come into widespread use. The Madrid region was the first in Spain to adopt such an approach. These systems, though initially introduced to protect users from sharps injuries, have now evolved to include patient protection features as well. Patient protection, simply stated, means closing the system to pathogen entry. The authors' purpose was to investigate, in a prospective and randomized study, the clinical performance of a closed safe intravenous system versus an open system (COSMOS - Compact Closed System versus Mounted Open System). COSMOS is designed to provide definitive answers, from a nursing perspective, to many topics related to peripheral venous catheterization, which have important implications in intravenous therapy and which have not been validated scientifically. Furthermore, it forms pioneering research in that it is the first clinical trial on medical devices in a legislated environment carried out entirely by nurses and whose promoter and principal investigator is a nurse. The objectives of COSMOS are to compare the effectiveness (as defined by time of survival without complications) and rates of catheter-related complications, such as phlebitis, pain, extravasation, blockage and catheter-related infections. It also looks at rates of catheter colonization, the ease of handling of both systems and overall costs. This article outlines the authors' approach, both in preparing hospital units for such an evaluation as well as in the choice of parameters and their method of study. Further articles will detail the results and findings of the study.

An international prospective cohort study of mobile phone users and health (COSMOS): Factors affecting validity of self-reported mobile phone use.

PubMed

Toledano, Mireille B; Auvinen, Anssi; Tettamanti, Giorgio; Cao, Yang; Feychting, Maria; Ahlbom, Anders; Fremling, Karin; Heinävaara, Sirpa; Kojo, Katja; Knowles, Gemma; Smith, Rachel B; Schüz, Joachim; Johansen, Christoffer; Poulsen, Aslak Harbo; Deltour, Isabelle; Vermeulen, Roel; Kromhout, Hans; Elliott, Paul; Hillert, Lena

2018-01-01

This study investigates validity of self-reported mobile phone use in a subset of 75 993 adults from the COSMOS cohort study. Agreement between self-reported and operator-derived mobile call frequency and duration for a 3-month period was assessed using Cohen's weighted Kappa (κ). Sensitivity and specificity of both self-reported high (≥10 calls/day or ≥4h/week) and low (≤6 calls/week or <30min/week) mobile phone use were calculated, as compared to operator data. For users of one mobile phone, agreement was fair for call frequency (κ=0.35, 95% CI: 0.35, 0.36) and moderate for call duration (κ=0.50, 95% CI: 0.49, 0.50). Self-reported low call frequency and duration demonstrated high sensitivity (87% and 76% respectively), but for high call frequency and duration sensitivity was lower (38% and 56% respectively), reflecting a tendency for greater underestimation than overestimation. Validity of self-reported mobile phone use was lower in women, younger age groups and those reporting symptoms during/shortly after using a mobile phone. This study highlights the ongoing value of using self-report data to measure mobile phone use. Furthermore, compared to continuous scale estimates used by previous studies, categorical response options used in COSMOS appear to improve validity considerably, most likely by preventing unrealistically high estimates from being reported. Copyright © 2017 Elsevier GmbH. All rights reserved.

The birth satisfaction scale: Turkish adaptation, validation and reliability study

PubMed Central

Cetin, Fatma Cosar; Sezer, Ayse; Merih, Yeliz Dogan

2015-01-01

OBJECTIVE: The objective of this study is to investigate the validity and the reliability of Birth Satisfaction Scale (BSS) and to adapt it into the Turkish language. This scale is used for measuring maternal satisfaction with birth in order to evaluate women’s birth perceptions. METHODS: In this study there were 150 women who attended to inpatient postpartum clinic. The participants filled in an information form and the BSS questionnaire forms. The properties of the scale were tested by conducting reliability and validation analyses. RESULTS: BSS entails 30 Likert-type questions. It was developed by Hollins Martin and Fleming. Total scale scores ranged between 30–150 points. Higher scores from the scale mean increases in birth satisfaction. Three overarching themes were identified in Scale: service provision (home assessment, birth environment, support, relationships with health care professionals); personal attributes (ability to cope during labour, feeling in control, childbirth preparation, relationship with baby); and stress experienced during labour (distress, obstetric injuries, receiving sufficient medical care, obstetric intervention, pain, prolonged labour and baby’s health). Cronbach’s alfa coefficient was 0.62. CONCLUSION: According to the present study, BSS entails 30 Likert-type questions and evaluates women’s birth perceptions. The Turkish version of BSS has been proven to be a valid and a reliable scale. PMID:28058355

Validating internal controls for quantitative plant gene expression studies

PubMed Central

Brunner, Amy M; Yakovlev, Igor A; Strauss, Steven H

2004-01-01

Background Real-time reverse transcription PCR (RT-PCR) has greatly improved the ease and sensitivity of quantitative gene expression studies. However, accurate measurement of gene expression with this method relies on the choice of a valid reference for data normalization. Studies rarely verify that gene expression levels for reference genes are adequately consistent among the samples used, nor compare alternative genes to assess which are most reliable for the experimental conditions analyzed. Results Using real-time RT-PCR to study the expression of 10 poplar (genus Populus) housekeeping genes, we demonstrate a simple method for determining the degree of stability of gene expression over a set of experimental conditions. Based on a traditional method for analyzing the stability of varieties in plant breeding, it defines measures of gene expression stability from analysis of variance (ANOVA) and linear regression. We found that the potential internal control genes differed widely in their expression stability over the different tissues, developmental stages and environmental conditions studied. Conclusion Our results support that quantitative comparisons of candidate reference genes are an important part of real-time RT-PCR studies that seek to precisely evaluate variation in gene expression. The method we demonstrated facilitates statistical and graphical evaluation of gene expression stability. Selection of the best reference gene for a given set of experimental conditions should enable detection of biologically significant changes in gene expression that are too small to be revealed by less precise methods, or when highly variable reference genes are unknowingly used in real-time RT-PCR experiments. PMID:15317655

Validating internal controls for quantitative plant gene expression studies.

PubMed

Brunner, Amy M; Yakovlev, Igor A; Strauss, Steven H

2004-08-18

Real-time reverse transcription PCR (RT-PCR) has greatly improved the ease and sensitivity of quantitative gene expression studies. However, accurate measurement of gene expression with this method relies on the choice of a valid reference for data normalization. Studies rarely verify that gene expression levels for reference genes are adequately consistent among the samples used, nor compare alternative genes to assess which are most reliable for the experimental conditions analyzed. Using real-time RT-PCR to study the expression of 10 poplar (genus Populus) housekeeping genes, we demonstrate a simple method for determining the degree of stability of gene expression over a set of experimental conditions. Based on a traditional method for analyzing the stability of varieties in plant breeding, it defines measures of gene expression stability from analysis of variance (ANOVA) and linear regression. We found that the potential internal control genes differed widely in their expression stability over the different tissues, developmental stages and environmental conditions studied. Our results support that quantitative comparisons of candidate reference genes are an important part of real-time RT-PCR studies that seek to precisely evaluate variation in gene expression. The method we demonstrated facilitates statistical and graphical evaluation of gene expression stability. Selection of the best reference gene for a given set of experimental conditions should enable detection of biologically significant changes in gene expression that are too small to be revealed by less precise methods, or when highly variable reference genes are unknowingly used in real-time RT-PCR experiments.

Validity and reliability of intraoral scanners compared to conventional gypsum models measurements: a systematic review.

PubMed

Aragón, Mônica L C; Pontes, Luana F; Bichara, Lívia M; Flores-Mir, Carlos; Normando, David

2016-08-01

The development of 3D technology and the trend of increasing the use of intraoral scanners in dental office routine lead to the need for comparisons with conventional techniques. To determine if intra- and inter-arch measurements from digital dental models acquired by an intraoral scanner are as reliable and valid as the similar measurements achieved from dental models obtained through conventional intraoral impressions. An unrestricted electronic search of seven databases until February 2015. Studies that focused on the accuracy and reliability of images obtained from intraoral scanners compared to images obtained from conventional impressions. After study selection the QUADAS risk of bias assessment tool for diagnostic studies was used to assess the risk of bias (RoB) among the included studies. Four articles were included in the qualitative synthesis. The scanners evaluated were OrthoProof, Lava, iOC intraoral, Lava COS, iTero and D250. These studies evaluated the reliability of tooth widths, Bolton ratio measurements, and image superimposition. Two studies were classified as having low RoB; one had moderate RoB and the remaining one had high RoB. Only one study evaluated the time required to complete clinical procedures and patient's opinion about the procedure. Patients reported feeling more comfortable with the conventional dental impression method. Associated costs were not considered in any of the included study. Inter- and intra-arch measurements from digital models produced from intraoral scans appeared to be reliable and accurate in comparison to those from conventional impressions. This assessment only applies to the intraoral scanners models considered in the finally included studies. Digital models produced by intraoral scan eliminate the need of impressions materials; however, currently, longer time is needed to take the digital images. PROSPERO (CRD42014009702). None. © The Author 2016. Published by Oxford University Press on behalf of the European

Evaluating Cardiovascular Health Disparities Using Estimated Race/Ethnicity: A Validation Study.

PubMed

Bykov, Katsiaryna; Franklin, Jessica M; Toscano, Michele; Rawlins, Wayne; Spettell, Claire M; McMahill-Walraven, Cheryl N; Shrank, William H; Choudhry, Niteesh K

2015-12-01

Methods of estimating race/ethnicity using administrative data are increasingly used to examine and target disparities; however, there has been no validation of these methods using clinically relevant outcomes. To evaluate the validity of the indirect method of race/ethnicity identification based on place of residence and surname for assessing clinically relevant outcomes. A total of 2387 participants in the Post-MI Free Rx Event and Economic Evaluation (MI FREEE) trial who had both self-reported and Bayesian Improved Surname Geocoding method (BISG)-estimated race/ethnicity information available. We used tests of interaction to compare differences in the effect of providing full drug coverage for post-MI medications on adherence and rates of major vascular events or revascularization for white and nonwhite patients based upon self-reported and indirect racial/ethnic assignment. The impact of full coverage on clinical events differed substantially when based upon self-identified race (HR=0.97 for whites, HR=0.65 for nonwhites; interaction P-value=0.05); however, it did not differ among race/ethnicity groups classified using indirect methods (HR=0.87 for white and nonwhites; interaction P-value=0.83). The impact on adherence was the same for self-reported and BISG-estimated race/ethnicity for 2 of the 3 medication classes studied. Quantitatively and qualitatively different results were obtained when indirectly estimated race/ethnicity was used, suggesting that these techniques may not accurately describe aspects of race/ethnicity related to actual health behaviors.

Comparison of type 2 diabetes prevalence estimates in Saudi Arabia from a validated Markov model against the International Diabetes Federation and other modelling studies

PubMed Central

Al-Quwaidhi, Abdulkareem J.; Pearce, Mark S.; Sobngwi, Eugene; Critchley, Julia A.; O’Flaherty, Martin

2014-01-01

Aims To compare the estimates and projections of type 2 diabetes mellitus (T2DM) prevalence in Saudi Arabia from a validated Markov model against other modelling estimates, such as those produced by the International Diabetes Federation (IDF) Diabetes Atlas and the Global Burden of Disease (GBD) project. Methods A discrete-state Markov model was developed and validated that integrates data on population, obesity and smoking prevalence trends in adult Saudis aged ≥25 years to estimate the trends in T2DM prevalence (annually from 1992 to 2022). The model was validated by comparing the age- and sex-specific prevalence estimates against a national survey conducted in 2005. Results Prevalence estimates from this new Markov model were consistent with the 2005 national survey and very similar to the GBD study estimates. Prevalence in men and women in 2000 was estimated by the GBD model respectively at 17.5% and 17.7%, compared to 17.7% and 16.4% in this study. The IDF estimates of the total diabetes prevalence were considerably lower at 16.7% in 2011 and 20.8% in 2030, compared with 29.2% in 2011 and 44.1% in 2022 in this study. Conclusion In contrast to other modelling studies, both the Saudi IMPACT Diabetes Forecast Model and the GBD model directly incorporated the trends in obesity prevalence and/or body mass index (BMI) to inform T2DM prevalence estimates. It appears that such a direct incorporation of obesity trends in modelling studies results in higher estimates of the future prevalence of T2DM, at least in countries where obesity has been rapidly increasing. PMID:24447810

Effects of Coaching on the Validity of the SAT: A Simulation Study.

ERIC Educational Resources Information Center

Baydar, Nazli

The effects of student coaching in preparation for the College Board Scholastic Aptitude Test (SAT) on the predictive validity of this test for freshman year performance were studied using data on 1985 freshman year students from four colleges. After the validity of the SAT was estimated for each school, a given proportion of students was picked,…

Comparing and validating models of driver steering behaviour in collision avoidance and vehicle stabilisation

NASA Astrophysics Data System (ADS)

Markkula, G.; Benderius, O.; Wahde, M.

2014-12-01

A number of driver models were fitted to a large data set of human truck driving, from a simulated near-crash, low-friction scenario, yielding two main insights: steering to avoid a collision was best described as an open-loop manoeuvre of predetermined duration, but with situation-adapted amplitude, and subsequent vehicle stabilisation could to a large extent be accounted for by a simple yaw rate nulling control law. These two phenomena, which could be hypothesised to generalise to passenger car driving, were found to determine the ability of four driver models adopted from the literature to fit the human data. Based on the obtained results, it is argued that the concept of internal vehicle models may be less valuable when modelling driver behaviour in non-routine situations such as near-crashes, where behaviour may be better described as direct responses to salient perceptual cues. Some methodological issues in comparing and validating driver models are also discussed.

Toward Supersonic Retropropulsion CFD Validation

NASA Technical Reports Server (NTRS)

Kleb, Bil; Schauerhamer, D. Guy; Trumble, Kerry; Sozer, Emre; Barnhardt, Michael; Carlson, Jan-Renee; Edquist, Karl

2011-01-01

This paper begins the process of verifying and validating computational fluid dynamics (CFD) codes for supersonic retropropulsive flows. Four CFD codes (DPLR, FUN3D, OVERFLOW, and US3D) are used to perform various numerical and physical modeling studies toward the goal of comparing predictions with a wind tunnel experiment specifically designed to support CFD validation. Numerical studies run the gamut in rigor from code-to-code comparisons to observed order-of-accuracy tests. Results indicate that this complex flowfield, involving time-dependent shocks and vortex shedding, design order of accuracy is not clearly evident. Also explored is the extent of physical modeling necessary to predict the salient flowfield features found in high-speed Schlieren images and surface pressure measurements taken during the validation experiment. Physical modeling studies include geometric items such as wind tunnel wall and sting mount interference, as well as turbulence modeling that ranges from a RANS (Reynolds-Averaged Navier-Stokes) 2-equation model to DES (Detached Eddy Simulation) models. These studies indicate that tunnel wall interference is minimal for the cases investigated; model mounting hardware effects are confined to the aft end of the model; and sparse grid resolution and turbulence modeling can damp or entirely dissipate the unsteadiness of this self-excited flow.

A content validity study of signs, symptoms and diseases/health problems expressed in LIBRAS.

PubMed

Aragão, Jamilly da Silva; de França, Inacia Sátiro Xavier; Coura, Alexsandro Silva; de Sousa, Francisco Stélio; Batista, Joana D'arc Lyra; Magalhães, Isabella Medeiros de Oliveira

2015-01-01

To validate the content of signs, symptoms and diseases/health problems expressed in LIBRAS for people with deafness. Method: Methodological development study, which involved 36 people with deafness and three LIBRAS specialists. The study was conducted in three stages: investigation of the signs, symptoms and diseases/health problems, referred to by people with deafness, reported in a questionnaire; video recordings of how people with deafness express, through LIBRA, the signs, symptoms and diseases/health problems; and validation of the contents of the recordings of the expressions by LIBRAS specialists. Data were processed in a spreadsheet and analyzed using univariate tables, with absolute frequencies and percentages. The validation results were analyzed using the Content Validity Index (CVI). 33 expressions in LIBRAS, of signs, symptoms and diseases/health problems were evaluated, and 28 expressions obtained a satisfactory CVI (1.00). The signs, symptoms and diseases/health problems expressed in LIBRAS presented validity, in the study region, for health professionals, especially nurses, for use in the clinical anamnesis of the nursing consultation for people with deafness.

Ride qualities criteria validation/pilot performance study: Flight test results

NASA Technical Reports Server (NTRS)

Nardi, L. U.; Kawana, H. Y.; Greek, D. C.

1979-01-01

Pilot performance during a terrain following flight was studied for ride quality criteria validation. Data from manual and automatic terrain following operations conducted during low level penetrations were analyzed to determine the effect of ride qualities on crew performance. The conditions analyzed included varying levels of turbulence, terrain roughness, and mission duration with a ride smoothing system on and off. Limited validation of the B-1 ride quality criteria and some of the first order interactions between ride qualities and pilot/vehicle performance are highlighted. An earlier B-1 flight simulation program correlated well with the flight test results.

Comparability of a short food frequency questionnaire to assess diet quality: the DISCOVER study.

PubMed

Dehghan, Mahshid; Ge, Yipeng; El Sheikh, Wala; Bawor, Monica; Rangarajan, Sumathy; Dennis, Brittany; Vair, Judith; Sholer, Heather; Hutchinson, Nichole; Iordan, Elizabeth; Mackie, Pam; Samaan, Zainab

2017-09-01

This study aims to assess comparability of a short food frequency questionnaire (SFFQ) used in the Determinants of Suicide: Conventional and Emergent Risk Study (DISCOVER Study) with a validated comprehensive FFQ (CFFQ). A total of 127 individuals completed SFFQ and CFFQ. Healthy eating was measured using Healthy Eating Score (HES). Estimated food intake and healthy eating assessed by SFFQ was compared with the CFFQ. For most food groups and HES, the highest Spearman's rank correlation coefficients between the two FFQs were r > .60. For macro-nutrients, the correlations exceeded 0.4. Cross-classification of quantile analysis showed that participants were classified between 46% and 81% into the exact same quantiles, while 10% or less were misclassified into opposite quantiles. The Bland-Altman plots showed an acceptable level of agreement between the two dietary measurement methods. The SFFQ can be used for Canadian with psychiatric disorders to rank them based on their dietary intake.

Comparative Packaging Study

NASA Technical Reports Server (NTRS)

Perchonok, Michele; Antonini, David

2008-01-01

This viewgraph presentation describes a comparative packaging study for use on long duration space missions. The topics include: 1) Purpose; 2) Deliverables; 3) Food Sample Selection; 4) Experimental Design Matrix; 5) Permeation Rate Comparison; and 6) Packaging Material Information.

Assessment and validation of CT scanogram to compare per-operative and post-operative mechanical axis after navigated total knee replacement