Validation of the German Diabetes Risk Score within a population-based representative cohort.

PubMed

Hartwig, S; Kuss, O; Tiller, D; Greiser, K H; Schulze, M B; Dierkes, J; Werdan, K; Haerting, J; Kluttig, A

2013-09-01

To validate the German Diabetes Risk Score within the population-based cohort of the Cardiovascular Disease - Living and Ageing in Halle (CARLA) study. The sample included 582 women and 719 men, aged 45-83 years, who did not have diabetes at baseline. The individual risk of every participant was calculated using the German Diabetes Risk Score, which was modified for 4 years of follow-up. Predicted probabilities and observed outcomes were compared using Hosmer-Lemeshow goodness-of-fit tests and receiver-operator characteristic analyses. Changes in prediction power were investigated by expanding the German Diabetes Risk Score to include metabolic variables and by subgroup analyses. We found 58 cases of incident diabetes. The median 4-year probability of developing diabetes based on the German Diabetes Risk Score was 6.5%. The observed and predicted probabilities of developing diabetes were similar, although estimation was imprecise owing to the small number of cases, and the Hosmer-Lemeshow test returned a poor correlation (chi-squared = 55.3; P = 5.8*10⁻¹²). The area under the receiver-operator characteristic curve (AUC) was 0.70 (95% CI 0.64-0.77), and after excluding participants ≥66 years old, the AUC increased to 0.77 (95% CI 0.70-0.84). Consideration of glycaemic diagnostic variables, in addition to self-reported diabetes, reduced the AUC to 0.65 (95% CI 0.58-0.71). A new model that included the German Diabetes Risk Score and blood glucose concentration (AUC 0.81; 95% CI 0.76-0.86) or HbA(1c) concentration (AUC 0.84; 95% CI 0.80-0.91) was found to peform better. Application of the German Diabetes Risk Score in the CARLA cohort did not reproduce the findings in the European Prospective Investigation into Cancer and Nutrition (EPIC) Potsdam study, which may be explained by cohort differences and model overfit in the latter; however, a high score does provide an indication of increased risk of diabetes. © 2013 The Authors. Diabetic Medicine © 2013 Diabetes

Predicting dementia risk in primary care: development and validation of the Dementia Risk Score using routinely collected data.

PubMed

Walters, K; Hardoon, S; Petersen, I; Iliffe, S; Omar, R Z; Nazareth, I; Rait, G

2016-01-21

Existing dementia risk scores require collection of additional data from patients, limiting their use in practice. Routinely collected healthcare data have the potential to assess dementia risk without the need to collect further information. Our objective was to develop and validate a 5-year dementia risk score derived from primary healthcare data. We used data from general practices in The Health Improvement Network (THIN) database from across the UK, randomly selecting 377 practices for a development cohort and identifying 930,395 patients aged 60-95 years without a recording of dementia, cognitive impairment or memory symptoms at baseline. We developed risk algorithm models for two age groups (60-79 and 80-95 years). An external validation was conducted by validating the model on a separate cohort of 264,224 patients from 95 randomly chosen THIN practices that did not contribute to the development cohort. Our main outcome was 5-year risk of first recorded dementia diagnosis. Potential predictors included sociodemographic, cardiovascular, lifestyle and mental health variables. Dementia incidence was 1.88 (95% CI, 1.83-1.93) and 16.53 (95% CI, 16.15-16.92) per 1000 PYAR for those aged 60-79 (n = 6017) and 80-95 years (n = 7104), respectively. Predictors for those aged 60-79 included age, sex, social deprivation, smoking, BMI, heavy alcohol use, anti-hypertensive drugs, diabetes, stroke/TIA, atrial fibrillation, aspirin, depression. The discrimination and calibration of the risk algorithm were good for the 60-79 years model; D statistic 2.03 (95% CI, 1.95-2.11), C index 0.84 (95% CI, 0.81-0.87), and calibration slope 0.98 (95% CI, 0.93-1.02). The algorithm had a high negative predictive value, but lower positive predictive value at most risk thresholds. Discrimination and calibration were poor for the 80-95 years model. Routinely collected data predicts 5-year risk of recorded diagnosis of dementia for those aged 60-79, but not those aged 80+. This

Risk score for first-screening of prevalent undiagnosed chronic kidney disease in Peru: the CRONICAS-CKD risk score.

PubMed

Carrillo-Larco, Rodrigo M; Miranda, J Jaime; Gilman, Robert H; Medina-Lezama, Josefina; Chirinos-Pacheco, Julio A; Muñoz-Retamozo, Paola V; Smeeth, Liam; Checkley, William; Bernabe-Ortiz, Antonio

2017-11-29

Chronic Kidney Disease (CKD) represents a great burden for the patient and the health system, particularly if diagnosed at late stages. Consequently, tools to identify patients at high risk of having CKD are needed, particularly in limited-resources settings where laboratory facilities are scarce. This study aimed to develop a risk score for prevalent undiagnosed CKD using data from four settings in Peru: a complete risk score including all associated risk factors and another excluding laboratory-based variables. Cross-sectional study. We used two population-based studies: one for developing and internal validation (CRONICAS), and another (PREVENCION) for external validation. Risk factors included clinical- and laboratory-based variables, among others: sex, age, hypertension and obesity; and lipid profile, anemia and glucose metabolism. The outcome was undiagnosed CKD: eGFR < 60 ml/min/1.73m 2 . We tested the performance of the risk scores using the area under the receiver operating characteristic (ROC) curve, sensitivity, specificity, positive/negative predictive values and positive/negative likelihood ratios. Participants in both studies averaged 57.7 years old, and over 50% were females. Age, hypertension and anemia were strongly associated with undiagnosed CKD. In the external validation, at a cut-off point of 2, the complete and laboratory-free risk scores performed similarly well with a ROC area of 76.2% and 76.0%, respectively (P = 0.784). The best assessment parameter of these risk scores was their negative predictive value: 99.1% and 99.0% for the complete and laboratory-free, respectively. The developed risk scores showed a moderate performance as a screening test. People with a score of ≥ 2 points should undergo further testing to rule out CKD. Using the laboratory-free risk score is a practical approach in developing countries where laboratories are not readily available and undiagnosed CKD has significant morbidity and mortality.

Risk scores for outcome in bacterial meningitis: Systematic review and external validation study.

PubMed

Bijlsma, Merijn W; Brouwer, Matthijs C; Bossuyt, Patrick M; Heymans, Martijn W; van der Ende, Arie; Tanck, Michael W T; van de Beek, Diederik

2016-11-01

To perform an external validation study of risk scores, identified through a systematic review, predicting outcome in community-acquired bacterial meningitis. MEDLINE and EMBASE were searched for articles published between January 1960 and August 2014. Performance was evaluated in 2108 episodes of adult community-acquired bacterial meningitis from two nationwide prospective cohort studies by the area under the receiver operating characteristic curve (AUC), the calibration curve, calibration slope or Hosmer-Lemeshow test, and the distribution of calculated risks. Nine risk scores were identified predicting death, neurological deficit or death, or unfavorable outcome at discharge in bacterial meningitis, pneumococcal meningitis and invasive meningococcal disease. Most studies had shortcomings in design, analyses, and reporting. Evaluation showed AUCs of 0.59 (0.57-0.61) and 0.74 (0.71-0.76) in bacterial meningitis, 0.67 (0.64-0.70) in pneumococcal meningitis, and 0.81 (0.73-0.90), 0.82 (0.74-0.91), 0.84 (0.75-0.93), 0.84 (0.76-0.93), 0.85 (0.75-0.95), and 0.90 (0.83-0.98) in meningococcal meningitis. Calibration curves showed adequate agreement between predicted and observed outcomes for four scores, but statistical tests indicated poor calibration of all risk scores. One score could be recommended for the interpretation and design of bacterial meningitis studies. None of the existing scores performed well enough to recommend routine use in individual patient management. Copyright © 2016 The British Infection Association. Published by Elsevier Ltd. All rights reserved.

Derivation and validation of a novel risk score for safe discharge after acute lower gastrointestinal bleeding: a modelling study.

PubMed

Oakland, Kathryn; Jairath, Vipul; Uberoi, Raman; Guy, Richard; Ayaru, Lakshmana; Mortensen, Neil; Murphy, Mike F; Collins, Gary S

2017-09-01

Acute lower gastrointestinal bleeding is a common reason for emergency hospital admission, and identification of patients at low risk of harm, who are therefore suitable for outpatient investigation, is a clinical and research priority. We aimed to develop and externally validate a simple risk score to identify patients with lower gastrointestinal bleeding who could safely avoid hospital admission. We undertook model development with data from the National Comparative Audit of Lower Gastrointestinal Bleeding from 143 hospitals in the UK in 2015. Multivariable logistic regression modelling was used to identify predictors of safe discharge, defined as the absence of rebleeding, blood transfusion, therapeutic intervention, 28 day readmission, or death. The model was converted into a simplified risk scoring system and was externally validated in 288 patients admitted with lower gastrointestinal bleeding (184 safely discharged) from two UK hospitals (Charing Cross Hospital, London, and Hammersmith Hospital, London) that had not contributed data to the development cohort. We calculated C statistics for the new model and did a comparative assessment with six previously developed risk scores. Of 2336 prospectively identified admissions in the development cohort, 1599 (68%) were safely discharged. Age, sex, previous admission for lower gastrointestinal bleeding, rectal examination findings, heart rate, systolic blood pressure, and haemoglobin concentration strongly discriminated safe discharge in the development cohort (C statistic 0·84, 95% CI 0·82-0·86) and in the validation cohort (0·79, 0·73-0·84). Calibration plots showed the new risk score to have good calibration in the validation cohort. The score was better than the Rockall, Blatchford, Strate, BLEED, AIMS65, and NOBLADS scores in predicting safe discharge. A score of 8 or less predicts a 95% probability of safe discharge. We developed and validated a novel clinical prediction model with good discriminative

Validating a Prognostic Scoring System for Postmastectomy Locoregional Recurrence in Breast Cancer

DOE Office of Scientific and Technical Information (OSTI.GOV)

Cheng, Skye Hung-Chun, E-mail: skye@kfsyscc.org; Clinical Research Office, Koo Foundation Sun Yat-Sen Cancer Center, Taipei, Taiwan; Department of Radiation Oncology, Duke University Medical Center, Durham, North Carolina

2013-03-15

Purpose: This study is designed to validate a previously developed locoregional recurrence risk (LRR) scoring system and further define which groups of patients with breast cancer would benefit from postmastectomy radiation therapy (PMRT). Methods and Materials: An LRR risk scoring system was developed previously at our institution using breast cancer patients initially treated with modified radical mastectomy between 1990 and 2001. The LRR score comprised 4 factors: patient age, lymphovascular invasion, estrogen receptor negativity, and number of involved lymph nodes. We sought to validate the original study by examining a new dataset of 1545 patients treated between 2002 and 2007. Results:more » The 1545 patients were scored according to the previously developed criteria: 920 (59.6%) were low risk (score 0-1), 493 (31.9%) intermediate risk (score 2-3), and 132 (8.5%) were high risk (score ≥4). The 5-year locoregional control rates with and without PMRT in low-risk, intermediate-risk, and high-risk groups were 98% versus 97% (P=.41), 97% versus 91% (P=.0005), and 89% versus 50% (P=.0002) respectively. Conclusions: This analysis of an additional 1545 patients treated between 2002 and 2007 validates our previously reported LRR scoring system and suggests appropriate patients for whom PMRT will be beneficial. Independent validation of this scoring system by other institutions is recommended.« less

Validation of a new mortality risk prediction model for people 65 years and older in northwest Russia: The Crystal risk score.

PubMed

Turusheva, Anna; Frolova, Elena; Bert, Vaes; Hegendoerfer, Eralda; Degryse, Jean-Marie

2017-07-01

Prediction models help to make decisions about further management in clinical practice. This study aims to develop a mortality risk score based on previously identified risk predictors and to perform internal and external validations. In a population-based prospective cohort study of 611 community-dwelling individuals aged 65+ in St. Petersburg (Russia), all-cause mortality risks over 2.5 years follow-up were determined based on the results obtained from anthropometry, medical history, physical performance tests, spirometry and laboratory tests. C-statistic, risk reclassification analysis, integrated discrimination improvement analysis, decision curves analysis, internal validation and external validation were performed. Older adults were at higher risk for mortality [HR (95%CI)=4.54 (3.73-5.52)] when two or more of the following components were present: poor physical performance, low muscle mass, poor lung function, and anemia. If anemia was combined with high C-reactive protein (CRP) and high B-type natriuretic peptide (BNP) was added the HR (95%CI) was slightly higher (5.81 (4.73-7.14)) even after adjusting for age, sex and comorbidities. Our models were validated in an external population of adults 80+. The extended model had a better predictive capacity for cardiovascular mortality [HR (95%CI)=5.05 (2.23-11.44)] compared to the baseline model [HR (95%CI)=2.17 (1.18-4.00)] in the external population. We developed and validated a new risk prediction score that may be used to identify older adults at higher risk for mortality in Russia. Additional studies need to determine which targeted interventions improve the outcomes of these at-risk individuals. Copyright © 2017 Elsevier B.V. All rights reserved.

Development and validation of the ORACLE score to predict risk of osteoporosis.

PubMed

Richy, Florent; Deceulaer, Fréderic; Ethgen, Olivier; Bruyère, Olivier; Reginster, Jean-Yves

2004-11-01

To develop and validate a composite index, the Osteoporosis Risk Assessment by Composite Linear Estimate (ORACLE), that includes risk factors and ultrasonometric outcomes to screen for osteoporosis. Two cohorts of postmenopausal women aged 45 years and older participated in the development (n = 407) and the validation (n = 202) of ORACLE. Their bone mineral density was determined by dual energy x-ray absorptiometry and quantitative ultrasonometry (QUS), and their historical and clinical risk factors were assessed (January to June 2003). Logistic regression analysis was used to select significant predictors of bone mineral density, whereas receiver operating characteristic (ROC) analysis was used to assess the discriminatory performance of ORACLE. The final logistic regression model retained 4 biometric or historical variables and 1 ultrasonometric outcome. The ROC areas under the curves (AUCs) for ORACLE were 84% for the prediction of osteoporosis and 78% for low bone mass. A sensitivity of 90% corresponded to a specificity of 50% for identification of women at risk of developing osteoporosis. The corresponding positive and negative predictive values were 86% and 54%, respectively, in the development cohort. In the validation cohort, the AUCs for identification of osteoporosis and low bone mass were 81% and 76% for ORACLE, 69% and 64% for QUS T score, 71% and 68% for QUS ultrasonometric bone profile index, and 76% and 75% for Osteoporosis Self-assessment Tool, respectively. ORACLE had the best discriminatory performance in identifying osteoporosis compared with the other approaches (P < .05). ORACLE exhibited the highest discriminatory properties compared with ultrasonography alone or other previously validated risk indices. It may be helpful to enhance the predictive value of QUS.

A Risk Score for Predicting Multiple Sclerosis.

PubMed

Dobson, Ruth; Ramagopalan, Sreeram; Topping, Joanne; Smith, Paul; Solanky, Bhavana; Schmierer, Klaus; Chard, Declan; Giovannoni, Gavin

2016-01-01

Multiple sclerosis (MS) develops as a result of environmental influences on the genetically susceptible. Siblings of people with MS have an increased risk of both MS and demonstrating asymptomatic changes in keeping with MS. We set out to develop an MS risk score integrating both genetic and environmental risk factors. We used this score to identify siblings at extremes of MS risk and attempted to validate the score using brain MRI. 78 probands with MS, 121 of their unaffected siblings and 103 healthy controls were studied. Personal history was taken, and serological and genetic analysis using the illumina immunochip was performed. Odds ratios for MS associated with each risk factor were derived from existing literature, and the log values of the odds ratios from each of the risk factors were combined in an additive model to provide an overall score. Scores were initially calculated using log odds ratio from the HLA-DRB1*1501 allele only, secondly using data from all MS-associated SNPs identified in the 2011 GWAS. Subjects with extreme risk scores underwent validation studies. MRI was performed on selected individuals. There was a significant difference in the both risk scores between people with MS, their unaffected siblings and healthy controls (p<0.0005). Unaffected siblings had a risk score intermediate to people with MS and controls (p<0.0005). The best performing risk score generated an AUC of 0.82 (95%CI 0.75-0.88). The risk score demonstrates an AUC on the threshold for clinical utility. Our score enables the identification of a high-risk sibling group to inform pre-symptomatic longitudinal studies.

Development and validation of a melanoma risk score based on pooled data from 16 case-control studies

PubMed Central

Davies, John R; Chang, Yu-mei; Bishop, D Timothy; Armstrong, Bruce K; Bataille, Veronique; Bergman, Wilma; Berwick, Marianne; Bracci, Paige M; Elwood, J Mark; Ernstoff, Marc S; Green, Adele; Gruis, Nelleke A; Holly, Elizabeth A; Ingvar, Christian; Kanetsky, Peter A; Karagas, Margaret R; Lee, Tim K; Le Marchand, Loïc; Mackie, Rona M; Olsson, Håkan; Østerlind, Anne; Rebbeck, Timothy R; Reich, Kristian; Sasieni, Peter; Siskind, Victor; Swerdlow, Anthony J; Titus, Linda; Zens, Michael S; Ziegler, Andreas; Gallagher, Richard P.; Barrett, Jennifer H; Newton-Bishop, Julia

2015-01-01

Background We report the development of a cutaneous melanoma risk algorithm based upon 7 factors; hair colour, skin type, family history, freckling, nevus count, number of large nevi and history of sunburn, intended to form the basis of a self-assessment webtool for the general public. Methods Predicted odds of melanoma were estimated by analysing a pooled dataset from 16 case-control studies using logistic random coefficients models. Risk categories were defined based on the distribution of the predicted odds in the controls from these studies. Imputation was used to estimate missing data in the pooled datasets. The 30th, 60th and 90th centiles were used to distribute individuals into four risk groups for their age, sex and geographic location. Cross-validation was used to test the robustness of the thresholds for each group by leaving out each study one by one. Performance of the model was assessed in an independent UK case-control study dataset. Results Cross-validation confirmed the robustness of the threshold estimates. Cases and controls were well discriminated in the independent dataset (area under the curve 0.75, 95% CI 0.73-0.78). 29% of cases were in the highest risk group compared with 7% of controls, and 43% of controls were in the lowest risk group compared with 13% of cases. Conclusion We have identified a composite score representing an estimate of relative risk and successfully validated this score in an independent dataset. Impact This score may be a useful tool to inform members of the public about their melanoma risk. PMID:25713022

A biomarker-based risk score to predict death in patients with atrial fibrillation: the ABC (age, biomarkers, clinical history) death risk score

PubMed Central

Hijazi, Ziad; Oldgren, Jonas; Lindbäck, Johan; Alexander, John H; Connolly, Stuart J; Eikelboom, John W; Ezekowitz, Michael D; Held, Claes; Hylek, Elaine M; Lopes, Renato D; Yusuf, Salim; Granger, Christopher B; Siegbahn, Agneta; Wallentin, Lars

2018-01-01

Abstract Aims In atrial fibrillation (AF), mortality remains high despite effective anticoagulation. A model predicting the risk of death in these patients is currently not available. We developed and validated a risk score for death in anticoagulated patients with AF including both clinical information and biomarkers. Methods and results The new risk score was developed and internally validated in 14 611 patients with AF randomized to apixaban vs. warfarin for a median of 1.9 years. External validation was performed in 8548 patients with AF randomized to dabigatran vs. warfarin for 2.0 years. Biomarker samples were obtained at study entry. Variables significantly contributing to the prediction of all-cause mortality were assessed by Cox-regression. Each variable obtained a weight proportional to the model coefficients. There were 1047 all-cause deaths in the derivation and 594 in the validation cohort. The most important predictors of death were N-terminal pro B-type natriuretic peptide, troponin-T, growth differentiation factor-15, age, and heart failure, and these were included in the ABC (Age, Biomarkers, Clinical history)-death risk score. The score was well-calibrated and yielded higher c-indices than a model based on all clinical variables in both the derivation (0.74 vs. 0.68) and validation cohorts (0.74 vs. 0.67). The reduction in mortality with apixaban was most pronounced in patients with a high ABC-death score. Conclusion A new biomarker-based score for predicting risk of death in anticoagulated AF patients was developed, internally and externally validated, and well-calibrated in two large cohorts. The ABC-death risk score performed well and may contribute to overall risk assessment in AF. ClinicalTrials.gov identifier NCT00412984 and NCT00262600 PMID:29069359

Rheumatoid arthritis-specific cardiovascular risk scores are not superior to general risk scores: a validation analysis of patients from seven countries.

PubMed

Crowson, Cynthia S; Gabriel, Sherine E; Semb, Anne Grete; van Riel, Piet L C M; Karpouzas, George; Dessein, Patrick H; Hitchon, Carol; Pascual-Ramos, Virginia; Kitas, George D

2017-07-01

Cardiovascular disease (CVD) risk calculators developed for the general population do not accurately predict CVD events in patients with RA. We sought to externally validate risk calculators recommended for use in patients with RA including the EULAR 1.5 multiplier, the Expanded Cardiovascular Risk Prediction Score for RA (ERS-RA) and QRISK2. Seven RA cohorts from UK, Norway, Netherlands, USA, South Africa, Canada and Mexico were combined. Data on baseline CVD risk factors, RA characteristics and CVD outcomes (including myocardial infarction, ischaemic stroke and cardiovascular death) were collected using standardized definitions. Performance of QRISK2, EULAR multiplier and ERS-RA was compared with other risk calculators [American College of Cardiology/American Heart Association (ACC/AHA), Framingham Adult Treatment Panel III Framingham risk score-Adult Treatment Panel (FRS-ATP) and Reynolds Risk Score] using c-statistics and net reclassification index. Among 1796 RA patients without prior CVD [mean ( s . d .) age: 54.0 (14.0) years, 74% female], 100 developed CVD events during a mean follow-up of 6.9 years (12430 person-years). Estimated CVD risk by ERS-RA [mean ( s . d .) 8.8% (9.8%)] was comparable to FRS-ATP [mean ( s . d .) 9.1% (8.3%)] and Reynolds [mean ( s . d .) 9.2% (12.2%)], but lower than ACC/AHA [mean ( s . d .) 9.8% (12.1%)]. QRISK2 substantially overestimated risk [mean ( s . d .) 15.5% (13.9%)]. Discrimination was not improved for ERS-RA (c-statistic = 0.69), QRISK2 or EULAR multiplier applied to ACC/AHA compared with ACC/AHA (c-statistic = 0.72 for all) or for FRS-ATP (c-statistic = 0.75). The net reclassification index for ERS-RA was low (-0.8% vs ACC/AHA and 2.3% vs FRS-ATP). The QRISK2, EULAR multiplier and ERS-RA algorithms did not predict CVD risk more accurately in patients with RA than CVD risk calculators developed for the general population. © The Author 2017. Published by Oxford University Press on behalf of the British Society for

A scoring system for ascertainment of incident stroke; the Risk Index Score (RISc).

PubMed

Kass-Hout, T A; Moyé, L A; Smith, M A; Morgenstern, L B

2006-01-01

The main objective of this study was to develop and validate a computer-based statistical algorithm that could be translated into a simple scoring system in order to ascertain incident stroke cases using hospital admission medical records data. The Risk Index Score (RISc) algorithm was developed using data collected prospectively by the Brain Attack Surveillance in Corpus Christi (BASIC) project, 2000. The validity of RISc was evaluated by estimating the concordance of scoring system stroke ascertainment to stroke ascertainment by physician and/or abstractor review of hospital admission records. RISc was developed on 1718 randomly selected patients (training set) and then statistically validated on an independent sample of 858 patients (validation set). A multivariable logistic model was used to develop RISc and subsequently evaluated by goodness-of-fit and receiver operating characteristic (ROC) analyses. The higher the value of RISc, the higher the patient's risk of potential stroke. The study showed RISc was well calibrated and discriminated those who had potential stroke from those that did not on initial screening. In this study we developed and validated a rapid, easy, efficient, and accurate method to ascertain incident stroke cases from routine hospital admission records for epidemiologic investigations. Validation of this scoring system was achieved statistically; however, clinical validation in a community hospital setting is warranted.

Risk assessment and risk scores in the management of aortic aneurysms.

PubMed

Von Meijenfeldt, Gerdine C I; Van Der Laan, Maarten J; Zeebregts, Clark J; Balm, Ron; Verhagen, Hence J M

2016-04-01

The decision whether to operate a patient or not can be challenging for a clinician for both ruptured abdominal aortic aneurysms (AAAs) as well as elective AAAs. Prior to surgical intervention it would be preferable that the clinician exactly knows which clinical variables lower or increase the chances of morbidity and mortality postintervention. To help in the preoperative counselling and shared decision making several clinical variables can be identified as risk factors and with these, risk models can be developed. An ideal risk score for aneurysm repair includes routinely obtained physiological and anatomical variables, has excellent discrimination and calibration, and is validated in different geographical areas. For elective AAA repair, several risk scores are available, for ruptured AAA treatment, these scores are far less well developed. In this manuscript, we describe the designs and results of published risk scores for elective and open repair. Also, suggestions for uniformly reporting of risk factors and their statistical analyses are described. Furthermore, the preliminary results of a new risk model for ruptured aortic aneurysm will be discussed. This score identifies age, hemoglobin, cardiopulmonary resuscitation and preoperative systolic blood pressure as risk factors after multivariate regression analysis. This new risk score can help to identify patients that would not benefit from repair, but it can also potentially identify patients who would benefit and therefore lower turndown rates. The challenge for further research is to expand on validation of already existing promising risk scores in order to come to a risk model with optimal discrimination and calibration.

Validation of the Mayo Hip Score: construct validity, reliability and responsiveness to change.

PubMed

Singh, Jasvinder A; Schleck, Cathy; Harmsen, W Scott; Lewallen, David G

2016-01-19

Previous studies have provided the initial evidence for construct validity and test-retest reliability of the Mayo Hip Score. Instruments used for Total Hip Arthroplasty (THA) outcomes assessment should be valid, reliable and responsive to change. Our main objective was to examine the responsiveness to change, association with subsequent revision and the construct validity of the Mayo hip score. Discriminant ability was assessed by calculating effect size (ES), standardized response mean (SRM) and Guyatt's responsiveness index (GRI). Minimal clinically important difference (MCII) and moderate improvement thresholds were calculated. We assessed construct validity by examining association of scores with preoperative patient characteristics and correlation with Harris hip score, and assessed association of scores with the risk of subsequent revision. Five thousand three hundred seven provided baseline data; of those with baseline data, 2,278 and 2,089 (39%) provided 2- and 5-year data, respectively. Large ES, SRM and GRI ranging 2.66-2.78, 2.42-2.61 and 1.67-1.88 were noted for Mayo hip scores with THA, respectively. The MCII and moderate improvement thresholds were 22.4-22.7 and 39.4-40.5 respectively. Hazard ratios of revision surgery were higher with lower final score or less improvement in Mayo hip score at 2-years and borderline significant/non-significant at 5-years, respectively: (1) score ≤55 with hazard ratios of 2.24 (95% CI, 1.45, 3.46; p = 0.0003) and 1.70 (95% CI, 1.00, 2.92; p = 0.05) of implant revision subsequently, compared to 72-80 points; (2) no improvement or worsening score with hazard ratios 3.94 (95% CI, 1.50, 10.30; p = 0.005) and 2.72 (95% CI, 0.85,8.70; p = 0.09), compared to improvement >50-points. Mayo hip score had significant positive correlation with younger age, male gender, lower BMI, lower ASA class and lower Deyo-Charlson index (p ≤ 0.003 for each) and with Harris hip scores (p < 0.001). Mayo Hip Score is

Post-bronchoscopy pneumonia in patients suffering from lung cancer: Development and validation of a risk prediction score.

PubMed

Takiguchi, Hiroto; Hayama, Naoki; Oguma, Tsuyoshi; Harada, Kazuki; Sato, Masako; Horio, Yukihiro; Tanaka, Jun; Tomomatsu, Hiromi; Tomomatsu, Katsuyoshi; Takihara, Takahisa; Niimi, Kyoko; Nakagawa, Tomoki; Masuda, Ryota; Aoki, Takuya; Urano, Tetsuya; Iwazaki, Masayuki; Asano, Koichiro

2017-05-01

The incidence, risk factors, and consequences of pneumonia after flexible bronchoscopy in patients with lung cancer have not been studied in detail. We retrospectively analyzed the data from 237 patients with lung cancer who underwent diagnostic bronchoscopy between April 2012 and July 2013 (derivation sample) and 241 patients diagnosed between August 2013 and July 2014 (validation sample) in a tertiary referral hospital in Japan. A score predictive of post-bronchoscopy pneumonia was developed in the derivation sample and tested in the validation sample. Pneumonia developed after bronchoscopy in 6.3% and 4.1% of patients in the derivation and validation samples, respectively. Patients who developed post-bronchoscopy pneumonia needed to change or cancel their planned cancer therapy more frequently than those without pneumonia (56% vs. 6%, p<0.001). Age ≥70 years, current smoking, and central location of the tumor were independent predictors of pneumonia, which we added to develop our predictive score. The incidence of pneumonia associated with scores=0, 1, and ≥2 was 0, 3.7, and 13.4% respectively in the derivation sample (p=0.003), and 0, 2.9, and 9.7% respectively in the validation sample (p=0.016). The incidence of post-bronchoscopy pneumonia in patients with lung cancer was not rare and associated with adverse effects on the clinical course. A simple 3-point predictive score identified patients with lung cancer at high risk of post-bronchoscopy pneumonia prior to the procedure. Copyright © 2017 The Japanese Respiratory Society. Published by Elsevier B.V. All rights reserved.

The UK-PBC risk scores: Derivation and validation of a scoring system for long-term prediction of end-stage liver disease in primary biliary cholangitis.

PubMed

Carbone, Marco; Sharp, Stephen J; Flack, Steve; Paximadas, Dimitrios; Spiess, Kelly; Adgey, Carolyn; Griffiths, Laura; Lim, Reyna; Trembling, Paul; Williamson, Kate; Wareham, Nick J; Aldersley, Mark; Bathgate, Andrew; Burroughs, Andrew K; Heneghan, Michael A; Neuberger, James M; Thorburn, Douglas; Hirschfield, Gideon M; Cordell, Heather J; Alexander, Graeme J; Jones, David E J; Sandford, Richard N; Mells, George F

2016-03-01

The biochemical response to ursodeoxycholic acid (UDCA)--so-called "treatment response"--strongly predicts long-term outcome in primary biliary cholangitis (PBC). Several long-term prognostic models based solely on the treatment response have been developed that are widely used to risk stratify PBC patients and guide their management. However, they do not take other prognostic variables into account, such as the stage of the liver disease. We sought to improve existing long-term prognostic models of PBC using data from the UK-PBC Research Cohort. We performed Cox's proportional hazards regression analysis of diverse explanatory variables in a derivation cohort of 1,916 UDCA-treated participants. We used nonautomatic backward selection to derive the best-fitting Cox model, from which we derived a multivariable fractional polynomial model. We combined linear predictors and baseline survivor functions in equations to score the risk of a liver transplant or liver-related death occurring within 5, 10, or 15 years. We validated these risk scores in an independent cohort of 1,249 UDCA-treated participants. The best-fitting model consisted of the baseline albumin and platelet count, as well as the bilirubin, transaminases, and alkaline phosphatase, after 12 months of UDCA. In the validation cohort, the 5-, 10-, and 15-year risk scores were highly accurate (areas under the curve: >0.90). The prognosis of PBC patients can be accurately evaluated using the UK-PBC risk scores. They may be used to identify high-risk patients for closer monitoring and second-line therapies, as well as low-risk patients who could potentially be followed up in primary care. © 2015 by the American Association for the Study of Liver Diseases.

Update of the German Diabetes Risk Score and external validation in the German MONICA/KORA study.

PubMed

Mühlenbruch, Kristin; Ludwig, Tonia; Jeppesen, Charlotte; Joost, Hans-Georg; Rathmann, Wolfgang; Meisinger, Christine; Peters, Annette; Boeing, Heiner; Thorand, Barbara; Schulze, Matthias B

2014-06-01

Several published diabetes prediction models include information about family history of diabetes. The aim of this study was to extend the previously developed German Diabetes Risk Score (GDRS) with family history of diabetes and to validate the updated GDRS in the Multinational MONItoring of trends and determinants in CArdiovascular Diseases (MONICA)/German Cooperative Health Research in the Region of Augsburg (KORA) study. We used data from the European Prospective Investigation into Cancer and Nutrition (EPIC)-Potsdam study for extending the GDRS, including 21,846 participants. Within 5 years of follow-up 492 participants developed diabetes. The definition of family history included information about the father, the mother and/or sibling/s. Model extension was evaluated by discrimination and reclassification. We updated the calculation of the score and absolute risks. External validation was performed in the MONICA/KORA study comprising 11,940 participants with 315 incident cases after 5 years of follow-up. The basic ROC-AUC of 0.856 (95%-CI: 0.842-0.870) was improved by 0.007 (0.003-0.011) when parent and sibling history was included in the GDRS. The net reclassification improvement was 0.110 (0.072-0.149), respectively. For the updated score we demonstrated good calibration across all tenths of risk. In MONICA/KORA, the ROC-AUC was 0.837 (0.819-0.855); regarding calibration we saw slight overestimation of absolute risks. Inclusion of the number of diabetes-affected parents and sibling history improved the prediction of type 2 diabetes. Therefore, we updated the GDRS algorithm accordingly. Validation in another German cohort study showed good discrimination and acceptable calibration for the vast majority of individuals. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

The performance of seven QPrediction risk scores in an independent external sample of patients from general practice: a validation study

PubMed Central

Hippisley-Cox, Julia; Coupland, Carol; Brindle, Peter

2014-01-01

Objectives To validate the performance of a set of risk prediction algorithms developed using the QResearch database, in an independent sample from general practices contributing to the Clinical Research Data Link (CPRD). Setting Prospective open cohort study using practices contributing to the CPRD database and practices contributing to the QResearch database. Participants The CPRD validation cohort consisted of 3.3 million patients, aged 25–99 years registered at 357 general practices between 1 Jan 1998 and 31 July 2012. The validation statistics for QResearch were obtained from the original published papers which used a one-third sample of practices separate to those used to derive the score. A cohort from QResearch was used to compare incidence rates and baseline characteristics and consisted of 6.8 million patients from 753 practices registered between 1 Jan 1998 and until 31 July 2013. Outcome measures Incident events relating to seven different risk prediction scores: QRISK2 (cardiovascular disease); QStroke (ischaemic stroke); QDiabetes (type 2 diabetes); QFracture (osteoporotic fracture and hip fracture); QKidney (moderate and severe kidney failure); QThrombosis (venous thromboembolism); QBleed (intracranial bleed and upper gastrointestinal haemorrhage). Measures of discrimination and calibration were calculated. Results Overall, the baseline characteristics of the CPRD and QResearch cohorts were similar though QResearch had higher recording levels for ethnicity and family history. The validation statistics for each of the risk prediction scores were very similar in the CPRD cohort compared with the published results from QResearch validation cohorts. For example, in women, the QDiabetes algorithm explained 50% of the variation within CPRD compared with 51% on QResearch and the receiver operator curve value was 0.85 on both databases. The scores were well calibrated in CPRD. Conclusions Each of the algorithms performed practically as well in the

Validation of the EBMT risk score in chronic myeloid leukemia in Brazil and allogeneic transplant outcome.

PubMed

De Souza, Carmino Antonio; Vigorito, Afonso Celso; Ruiz, Milton Artur; Nucci, Márcio; Dulley, Frederico Luiz; Funcke, Vaneusa; Tabak, Daniel; Azevedo, Alexandre Mello; Byington, Rita; Macedo, Maria Cristina; Saboya, Rosaura; Penteado Aranha, Francisco José; Oliveira, Gislaine Barbosa; Zulli, Roberto; Martins Miranda, Eliana Cristina; Azevedo, Wellington Moraes; Lodi, Fernanda Maria; Voltarelli, Júlio Cesar; Simões, Belinda Pinto; Colturato, Vergílio; De Souza, Mair Pedro; Silla, Lúcia; Bittencourt, Henrique; Piron-Ruiz, Lilian; Maiolino, Angelo; Gratwohl, Alois; Pasquini, Ricardo

2005-02-01

The management of chronic myeloid leukemia (CML) has changed radically since the introduction of imatinib therapy. The decision of whether to offer a patient a hematopoietic stem cell transplant (HSCT) must be based on the probability of success of the procedure. The aim of this retrospective analysis of 1,084 CML patients who received an allogeneic HSCT in 10 Brazilian Centers between February 1983 and March 2003 was to validate the EBMT risk score. The study population comprised 647 (60%) males and 437 (40%) females, with a median age of 32 years old (range 1 - 59); 898 (83%) were in chronic phase, 146 (13%) were in accelerated phase and 40 (4%) were in blast crisis; 151 (14%) were younger than 20 years old, 620 (57%) were between 20 and 40 and 313 (29%) were older than 40; 1,025 (94%) received an HLA fully matched sibling transplant and only 59 (6%) received an unrelated transplant. In 283 cases (26%) a male recipient received a graft from a female donor. The interval from diagnosis to transplantation was less than 12 months in 223 (21%) cases and greater in 861 (79%). The overall survival, disease-free survival, transplant-related mortality and relapse incidence were 49%, 50%, 45% and 25%, respectively. Of the 1084 patients, 179 (17%) had a risk score of 0 or 1, 397 (37%) had a score of 2, 345 (32%) had a score of 3, 135 (12%) had a score of 4 and 28 (2%) a score of 5 or 6. The overall survival (OS) rate in patients with risk scores 0-1 and 2 was similar (58% and 55%, respectively) but significantly better than that in patients with scores 3 or more (score 3 - 44%, 4 - 36 % and 5-6 - 27%, respectively) pp<0.001). Disease-free survival (DFS) and transplant related mortality (TRM) in a patients with a score of 3 or more were 46% and 49%, respectively and the relapse rate beyond score 5-6 was 77%. Disease status had a negative impact on all outcomes (OS, DFS, TRM, and relapse). The OS rate for male recipients of a graft from a female donor was 40% compared to 52

Clinical risk scoring for predicting non-alcoholic fatty liver disease in metabolic syndrome patients (NAFLD-MS score).

PubMed

Saokaew, Surasak; Kanchanasuwan, Shada; Apisarnthanarak, Piyaporn; Charoensak, Aphinya; Charatcharoenwitthaya, Phunchai; Phisalprapa, Pochamana; Chaiyakunapruk, Nathorn

2017-10-01

Non-alcoholic fatty liver disease (NAFLD) can progress from simple steatosis to hepatocellular carcinoma. None of tools have been developed specifically for high-risk patients. This study aimed to develop a simple risk scoring to predict NAFLD in patients with metabolic syndrome (MetS). A total of 509 patients with MetS were recruited. All were diagnosed by clinicians with ultrasonography-confirmed whether they were patients with NAFLD. Patients were randomly divided into derivation (n=400) and validation (n=109) cohort. To develop the risk score, clinical risk indicators measured at the time of recruitment were built by logistic regression. Regression coefficients were transformed into item scores and added up to a total score. A risk scoring scheme was developed from clinical predictors: BMI ≥25, AST/ALT ≥1, ALT ≥40, type 2 diabetes mellitus and central obesity. The scoring scheme was applied in validation cohort to test the performance. The scheme explained, by area under the receiver operating characteristic curve (AuROC), 76.8% of being NAFLD with good calibration (Hosmer-Lemeshow χ 2 =4.35; P=.629). The positive likelihood ratio of NAFLD in patients with low risk (scores below 3) and high risk (scores 5 and over) were 2.32 (95% CI: 1.90-2.82) and 7.77 (95% CI: 2.47-24.47) respectively. When applied in validation cohort, the score showed good performance with AuROC 76.7%, and illustrated 84%, and 100% certainty in low- and high-risk groups respectively. A simple and non-invasive scoring scheme of five predictors provides good prediction indices for NAFLD in MetS patients. This scheme may help clinicians in order to take further appropriate action. © 2017 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

External Validity of a Risk Stratification Score Predicting Early Distant Brain Failure and Salvage Whole Brain Radiation Therapy After Stereotactic Radiosurgery for Brain Metastases.

PubMed

Press, Robert H; Boselli, Danielle M; Symanowski, James T; Lankford, Scott P; McCammon, Robert J; Moeller, Benjamin J; Heinzerling, John H; Fasola, Carolina E; Burri, Stuart H; Patel, Kirtesh R; Asher, Anthony L; Sumrall, Ashley L; Curran, Walter J; Shu, Hui-Kuo G; Crocker, Ian R; Prabhu, Roshan S

2017-07-01

A scoring system using pretreatment factors was recently published for predicting the risk of early (≤6 months) distant brain failure (DBF) and salvage whole brain radiation therapy (WBRT) after stereotactic radiosurgery (SRS) alone. Four risk factors were identified: (1) lack of prior WBRT; (2) melanoma or breast histologic features; (3) multiple brain metastases; and (4) total volume of brain metastases <1.3 cm 3 , with each factor assigned 1 point. The purpose of this study was to assess the validity of this scoring system and its appropriateness for clinical use in an independent external patient population. We reviewed the records of 247 patients with 388 brain metastases treated with SRS between 2010 at 2013 at Levine Cancer Institute. The Press (Emory) risk score was calculated and applied to the validation cohort population, and subsequent risk groups were analyzed using cumulative incidence. The low-risk (LR) group had a significantly lower risk of early DBF than did the high-risk (HR) group (22.6% vs 44%, P=.004), but there was no difference between the HR and intermediate-risk (IR) groups (41.2% vs 44%, P=.79). Total lesion volume <1.3 cm 3  (P=.004), malignant melanoma (P=.007), and multiple metastases (P<.001) were validated as predictors for early DBF. Prior WBRT and breast cancer histologic features did not retain prognostic significance. Risk stratification for risk of early salvage WBRT were similar, with a trend toward an increased risk for HR compared with LR (P=.09) but no difference between IR and HR (P=.53). The 3-level Emory risk score was shown to not be externally valid, but the model was able to stratify between 2 levels (LR and not-LR [combined IR and HR]) for early (≤6 months) DBF. These results reinforce the importance of validating predictive models in independent cohorts. Further refinement of this scoring system with molecular information and in additional contemporary patient populations is warranted. Copyright © 2017

Development and Validation of a Simple Risk Score for Undiagnosed Type 2 Diabetes in a Resource-Constrained Setting

PubMed Central

Gilman, Robert H.; Sanchez-Abanto, Jose R.; Study Group, CRONICAS Cohort

2016-01-01

Objective. To develop and validate a risk score for detecting cases of undiagnosed diabetes in a resource-constrained country. Methods. Two population-based studies in Peruvian population aged ≥35 years were used in the analysis: the ENINBSC survey (n = 2,472) and the CRONICAS Cohort Study (n = 2,945). Fasting plasma glucose ≥7.0 mmol/L was used to diagnose diabetes in both studies. Coefficients for risk score were derived from the ENINBSC data and then the performance was validated using both baseline and follow-up data of the CRONICAS Cohort Study. Results. The prevalence of undiagnosed diabetes was 2.0% in the ENINBSC survey and 2.9% in the CRONICAS Cohort Study. Predictors of undiagnosed diabetes were age, diabetes in first-degree relatives, and waist circumference. Score values ranged from 0 to 4, with an optimal cutoff ≥2 and had a moderate performance when applied in the CRONICAS baseline data (AUC = 0.68; 95% CI: 0.62–0.73; sensitivity 70%; specificity 59%). When predicting incident cases, the AUC was 0.66 (95% CI: 0.61–0.71), with a sensitivity of 69% and specificity of 59%. Conclusions. A simple nonblood based risk score based on age, diabetes in first-degree relatives, and waist circumference can be used as a simple screening tool for undiagnosed and incident cases of diabetes in Peru. PMID:27689096

Upper gastrointestinal bleeding risk scores: Who, when and why?

PubMed Central

Monteiro, Sara; Gonçalves, Tiago Cúrdia; Magalhães, Joana; Cotter, José

2016-01-01

Upper gastrointestinal bleeding (UGIB) remains a significant cause of hospital admission. In order to stratify patients according to the risk of the complications, such as rebleeding or death, and to predict the need of clinical intervention, several risk scores have been proposed and their use consistently recommended by international guidelines. The use of risk scoring systems in early assessment of patients suffering from UGIB may be useful to distinguish high-risks patients, who may need clinical intervention and hospitalization, from low risk patients with a lower chance of developing complications, in which management as outpatients can be considered. Although several scores have been published and validated for predicting different outcomes, the most frequently cited ones are the Rockall score and the Glasgow Blatchford score (GBS). While Rockall score, which incorporates clinical and endoscopic variables, has been validated to predict mortality, the GBS, which is based on clinical and laboratorial parameters, has been studied to predict the need of clinical intervention. Despite the advantages previously reported, their use in clinical decisions is still limited. This review describes the different risk scores used in the UGIB setting, highlights the most important research, explains why and when their use may be helpful, reflects on the problems that remain unresolved and guides future research with practical impact. PMID:26909231

Validation of risk assessment scoring systems for an audit of elective surgery for gastrointestinal cancer in elderly patients: an audit.

PubMed

Wakabayashi, Hisao; Sano, Takanori; Yachida, Shinichi; Okano, Keiichi; Izuishi, Kunihiko; Suzuki, Yasuyuki

2007-10-01

The goal of this study was to validate the usefulness of risk assessment scoring systems for a surgical audit in elective digestive surgery for elderly patients. The validated scoring systems used were the Physiological and Operative Severity Score for enUmeration of Mortality and morbidity (POSSUM) and the Portsmouth predictor equation for mortality (P-POSSUM). This study involved 153 consecutive patients aged 75 years and older who underwent elective gastric or colorectal surgery between July 2004 and June 2006. A retrospective analysis was performed on data collected prior to each surgery. The predicted mortality and morbidity risks were calculated using each of the scoring systems and were used to obtain the observed/predicted (O/E) mortality and morbidity ratios. New logistic regression equations for morbidity and mortality were then calculated using the scores from the POSSUM system and applied retrospectively. The O/E ratio for morbidity obtained from POSSUM score was 0.23. The O/E ratios for mortality from the POSSUM score and the P-POSSUM were 0.15 and 0.38, respectively. Utilizing the new equations using scores from the POSSUM, the O/E ratio increased to 0.88. Both the POSSUM and P-POSSUM over-predicted the morbidity and mortality in elective gastrointestinal surgery for malignant tumors in elderly patients. However, if a surgical unit makes appropriate calculations using its own patient series and updates these equations, the POSSUM system can be useful in the risk assessment for surgery in elderly patients.

A simple validated method for predicting the risk of hospitalization for worsening of heart failure in ambulatory patients: the Redin-SCORE.

PubMed

Álvarez-García, Jesús; Ferrero-Gregori, Andreu; Puig, Teresa; Vázquez, Rafael; Delgado, Juan; Pascual-Figal, Domingo; Alonso-Pulpón, Luis; González-Juanatey, José R; Rivera, Miguel; Worner, Fernando; Bardají, Alfredo; Cinca, Juan

2015-08-01

Prevention of hospital readmissions is one of the main objectives in the management of patients with heart failure (HF). Most of the models predicting readmissions are based on data extracted from hospitalized patients rather than from outpatients. Our objective was to develop a validated score predicting 1-month and 1-year risk of readmission for worsening of HF in ambulatory patients. A cohort of 2507 ambulatory patients with chronic HF was prospectively followed for a median of 3.3 years. Clinical, echocardiographic, ECG, and biochemical variables were used in a competing risk regression analysis to construct a risk score for readmissions due to worsening of HF. Thereafter, the score was externally validated using a different cohort of 992 patients with chronic HF (MUSIC registry). Predictors of 1-month readmission were the presence of elevated natriuretic peptides, left ventricular (LV) HF signs, and estimated glomerular filtration rate (eGFR) <60 mL/min/m(2) . Predictors of 1-year readmission were elevated natriuretic peptides, anaemia, left atrial size >26 mm/m(2) , heart rate >70 b.p.m., LV HF signs, and eGFR <60 mL/min/m(2) . The C-statistics for the models were 0.72 and 0.66, respectively. The cumulative incidence function distinguished low-risk (<1% event rate) and high-risk groups (>5% event rate) for 1-month HF readmission. Likewise, low-risk (7.8%), intermediate-risk (15.6%) and high-risk groups (26.1%) were identified for 1-year HF readmission risk. The C-statistics remained consistent after the external validation (<5% loss of discrimination). The Redin-SCORE predicts early and late readmission for worsening of HF using proven prognostic variables that are routinely collected in outpatient management of chronic HF. © 2015 The Authors. European Journal of Heart Failure published by John Wiley & Sons Ltd on behalf of European Society of Cardiology.

Validation of the GRACE Risk score for hospital mortality in patients with acute coronary syndrome in the Arab Middle East.

PubMed

Yusufali, Afzalhussein; Zubaid, Mohammad; Al-Zakwani, Ibrahim; Alsheikh-Ali, Alawi A; Al-Mallah, Mouaz H; Al Suwaidi, Jassim; AlMahmeed, Wael; Rashed, Wafa; Sulaiman, Kadhim; Amin, Haitham

2011-07-01

Our objective was to validate the Global Registry of Acute Coronary Events (GRACE) risk score for in-hospital mortality in a Middle Eastern acute coronary syndrome (ACS) population enrolled in the Gulf Registry of Acute Coronary Events (Gulf RACE). Out of 8176, unselected, consecutive patients with ACS, during 6 months in 2006 and 2007 from 63 hospitals in 6 Arab countries in the Middle East Gulf region, 7709 (94.3%) with available data were included. The main outcome measures were discriminatory performance (using C-index) and calibration of the GRACE risk score (in-hospital mortality predicted by GRACE risk score versus the actual mortality). In-hospital mortality in the Gulf RACE was 3.09% (n = 238). The discriminatory performance of the GRACE risk scores in the Gulf RACE was good overall (C-index = 0.86). Observed and predicted risk corresponded well in each stratum of risk of in-hospital mortality. This suggests its suitability for clinical use in this patient population.

US Commercial Air Tour Crashes, 2000–2011: Burden, Fatal Risk Factors, and FIA Score Validation

PubMed Central

Ballard, Sarah-Blythe; Beaty, Leland P.; Baker, Susan P.

2013-01-01

Introduction This study provides new public health data concerning the US commercial air tour industry. Risk factors for fatality in air tour crashes were analyzed to determine the value of the FIA score in predicting fatal outcomes. Methods Using the Federal Aviation Administration’s (FAA) General Aviation and Air Taxi Survey and National Transportation Safety Board data, the incidence of commercial air tour crashes from 2000 through 2010 was calculated. Fatality risk factors for crashes occurring from 2000 through 2011 were analyzed using regression methods. The FIA score, Li and Baker’s fatality risk index, was validated using receiver operating characteristic (ROC) curves. Results The industry-wide commercial air tour crash rate was 2.7 per 100,000 flight hours. The incidence rates of Part 91 and 135 commercial air tour crashes were 3.4 and 2.3 per 100,000 flight hours, respectively (relative risk [RR] 1.5, 95% confidence interval [CI] 1.1–2.1, P=0.015). Of the 152 air tour crashes that occurred from 2000 through 2011, 30 (20%) involved at least one fatality and, on average, 3.5 people died per fatal crash. Fatalities were associated with three major risk factors: fire (Adjusted odds ratio [AOR] 5.1, 95% CI 1.5–16.7, P=0.008), instrument meteorological conditions (AOR 5.4, 95% CI 1.1–26.4, P=0.038), and off-airport location (AOR 7.2, 95% CI 1.6–33.2, P=0.011). The area under the FIA Score’s ROC curve was 0.79 (95% CI 0.71–0.88). Discussion Commercial air tour crash rates were high relative to similar commercial aviation operations. Disparities between Part 91 and 135 air tour crash rates reflect regulatory disparities that require FAA action. The FIA Score appeared to be a valid measurement of fatal risk in air tour crashes. The FIA should prioritize interventions that address the three major risk factors identified by this study. PMID:23631935

Development and validation of an all-cause mortality risk score in type 2 diabetes.

PubMed

Yang, Xilin; So, Wing Yee; Tong, Peter C Y; Ma, Ronald C W; Kong, Alice P S; Lam, Christopher W K; Ho, Chung Shun; Cockram, Clive S; Ko, Gary T C; Chow, Chun-Chung; Wong, Vivian C W; Chan, Juliana C N

2008-03-10

Diabetes reduces life expectancy by 10 to 12 years, but whether death can be predicted in type 2 diabetes mellitus remains uncertain. A prospective cohort of 7583 type 2 diabetic patients enrolled since 1995 were censored on July 30, 2005, or after 6 years of follow-up, whichever came first. A restricted cubic spline model was used to check data linearity and to develop linear-transforming formulas. Data were randomly assigned to a training data set and to a test data set. A Cox model was used to develop risk scores in the test data set. Calibration and discrimination were assessed in the test data set. A total of 619 patients died during a median follow-up period of 5.51 years, resulting in a mortality rate of 18.69 per 1000 person-years. Age, sex, peripheral arterial disease, cancer history, insulin use, blood hemoglobin levels, linear-transformed body mass index, random spot urinary albumin-creatinine ratio, and estimated glomerular filtration rate at enrollment were predictors of all-cause death. A risk score for all-cause mortality was developed using these predictors. The predicted and observed death rates in the test data set were similar (P > .70). The area under the receiver operating characteristic curve was 0.85 for 5 years of follow-up. Using the risk score in ranking cause-specific deaths, the area under the receiver operating characteristic curve was 0.95 for genitourinary death, 0.85 for circulatory death, 0.85 for respiratory death, and 0.71 for neoplasm death. Death in type 2 diabetes mellitus can be predicted using a risk score consisting of commonly measured clinical and biochemical variables. Further validation is needed before clinical use.

Alternative Fistula Risk Score for Pancreatoduodenectomy (a-FRS): Design and International External Validation.

PubMed

Mungroop, Timothy H; van Rijssen, L Bengt; van Klaveren, David; Smits, F Jasmijn; van Woerden, Victor; Linnemann, Ralph J; de Pastena, Matteo; Klompmaker, Sjors; Marchegiani, Giovanni; Ecker, Brett L; van Dieren, Susan; Bonsing, Bert; Busch, Olivier R; van Dam, Ronald M; Erdmann, Joris; van Eijck, Casper H; Gerhards, Michael F; van Goor, Harry; van der Harst, Erwin; de Hingh, Ignace H; de Jong, Koert P; Kazemier, Geert; Luyer, Misha; Shamali, Awad; Barbaro, Salvatore; Armstrong, Thomas; Takhar, Arjun; Hamady, Zaed; Klaase, Joost; Lips, Daan J; Molenaar, I Quintus; Nieuwenhuijs, Vincent B; Rupert, Coen; van Santvoort, Hjalmar C; Scheepers, Joris J; van der Schelling, George P; Bassi, Claudio; Vollmer, Charles M; Steyerberg, Ewout W; Abu Hilal, Mohammed; Groot Koerkamp, Bas; Besselink, Marc G

2017-12-12

The aim of this study was to develop an alternative fistula risk score (a-FRS) for postoperative pancreatic fistula (POPF) after pancreatoduodenectomy, without blood loss as a predictor. Blood loss, one of the predictors of the original-FRS, was not a significant factor during 2 recent external validations. The a-FRS was developed in 2 databases: the Dutch Pancreatic Cancer Audit (18 centers) and the University Hospital Southampton NHS. Primary outcome was grade B/C POPF according to the 2005 International Study Group on Pancreatic Surgery (ISGPS) definition. The score was externally validated in 2 independent databases (University Hospital of Verona and University Hospital of Pennsylvania), using both 2005 and 2016 ISGPS definitions. The a-FRS was also compared with the original-FRS. For model design, 1924 patients were included of whom 12% developed POPF. Three predictors were strongly associated with POPF: soft pancreatic texture [odds ratio (OR) 2.58, 95% confidence interval (95% CI) 1.80-3.69], small pancreatic duct diameter (per mm increase, OR: 0.68, 95% CI: 0.61-0.76), and high body mass index (BMI) (per kg/m increase, OR: 1.07, 95% CI: 1.04-1.11). Discrimination was adequate with an area under curve (AUC) of 0.75 (95% CI: 0.71-0.78) after internal validation, and 0.78 (0.74-0.82) after external validation. The predictive capacity of a-FRS was comparable with the original-FRS, both for the 2005 definition (AUC 0.78 vs 0.75, P = 0.03), and 2016 definition (AUC 0.72 vs 0.70, P = 0.05). The a-FRS predicts POPF after pancreatoduodenectomy based on 3 easily available variables (pancreatic texture, duct diameter, BMI) without blood loss and pathology, and was successfully validated for both the 2005 and 2016 POPF definition.

Independent validation of a new reirradiation risk score (RRRS) for glioma patients predicting post-recurrence survival: A multicenter DKTK/ROG analysis.

PubMed

Niyazi, Maximilian; Adeberg, Sebastian; Kaul, David; Boulesteix, Anne-Laure; Bougatf, Nina; Fleischmann, Daniel F; Grün, Arne; Krämer, Anna; Rödel, Claus; Eckert, Franziska; Paulsen, Frank; Kessel, Kerstin A; Combs, Stephanie E; Oehlke, Oliver; Grosu, Anca-Ligia; Seidlitz, Annekatrin; Lattermann, Annika; Krause, Mechthild; Baumann, Michael; Guberina, Maja; Stuschke, Martin; Budach, Volker; Belka, Claus; Debus, Jürgen

2018-04-01

Reirradiation (reRT) is a valid option with considerable efficacy in patients with recurrent high-grade glioma, but it is still not known which patients might be optimal candidates for a second course of irradiation. This study validated a newly developed prognostic score independently in an external patient cohort. The reRT risk score (RRRS) is based on a linear combination of initial histology, clinical performance status, and age derived from a multivariable model of 353 patients. This score can predict post-recurrence survival (PRS) after reRT. The validation dataset consisted of 212 patients. The RRRS differentiates three prognostic groups. Discrimination and calibration were maintained in the validation group. Median PRS times in the development cohort for the good/intermediate/poor risk categories were 14.2, 9.1, and 5.3 months, respectively. The respective groups within the validation cohort displayed median PRS times of 13.8, 8.8, and 3.8 months, respectively. Uno's C for development data was 0.64 (CI: 0.60-0.69) and for validation data 0.63 (CI: 0.58-0.68). The RRRS has been successfully validated in an independent patient cohort. This linear combination of three easily determined clinicopathological factors allows for a reliable classification of patients and may be used as stratification factor for future trials. Copyright © 2018 Elsevier B.V. All rights reserved.

Development and validation of the San Diego Early Test Score to predict acute and early HIV infection risk in men who have sex with men.

PubMed

Hoenigl, Martin; Weibel, Nadir; Mehta, Sanjay R; Anderson, Christy M; Jenks, Jeffrey; Green, Nella; Gianella, Sara; Smith, Davey M; Little, Susan J

2015-08-01

Although men who have sex with men (MSM) represent a dominant risk group for human immunodeficiency virus (HIV), the risk of HIV infection within this population is not uniform. The objective of this study was to develop and validate a score to estimate incident HIV infection risk. Adult MSM who were tested for acute and early HIV (AEH) between 2008 and 2014 were retrospectively randomized 2:1 to a derivation and validation dataset, respectively. Using the derivation dataset, each predictor associated with an AEH outcome in the multivariate prediction model was assigned a point value that corresponded to its odds ratio. The score was validated on the validation dataset using C-statistics. Data collected at a single HIV testing encounter from 8326 unique MSM were analyzed, including 200 with AEH (2.4%). Four risk behavior variables were significantly associated with an AEH diagnosis (ie, incident infection) in multivariable analysis and were used to derive the San Diego Early Test (SDET) score: condomless receptive anal intercourse (CRAI) with an HIV-positive MSM (3 points), the combination of CRAI plus ≥5 male partners (3 points), ≥10 male partners (2 points), and diagnosis of bacterial sexually transmitted infection (2 points)-all as reported for the prior 12 months. The C-statistic for this risk score was >0.7 in both data sets. The SDET risk score may help to prioritize resources and target interventions, such as preexposure prophylaxis, to MSM at greatest risk of acquiring HIV infection. The SDET risk score is deployed as a freely available tool at http://sdet.ucsd.edu. © The Author 2015. Published by Oxford University Press on behalf of the Infectious Diseases Society of America. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

Australian validation of the Cancer of the Prostate Risk Assessment Post-Surgical score to predict biochemical recurrence after radical prostatectomy.

PubMed

Beckmann, Kerri; O'Callaghan, Michael; Vincent, Andrew; Roder, David; Millar, Jeremy; Evans, Sue; McNeil, John; Moretti, Kim

2018-03-01

The Cancer of the Prostate Risk Assessment Post-Surgical (CAPRA-S) score is a simple post-operative risk assessment tool predicting disease recurrence after radical prostatectomy, which is easily calculated using available clinical data. To be widely useful, risk tools require multiple external validations. We aimed to validate the CAPRA-S score in an Australian multi-institutional population, including private and public settings and reflecting community practice. The study population were all men on the South Australian Prostate Cancer Clinical Outcomes Collaborative Database with localized prostate cancer diagnosed during 1998-2013, who underwent radical prostatectomy without adjuvant therapy (n = 1664). Predictive performance was assessed via Kaplan-Meier and Cox proportional regression analyses, Harrell's Concordance index, calibration plots and decision curve analysis. Biochemical recurrence occurred in 342 (21%) cases. Five-year recurrence-free probabilities for CAPRA-S scores indicating low (0-2), intermediate (3-5) and high risk were 95, 79 and 46%, respectively. The hazard ratio for CAPRA-S score increments was 1.56 (95% confidence interval 1.49-1.64). The Concordance index for 5-year recurrence-free survival was 0.77. The calibration plot showed good correlation between predicted and observed recurrence-free survival across scores. Limitations include the retrospective nature and small numbers with higher CAPRA-S scores. The CAPRA-S score is an accurate predictor of recurrence after radical prostatectomy in our cohort, supporting its utility in the Australian setting. This simple tool can assist in post-surgical selection of patients who would benefit from adjuvant therapy while avoiding morbidity among those less likely to benefit. © 2017 Royal Australasian College of Surgeons.

External Validation of European System for Cardiac Operative Risk Evaluation II (EuroSCORE II) for Risk Prioritization in an Iranian Population

PubMed Central

Atashi, Alireza; Amini, Shahram; Tashnizi, Mohammad Abbasi; Moeinipour, Ali Asghar; Aazami, Mathias Hossain; Tohidnezhad, Fariba; Ghasemi, Erfan; Eslami, Saeid

2018-01-01

Introduction The European System for Cardiac Operative Risk Evaluation II (EuroSCORE II) is a prediction model which maps 18 predictors to a 30-day post-operative risk of death concentrating on accurate stratification of candidate patients for cardiac surgery. Objective The objective of this study was to determine the performance of the EuroSCORE II risk-analysis predictions among patients who underwent heart surgeries in one area of Iran. Methods A retrospective cohort study was conducted to collect the required variables for all consecutive patients who underwent heart surgeries at Emam Reza hospital, Northeast Iran between 2014 and 2015. Univariate and multivariate analysis were performed to identify covariates which significantly contribute to higher EuroSCORE II in our population. External validation was performed by comparing the real and expected mortality using area under the receiver operating characteristic curve (AUC) for discrimination assessment. Also, Brier Score and Hosmer-Lemeshow goodness-of-fit test were used to show the overall performance and calibration level, respectively. Results Two thousand five hundred eight one (59.6% males) were included. The observed mortality rate was 3.3%, but EuroSCORE II had a prediction of 4.7%. Although the overall performance was acceptable (Brier score=0.047), the model showed poor discriminatory power by AUC=0.667 (sensitivity=61.90, and specificity=66.24) and calibration (Hosmer-Lemeshow test, P<0.01). Conclusion Our study showed that the EuroSCORE II discrimination power is less than optimal for outcome prediction and less accurate for resource allocation programs. It highlights the need for recalibration of this risk stratification tool aiming to improve post cardiac surgery outcome predictions in Iran. PMID:29617500

Evaluation of the validity of osteoporosis and fracture risk assessment tools (IOF One Minute Test, SCORE, and FRAX) in postmenopausal Palestinian women.

PubMed

Kharroubi, Akram; Saba, Elias; Ghannam, Ibrahim; Darwish, Hisham

2017-12-01

The need for simple self-assessment tools is necessary to predict women at high risk for developing osteoporosis. In this study, tools like the IOF One Minute Test, Fracture Risk Assessment Tool (FRAX), and Simple Calculated Osteoporosis Risk Estimation (SCORE) were found to be valid for Palestinian women. The threshold for predicting women at risk for each tool was estimated. The purpose of this study is to evaluate the validity of the updated IOF (International Osteoporosis Foundation) One Minute Osteoporosis Risk Assessment Test, FRAX, SCORE as well as age alone to detect the risk of developing osteoporosis in postmenopausal Palestinian women. Three hundred eighty-two women 45 years and older were recruited including 131 women with osteoporosis and 251 controls following bone mineral density (BMD) measurement, 287 completed questionnaires of the different risk assessment tools. Receiver operating characteristic (ROC) curves were evaluated for each tool using bone BMD as the gold standard for osteoporosis. The area under the ROC curve (AUC) was the highest for FRAX calculated with BMD for predicting hip fractures (0.897) followed by FRAX for major fractures (0.826) with cut-off values ˃1.5 and ˃7.8%, respectively. The IOF One Minute Test AUC (0.629) was the lowest compared to other tested tools but with sufficient accuracy for predicting the risk of developing osteoporosis with a cut-off value ˃4 total yes questions out of 18. SCORE test and age alone were also as good predictors of risk for developing osteoporosis. According to the ROC curve for age, women ≥64 years had a higher risk of developing osteoporosis. Higher percentage of women with low BMD (T-score ≤-1.5) or osteoporosis (T-score ≤-2.5) was found among women who were not exposed to the sun, who had menopause before the age of 45 years, or had lower body mass index (BMI) compared to controls. Women who often fall had lower BMI and approximately 27% of the recruited postmenopausal

Predicting Early Death Among Elderly Dialysis Patients: Development and Validation of a Risk Score to Assist Shared Decision Making for Dialysis Initiation.

PubMed

Thamer, Mae; Kaufman, James S; Zhang, Yi; Zhang, Qian; Cotter, Dennis J; Bang, Heejung

2015-12-01

A shared decision-making tool could help elderly patients with advanced chronic kidney disease decide about initiating dialysis therapy. Because mortality may be high in the first few months after initiating dialysis therapy, incorporating early mortality predictors in such a tool would be important for an informed decision. Our objective is to derive and validate a predictive risk score for early mortality after initiating dialysis therapy. Retrospective observational cohort, with development and validation cohorts. US Renal Data System and claims data from the Centers for Medicare & Medicaid Services for 69,441 (aged ≥67 years) patients with end-stage renal disease with a previous 2-year Medicare history who initiated dialysis therapy from January 1, 2009, to December 31, 2010. Demographics, predialysis care, laboratory data, functional limitations, and medical history. All-cause mortality in the first 3 and 6 months. Predicted mortality by logistic regression. The simple risk score (total score, 0-9) included age (0-3 points), low albumin level, assistance with daily living, nursing home residence, cancer, heart failure, and hospitalization (1 point each), and showed area under the receiver operating characteristic curve (AUROC)=0.69 in the validation sample. A comprehensive risk score with additional predictors was also developed (with AUROC=0.72, high concordance between predicted vs observed risk). Mortality probabilities were estimated from these models, with the median score of 3 indicating 12% risk in 3 months and 20% in 6 months, and the highest scores (≥8) indicating 39% risk in 3 months and 55% in 6 months. Patients who did not choose dialysis therapy and did not have a 2-year Medicare history were excluded. Routinely available information can be used by patients with chronic kidney disease, families, and their nephrologists to estimate the risk of early mortality after dialysis therapy initiation, which may facilitate informed decision making

Development and validation of a risk score for chronic kidney disease in HIV infection using prospective cohort data from the D:A:D study.

PubMed

Mocroft, Amanda; Lundgren, Jens D; Ross, Michael; Law, Matthew; Reiss, Peter; Kirk, Ole; Smith, Colette; Wentworth, Deborah; Neuhaus, Jacqueline; Fux, Christoph A; Moranne, Olivier; Morlat, Phillipe; Johnson, Margaret A; Ryom, Lene

2015-03-01

Chronic kidney disease (CKD) is a major health issue for HIV-positive individuals, associated with increased morbidity and mortality. Development and implementation of a risk score model for CKD would allow comparison of the risks and benefits of adding potentially nephrotoxic antiretrovirals to a treatment regimen and would identify those at greatest risk of CKD. The aims of this study were to develop a simple, externally validated, and widely applicable long-term risk score model for CKD in HIV-positive individuals that can guide decision making in clinical practice. A total of 17,954 HIV-positive individuals from the Data Collection on Adverse Events of Anti-HIV Drugs (D:A:D) study with ≥3 estimated glomerular filtration rate (eGFR) values after 1 January 2004 were included. Baseline was defined as the first eGFR > 60 ml/min/1.73 m2 after 1 January 2004; individuals with exposure to tenofovir, atazanavir, atazanavir/ritonavir, lopinavir/ritonavir, other boosted protease inhibitors before baseline were excluded. CKD was defined as confirmed (>3 mo apart) eGFR ≤ 60 ml/min/1.73 m2. Poisson regression was used to develop a risk score, externally validated on two independent cohorts. In the D:A:D study, 641 individuals developed CKD during 103,185 person-years of follow-up (PYFU; incidence 6.2/1,000 PYFU, 95% CI 5.7-6.7; median follow-up 6.1 y, range 0.3-9.1 y). Older age, intravenous drug use, hepatitis C coinfection, lower baseline eGFR, female gender, lower CD4 count nadir, hypertension, diabetes, and cardiovascular disease (CVD) predicted CKD. The adjusted incidence rate ratios of these nine categorical variables were scaled and summed to create the risk score. The median risk score at baseline was -2 (interquartile range -4 to 2). There was a 1:393 chance of developing CKD in the next 5 y in the low risk group (risk score < 0, 33 events), rising to 1:47 and 1:6 in the medium (risk score 0-4, 103 events) and high risk groups (risk score ≥ 5, 505 events

Validation of the 12-gene colon cancer recurrence score as a predictor of recurrence risk in stage II and III rectal cancer patients.

PubMed

Reimers, Marlies S; Kuppen, Peter J K; Lee, Mark; Lopatin, Margarita; Tezcan, Haluk; Putter, Hein; Clark-Langone, Kim; Liefers, Gerrit Jan; Shak, Steve; van de Velde, Cornelis J H

2014-11-01

The 12-gene Recurrence Score assay is a validated predictor of recurrence risk in stage II and III colon cancer patients. We conducted a prospectively designed study to validate this assay for prediction of recurrence risk in stage II and III rectal cancer patients from the Dutch Total Mesorectal Excision (TME) trial. RNA was extracted from fixed paraffin-embedded primary rectal tumor tissue from stage II and III patients randomized to TME surgery alone, without (neo)adjuvant treatment. Recurrence Score was assessed by quantitative real time-polymerase chain reaction using previously validated colon cancer genes and algorithm. Data were analysed by Cox proportional hazards regression, adjusting for stage and resection margin status. All statistical tests were two-sided. Recurrence Score predicted risk of recurrence (hazard ratio [HR] = 1.57, 95% confidence interval [CI] = 1.11 to 2.21, P = .01), risk of distant recurrence (HR = 1.50, 95% CI = 1.04 to 2.17, P = .03), and rectal cancer-specific survival (HR = 1.64, 95% CI = 1.15 to 2.34, P = .007). The effect of Recurrence Score was most prominent in stage II patients and attenuated with more advanced stage (P(interaction) ≤ .007 for each endpoint). In stage II, five-year cumulative incidence of recurrence ranged from 11.1% in the predefined low Recurrence Score group (48.5% of patients) to 43.3% in the high Recurrence Score group (23.1% of patients). The 12-gene Recurrence Score is a predictor of recurrence risk and cancer-specific survival in rectal cancer patients treated with surgery alone, suggesting a similar underlying biology in colon and rectal cancers. © The Author 2014. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

The Development, Validation, and Utility of the Diabetes Prevention Trial-Type 1 Risk Score (DPTRS)

PubMed Central

Sosenko, Jay M.; Skyler, Jay S.; Palmer, Jerry P.

2016-01-01

Summary This report details the development, validation, and utility of the Diabetes Prevention Trial-Type 1 (DPT-1) Risk Score (DPTRS) for type 1 diabetes (T1D). Proportional hazards regression was used to develop the DPTRS model which includes the glucose and C-peptide sums from oral glucose tolerance tests at 30, 60, 90, and 120 minutes, the log fasting C-peptide, age, and the log BMI. The DPTRS was externally validated in the TrialNet Natural History Study cohort (TNNHS). In a study of the application of the DPTRS, the findings showed that it could be used to identify normoglycemic individuals who were at a similar risk for T1D as those with dysglycemia. The DPTRS could also be used to identify lower risk dysglycemic individuals. Risk estimates of individuals deemed to be at higher risk according to DPTRS values did not differ significantly between the DPT-1 and the TNNHS, whereas the risk estimates for those with dysglycemia were significantly higher in DPT-1. Individuals with very high DPTRS values were found to be at such marked risk for T1D that they could reasonably be considered to be in a pre-diabetic state. The findings indicate that the DPTRS has utility in T1D prevention trials and for identifying pre-diabetic individuals. PMID:26077017

The development, validation, and utility of the Diabetes Prevention Trial-Type 1 Risk Score (DPTRS).

PubMed

Sosenko, Jay M; Skyler, Jay S; Palmer, Jerry P

2015-08-01

This report details the development, validation, and utility of the Diabetes Prevention Trial-Type 1 (DPT-1) Risk Score (DPTRS) for type 1 diabetes (T1D). Proportional hazards regression was used to develop the DPTRS model which includes the glucose and C-peptide sums from oral glucose tolerance tests at 30, 60, 90, and 120 min, the log fasting C-peptide, age, and the log BMI. The DPTRS was externally validated in the TrialNet Natural History Study cohort (TNNHS). In a study of the application of the DPTRS, the findings showed that it could be used to identify normoglycemic individuals who were at a similar risk for T1D as those with dysglycemia. The DPTRS could also be used to identify lower risk dysglycemic individuals. Risk estimates of individuals deemed to be at higher risk according to DPTRS values did not differ significantly between the DPT-1 and the TNNHS; whereas, the risk estimates for those with dysglycemia were significantly higher in DPT-1. Individuals with very high DPTRS values were found to be at such marked risk for T1D that they could reasonably be considered to be in a pre-diabetic state. The findings indicate that the DPTRS has utility in T1D prevention trials and for identifying pre-diabetic individuals.

Development and Validation of a Practical Two-Step Prediction Model and Clinical Risk Score for Post-Thrombotic Syndrome.

PubMed

Amin, Elham E; van Kuijk, Sander M J; Joore, Manuela A; Prandoni, Paolo; Cate, Hugo Ten; Cate-Hoek, Arina J Ten

2018-06-04

 Post-thrombotic syndrome (PTS) is a common chronic consequence of deep vein thrombosis that affects the quality of life and is associated with substantial costs. In clinical practice, it is not possible to predict the individual patient risk. We develop and validate a practical two-step prediction tool for PTS in the acute and sub-acute phase of deep vein thrombosis.  Multivariable regression modelling with data from two prospective cohorts in which 479 (derivation) and 1,107 (validation) consecutive patients with objectively confirmed deep vein thrombosis of the leg, from thrombosis outpatient clinic of Maastricht University Medical Centre, the Netherlands (derivation) and Padua University hospital in Italy (validation), were included. PTS was defined as a Villalta score of ≥ 5 at least 6 months after acute thrombosis.  Variables in the baseline model in the acute phase were: age, body mass index, sex, varicose veins, history of venous thrombosis, smoking status, provoked thrombosis and thrombus location. For the secondary model, the additional variable was residual vein obstruction. Optimism-corrected area under the receiver operating characteristic curves (AUCs) were 0.71 for the baseline model and 0.60 for the secondary model. Calibration plots showed well-calibrated predictions. External validation of the derived clinical risk scores was successful: AUC, 0.66 (95% confidence interval [CI], 0.63-0.70) and 0.64 (95% CI, 0.60-0.69).  Individual risk for PTS in the acute phase of deep vein thrombosis can be predicted based on readily accessible baseline clinical and demographic characteristics. The individual risk in the sub-acute phase can be predicted with limited additional clinical characteristics. Schattauer GmbH Stuttgart.

Risk Prediction Score for HIV Infection: Development and Internal Validation with Cross-Sectional Data from Men Who Have Sex with Men in China.

PubMed

Yin, Lu; Zhao, Yuejuan; Peratikos, Meridith Blevins; Song, Liang; Zhang, Xiangjun; Xin, Ruolei; Sun, Zheya; Xu, Yunan; Zhang, Li; Hu, Yifei; Hao, Chun; Ruan, Yuhua; Shao, Yiming; Vermund, Sten H; Qian, Han-Zhu

2018-05-21

Receptive anal intercourse, multiple partners, condomless sex, sexually transmitted infections (STIs), and drug/alcohol addiction are familiar factors that correlate with increased human immunodeficiency virus (HIV) risk among men who have sex with men (MSM). To improve estimation to HIV acquisition, we created a composite score using questions from routine survey of 3588 MSM in Beijing, China. The HIV prevalence was 13.4%. A risk scoring tool using penalized maximum likelihood multivariable logistic regression modeling was developed, deploying backward step-down variable selection to obtain a reduced-form model. The full penalized model included 19 sexual predictors, while the reduced-form model had 12 predictors. Both models calibrated well; bootstrap-corrected c-indices were 0.70 (full model) and 0.71 (reduced-form model). Non-Beijing residence, short-term living in Beijing, illegal drug use, multiple male sexual partners, receptive anal sex, inconsistent condom use, alcohol consumption before sex, and syphilis infection were the strongest predictors of HIV infection. Discriminating higher-risk MSM for targeted HIV prevention programming using a validated risk score could improve the efficiency of resource deployment for educational and risk reduction programs. A valid risk score can also identify higher risk persons into prevention and vaccine clinical trials, which would improve trial cost-efficiency.

Risk score to predict gastrointestinal bleeding after acute ischemic stroke.

PubMed

Ji, Ruijun; Shen, Haipeng; Pan, Yuesong; Wang, Penglian; Liu, Gaifen; Wang, Yilong; Li, Hao; Singhal, Aneesh B; Wang, Yongjun

2014-07-25

Gastrointestinal bleeding (GIB) is a common and often serious complication after stroke. Although several risk factors for post-stroke GIB have been identified, no reliable or validated scoring system is currently available to predict GIB after acute stroke in routine clinical practice or clinical trials. In the present study, we aimed to develop and validate a risk model (acute ischemic stroke associated gastrointestinal bleeding score, the AIS-GIB score) to predict in-hospital GIB after acute ischemic stroke. The AIS-GIB score was developed from data in the China National Stroke Registry (CNSR). Eligible patients in the CNSR were randomly divided into derivation (60%) and internal validation (40%) cohorts. External validation was performed using data from the prospective Chinese Intracranial Atherosclerosis Study (CICAS). Independent predictors of in-hospital GIB were obtained using multivariable logistic regression in the derivation cohort, and β-coefficients were used to generate point scoring system for the AIS-GIB. The area under the receiver operating characteristic curve (AUROC) and the Hosmer-Lemeshow goodness-of-fit test were used to assess model discrimination and calibration, respectively. A total of 8,820, 5,882, and 2,938 patients were enrolled in the derivation, internal validation and external validation cohorts. The overall in-hospital GIB after AIS was 2.6%, 2.3%, and 1.5% in the derivation, internal, and external validation cohort, respectively. An 18-point AIS-GIB score was developed from the set of independent predictors of GIB including age, gender, history of hypertension, hepatic cirrhosis, peptic ulcer or previous GIB, pre-stroke dependence, admission National Institutes of Health stroke scale score, Glasgow Coma Scale score and stroke subtype (Oxfordshire). The AIS-GIB score showed good discrimination in the derivation (0.79; 95% CI, 0.764-0.825), internal (0.78; 95% CI, 0.74-0.82) and external (0.76; 95% CI, 0.71-0.82) validation cohorts

Novel risk score of contrast-induced nephropathy after percutaneous coronary intervention.

PubMed

Ji, Ling; Su, XiaoFeng; Qin, Wei; Mi, XuHua; Liu, Fei; Tang, XiaoHong; Li, Zi; Yang, LiChuan

2015-08-01

Contrast-induced nephropathy (CIN) post-percutaneous coronary intervention (PCI) is a major cause of acute kidney injury. In this study, we established a comprehensive risk score model to assess risk of CIN after PCI procedure, which could be easily used in a clinical environment. A total of 805 PCI patients, divided into analysis cohort (70%) and validation cohort (30%), were enrolled retrospectively in this study. Risk factors for CIN were identified using univariate analysis and multivariate logistic regression in the analysis cohort. Risk score model was developed based on multiple regression coefficients. Sensitivity and specificity of the new risk score system was validated in the validation cohort. Comparisons between the new risk score model and previous reported models were applied. The incidence of post-PCI CIN in the analysis cohort (n = 565) was 12%. Considerably high CIN incidence (50%) was observed in patients with chronic kidney disease (CKD). Age >75, body mass index (BMI) >25, myoglobin level, cardiac function level, hypoalbuminaemia, history of chronic kidney disease (CKD), Intra-aortic balloon pump (IABP) and peripheral vascular disease (PVD) were identified as independent risk factors of post-PCI CIN. A novel risk score model was established using multivariate regression coefficients, which showed highest sensitivity and specificity (0.917, 95%CI 0.877-0.957) compared with previous models. A new post-PCI CIN risk score model was developed based on a retrospective study of 805 patients. Application of this model might be helpful to predict CIN in patients undergoing PCI procedure. © 2015 Asian Pacific Society of Nephrology.

Development and Validation of a Risk Score for Age-Related Macular Degeneration: The STARS Questionnaire.

PubMed

Delcourt, Cécile; Souied, Eric; Sanchez, Alice; Bandello, Francesco

2017-12-01

To develop and validate a risk score for AMD based on a simple self-administered questionnaire. Risk factors having shown the most consistent associations with AMD were included in the STARS (Simplified Théa AMD Risk-Assessment Scale) questionnaire. Two studies were conducted, one in Italy (127 participating ophthalmologists) and one in France (80 participating ophthalmologists). During 1 week, participating ophthalmologists invited all their patients aged 55 years or older to fill in the STARS questionnaire. Based on fundus examination, early AMD was defined by the presence of soft drusen and/or pigmentary abnormalities and late AMD by the presence of geographic atrophy and/or neovascular AMD. The Italian and French samples consisted of 12,639 and 6897 patients, respectively. All 13 risk factors included in the STARS questionnaire showed significant associations with AMD in the Italian sample. The area under the receiving operating characteristic curve for the STARS risk score, derived from the multivariate logistic regression in the Italian sample, was 0.78 in the Italian sample and 0.72 in the French sample. In both samples, less than 10% of patients without AMD were classified at high risk, and less than 13% of late AMD cases were classified as low risk, with a more intermediate situation in early AMD cases. STARS is a new, simple self-assessed questionnaire showing good discrimination of risk for AMD in two large European samples. It might be used by ophthalmologists in routine clinical practice or as a self-assessment for risk of AMD in the general population.

The Pediatric Risk of Mortality Score: Update 2015

PubMed Central

Pollack, Murray M.; Holubkov, Richard; Funai, Tomohiko; Dean, J. Michael; Berger, John T.; Wessel, David L.; Meert, Kathleen; Berg, Robert A.; Newth, Christopher J. L.; Harrison, Rick E.; Carcillo, Joseph; Dalton, Heidi; Shanley, Thomas; Jenkins, Tammara L.; Tamburro, Robert

2016-01-01

Objectives Severity of illness measures have long been used in pediatric critical care. The Pediatric Risk of Mortality is a physiologically based score used to quantify physiologic status, and when combined with other independent variables, it can compute expected mortality risk and expected morbidity risk. Although the physiologic ranges for the Pediatric Risk of Mortality variables have not changed, recent Pediatric Risk of Mortality data collection improvements have been made to adapt to new practice patterns, minimize bias, and reduce potential sources of error. These include changing the outcome to hospital survival/death for the first PICU admission only, shortening the data collection period and altering the Pediatric Risk of Mortality data collection period for patients admitted for “optimizing” care before cardiac surgery or interventional catheterization. This analysis incorporates those changes, assesses the potential for Pediatric Risk of Mortality physiologic variable subcategories to improve score performance, and recalibrates the Pediatric Risk of Mortality score, placing the algorithms (Pediatric Risk of Mortality IV) in the public domain. Design Prospective cohort study from December 4, 2011, to April 7, 2013. Measurements and Main Results Among 10,078 admissions, the unadjusted mortality rate was 2.7% (site range, 1.3–5.0%). Data were divided into derivation (75%) and validation (25%) sets. The new Pediatric Risk of Mortality prediction algorithm (Pediatric Risk of Mortality IV) includes the same Pediatric Risk of Mortality physiologic variable ranges with the subcategories of neurologic and nonneurologic Pediatric Risk of Mortality scores, age, admission source, cardiopulmonary arrest within 24 hours before admission, cancer, and low-risk systems of primary dysfunction. The area under the receiver operating characteristic curve for the development and validation sets was 0.88 ± 0.013 and 0.90 ± 0.018, respectively. The Hosmer

Development and validation of a risk score for hospitalization for heart failure in patients with Type 2 diabetes mellitus.

PubMed

Yang, Xilin; Ma, Ronald C; So, Wing-Yee; Kong, Alice P; Ko, Gary T; Ho, Chun-Shun; Lam, Christopher W; Cockram, Clive S; Tong, Peter C; Chan, Juliana C

2008-04-22

There are no risk scores available for predicting heart failure in Type 2 diabetes mellitus (T2DM). Based on the Hong Kong Diabetes Registry, this study aimed to develop and validate a risk score for predicting heart failure that needs hospitalisation in T2DM. 7067 Hong Kong Chinese diabetes patients without history of heart failure, and without history and clinical evidence of coronary heart disease at baseline were analyzed. The subjects have been followed up for a median period of 5.5 years. Data were randomly and evenly assigned to a training dataset and a test dataset. Sex-stratified Cox proportional hazard regression was used to obtain predictors of HF-related hospitalization in the training dataset. Calibration was assessed using Hosmer-Lemeshow test and discrimination was examined using the area under receiver's operating characteristic curve (aROC) in the test dataset. During the follow-up, 274 patients developed heart failure event/s that needed hospitalisation. Age, body mass index (BMI), spot urinary albumin to creatinine ratio (ACR), HbA1c, blood haemoglobin (Hb) at baseline and coronary heart disease during follow-up were predictors of HF-related hospitalization in the training dataset. HF-related hospitalization risk score = 0.0709 x age (year) + 0.0627 x BMI (kg/m2) + 0.1363 x HbA1c(%) + 0.9915 x Log10(1+ACR) (mg/mmol) - 0.3606 x Blood Hb(g/dL) + 0.8161 x CHD during follow-up (1 if yes). The 5-year probability of heart failure = 1-S0(5)EXP{0.9744 x (Risk Score - 2.3961)}. Where S0(5) = 0.9888 if male and 0.9809 if female. The predicted and observed 5-year probabilities of HF-related hospitalization were similar (p > 0.20) and the adjusted aROC was 0.920 for 5 years of follow-up. The risk score had adequate performance. Further validations in other cohorts of patients with T2DM are needed before clinical use.

Scoring Rubric Development: Validity and Reliability.

ERIC Educational Resources Information Center

Moskal, Barbara M.; Leydens, Jon A.

2000-01-01

Provides clear definitions of the terms "validity" and "reliability" in the context of developing scoring rubrics and illustrates these definitions through examples. Also clarifies how validity and reliability may be addressed in the development of scoring rubrics, defined as descriptive scoring schemes developed to guide the analysis of the…

Development and Validation of a Risk Score for Chronic Kidney Disease in HIV Infection Using Prospective Cohort Data from the D:A:D Study

PubMed Central

Mocroft, Amanda; Lundgren, Jens D.; Ross, Michael; Law, Matthew; Reiss, Peter; Kirk, Ole; Smith, Colette; Wentworth, Deborah; Neuhaus, Jacqueline; Fux, Christoph A.; Moranne, Olivier; Morlat, Phillipe; Johnson, Margaret A.; Ryom, Lene

2015-01-01

Background Chronic kidney disease (CKD) is a major health issue for HIV-positive individuals, associated with increased morbidity and mortality. Development and implementation of a risk score model for CKD would allow comparison of the risks and benefits of adding potentially nephrotoxic antiretrovirals to a treatment regimen and would identify those at greatest risk of CKD. The aims of this study were to develop a simple, externally validated, and widely applicable long-term risk score model for CKD in HIV-positive individuals that can guide decision making in clinical practice. Methods and Findings A total of 17,954 HIV-positive individuals from the Data Collection on Adverse Events of Anti-HIV Drugs (D:A:D) study with ≥3 estimated glomerular filtration rate (eGFR) values after 1 January 2004 were included. Baseline was defined as the first eGFR > 60 ml/min/1.73 m2 after 1 January 2004; individuals with exposure to tenofovir, atazanavir, atazanavir/ritonavir, lopinavir/ritonavir, other boosted protease inhibitors before baseline were excluded. CKD was defined as confirmed (>3 mo apart) eGFR ≤ 60 ml/min/1.73 m2. Poisson regression was used to develop a risk score, externally validated on two independent cohorts. In the D:A:D study, 641 individuals developed CKD during 103,185 person-years of follow-up (PYFU; incidence 6.2/1,000 PYFU, 95% CI 5.7–6.7; median follow-up 6.1 y, range 0.3–9.1 y). Older age, intravenous drug use, hepatitis C coinfection, lower baseline eGFR, female gender, lower CD4 count nadir, hypertension, diabetes, and cardiovascular disease (CVD) predicted CKD. The adjusted incidence rate ratios of these nine categorical variables were scaled and summed to create the risk score. The median risk score at baseline was −2 (interquartile range –4 to 2). There was a 1:393 chance of developing CKD in the next 5 y in the low risk group (risk score < 0, 33 events), rising to 1:47 and 1:6 in the medium (risk score 0–4, 103 events) and high risk

Lowering risk score profile during PCI in multiple vessel disease is associated with low adverse events: The ERACI risk score.

PubMed

Rodriguez, Alfredo E; Fernandez-Pereira, Carlos; Mieres, Juan; Pavlovsky, Hernan; Del Pozo, Juan; Rodriguez-Granillo, Alfredo M; Antoniucci, David

2018-02-13

In recent years angiographic risk scores have been introduced in clinical practice to stratify different levels of risk after percutaneous coronary interventions (PCI). The SYNTAX score included all intermediate lesions in vessels ≥1.5 mm, consequently, multiple stent implantation was required. Four years ago, we built a new angiographic score in order to guide PCI strategy avoiding stent deployment both in intermediate stenosis as in small vessels, therefore these were not scored (ERACI risk score). The purpose of this mini review is to validate the strategy of PCI guided by this scoring, taking into account long term follow up outcomes of two observational and prospective registries where this policy was used. With this new risk score we have modified risk profile of our patient's candidates for PCI or coronary artery bypass surgery lowering the risk and <20% of them are now included anatomically as high risk for PCI. The simple exclusion of small vessels and intermediate stenosis from the revascularization approach resulted in clinical outcome comparable with the one of fractional flow reserve guided revascularization. Low events rate at late follow up observed in both studies was also in agreement with guided PCI by functional lesion assessment observed by Syntax II registry, where investigators found lower events rate in spite of a few number of stents implanted per patient. use of ERACI risk scores may significantly reclassify patients into a lower risk category and be associated with low adverse events rate. Copyright © 2018. Published by Elsevier Inc.

Early Identification of Children at Risk for Academic Difficulties Using Standardized Assessment: Stability and Predictive Validity of Preschool Math and Language Scores

ERIC Educational Resources Information Center

Frans, Niek; Post, Wendy J.; Huisman, Mark; Oenema-Mostert, Ineke C. E.; Keegstra, Anne L.; Minnaert, Alexander E. M. G.

2017-01-01

Despite the claim by several researchers that variability in performance may complicate the identification of "at-risk" children, variability in the academic performance of young children remains an undervalued area of research. The goal of this study is to examine the predictive validity for future scores and the score stability of two…

Validation of the Framingham Heart Study and CHARGE-AF Risk Scores for Atrial Fibrillation in Hispanics, African-Americans, and Non-Hispanic Whites.

PubMed

Shulman, Eric; Kargoli, Faraj; Aagaard, Philip; Hoch, Ethan; Di Biase, Luigi; Fisher, John; Gross, Jay; Kim, Soo; Krumerman, Andrew; Ferrick, Kevin J

2016-01-01

A risk score for atrial fibrillation (AF) has been developed by the Framingham Heart Study and Cohorts for Heart and Aging Research in Genomic Epidemiology (CHARGE)-AF consortium. However, validation of these risk scores in an inner-city population is uncertain. Thus, a validation model was built using the Framingham Risk Score for AF and CHARGE-AF covariates. An in and outpatient electrocardiographic database was interrogated from 2000 to 2013 for the development of AF. Patients were included if their age was >45 and <95 years, had <10-year follow-up, if their initial electrocardiogram was without AF, had ≥ 2 electrocardiograms, and declared a race and/or ethnicity as non-Hispanic white, African-American, or Hispanic. For the Framingham Heart Study, 49,599 patients met inclusion criteria, of which 4,860 developed AF. Discrimination analysis using area under the curve (AUC) for original risk equations: non-Hispanic white AUC = 0.712 (95% confidence interval [CI] 0.694 to 0.731), African-American AUC = 0.733 (95% CI 0.716 to 0.751), and Hispanic AUC = 0.740 (95% CI 0.723 to 0.757). For the CHARGE-AF, 45,571 patients met inclusion criteria, of which 4,512 developed AF. Non-Hispanic white AUC = 0.673 (95% CI 0.652 to 0.694), African-American AUC = 0.706 (95% CI 0.685 to 0.727), and Hispanic AUC = 0.711 (95% CI 0.691 to 0.732). Calibration analysis showed qualitative similarities between cohorts. In conclusion, this is the first study to validate both the Framingham Heart Study and CHARGE-AF risk scores in both a Hispanic and African-American cohort. All models predicted AF well across all race and ethnic cohorts. Copyright © 2016 Elsevier Inc. All rights reserved.

The PER (Preoperative Esophagectomy Risk) Score: A Simple Risk Score to Predict Short-Term and Long-Term Outcome in Patients with Surgically Treated Esophageal Cancer.

PubMed

Reeh, Matthias; Metze, Johannes; Uzunoglu, Faik G; Nentwich, Michael; Ghadban, Tarik; Wellner, Ullrich; Bockhorn, Maximilian; Kluge, Stefan; Izbicki, Jakob R; Vashist, Yogesh K

2016-02-01

Esophageal resection in patients with esophageal cancer (EC) is still associated with high mortality and morbidity rates. We aimed to develop a simple preoperative risk score for the prediction of short-term and long-term outcomes for patients with EC treated by esophageal resection. In total, 498 patients suffering from esophageal carcinoma, who underwent esophageal resection, were included in this retrospective cohort study. Three preoperative esophagectomy risk (PER) groups were defined based on preoperative functional evaluation of different organ systems by validated tools (revised cardiac risk index, model for end-stage liver disease score, and pulmonary function test). Clinicopathological parameters, morbidity, and mortality as well as disease-free survival (DFS) and overall survival (OS) were correlated to the PER score. The PER score significantly predicted the short-term outcome of patients with EC who underwent esophageal resection. PER 2 and PER 3 patients had at least double the risk of morbidity and mortality compared to PER 1 patients. Furthermore, a higher PER score was associated with shorter DFS (P < 0.001) and OS (P < 0.001). The PER score was identified as an independent predictor of tumor recurrence (hazard ratio [HR] 2.1; P < 0.001) and OS (HR 2.2; P < 0.001). The PER score allows preoperative objective allocation of patients with EC into different risk categories for morbidity, mortality, and long-term outcomes. Thus, multicenter studies are needed for independent validation of the PER score.

External Validation of Risk Scores for Major Bleeding in a Population-Based Cohort of Transient Ischemic Attack and Ischemic Stroke Patients.

PubMed

Hilkens, Nina A; Li, Linxin; Rothwell, Peter M; Algra, Ale; Greving, Jacoba P

2018-03-01

The S 2 TOP-BLEED score may help to identify patients at high risk of bleeding on antiplatelet drugs after a transient ischemic attack or ischemic stroke. The score was derived on trial populations, and its performance in a real-world setting is unknown. We aimed to externally validate the S 2 TOP-BLEED score for major bleeding in a population-based cohort and to compare its performance with other risk scores for bleeding. We studied risk of bleeding in 2072 patients with a transient ischemic attack or ischemic stroke on antiplatelet agents in the population-based OXVASC (Oxford Vascular Study) according to 3 scores: S 2 TOP-BLEED, REACH, and Intracranial-B 2 LEED 3 S. Performance was assessed with C statistics and calibration plots. During 8302 patient-years of follow-up, 117 patients had a major bleed. The S 2 TOP-BLEED score showed a C statistic of 0.69 (95% confidence interval [CI], 0.64-0.73) and accurate calibration for 3-year risk of major bleeding. The S 2 TOP-BLEED score was much more predictive of fatal bleeding than nonmajor bleeding (C statistics 0.77; 95% CI, 0.69-0.85 and 0.50; 95% CI, 0.44-0.58). The REACH score had a C statistic of 0.63 (95% CI, 0.58-0.69) for major bleeding and the Intracranial-B 2 LEED 3 S score a C statistic of 0.60 (95% CI, 0.51-0.70) for intracranial bleeding. The ratio of ischemic events versus bleeds decreased across risk groups of bleeding from 6.6:1 in the low-risk group to 1.8:1 in the high-risk group. The S 2 TOP-BLEED score shows modest performance in a population-based cohort of patients with a transient ischemic attack or ischemic stroke. Although bleeding risks were associated with risks of ischemic events, risk stratification may still be useful to identify a subgroup of patients at particularly high risk of bleeding, in whom preventive measures are indicated. © 2018 The Authors.

Texting while driving: the development and validation of the distracted driving survey and risk score among young adults.

PubMed

Bergmark, Regan W; Gliklich, Emily; Guo, Rong; Gliklich, Richard E

Texting while driving and other cell-phone reading and writing activities are high-risk activities associated with motor vehicle collisions and mortality. This paper describes the development and preliminary evaluation of the Distracted Driving Survey (DDS) and score. Survey questions were developed by a research team using semi-structured interviews, pilot-tested, and evaluated in young drivers for validity and reliability. Questions focused on texting while driving and use of email, social media, and maps on cellular phones with specific questions about the driving speeds at which these activities are performed. In 228 drivers 18-24 years old, the DDS showed excellent internal consistency (Cronbach's alpha = 0.93) and correlations with reported 12-month crash rates. The score is reported on a 0-44 scale with 44 being highest risk behaviors. For every 1 unit increase of the DDS score, the odds of reporting a car crash increases 7 %. The survey can be completed in two minutes, or less than five minutes if demographic and background information is included. Text messaging was common; 59.2 and 71.5 % of respondents said they wrote and read text messages, respectively, while driving in the last 30 days. The DDS is an 11-item scale that measures cell phone-related distracted driving risk and includes reading/viewing and writing subscores. The scale demonstrated strong validity and reliability in drivers age 24 and younger. The DDS may be useful for measuring rates of cell-phone related distracted driving and for evaluating public health interventions focused on reducing such behaviors.

Texting while driving: the development and validation of the distracted driving survey and risk score among young adults.

PubMed

Bergmark, Regan W; Gliklich, Emily; Guo, Rong; Gliklich, Richard E

2016-12-01

Texting while driving and other cell-phone reading and writing activities are high-risk activities associated with motor vehicle collisions and mortality. This paper describes the development and preliminary evaluation of the Distracted Driving Survey (DDS) and score. Survey questions were developed by a research team using semi-structured interviews, pilot-tested, and evaluated in young drivers for validity and reliability. Questions focused on texting while driving and use of email, social media, and maps on cellular phones with specific questions about the driving speeds at which these activities are performed. In 228 drivers 18-24 years old, the DDS showed excellent internal consistency (Cronbach's alpha = 0.93) and correlations with reported 12-month crash rates. The score is reported on a 0-44 scale with 44 being highest risk behaviors. For every 1 unit increase of the DDS score, the odds of reporting a car crash increases 7 %. The survey can be completed in two minutes, or less than five minutes if demographic and background information is included. Text messaging was common; 59.2 and 71.5 % of respondents said they wrote and read text messages, respectively, while driving in the last 30 days. The DDS is an 11-item scale that measures cell phone-related distracted driving risk and includes reading/viewing and writing subscores. The scale demonstrated strong validity and reliability in drivers age 24 and younger. The DDS may be useful for measuring rates of cell-phone related distracted driving and for evaluating public health interventions focused on reducing such behaviors.

Principles for valid histopathologic scoring in research

PubMed Central

Gibson-Corley, Katherine N.; Olivier, Alicia K.; Meyerholz, David K.

2013-01-01

Histopathologic scoring is a tool by which semi-quantitative data can be obtained from tissues. Initially, a thorough understanding of the experimental design, study objectives and methods are required to allow the pathologist to appropriately examine tissues and develop lesion scoring approaches. Many principles go into the development of a scoring system such as tissue examination, lesion identification, scoring definitions and consistency in interpretation. Masking (a.k.a. “blinding”) of the pathologist to experimental groups is often necessary to constrain bias and multiple mechanisms are available. Development of a tissue scoring system requires appreciation of the attributes and limitations of the data (e.g. nominal, ordinal, interval and ratio data) to be evaluated. Incidence, ordinal and rank methods of tissue scoring are demonstrated along with key principles for statistical analyses and reporting. Validation of a scoring system occurs through two principal measures: 1) validation of repeatability and 2) validation of tissue pathobiology. Understanding key principles of tissue scoring can help in the development and/or optimization of scoring systems so as to consistently yield meaningful and valid scoring data. PMID:23558974

Multiple Score Comparison: a network meta-analysis approach to comparison and external validation of prognostic scores.

PubMed

Haile, Sarah R; Guerra, Beniamino; Soriano, Joan B; Puhan, Milo A

2017-12-21

Prediction models and prognostic scores have been increasingly popular in both clinical practice and clinical research settings, for example to aid in risk-based decision making or control for confounding. In many medical fields, a large number of prognostic scores are available, but practitioners may find it difficult to choose between them due to lack of external validation as well as lack of comparisons between them. Borrowing methodology from network meta-analysis, we describe an approach to Multiple Score Comparison meta-analysis (MSC) which permits concurrent external validation and comparisons of prognostic scores using individual patient data (IPD) arising from a large-scale international collaboration. We describe the challenges in adapting network meta-analysis to the MSC setting, for instance the need to explicitly include correlations between the scores on a cohort level, and how to deal with many multi-score studies. We propose first using IPD to make cohort-level aggregate discrimination or calibration scores, comparing all to a common comparator. Then, standard network meta-analysis techniques can be applied, taking care to consider correlation structures in cohorts with multiple scores. Transitivity, consistency and heterogeneity are also examined. We provide a clinical application, comparing prognostic scores for 3-year mortality in patients with chronic obstructive pulmonary disease using data from a large-scale collaborative initiative. We focus on the discriminative properties of the prognostic scores. Our results show clear differences in performance, with ADO and eBODE showing higher discrimination with respect to mortality than other considered scores. The assumptions of transitivity and local and global consistency were not violated. Heterogeneity was small. We applied a network meta-analytic methodology to externally validate and concurrently compare the prognostic properties of clinical scores. Our large-scale external validation indicates

Validation of MASCC Score for Risk Stratification in Patients of Hematological Disorders with Febrile Neutropenia.

PubMed

Taj, M; Nadeem, M; Maqsood, S; Shah, T; Farzana, T; Shamsi, T S

2017-09-01

The purpose of this study is to evaluate the association of MASCC score (Multinational Association for Supportive Care in Cancer Score) in patients with febrile neutropenia (as resultant treatment of hematological disorders) for risk assessment of morbidity and mortality. Patients presenting with Febrile Neutropenia from November 2011 till December 2013 were enrolled in the study. Initially all patients were hospitalized and their MASCC score was calculated, however those with high risk stayed in hospital till full ANC recovery while low risk group was discharged earlier and keenly followed as out-patient while being on prophylactic oral antibiotics. The MASCC risk-index score was calculated and patients with risk score >21 were regarded as low-risk while <21 were labeled as high-risk. On the basis of 226 febrile neutropenia patient 132(58.4 %) were categorized as low risk while 94(41.5 %) as high risk patients according to MASCC risk index score. In low risk group 123(93 %) had uncomplicated infection while 9(7 %) had complicated infections. There was no mortality documented in low risk group while eight patients died in high risk group. In this study we correctly predicted outcome of 123(93 %) low risk group patients. The study had positive predictive value of 93 % with both sensitivity and specificity of 65 and 75 % respectively. The MASCC risk score is a valuable tool in determining the outcome in patients with febrile neutropenia.

Validation of a prognostic score for hidden cancer in unprovoked venous thromboembolism

PubMed Central

Otero, Remedios; Jimenez, David; Praena-Fernandez, Juan Manuel; Font, Carme; Falga, Conxita; Soler, Silvia; Riesco, David; Verhamme, Peter; Monreal, Manuel

2018-01-01

The usefulness of a diagnostic workup for occult cancer in patients with venous thromboembolism (VTE) is controversial. We used the RIETE (Registro Informatizado Enfermedad Trombo Embólica) database to perform a nested case-control study to validate a prognostic score that identifies patients with unprovoked VTE at increased risk for cancer. We dichotomized patients as having low- (≤2 points) or high (≥3 points) risk for cancer, and tried to validate the score at 12 and 24 months. From January 2014 to October 2016, 11,695 VTE patients were recruited. Of these, 1,360 with unprovoked VTE (11.6%) were eligible for the study. At 12 months, 52 patients (3.8%; 95%CI: 2.9–5%) were diagnosed with cancer. Among 905 patients (67%) scoring ≤2 points, 22 (2.4%) had cancer. Among 455 scoring ≥3 points, 30 (6.6%) had cancer (hazard ratio 2.8; 95%CI 1.6–5; p<0.01). C-statistic was 0.63 (95%CI 0.55–0.71). At 24 months, 58 patients (4.3%; 95%CI: 3.3–5.5%) were diagnosed with cancer. Among 905 patients scoring ≤2 points, 26 (2.9%) had cancer. Among 455 patients scoring ≥3 points, 32 (7%) had cancer (hazard ratio 2.6; 95%CI 1.5–4.3; p<0.01). C-statistic was 0.61 (95%CI, 0.54–0.69). We validated our prognostic score at 12 and 24 months, although prospective cohort validation is needed. This may help to identify patients for whom more extensive screening workup may be required. PMID:29558509

An Empiric HIV Risk Scoring Tool to Predict HIV-1 Acquisition in African Women.

PubMed

Balkus, Jennifer E; Brown, Elizabeth; Palanee, Thesla; Nair, Gonasagrie; Gafoor, Zakir; Zhang, Jingyang; Richardson, Barbra A; Chirenje, Zvavahera M; Marrazzo, Jeanne M; Baeten, Jared M

2016-07-01

To develop and validate an HIV risk assessment tool to predict HIV acquisition among African women. Data were analyzed from 3 randomized trials of biomedical HIV prevention interventions among African women (VOICE, HPTN 035, and FEM-PrEP). We implemented standard methods for the development of clinical prediction rules to generate a risk-scoring tool to predict HIV acquisition over the course of 1 year. Performance of the score was assessed through internal and external validations. The final risk score resulting from multivariable modeling included age, married/living with a partner, partner provides financial or material support, partner has other partners, alcohol use, detection of a curable sexually transmitted infection, and herpes simplex virus 2 serostatus. Point values for each factor ranged from 0 to 2, with a maximum possible total score of 11. Scores ≥5 were associated with HIV incidence >5 per 100 person-years and identified 91% of incident HIV infections from among only 64% of women. The area under the curve (AUC) for predictive ability of the score was 0.71 (95% confidence interval [CI]: 0.68 to 0.74), indicating good predictive ability. Risk score performance was generally similar with internal cross-validation (AUC = 0.69; 95% CI: 0.66 to 0.73) and external validation in HPTN 035 (AUC = 0.70; 95% CI: 0.65 to 0.75) and FEM-PrEP (AUC = 0.58; 95% CI: 0.51 to 0.65). A discrete set of characteristics that can be easily assessed in clinical and research settings was predictive of HIV acquisition over 1 year. The use of a validated risk score could improve efficiency of recruitment into HIV prevention research and inform scale-up of HIV prevention strategies in women at highest risk.

Risk score for identifying adults with CSF pleocytosis and negative CSF Gram stain at low risk for an urgent treatable cause.

PubMed

Hasbun, Rodrigo; Bijlsma, Merijn; Brouwer, Matthijs C; Khoury, Nabil; Hadi, Christiane M; van der Ende, Arie; Wootton, Susan H; Salazar, Lucrecia; Hossain, Md Monir; Beilke, Mark; van de Beek, Diederik

2013-08-01

We aimed to derive and validate a risk score that identifies adults with cerebrospinal fluid (CSF) pleocytosis and a negative CSF Gram stain at low risk for an urgent treatable cause. Patients with CSF pleocytosis and a negative CSF Gram stain were stratified into a prospective derivation (n = 193) and a retrospective validation (n = 567) cohort. Clinically related baseline characteristics were grouped into three composite variables, each independently associated with a set of predefined urgent treatable causes. We subsequently derived a risk score classifying patients into low (0 composite variables present) or high (≥ 1 composite variables present) risk for an urgent treatable cause. The sensitivity of the risk score was determined in the validation cohort and in a prospective case series of 214 adults with CSF-culture proven bacterial meningitis, CSF pleocytosis and a negative Gram stain. A total of 41 of 193 patients (21%) in the derivation cohort and 71 of 567 (13%) in the validation cohort had an urgent treatable cause. Sensitivity of the dichotomized risk score to detect an urgent treatable cause was 100.0% (95% CI 93.9-100.0%) in the validation cohort and 100.0% (95% CI 97.8-100.0%) in bacterial meningitis patients. The risk score can be used to identify adults with CSF pleocytosis and a negative CSF Gram stain at low risk for an urgent treatable cause. Copyright © 2013 The British Infection Association. Published by Elsevier Ltd. All rights reserved.

RISK SCORE FOR IDENTIFYING ADULTS WITH CSF PLEOCYTOSIS AND NEGATIVE CSF GRAM STAIN AT LOW RISK FOR AN URGENT TREATABLE CAUSE

PubMed Central

Hasbun, Rodrigo; Bijlsma, Merijn; Brouwer, Matthijs C; Khoury, Nabil; Hadi, Christiane M; van der Ende, Arie; Wootton, Susan H.; Salazar, Lucrecia; Hossain, Md Monir; Beilke, Mark; van de Beek, Diederik

2013-01-01

Background We aimed to derive and validate a risk score that identifies adults with cerebrospinal fluid (CSF) pleocytosis and a negative CSF Gram stain at low risk for an urgent treatable cause. Methods Patients with CSF pleocytosis and a negative CSF Gram stain were stratified into a prospective derivation (n=193) and a retrospective validation (n=567) cohort. Clinically related baseline characteristics were grouped into three composite variables, each independently associated with a set of predefined urgent treatable causes. We subsequently derived a risk score classifying patients into low (0 composite variables present) or high ( ≥ 1 composite variables present) risk for an urgent treatable cause. The sensitivity of the risk score was determined in the validation cohort and in a prospective case series of 214 adults with CSF-culture proven bacterial meningitis, CSF pleocytosis and a negative Gram stain. Findings A total of 41 of 193 patients (21%) in the derivation cohort and 71 of 567 (13%) in the validation cohort had an urgent treatable cause. Sensitivity of the dichotomized risk score to detect an urgent treatable cause was 100.0% (95%CI 93.9-100.0%) in the validation cohort and 100.0% (95%CI 97.8-100.0%) in bacterial meningitis patients. Interpretation The risk score can be used to identify adults with CSF pleocytosis and a negative CSF Gram stain at low risk for an urgent treatable cause. PMID:23619080

External Validation of Risk Prediction Scores for Invasive Candidiasis in a Medical/Surgical Intensive Care Unit: An Observational Study

PubMed Central

Ahmed, Armin; Baronia, Arvind Kumar; Azim, Afzal; Marak, Rungmei S. K.; Yadav, Reema; Sharma, Preeti; Gurjar, Mohan; Poddar, Banani; Singh, Ratender Kumar

2017-01-01

Background: The aim of this study was to conduct external validation of risk prediction scores for invasive candidiasis. Methods: We conducted a prospective observational study in a 12-bedded adult medical/surgical Intensive Care Unit (ICU) to evaluate Candida score >3, colonization index (CI) >0.5, corrected CI >0.4 (CCI), and Ostrosky's clinical prediction rule (CPR). Patients' characteristics and risk factors for invasive candidiasis were noted. Patients were divided into two groups; invasive candidiasis and no-invasive candidiasis. Results: Of 198 patients, 17 developed invasive candidiasis. Discriminatory power (area under receiver operator curve [AUROC]) for Candida score, CI, CCI, and CPR were 0.66, 0.67, 0.63, and 0.62, respectively. A large number of patients in the no-invasive candidiasis group (114 out of 181) were exposed to antifungal agents during their stay in ICU. Subgroup analysis was carried out after excluding such patients from no-invasive candidiasis group. AUROC of Candida score, CI, CCI, and CPR were 0.7, 0.7, 0.65, and 0.72, respectively, and positive predictive values (PPVs) were in the range of 25%–47%, along with negative predictive values (NPVs) in the range of 84%–96% in the subgroup analysis. Conclusion: Currently available risk prediction scores have good NPV but poor PPV. They are useful for selecting patients who are not likely to benefit from antifungal therapy. PMID:28904481

A population-based validation study of the DCIS Score predicting recurrence risk in individuals treated by breast-conserving surgery alone.

PubMed

Rakovitch, Eileen; Nofech-Mozes, Sharon; Hanna, Wedad; Baehner, Frederick L; Saskin, Refik; Butler, Steven M; Tuck, Alan; Sengupta, Sandip; Elavathil, Leela; Jani, Prashant A; Bonin, Michel; Chang, Martin C; Robertson, Susan J; Slodkowska, Elzbieta; Fong, Cindy; Anderson, Joseph M; Jamshidian, Farid; Miller, Dave P; Cherbavaz, Diana B; Shak, Steven; Paszat, Lawrence

2015-07-01

Validated biomarkers are needed to improve risk assessment and treatment decision-making for women with ductal carcinoma in situ (DCIS) of the breast. The Oncotype DX DCIS Score (DS) was shown to predict the risk of local recurrence (LR) in individuals with low-risk DCIS treated by breast-conserving surgery (BCS) alone. Our objective was to confirm these results in a larger population-based cohort of individuals. We used an established population-based cohort of individuals diagnosed with DCIS treated with BCS alone from 1994 to 2003 with validation of treatment and outcomes. Central pathology assessment excluded cases with invasive cancer, DCIS < 2 mm or positive margins. Cox model was used to determine the relationship between independent covariates, the DS (hazard ratio (HR)/50 Cp units (U)) and LR. Tumor blocks were collected for 828 patients. Final evaluable population includes 718 cases, of whom 571 had negative margins. Median follow-up was 9.6 years. 100 cases developed LR following BCS alone (DCIS, N = 44; invasive, N = 57). In the primary pre-specified analysis, the DS was associated with any LR (DCIS or invasive) in ER+ patients (HR 2.26; P < 0.001) and in all patients regardless of ER status (HR 2.15; P < 0.001). DCIS Score provided independent information on LR risk beyond clinical and pathologic variables including size, age, grade, necrosis, multifocality, and subtype (adjusted HR 1.68; P = 0.02). DCIS was associated with invasive LR (HR 1.78; P = 0.04) and DCIS LR (HR 2.43; P = 0.005). The DCIS Score independently predicts and quantifies individualized recurrence risk in a population of patients with pure DCIS treated by BCS alone.

The novel biomarker-based ABC (age, biomarkers, clinical history)-bleeding risk score for patients with atrial fibrillation: a derivation and validation study.

PubMed

Hijazi, Ziad; Oldgren, Jonas; Lindbäck, Johan; Alexander, John H; Connolly, Stuart J; Eikelboom, John W; Ezekowitz, Michael D; Held, Claes; Hylek, Elaine M; Lopes, Renato D; Siegbahn, Agneta; Yusuf, Salim; Granger, Christopher B; Wallentin, Lars

2016-06-04

The benefit of oral anticoagulation in atrial fibrillation is based on a balance between reduction in ischaemic stroke and increase in major bleeding. We aimed to develop and validate a new biomarker-based risk score to improve the prognostication of major bleeding in patients with atrial fibrillation. We developed and internally validated a new biomarker-based risk score for major bleeding in 14,537 patients with atrial fibrillation randomised to apixaban versus warfarin in the ARISTOTLE trial and externally validated it in 8468 patients with atrial fibrillation randomised to dabigatran versus warfarin in the RE-LY trial. Plasma samples for determination of candidate biomarker concentrations were obtained at randomisation. Major bleeding events were centrally adjudicated. The predictive values of biomarkers and clinical variables were assessed with Cox regression models. The most important variables were included in the score with weights proportional to the model coefficients. The ARISTOTLE and RE-LY trials are registered with ClinicalTrials.gov, numbers NCT00412984 and NCT00262600, respectively. The most important predictors for major bleeding were the concentrations of the biomarkers growth differentiation factor-15 (GDF-15), high-sensitivity cardiac troponin T (cTnT-hs) and haemoglobin, age, and previous bleeding. The ABC-bleeding score (age, biomarkers [GDF-15, cTnT-hs, and haemoglobin], and clinical history [previous bleeding]) score yielded a higher c-index than the conventional HAS-BLED and the newer ORBIT scores for major bleeding in both the derivation cohort (0·68 [95% CI 0·66-0·70] vs 0·61 [0·59-0·63] vs 0·65 [0·62-0·67], respectively; ABC-bleeding vs HAS-BLED p<0·0001 and ABC-bleeding vs ORBIT p=0·0008). ABC-bleeding score also yielded a higher c-index score in the the external validation cohort (0·71 [95% CI 0·68-0·73] vs 0·62 [0·59-0·64] for HAS-BLED vs 0·68 [0·65-0·70] for ORBIT; ABC-bleeding vs HAS-BLED p<0·0001 and ABC

The ACTA PORT-score for predicting perioperative risk of blood transfusion for adult cardiac surgery.

PubMed

Klein, A A; Collier, T; Yeates, J; Miles, L F; Fletcher, S N; Evans, C; Richards, T

2017-09-01

A simple and accurate scoring system to predict risk of transfusion for patients undergoing cardiac surgery is lacking. We identified independent risk factors associated with transfusion by performing univariate analysis, followed by logistic regression. We then simplified the score to an integer-based system and tested it using the area under the receiver operator characteristic (AUC) statistic with a Hosmer-Lemeshow goodness-of-fit test. Finally, the scoring system was applied to the external validation dataset and the same statistical methods applied to test the accuracy of the ACTA-PORT score. Several factors were independently associated with risk of transfusion, including age, sex, body surface area, logistic EuroSCORE, preoperative haemoglobin and creatinine, and type of surgery. In our primary dataset, the score accurately predicted risk of perioperative transfusion in cardiac surgery patients with an AUC of 0.76. The external validation confirmed accuracy of the scoring method with an AUC of 0.84 and good agreement across all scores, with a minor tendency to under-estimate transfusion risk in very high-risk patients. The ACTA-PORT score is a reliable, validated tool for predicting risk of transfusion for patients undergoing cardiac surgery. This and other scores can be used in research studies for risk adjustment when assessing outcomes, and might also be incorporated into a Patient Blood Management programme. © The Author 2017. Published by Oxford University Press on behalf of the British Journal of Anaesthesia. All rights reserved. For Permissions, please email: journals.permissions@oup.com

Validation of the Framingham general cardiovascular risk score in a multiethnic Asian population: a retrospective cohort study

PubMed Central

Gray, Sarah Yu Weng; Ching, Siew Mooi; Lim, Hooi Min; Chinna, Karuthan

2015-01-01

Objective This study aims to examine the validity of the Framingham general cardiovascular disease (CVD) risk chart in a primary care setting. Design This is a 10-year retrospective cohort study. Setting A primary care clinic in a teaching hospital in Malaysia. Participants 967 patients’ records were randomly selected from patients who were attending follow-up in the clinic. Main outcome measures Baseline demographic data, history of diabetes and smoking, blood pressure (BP), and serum lipids were captured from patient records in 1998. Each patient's Framingham CVD score was computed from these parameters. All atherosclerotic CVD events occurring between 1998 and 2007 were counted. Results In 1998, mean age was 57 years with 33.8% men, 6.1% smokers, 43.3% diabetics and 59.7% hypertensive. Median BP was 140/80 mm Hg and total cholesterol 6.0 mmol/L (1.3). The predicted median Framingham general CVD risk score for the study population was 21.5% (IQR 1.2–30.0) while the actual CVD events that occurred in the 10 years was 13.1% (127/967). The median CVD points for men was 30.0, giving them a CVD risk of more than 30%; for women it is 18.5, a CVD risk of 21.5%. Our study found that the Framingham general CVD risk score to have moderate discrimination with an area under the receiver operating characteristic curve (AUC) of 0.63. It also discriminates well for Malay (AUC 0.65, p=0.01), Chinese (AUC 0.60, p=0.03), and Indians (AUC 0.65, p=0.001). There was good calibration with Hosmer-Lemeshow test χ2=3.25, p=0.78. Conclusions Taking into account that this cohort of patients were already on treatment, the Framingham General CVD Risk Prediction Score predicts fairly accurately for men and overestimates somewhat for women. In the absence of local risk prediction charts, the Framingham general CVD risk prediction chart is a reasonable alternative for use in a multiethnic group in a primary care setting. PMID:25991451

Validation of the Framingham general cardiovascular risk score in a multiethnic Asian population: a retrospective cohort study.

PubMed

Chia, Yook Chin; Gray, Sarah Yu Weng; Ching, Siew Mooi; Lim, Hooi Min; Chinna, Karuthan

2015-05-19

This study aims to examine the validity of the Framingham general cardiovascular disease (CVD) risk chart in a primary care setting. This is a 10-year retrospective cohort study. A primary care clinic in a teaching hospital in Malaysia. 967 patients' records were randomly selected from patients who were attending follow-up in the clinic. Baseline demographic data, history of diabetes and smoking, blood pressure (BP), and serum lipids were captured from patient records in 1998. Each patient's Framingham CVD score was computed from these parameters. All atherosclerotic CVD events occurring between 1998 and 2007 were counted. In 1998, mean age was 57 years with 33.8% men, 6.1% smokers, 43.3% diabetics and 59.7% hypertensive. Median BP was 140/80 mm Hg and total cholesterol 6.0 mmol/L (1.3). The predicted median Framingham general CVD risk score for the study population was 21.5% (IQR 1.2-30.0) while the actual CVD events that occurred in the 10 years was 13.1% (127/967). The median CVD points for men was 30.0, giving them a CVD risk of more than 30%; for women it is 18.5, a CVD risk of 21.5%. Our study found that the Framingham general CVD risk score to have moderate discrimination with an area under the receiver operating characteristic curve (AUC) of 0.63. It also discriminates well for Malay (AUC 0.65, p=0.01), Chinese (AUC 0.60, p=0.03), and Indians (AUC 0.65, p=0.001). There was good calibration with Hosmer-Lemeshow test χ(2)=3.25, p=0.78. Taking into account that this cohort of patients were already on treatment, the Framingham General CVD Risk Prediction Score predicts fairly accurately for men and overestimates somewhat for women. In the absence of local risk prediction charts, the Framingham general CVD risk prediction chart is a reasonable alternative for use in a multiethnic group in a primary care setting. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Evaluation of polygenic risk scores for predicting breast and prostate cancer risk.

PubMed

Machiela, Mitchell J; Chen, Chia-Yen; Chen, Constance; Chanock, Stephen J; Hunter, David J; Kraft, Peter

2011-09-01

Recently, polygenic risk scores (PRS) have been shown to be associated with certain complex diseases. The approach has been based on the contribution of counting multiple alleles associated with disease across independent loci, without requiring compelling evidence that every locus had already achieved definitive genome-wide statistical significance. Whether PRS assist in the prediction of risk of common cancers is unknown. We built PRS from lists of genetic markers prioritized by their association with breast cancer (BCa) or prostate cancer (PCa) in a training data set and evaluated whether these scores could improve current genetic prediction of these specific cancers in independent test samples. We used genome-wide association data on 1,145 BCa cases and 1,142 controls from the Nurses' Health Study and 1,164 PCa cases and 1,113 controls from the Prostate Lung Colorectal and Ovarian Cancer Screening Trial. Ten-fold cross validation was used to build and evaluate PRS with 10 to 60,000 independent single nucleotide polymorphisms (SNPs). For both BCa and PCa, the models that included only published risk alleles maximized the cross-validation estimate of the area under the ROC curve (0.53 for breast and 0.57 for prostate). We found no significant evidence that PRS using common variants improved risk prediction for BCa and PCa over replicated SNP scores. © 2011 Wiley-Liss, Inc.

External validation of the simple clinical score and the HOTEL score, two scores for predicting short-term mortality after admission to an acute medical unit.

PubMed

Stræde, Mia; Brabrand, Mikkel

2014-01-01

Clinical scores can be of aid to predict early mortality after admission to a medical admission unit. A developed scoring system needs to be externally validated to minimise the risk of the discriminatory power and calibration to be falsely elevated. We performed the present study with the objective of validating the Simple Clinical Score (SCS) and the HOTEL score, two existing risk stratification systems that predict mortality for medical patients based solely on clinical information, but not only vital signs. Pre-planned prospective observational cohort study. Danish 460-bed regional teaching hospital. We included 3046 consecutive patients from 2 October 2008 until 19 February 2009. 26 (0.9%) died within one calendar day and 196 (6.4%) died within 30 days. We calculated SCS for 1080 patients. We found an AUROC of 0.960 (95% confidence interval [CI], 0.932 to 0.988) for 24-hours mortality and 0.826 (95% CI, 0.774-0.879) for 30-day mortality, and goodness-of-fit test, χ(2) = 2.68 (10 degrees of freedom), P = 0.998 and χ(2) = 4.00, P = 0.947, respectively. We included 1470 patients when calculating the HOTEL score. Discriminatory power (AUROC) was 0.931 (95% CI, 0.901-0.962) for 24-hours mortality and goodness-of-fit test, χ(2) = 5.56 (10 degrees of freedom), P = 0.234. We find that both the SCS and HOTEL scores showed an excellent to outstanding ability in identifying patients at high risk of dying with good or acceptable precision.

External validation of the NUn score for predicting anastomotic leakage after oesophageal resection.

PubMed

Paireder, Matthias; Jomrich, Gerd; Asari, Reza; Kristo, Ivan; Gleiss, Andreas; Preusser, Matthias; Schoppmann, Sebastian F

2017-08-29

Early detection of anastomotic leakage (AL) after oesophageal resection for malignancy is crucial. This retrospective study validates a risk score, predicting AL, which includes C-reactive protein, albumin and white cell count in patients undergoing oesophageal resection between 2003 and 2014. For validation of the NUn score a receiver operating characteristic (ROC) curve is estimated. Area under the ROC curve (AUC) is reported with 95% confidence interval (CI). Among 258 patients (79.5% male) 32 patients showed signs of anastomotic leakage (12.4%). NUn score in our data has a median of 9.3 (range 6.2-17.6). The odds ratio for AL was 1.31 (CI 1.03-1.67; p = 0.028). AUC for AL was 0.59 (CI 0.47-0.72). Using the original cutoff value of 10, the sensitivity was 45.2% an the specificity was 73.8%. This results in a positive predictive value of 19.4% and a negative predictive value of 90.6%. The proportion of variation in AL occurrence, which is explained by the NUn score, was 2.5% (PEV = 0.025). This study provides evidence for an external validation of a simple risk score for AL after oesophageal resection. In this cohort, the NUn score is not useful due to its poor discrimination.

Two risk score models for predicting incident Type 2 diabetes in Japan.

PubMed

Doi, Y; Ninomiya, T; Hata, J; Hirakawa, Y; Mukai, N; Iwase, M; Kiyohara, Y

2012-01-01

Risk scoring methods are effective for identifying persons at high risk of Type 2 diabetes mellitus, but such approaches have not yet been established in Japan. A total of 1935 subjects of a derivation cohort were followed up for 14 years from 1988 and 1147 subjects of a validation cohort independent of the derivation cohort were followed up for 5 years from 2002. Risk scores were estimated based on the coefficients (β) of Cox proportional hazards model in the derivation cohort and were verified in the validation cohort. In the derivation cohort, the non-invasive risk model was established using significant risk factors; namely, age, sex, family history of diabetes, abdominal circumference, body mass index, hypertension, regular exercise and current smoking. We also created another scoring risk model by adding fasting plasma glucose levels to the non-invasive model (plus-fasting plasma glucose model). The area under the curve of the non-invasive model was 0.700 and it increased significantly to 0.772 (P < 0.001) in the plus-fasting plasma glucose model. The ability of the non-invasive model to predict Type 2 diabetes was comparable with that of impaired glucose tolerance, and the plus-fasting plasma glucose model was superior to it. The cumulative incidence of Type 2 diabetes was significantly increased with elevating quintiles of the sum scores of both models in the validation cohort (P for trend < 0.001). We developed two practical risk score models for easily identifying individuals at high risk of incident Type 2 diabetes without an oral glucose tolerance test in the Japanese population. © 2011 The Authors. Diabetic Medicine © 2011 Diabetes UK.

Validation of the Retinal Detachment after Open Globe Injury (RD-OGI) Score as an Effective Tool for Predicting Retinal Detachment.

PubMed

Brodowska, Katarzyna; Stryjewski, Tomasz P; Papavasileiou, Evangelia; Chee, Yewlin E; Eliott, Dean

2017-05-01

The Retinal Detachment after Open Globe Injury (RD-OGI) Score is a clinical prediction model that was developed at the Massachusetts Eye and Ear Infirmary to predict the risk of retinal detachment (RD) after open globe injury (OGI). This study sought to validate the RD-OGI Score in an independent cohort of patients. Retrospective cohort study. The predictive value of the RD-OGI Score was evaluated by comparing the original RD-OGI Scores of 893 eyes with OGI that presented between 1999 and 2011 (the derivation cohort) with 184 eyes with OGI that presented from January 1, 2012, to January 31, 2014 (the validation cohort). Three risk classes (low, moderate, and high) were created and logistic regression was undertaken to evaluate the optimal predictive value of the RD-OGI Score. A Kaplan-Meier survival analysis evaluated survival experience between the risk classes. Time to RD. At 1 year after OGI, 255 eyes (29%) in the derivation cohort and 66 eyes (36%) in the validation cohort were diagnosed with an RD. At 1 year, the low risk class (RD-OGI Scores 0-2) had a 3% detachment rate in the derivation cohort and a 0% detachment rate in the validation cohort, the moderate risk class (RD-OGI Scores 2.5-4.5) had a 29% detachment rate in the derivation cohort and a 35% detachment rate in the validation cohort, and the high risk class (RD-OGI scores 5-7.5) had a 73% detachment rate in the derivation cohort and an 86% detachment rate in the validation cohort. Regression modeling revealed the RD-OGI to be highly discriminative, especially 30 days after injury, with an area under the receiver operating characteristic curve of 0.939 in the validation cohort. Survival experience was significantly different depending upon the risk class (P < 0.0001, log-rank chi-square). The RD-OGI Score can reliably predict the future risk of developing an RD based on clinical variables that are present at the time of the initial evaluation after OGI. Copyright © 2017 American Academy of

Validating Test Score Meaning and Defending Test Score Use: Different Aims, Different Methods

ERIC Educational Resources Information Center

Cizek, Gregory J.

2016-01-01

Advances in validity theory and alacrity in validation practice have suffered because the term "validity" has been used to refer to two incompatible concerns: (1) the degree of support for specified interpretations of test scores (i.e. intended score meaning) and (2) the degree of support for specified applications (i.e. intended test…

External validation of the TIMI risk score for secondary cardiovascular events among patients with recent myocardial infarction.

PubMed

Williams, Brent A; Chagin, Kevin M; Bash, Lori D; Boden, William E; Duval, Sue; Fowkes, F Gerry R; Mahaffey, Kenneth W; Patel, Mehul D; D'Agostino, Ralph B; Peterson, Eric D; Kattan, Michael W; Bhatt, Deepak L; Bonaca, Marc P

2018-05-01

Risk stratification of patients with recent myocardial infarction (MI) for subsequent cardiovascular (CV) events helps identify patients most likely to benefit from secondary prevention therapies. This study externally validated a new risk score (TRS2˚P) for secondary events derived from the TRA2°P-TIMI 50 trial among post-MI patients from two large health care systems. This retrospective cohort study included 9618 patients treated for acute MI at either the Cleveland Clinic (CC) or Geisinger Health System (GHS) between 2008 and 2013. Patients with a clinic visit within 2-52 weeks of MI were included and followed for CV death, repeat MI, and ischemic stroke through electronic medical records (EMR). The TRS2˚P is based on nine factors determined through EMR documentation. Discrimination and calibration of the TRS2˚P were quantified in both patient populations. MI patients at CC and GHS were older, had more comorbidities, received fewer medications, and had higher 3-year event rates compared to subjects in the TRA2°P trial: 31% (CC), 33% (GHS), and 10% (TRA2°P-TIMI 50). The proposed risk score had similar discrimination across the three cohorts with c-statistics of 0.66 (CC), 0.66 (GHS), and 0.67 (TRA2°P-TIMI 50). A strong graded relationship between the risk score and event rates was observed in all cohorts, though 3-year event rates were consistently higher within TRS2°P strata in the CC and GHS cohorts relative to TRA2˚P-TIMI 50. The TRS2˚P demonstrated consistent risk discrimination across trial and non-trial patients with recent MI, but event rates were consistently higher in the non-trial cohorts. Copyright © 2018. Published by Elsevier B.V.

Prediction of Waitlist Mortality in Adult Heart Transplant Candidates: The Candidate Risk Score.

PubMed

Jasseron, Carine; Legeai, Camille; Jacquelinet, Christian; Leprince, Pascal; Cantrelle, Christelle; Audry, Benoît; Porcher, Raphael; Bastien, Olivier; Dorent, Richard

2017-09-01

The cardiac allocation system in France is currently based on urgency and geography. Medical urgency is defined by therapies without considering objective patient mortality risk factors. This study aimed to develop a waitlist mortality risk score from commonly available candidate variables. The study included all patients, aged 16 years or older, registered on the national registry CRISTAL for first single-organ heart transplantation between January 2010 and December 2014. This population was randomly divided in a 2:1 ratio into derivation and validation cohorts. The association of variables at listing with 1-year waitlist death or delisting for worsening medical condition was assessed within the derivation cohort. The predictors were used to generate a candidate risk score (CRS). Validation of the CRS was performed in the validation cohort. Concordance probability estimation (CPE) was used to evaluate the discriminative capacity of the models. During the study period, 2333 patients were newly listed. The derivation (n =1 555) and the validation cohorts (n = 778) were similar. Short-term mechanical circulatory support, natriuretic peptide decile, glomerular filtration rate, and total bilirubin level were included in a simplified model and incorporated into the score. The Concordance probability estimation of the CRS was 0.73 in the derivation cohort and 0.71 in the validation cohort. The correlation between observed and expected 1-year waitlist mortality in the validation cohort was 0.87. The candidate risk score provides an accurate objective prediction of waitlist mortality. It is currently being used to develop a modified cardiac allocation system in France.

External Validation of the Simple Clinical Score and the HOTEL Score, Two Scores for Predicting Short-Term Mortality after Admission to an Acute Medical Unit

PubMed Central

Stræde, Mia; Brabrand, Mikkel

2014-01-01

Background Clinical scores can be of aid to predict early mortality after admission to a medical admission unit. A developed scoring system needs to be externally validated to minimise the risk of the discriminatory power and calibration to be falsely elevated. We performed the present study with the objective of validating the Simple Clinical Score (SCS) and the HOTEL score, two existing risk stratification systems that predict mortality for medical patients based solely on clinical information, but not only vital signs. Methods Pre-planned prospective observational cohort study. Setting Danish 460-bed regional teaching hospital. Findings We included 3046 consecutive patients from 2 October 2008 until 19 February 2009. 26 (0.9%) died within one calendar day and 196 (6.4%) died within 30 days. We calculated SCS for 1080 patients. We found an AUROC of 0.960 (95% confidence interval [CI], 0.932 to 0.988) for 24-hours mortality and 0.826 (95% CI, 0.774–0.879) for 30-day mortality, and goodness-of-fit test, χ2 = 2.68 (10 degrees of freedom), P = 0.998 and χ2 = 4.00, P = 0.947, respectively. We included 1470 patients when calculating the HOTEL score. Discriminatory power (AUROC) was 0.931 (95% CI, 0.901–0.962) for 24-hours mortality and goodness-of-fit test, χ2 = 5.56 (10 degrees of freedom), P = 0.234. Conclusion We find that both the SCS and HOTEL scores showed an excellent to outstanding ability in identifying patients at high risk of dying with good or acceptable precision. PMID:25144186

Validation of an abbreviated version of the Denver HIV risk score for prediction of HIV infection in an urban ED.

PubMed

Hsieh, Yu-Hsiang; Haukoos, Jason S; Rothman, Richard E

2014-07-01

We sought to evaluate the performance of an abbreviated version of the Denver HIV Risk Score in 2 urban emergency departments (ED) with known high undiagnosed HIV prevalence. We performed a secondary analysis of data collected prospectively between November 2005 and December 2009 as part of an ED-based nontargeted rapid HIV testing program from 2 sites. Demographics; HIV testing history; injection drug use; and select high-risk sexual behaviors, including men who have sex with men, were collected by standardized interview. Information regarding receptive anal intercourse and vaginal intercourse was either not collected or collected inconsistently and was thus omitted from the model to create its abbreviated version. The study cohort included 15184 patients with 114 (0.75%) newly diagnosed with HIV infection. HIV prevalence was 0.41% (95% confidence interval [CI], 0.21%-0.71%) for those with a score less than 20, 0.29% (95% CI, 0.14%-0.52%) for those with a score of 20 to 29, 0.65% (95% CI, 0.48%-0.87%) for those with a score of 30 to 39, 2.38% (95% CI, 1.68%-3.28%) for those with a score of 40 to 49, and 4.57% (95% CI, 2.09%-8.67%) for those with a score of 50 or higher. External validation resulted in good discrimination (area under the receiver operating characteristic curve, 0.75; 95% CI, 0.71-0.79). The calibration regression slope was 0.92 and its R(2) was 0.78. An abbreviated version of the Denver HIV Risk Score had comparable performance to that reported previously, offering a promising alternative strategy for HIV screening in the ED where limited sexual risk behavior information may be obtainable. Copyright © 2014 Elsevier Inc. All rights reserved.

Development of a self-assessment score for metabolic syndrome risk in non-obese Korean adults.

PubMed

Je, Youjin; Kim, Youngyo; Park, Taeyoung

2017-03-01

There is a need for simple risk scores that identify individuals at high risk for metabolic syndrome (MetS). Therefore, this study was performed to develop and validate a self-assessment score for MetS risk in non-obese Korean adults. Data from the fourth Korea National Health and Nutrition Examination Survey (KNHANES IV), 2007-2009 were used to develop a MetS risk score. We included a total of 5,508 non-obese participants aged 19-64 years who were free of a self-reported diagnosis of diabetes, hyperlipidemia, hypertension, stroke, angina, or cancer. Multivariable logistic regression model coefficients were used to assign each variable category a score. The validity of the score was assessed in an independent population survey performed in 2010 and 2011, KNHANES V (n=3,892). Age, BMI, physical activity, smoking, alcohol consumption, dairy consumption, dietary habit of eating less salty and food insecurity were selected as categorical variables. The MetS risk score value varied from 0 to 13, and a cut-point MetS risk score of >=7 was selected based on the highest Youden index. The cut-point provided a sensitivity of 81%, specificity of 61%, positive predictive value of 14%, and negative predictive value of 98%, with an area under the curve (AUC) of 0.78. Consistent results were obtained in the validation data sets. This simple risk score may be used to identify individuals at high risk for MetS without laboratory tests among non-obese Korean adults. Further studies are needed to verify the usefulness and feasibility of this score in various settings.

Validated Risk Score for Predicting 6-Month Mortality in Infective Endocarditis.

PubMed

Park, Lawrence P; Chu, Vivian H; Peterson, Gail; Skoutelis, Athanasios; Lejko-Zupa, Tatjana; Bouza, Emilio; Tattevin, Pierre; Habib, Gilbert; Tan, Ren; Gonzalez, Javier; Altclas, Javier; Edathodu, Jameela; Fortes, Claudio Querido; Siciliano, Rinaldo Focaccia; Pachirat, Orathai; Kanj, Souha; Wang, Andrew

2016-04-18

Host factors and complications have been associated with higher mortality in infective endocarditis (IE). We sought to develop and validate a model of clinical characteristics to predict 6-month mortality in IE. Using a large multinational prospective registry of definite IE (International Collaboration on Endocarditis [ICE]-Prospective Cohort Study [PCS], 2000-2006, n=4049), a model to predict 6-month survival was developed by Cox proportional hazards modeling with inverse probability weighting for surgery treatment and was internally validated by the bootstrapping method. This model was externally validated in an independent prospective registry (ICE-PLUS, 2008-2012, n=1197). The 6-month mortality was 971 of 4049 (24.0%) in the ICE-PCS cohort and 342 of 1197 (28.6%) in the ICE-PLUS cohort. Surgery during the index hospitalization was performed in 48.1% and 54.0% of the cohorts, respectively. In the derivation model, variables related to host factors (age, dialysis), IE characteristics (prosthetic or nosocomial IE, causative organism, left-sided valve vegetation), and IE complications (severe heart failure, stroke, paravalvular complication, and persistent bacteremia) were independently associated with 6-month mortality, and surgery was associated with a lower risk of mortality (Harrell's C statistic 0.715). In the validation model, these variables had similar hazard ratios (Harrell's C statistic 0.682), with a similar, independent benefit of surgery (hazard ratio 0.74, 95% CI 0.62-0.89). A simplified risk model was developed by weight adjustment of these variables. Six-month mortality after IE is ≈25% and is predicted by host factors, IE characteristics, and IE complications. Surgery during the index hospitalization is associated with lower mortality but is performed less frequently in the highest risk patients. A simplified risk model may be used to identify specific risk subgroups in IE. © 2016 The Authors. Published on behalf of the American Heart

A prospective validation of the Bova score in normotensive patients with acute pulmonary embolism.

PubMed

Bova, Carlo; Vanni, Simone; Prandoni, Paolo; Morello, Fulvio; Dentali, Francesco; Bernardi, Enrico; Mumoli, Nicola; Bucherini, Eugenio; Barbar, Sofia; Picariello, Claudio; Enea, Iolanda; Pesavento, Raffaele; Bottino, Fabrizio; Jiménez, David

2018-05-01

The Bova score has shown usefulness in the identification of intermediate-high risk patients with acute pulmonary embolism (PE), but lacks prospective validation. The aim of this study was to prospectively validate the Bova score in different settings from the original derivation cohort. Consecutive, normotensive patients with acute PE recruited at 13 academic or general hospitals were stratified, using their baseline data, into the three Bova risk stages (I-III). The primary outcome was the 30-day composite of PE-related mortality, hemodynamic collapse and non-fatal PE recurrences in the three risk categories. In the study period, 639 patients were enrolled. The primary end point occurred in 45 patients (7.0%; 95% Confidence Intervals, 5.2%-9.3%). Risk stage correlated with the PE-related complication rate (stage I, 2.9%; stage II, 17%; stage III, 27%). Patients classified as stage III by the Bova score had a 6.5-fold increased risk for adverse outcomes (3.1-13.5, p < 0.001) compared with stages I and II combined. Rescue thrombolysis increased from stage I to stage III (0.6%, 12% and 15% respectively). All-cause mortality (5.3%) did not substantially differ among the stages. The Bova score accurately stratifies normotensive patients with acute PE into stages of increasing risk of 30-day PE-related complications. Copyright © 2018 Elsevier Ltd. All rights reserved.

Establishment and Validation of GV-SAPS II Scoring System for Non-Diabetic Critically Ill Patients

PubMed Central

Liu, Wen-Yue; Lin, Shi-Gang; Zhu, Gui-Qi; Poucke, Sven Van; Braddock, Martin; Zhang, Zhongheng; Mao, Zhi; Shen, Fei-Xia

2016-01-01

Background and Aims Recently, glucose variability (GV) has been reported as an independent risk factor for mortality in non-diabetic critically ill patients. However, GV is not incorporated in any severity scoring system for critically ill patients currently. The aim of this study was to establish and validate a modified Simplified Acute Physiology Score II scoring system (SAPS II), integrated with GV parameters and named GV-SAPS II, specifically for non-diabetic critically ill patients to predict short-term and long-term mortality. Methods Training and validation cohorts were exacted from the Multiparameter Intelligent Monitoring in Intensive Care database III version 1.3 (MIMIC-III v1.3). The GV-SAPS II score was constructed by Cox proportional hazard regression analysis and compared with the original SAPS II, Sepsis-related Organ Failure Assessment Score (SOFA) and Elixhauser scoring systems using area under the curve of the receiver operator characteristic (auROC) curve. Results 4,895 and 5,048 eligible individuals were included in the training and validation cohorts, respectively. The GV-SAPS II score was established with four independent risk factors, including hyperglycemia, hypoglycemia, standard deviation of blood glucose levels (GluSD), and SAPS II score. In the validation cohort, the auROC values of the new scoring system were 0.824 (95% CI: 0.813–0.834, P< 0.001) and 0.738 (95% CI: 0.725–0.750, P< 0.001), respectively for 30 days and 9 months, which were significantly higher than other models used in our study (all P < 0.001). Moreover, Kaplan-Meier plots demonstrated significantly worse outcomes in higher GV-SAPS II score groups both for 30-day and 9-month mortality endpoints (all P< 0.001). Conclusions We established and validated a modified prognostic scoring system that integrated glucose variability for non-diabetic critically ill patients, named GV-SAPS II. It demonstrated a superior prognostic capability and may be an optimal scoring system

Establishment and Validation of GV-SAPS II Scoring System for Non-Diabetic Critically Ill Patients.

PubMed

Liu, Wen-Yue; Lin, Shi-Gang; Zhu, Gui-Qi; Poucke, Sven Van; Braddock, Martin; Zhang, Zhongheng; Mao, Zhi; Shen, Fei-Xia; Zheng, Ming-Hua

2016-01-01

Recently, glucose variability (GV) has been reported as an independent risk factor for mortality in non-diabetic critically ill patients. However, GV is not incorporated in any severity scoring system for critically ill patients currently. The aim of this study was to establish and validate a modified Simplified Acute Physiology Score II scoring system (SAPS II), integrated with GV parameters and named GV-SAPS II, specifically for non-diabetic critically ill patients to predict short-term and long-term mortality. Training and validation cohorts were exacted from the Multiparameter Intelligent Monitoring in Intensive Care database III version 1.3 (MIMIC-III v1.3). The GV-SAPS II score was constructed by Cox proportional hazard regression analysis and compared with the original SAPS II, Sepsis-related Organ Failure Assessment Score (SOFA) and Elixhauser scoring systems using area under the curve of the receiver operator characteristic (auROC) curve. 4,895 and 5,048 eligible individuals were included in the training and validation cohorts, respectively. The GV-SAPS II score was established with four independent risk factors, including hyperglycemia, hypoglycemia, standard deviation of blood glucose levels (GluSD), and SAPS II score. In the validation cohort, the auROC values of the new scoring system were 0.824 (95% CI: 0.813-0.834, P< 0.001) and 0.738 (95% CI: 0.725-0.750, P< 0.001), respectively for 30 days and 9 months, which were significantly higher than other models used in our study (all P < 0.001). Moreover, Kaplan-Meier plots demonstrated significantly worse outcomes in higher GV-SAPS II score groups both for 30-day and 9-month mortality endpoints (all P< 0.001). We established and validated a modified prognostic scoring system that integrated glucose variability for non-diabetic critically ill patients, named GV-SAPS II. It demonstrated a superior prognostic capability and may be an optimal scoring system for prognostic evaluation in this patient group.

Score tests for independence in semiparametric competing risks models.

PubMed

Saïd, Mériem; Ghazzali, Nadia; Rivest, Louis-Paul

2009-12-01

A popular model for competing risks postulates the existence of a latent unobserved failure time for each risk. Assuming that these underlying failure times are independent is attractive since it allows standard statistical tools for right-censored lifetime data to be used in the analysis. This paper proposes simple independence score tests for the validity of this assumption when the individual risks are modeled using semiparametric proportional hazards regressions. It assumes that covariates are available, making the model identifiable. The score tests are derived for alternatives that specify that copulas are responsible for a possible dependency between the competing risks. The test statistics are constructed by adding to the partial likelihoods for the individual risks an explanatory variable for the dependency between the risks. A variance estimator is derived by writing the score function and the Fisher information matrix for the marginal models as stochastic integrals. Pitman efficiencies are used to compare test statistics. A simulation study and a numerical example illustrate the methodology proposed in this paper.

Testing the Predictive Validity of the Hendrich II Fall Risk Model.

PubMed

Jung, Hyesil; Park, Hyeoun-Ae

2018-03-01

Cumulative data on patient fall risk have been compiled in electronic medical records systems, and it is possible to test the validity of fall-risk assessment tools using these data between the times of admission and occurrence of a fall. The Hendrich II Fall Risk Model scores assessed during three time points of hospital stays were extracted and used for testing the predictive validity: (a) upon admission, (b) when the maximum fall-risk score from admission to falling or discharge, and (c) immediately before falling or discharge. Predictive validity was examined using seven predictive indicators. In addition, logistic regression analysis was used to identify factors that significantly affect the occurrence of a fall. Among the different time points, the maximum fall-risk score assessed between admission and falling or discharge showed the best predictive performance. Confusion or disorientation and having a poor ability to rise from a sitting position were significant risk factors for a fall.

Development and initial validation of the Bedside Paediatric Early Warning System score

PubMed Central

2009-01-01

Introduction Adverse outcomes following clinical deterioration in children admitted to hospital wards is frequently preventable. Identification of children for referral to critical care experts remains problematic. Our objective was to develop and validate a simple bedside score to quantify severity of illness in hospitalized children. Methods A case-control design was used to evaluate 11 candidate items and identify a pragmatic score for routine bedside use. Case-patients were urgently admitted to the intensive care unit (ICU). Control-patients had no 'code blue', ICU admission or care restrictions. Validation was performed using two prospectively collected datasets. Results Data from 60 case and 120 control-patients was obtained. Four out of eleven candidate-items were removed. The seven-item Bedside Paediatric Early Warning System (PEWS) score ranges from 0–26. The mean maximum scores were 10.1 in case-patients and 3.4 in control-patients. The area under the receiver operating characteristics curve was 0.91, compared with 0.84 for the retrospective nurse-rating of patient risk for near or actual cardiopulmonary arrest. At a score of 8 the sensitivity and specificity were 82% and 93%, respectively. The score increased over 24 hours preceding urgent paediatric intensive care unit (PICU) admission (P < 0.0001). In 436 urgent consultations, the Bedside PEWS score was higher in patients admitted to the ICU than patients who were not admitted (P < 0.0001). Conclusions We developed and performed the initial validation of the Bedside PEWS score. This 7-item score can quantify severity of illness in hospitalized children and identify critically ill children with at least one hours notice. Prospective validation in other populations is required before clinical application. PMID:19678924

Development and validation of a predictive score for perioperative transfusion in patients with hepatocellular carcinoma undergoing liver resection.

PubMed

Wang, Hai-Qing; Yang, Jian; Yang, Jia-Yin; Wang, Wen-Tao; Yan, Lu-Nan

2015-08-01

Liver resection is a major surgery requiring perioperative blood transfusion. Predicting the need for blood transfusion for patients undergoing liver resection is of great importance. The present study aimed to develop and validate a model for predicting transfusion requirement in HBV-related hepatocellular carcinoma patients undergoing liver resection. A total of 1543 consecutive liver resections were included in the study. Randomly selected sample set of 1080 cases (70% of the study cohort) were used to develop a predictive score for transfusion requirement and the remaining 30% (n=463) was used to validate the score. Based on the preoperative and predictable intraoperative parameters, logistic regression was used to identify risk factors and to create an integer score for the prediction of transfusion requirement. Extrahepatic procedure, major liver resection, hemoglobin level and platelets count were identified as independent predictors for transfusion requirement by logistic regression analysis. A score system integrating these 4 factors was stratified into three groups which could predict the risk of transfusion, with a rate of 11.4%, 24.7% and 57.4% for low, moderate and high risk, respectively. The prediction model appeared accurate with good discriminatory abilities, generating an area under the receiver operating characteristic curve of 0.736 in the development set and 0.709 in the validation set. We have developed and validated an integer-based risk score to predict perioperative transfusion for patients undergoing liver resection in a high-volume surgical center. This score allows identifying patients at a high risk and may alter transfusion practices.

Prediction of cardiovascular risk in rheumatoid arthritis: performance of original and adapted SCORE algorithms.

PubMed

Arts, E E A; Popa, C D; Den Broeder, A A; Donders, R; Sandoo, A; Toms, T; Rollefstad, S; Ikdahl, E; Semb, A G; Kitas, G D; Van Riel, P L C M; Fransen, J

2016-04-01

Predictive performance of cardiovascular disease (CVD) risk calculators appears suboptimal in rheumatoid arthritis (RA). A disease-specific CVD risk algorithm may improve CVD risk prediction in RA. The objectives of this study are to adapt the Systematic COronary Risk Evaluation (SCORE) algorithm with determinants of CVD risk in RA and to assess the accuracy of CVD risk prediction calculated with the adapted SCORE algorithm. Data from the Nijmegen early RA inception cohort were used. The primary outcome was first CVD events. The SCORE algorithm was recalibrated by reweighing included traditional CVD risk factors and adapted by adding other potential predictors of CVD. Predictive performance of the recalibrated and adapted SCORE algorithms was assessed and the adapted SCORE was externally validated. Of the 1016 included patients with RA, 103 patients experienced a CVD event. Discriminatory ability was comparable across the original, recalibrated and adapted SCORE algorithms. The Hosmer-Lemeshow test results indicated that all three algorithms provided poor model fit (p<0.05) for the Nijmegen and external validation cohort. The adapted SCORE algorithm mainly improves CVD risk estimation in non-event cases and does not show a clear advantage in reclassifying patients with RA who develop CVD (event cases) into more appropriate risk groups. This study demonstrates for the first time that adaptations of the SCORE algorithm do not provide sufficient improvement in risk prediction of future CVD in RA to serve as an appropriate alternative to the original SCORE. Risk assessment using the original SCORE algorithm may underestimate CVD risk in patients with RA. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Derivation and validation of the prediabetes self-assessment screening score after acute pancreatitis (PERSEUS).

PubMed

Soo, Danielle H E; Pendharkar, Sayali A; Jivanji, Chirag J; Gillies, Nicola A; Windsor, John A; Petrov, Maxim S

2017-10-01

Approximately 40% of patients develop abnormal glucose metabolism after a single episode of acute pancreatitis. This study aimed to develop and validate a prediabetes self-assessment screening score for patients after acute pancreatitis. Data from non-overlapping training (n=82) and validation (n=80) cohorts were analysed. Univariate logistic and linear regression identified variables associated with prediabetes after acute pancreatitis. Multivariate logistic regression developed the score, ranging from 0 to 215. The area under the receiver-operating characteristic curve (AUROC), Hosmer-Lemeshow χ 2 statistic, and calibration plots were used to assess model discrimination and calibration. The developed score was validated using data from the validation cohort. The score had an AUROC of 0.88 (95% CI, 0.80-0.97) and Hosmer-Lemeshow χ 2 statistic of 5.75 (p=0.676). Patients with a score of ≥75 had a 94.1% probability of having prediabetes, and were 29 times more likely to have prediabetes than those with a score of <75. The AUROC in the validation cohort was 0.81 (95% CI, 0.70-0.92) and the Hosmer-Lemeshow χ 2 statistic was 5.50 (p=0.599). Model calibration of the score showed good calibration in both cohorts. The developed and validated score, called PERSEUS, is the first instrument to identify individuals who are at high risk of developing abnormal glucose metabolism following an episode of acute pancreatitis. Copyright © 2017 Editrice Gastroenterologica Italiana S.r.l. Published by Elsevier Ltd. All rights reserved.

Risk prediction score for death of traumatised and injured children

PubMed Central

2014-01-01

Background Injury prediction scores facilitate the development of clinical management protocols to decrease mortality. However, most of the previously developed scores are limited in scope and are non-specific for use in children. We aimed to develop and validate a risk prediction model of death for injured and Traumatised Thai children. Methods Our cross-sectional study included 43,516 injured children from 34 emergency services. A risk prediction model was derived using a logistic regression analysis that included 15 predictors. Model performance was assessed using the concordance statistic (C-statistic) and the observed per expected (O/E) ratio. Internal validation of the model was performed using a 200-repetition bootstrap analysis. Results Death occurred in 1.7% of the injured children (95% confidence interval [95% CI]: 1.57–1.82). Ten predictors (i.e., age, airway intervention, physical injury mechanism, three injured body regions, the Glasgow Coma Scale, and three vital signs) were significantly associated with death. The C-statistic and the O/E ratio were 0.938 (95% CI: 0.929–0.947) and 0.86 (95% CI: 0.70–1.02), respectively. The scoring scheme classified three risk stratifications with respective likelihood ratios of 1.26 (95% CI: 1.25–1.27), 2.45 (95% CI: 2.42–2.52), and 4.72 (95% CI: 4.57–4.88) for low, intermediate, and high risks of death. Internal validation showed good model performance (C-statistic = 0.938, 95% CI: 0.926–0.952) and a small calibration bias of 0.002 (95% CI: 0.0005–0.003). Conclusions We developed a simplified Thai pediatric injury death prediction score with satisfactory calibrated and discriminative performance in emergency room settings. PMID:24575982

The HAT Score-A Simple Risk Stratification Score for Coagulopathic Bleeding During Adult Extracorporeal Membrane Oxygenation.

PubMed

Lonergan, Terence; Herr, Daniel; Kon, Zachary; Menaker, Jay; Rector, Raymond; Tanaka, Kenichi; Mazzeffi, Michael

2017-06-01

The study objective was to create an adult extracorporeal membrane oxygenation (ECMO) coagulopathic bleeding risk score. Secondary analysis was performed on an existing retrospective cohort. Pre-ECMO variables were tested for association with coagulopathic bleeding, and those with the strongest association were included in a multivariable model. Using this model, a risk stratification score was created. The score's utility was validated by comparing bleeding and transfusion rates between score levels. Bleeding also was examined after stratifying by nadir platelet count and overanticoagulation. Predictive power of the score was compared against the risk score for major bleeding during anti-coagulation for atrial fibrillation (HAS-BLED). Tertiary care academic medical center. The study comprised patients who received venoarterial or venovenous ECMO over a 3-year period, excluding those with an identified source of surgical bleeding during exploration. None. Fifty-three (47.3%) of 112 patients experienced coagulopathic bleeding. A 3-variable score-hypertension, age greater than 65, and ECMO type (HAT)-had fair predictive value (area under the receiver operating characteristic curve [AUC] = 0.66) and was superior to HAS-BLED (AUC = 0.64). As the HAT score increased from 0 to 3, bleeding rates also increased as follows: 30.8%, 48.7%, 63.0%, and 71.4%, respectively. Platelet and fresh frozen plasma transfusion tended to increase with the HAT score, but red blood cell transfusion did not. Nadir platelet count less than 50×10 3 /µL and overanticoagulation during ECMO increased the AUC for the model to 0.73, suggesting additive risk. The HAT score may allow for bleeding risk stratification in adult ECMO patients. Future studies in larger cohorts are necessary to confirm these findings. Copyright © 2017 Elsevier Inc. All rights reserved.

Development and validation of a Hospital Frailty Risk Score focusing on older people in acute care settings using electronic hospital records: an observational study.

PubMed

Gilbert, Thomas; Neuburger, Jenny; Kraindler, Joshua; Keeble, Eilis; Smith, Paul; Ariti, Cono; Arora, Sandeepa; Street, Andrew; Parker, Stuart; Roberts, Helen C; Bardsley, Martin; Conroy, Simon

2018-05-05

Older people are increasing users of health care globally. We aimed to establish whether older people with characteristics of frailty and who are at risk of adverse health-care outcomes could be identified using routinely collected data. A three-step approach was used to develop and validate a Hospital Frailty Risk Score from International Statistical Classification of Diseases and Related Health Problems, Tenth Revision (ICD-10) diagnostic codes. First, we carried out a cluster analysis to identify a group of older people (≥75 years) admitted to hospital who had high resource use and diagnoses associated with frailty. Second, we created a Hospital Frailty Risk Score based on ICD-10 codes that characterised this group. Third, in separate cohorts, we tested how well the score predicted adverse outcomes and whether it identified similar groups as other frailty tools. In the development cohort (n=22 139), older people with frailty diagnoses formed a distinct group and had higher non-elective hospital use (33·6 bed-days over 2 years compared with 23·0 bed-days for the group with the next highest number of bed-days). In the national validation cohort (n=1 013 590), compared with the 429 762 (42·4%) patients with the lowest risk scores, the 202 718 (20·0%) patients with the highest Hospital Frailty Risk Scores had increased odds of 30-day mortality (odds ratio 1·71, 95% CI 1·68-1·75), long hospital stay (6·03, 5·92-6·10), and 30-day readmission (1·48, 1·46-1·50). The c statistics (ie, model discrimination) between individuals for these three outcomes were 0·60, 0·68, and 0·56, respectively. The Hospital Frailty Risk Score showed fair overlap with dichotomised Fried and Rockwood scales (kappa scores 0·22, 95% CI 0·15-0·30 and 0·30, 0·22-0·38, respectively) and moderate agreement with the Rockwood Frailty Index (Pearson's correlation coefficient 0·41, 95% CI 0·38-0·47). The Hospital Frailty Risk Score provides hospitals and health

Validation of the DECAF score to predict hospital mortality in acute exacerbations of COPD

PubMed Central

Echevarria, C; Steer, J; Heslop-Marshall, K; Stenton, SC; Hickey, PM; Hughes, R; Wijesinghe, M; Harrison, RN; Steen, N; Simpson, AJ; Gibson, GJ; Bourke, SC

2016-01-01

Background Hospitalisation due to acute exacerbations of COPD (AECOPD) is common, and subsequent mortality high. The DECAF score was derived for accurate prediction of mortality and risk stratification to inform patient care. We aimed to validate the DECAF score, internally and externally, and to compare its performance to other predictive tools. Methods The study took place in the two hospitals within the derivation study (internal validation) and in four additional hospitals (external validation) between January 2012 and May 2014. Consecutive admissions were identified by screening admissions and searching coding records. Admission clinical data, including DECAF indices, and mortality were recorded. The prognostic value of DECAF and other scores were assessed by the area under the receiver operator characteristic (AUROC) curve. Results In the internal and external validation cohorts, 880 and 845 patients were recruited. Mean age was 73.1 (SD 10.3) years, 54.3% were female, and mean (SD) FEV1 45.5 (18.3) per cent predicted. Overall mortality was 7.7%. The DECAF AUROC curve for inhospital mortality was 0.83 (95% CI 0.78 to 0.87) in the internal cohort and 0.82 (95% CI 0.77 to 0.87) in the external cohort, and was superior to other prognostic scores for inhospital or 30-day mortality. Conclusions DECAF is a robust predictor of mortality, using indices routinely available on admission. Its generalisability is supported by consistent strong performance; it can identify low-risk patients (DECAF 0–1) potentially suitable for Hospital at Home or early supported discharge services, and high-risk patients (DECAF 3–6) for escalation planning or appropriate early palliation. Trial registration number UKCRN ID 14214. PMID:26769015

The SAFARI Score to Assess the Risk of Convulsive Seizure During Admission for Aneurysmal Subarachnoid Hemorrhage.

PubMed

Jaja, Blessing N R; Schweizer, Tom A; Claassen, Jan; Le Roux, Peter; Mayer, Stephan A; Macdonald, R Loch

2018-06-01

Seizure is a significant complication in patients under acute admission for aneurysmal SAH and could result in poor outcomes. Treatment strategies to optimize management will benefit from methods to better identify at-risk patients. To develop and validate a risk score for convulsive seizure during acute admission for SAH. A risk score was developed in 1500 patients from a single tertiary hospital and externally validated in 852 patients. Candidate predictors were identified by systematic review of the literature and were included in a backward stepwise logistic regression model with in-hospital seizure as a dependent variable. The risk score was assessed for discrimination using the area under the receiver operator characteristics curve (AUC) and for calibration using a goodness-of-fit test. The SAFARI score, based on 4 items (age ≥ 60 yr, seizure occurrence before hospitalization, ruptured aneurysm in the anterior circulation, and hydrocephalus requiring cerebrospinal fluid diversion), had AUC = 0.77, 95% confidence interval (CI): 0.73-0.82 in the development cohort. The validation cohort had AUC = 0.65, 95% CI 0.56-0.73. A calibrated increase in the risk of seizure was noted with increasing SAFARI score points. The SAFARI score is a simple tool that adequately stratified SAH patients according to their risk for seizure using a few readily derived predictor items. It may contribute to a more individualized management of seizure following SAH.

Financial validation of the European Society of Thoracic Surgeons risk score predicting prolonged air leak after video-assisted thoracic surgery lobectomy.

PubMed

Brunelli, Alessandro; Pompili, Cecilia; Dinesh, Padma; Bassi, Vinod; Imperatori, Andrea

2018-04-27

The objective of this study was to verify whether the European Society of Thoracic Surgeons prolonged air leak risk score for video-assisted thoracoscopic lobectomy was associated with incremental postoperative costs. We retrospectively analyzed 353 patients subjected to video-assisted thoracoscopic lobectomy or segmentectomy (April 2014 to March 2016). Postoperative costs were obtained from the hospital Finance Department. Patients were grouped in different classes of risk according to their prolonged air leak risk score. To verify the independent association of the prolonged air leak risk score with postoperative costs, we performed a stepwise multivariable regression analysis in which the dependent variable was postoperative cost. Prolonged air leak developed in 56 patients (15.9%). Their length of stay was 3 days longer compared with those without prolonged air leak (8.3 vs 5.4, P < .0001). Their postoperative cost was higher than that of patients without prolonged air leak: $5939.8 versus $4381.7 (P = .001). After grouping the patients according to their prolonged air leak risk score, prolonged air leak incidence was 12.3% in class A, 13.7% in class B, 28.8% in class C, and 22.2% in class D (P = .020). The average postoperative cost was $4031.0 in class A, $4498.2 in class B, $6146.6 in class C, and $6809.3 in class D (analysis of variance test, P < .001). Multivariable regression analysis showed that being in classes C and D of PAL score (P = .001) and the presence of cardiopulmonary complications (P < .0001) were the only independent factors significantly associated with postoperative costs. We financially validated the European Society of Thoracic Surgeons prolonged air leak risk score for video-assisted thoracoscopic lobectomies, which appears useful in selecting those patients in whom the application of additional intraoperative interventions to avoid prolonged air leak may be more cost-effective. Copyright © 2018 The American Association

Early inpatient calculation of laboratory-based 30-day readmission risk scores empowers clinical risk modification during index hospitalization.

PubMed

Horne, Benjamin D; Budge, Deborah; Masica, Andrew L; Savitz, Lucy A; Benuzillo, José; Cantu, Gabriela; Bradshaw, Alejandra; McCubrey, Raymond O; Bair, Tami L; Roberts, Colleen A; Rasmusson, Kismet D; Alharethi, Rami; Kfoury, Abdallah G; James, Brent C; Lappé, Donald L

2017-03-01

Improving 30-day readmission continues to be problematic for most hospitals. This study reports the creation and validation of sex-specific inpatient (i) heart failure (HF) risk scores using electronic data from the beginning of inpatient care for effective and efficient prediction of 30-day readmission risk. HF patients hospitalized at Intermountain Healthcare from 2005 to 2012 (derivation: n=6079; validation: n=2663) and Baylor Scott & White Health (North Region) from 2005 to 2013 (validation: n=5162) were studied. Sex-specific iHF scores were derived to predict post-hospitalization 30-day readmission using common HF laboratory measures and age. Risk scores adding social, morbidity, and treatment factors were also evaluated. The iHF model for females utilized potassium, bicarbonate, blood urea nitrogen, red blood cell count, white blood cell count, and mean corpuscular hemoglobin concentration; for males, components were B-type natriuretic peptide, sodium, creatinine, hematocrit, red cell distribution width, and mean platelet volume. Among females, odds ratios (OR) were OR=1.99 for iHF tertile 3 vs. 1 (95% confidence interval [CI]=1.28, 3.08) for Intermountain validation (P-trend across tertiles=0.002) and OR=1.29 (CI=1.01, 1.66) for Baylor patients (P-trend=0.049). Among males, iHF had OR=1.95 (CI=1.33, 2.85) for tertile 3 vs. 1 in Intermountain (P-trend <0.001) and OR=2.03 (CI=1.52, 2.71) in Baylor (P-trend < 0.001). Expanded models using 182-183 variables had predictive abilities similar to iHF. Sex-specific laboratory-based electronic health record-delivered iHF risk scores effectively predicted 30-day readmission among HF patients. Efficient to calculate and deliver to clinicians, recent clinical implementation of iHF scores suggest they are useful and useable for more precise clinical HF treatment. Copyright © 2016 Elsevier Inc. All rights reserved.

Development and Validation of a Disease Severity Scoring Model for Pediatric Sepsis.

PubMed

Hu, Li; Zhu, Yimin; Chen, Mengshi; Li, Xun; Lu, Xiulan; Liang, Ying; Tan, Hongzhuan

2016-07-01

Multiple severity scoring systems have been devised and evaluated in adult sepsis, but a simplified scoring model for pediatric sepsis has not yet been developed. This study aimed to develop and validate a new scoring model to stratify the severity of pediatric sepsis, thus assisting the treatment of sepsis in children. Data from 634 consecutive patients who presented with sepsis at Children's hospital of Hunan province in China in 2011-2013 were analyzed, with 476 patients placed in training group and 158 patients in validation group. Stepwise discriminant analysis was used to develop the accurate discriminate model. A simplified scoring model was generated using weightings defined by the discriminate coefficients. The discriminant ability of the model was tested by receiver operating characteristic curves (ROC). The discriminant analysis showed that prothrombin time, D-dimer, total bilirubin, serum total protein, uric acid, PaO2/FiO2 ratio, myoglobin were associated with severity of sepsis. These seven variables were assigned with values of 4, 3, 3, 4, 3, 3, 3 respectively based on the standardized discriminant coefficients. Patients with higher scores had higher risk of severe sepsis. The areas under ROC (AROC) were 0.836 for accurate discriminate model, and 0.825 for simplified scoring model in validation group. The proposed disease severity scoring model for pediatric sepsis showed adequate discriminatory capacity and sufficient accuracy, which has important clinical significance in evaluating the severity of pediatric sepsis and predicting its progress.

Predicting Hemorrhagic Transformation of Acute Ischemic Stroke: Prospective Validation of the HeRS Score.

PubMed

Marsh, Elisabeth B; Llinas, Rafael H; Schneider, Andrea L C; Hillis, Argye E; Lawrence, Erin; Dziedzic, Peter; Gottesman, Rebecca F

2016-01-01

Hemorrhagic transformation (HT) increases the morbidity and mortality of ischemic stroke. Anticoagulation is often indicated in patients with atrial fibrillation, low ejection fraction, or mechanical valves who are hospitalized with acute stroke, but increases the risk of HT. Risk quantification would be useful. Prior studies have investigated risk of systemic hemorrhage in anticoagulated patients, but none looked specifically at HT. In our previously published work, age, infarct volume, and estimated glomerular filtration rate (eGFR) significantly predicted HT. We created the hemorrhage risk stratification (HeRS) score based on regression coefficients in multivariable modeling and now determine its validity in a prospectively followed inpatient cohort.A total of 241 consecutive patients presenting to 2 academic stroke centers with acute ischemic stroke and an indication for anticoagulation over a 2.75-year period were included. Neuroimaging was evaluated for infarct volume and HT. Hemorrhages were classified as symptomatic versus asymptomatic, and by severity. HeRS scores were calculated for each patient and compared to actual hemorrhage status using receiver operating curve analysis.Area under the curve (AUC) comparing predicted odds of hemorrhage (HeRS score) to actual hemorrhage status was 0.701. Serum glucose (P < 0.001), white blood cell count (P < 0.001), and warfarin use prior to admission (P = 0.002) were also associated with HT in the validation cohort. With these variables, AUC improved to 0.854. Anticoagulation did not significantly increase HT; but with higher intensity anticoagulation, hemorrhages were more likely to be symptomatic and more severe.The HeRS score is a valid predictor of HT in patients with ischemic stroke and indication for anticoagulation.

Genetic assessment of age-associated Alzheimer disease risk: Development and validation of a polygenic hazard score.

PubMed

Desikan, Rahul S; Fan, Chun Chieh; Wang, Yunpeng; Schork, Andrew J; Cabral, Howard J; Cupples, L Adrienne; Thompson, Wesley K; Besser, Lilah; Kukull, Walter A; Holland, Dominic; Chen, Chi-Hua; Brewer, James B; Karow, David S; Kauppi, Karolina; Witoelar, Aree; Karch, Celeste M; Bonham, Luke W; Yokoyama, Jennifer S; Rosen, Howard J; Miller, Bruce L; Dillon, William P; Wilson, David M; Hess, Christopher P; Pericak-Vance, Margaret; Haines, Jonathan L; Farrer, Lindsay A; Mayeux, Richard; Hardy, John; Goate, Alison M; Hyman, Bradley T; Schellenberg, Gerard D; McEvoy, Linda K; Andreassen, Ole A; Dale, Anders M

2017-03-01

Identifying individuals at risk for developing Alzheimer disease (AD) is of utmost importance. Although genetic studies have identified AD-associated SNPs in APOE and other genes, genetic information has not been integrated into an epidemiological framework for risk prediction. Using genotype data from 17,008 AD cases and 37,154 controls from the International Genomics of Alzheimer's Project (IGAP Stage 1), we identified AD-associated SNPs (at p < 10-5). We then integrated these AD-associated SNPs into a Cox proportional hazard model using genotype data from a subset of 6,409 AD patients and 9,386 older controls from Phase 1 of the Alzheimer's Disease Genetics Consortium (ADGC), providing a polygenic hazard score (PHS) for each participant. By combining population-based incidence rates and the genotype-derived PHS for each individual, we derived estimates of instantaneous risk for developing AD, based on genotype and age, and tested replication in multiple independent cohorts (ADGC Phase 2, National Institute on Aging Alzheimer's Disease Center [NIA ADC], and Alzheimer's Disease Neuroimaging Initiative [ADNI], total n = 20,680). Within the ADGC Phase 1 cohort, individuals in the highest PHS quartile developed AD at a considerably lower age and had the highest yearly AD incidence rate. Among APOE ε3/3 individuals, the PHS modified expected age of AD onset by more than 10 y between the lowest and highest deciles (hazard ratio 3.34, 95% CI 2.62-4.24, p = 1.0 × 10-22). In independent cohorts, the PHS strongly predicted empirical age of AD onset (ADGC Phase 2, r = 0.90, p = 1.1 × 10-26) and longitudinal progression from normal aging to AD (NIA ADC, Cochran-Armitage trend test, p = 1.5 × 10-10), and was associated with neuropathology (NIA ADC, Braak stage of neurofibrillary tangles, p = 3.9 × 10-6, and Consortium to Establish a Registry for Alzheimer's Disease score for neuritic plaques, p = 6.8 × 10-6) and in vivo markers of AD neurodegeneration (ADNI, volume loss

Concordance of Motion Sensor and Clinician-Rated Fall Risk Scores in Older Adults.

PubMed

Elledge, Julie

2017-12-01

As the older adult population in the United States continues to grow, developing reliable, valid, and practical methods for identifying fall risk is a high priority. Falls are prevalent in older adults and contribute significantly to morbidity and mortality rates and rising health costs. Identifying at-risk older adults and intervening in a timely manner can reduce falls. Conventional fall risk assessment tools require a health professional trained in the use of each tool for administration and interpretation. Motion sensor technology, which uses three-dimensional cameras to measure patient movements, is promising for assessing older adults' fall risk because it could eliminate or reduce the need for provider oversight. The purpose of this study was to assess the concordance of fall risk scores as measured by a motion sensor device, the OmniVR Virtual Rehabilitation System, with clinician-rated fall risk scores in older adult outpatients undergoing physical rehabilitation. Three standardized fall risk assessments were administered by the OmniVR and by a clinician. Validity of the OmniVR was assessed by measuring the concordance between the two assessment methods. Stability of the OmniVR fall risk ratings was assessed by measuring test-retest reliability. The OmniVR scores showed high concordance with the clinician-rated scores and high stability over time, demonstrating comparability with provider measurements.

Translation and validation of the Canadian diabetes risk assessment questionnaire in China.

PubMed

Guo, Jia; Shi, Zhengkun; Chen, Jyu-Lin; Dixon, Jane K; Wiley, James; Parry, Monica

2018-01-01

To adapt the Canadian Diabetes Risk Assessment Questionnaire for the Chinese population and to evaluate its psychometric properties. A cross-sectional study was conducted with a convenience sample of 194 individuals aged 35-74 years from October 2014 to April 2015. The Canadian Diabetes Risk Assessment Questionnaire was adapted and translated for the Chinese population. Test-retest reliability was conducted to measure stability. Criterion and convergent validity of the adapted questionnaire were assessed using 2-hr 75 g oral glucose tolerance tests and the Finnish Diabetes Risk Scores, respectively. Sensitivity and specificity were evaluated to establish its predictive validity. The test-retest reliability was 0.988. Adequate validity of the adapted questionnaire was demonstrated by positive correlations found between the scores and 2-hr 75 g oral glucose tolerance tests (r = .343, p < .001) and with the Finnish Diabetes Risk Scores (r = .738, p < .001). The area under receiver operating characteristic curve was 0.705 (95% CI .632, .778), demonstrating moderate diagnostic value at a cutoff score of 30. The sensitivity was 73%, with a positive predictive value of 57% and negative predictive value of 78%. Our results provided evidence supporting the translation consistency, content validity, convergent validity, criterion validity, sensitivity, and specificity of the translated Canadian Diabetes Risk Assessment Questionnaire with minor modifications. This paper provides clinical, practical, and methodological information on how to adapt a diabetes risk calculator between cultures for public health nurses. © 2017 Wiley Periodicals, Inc.

A novel early risk assessment tool for detecting clinical outcomes in patients with heat-related illness (J-ERATO score): Development and validation in independent cohorts in Japan.

PubMed

Hayashida, Kei; Kondo, Yutaka; Hifumi, Toru; Shimazaki, Junya; Oda, Yasutaka; Shiraishi, Shinichiro; Fukuda, Tatsuma; Sasaki, Junichi; Shimizu, Keiki

2018-01-01

We sought to develop a novel risk assessment tool to predict the clinical outcomes after heat-related illness. Prospective, multicenter observational study. Patients who transferred to emergency hospitals in Japan with heat-related illness were registered. The sample was divided into two parts: 60% to construct the score and 40% to validate it. A binary logistic regression model was used to predict hospital admission as a primary outcome. The resulting model was transformed into a scoring system. A total of 3,001 eligible patients were analyzed. There was no difference in variables between development and validation cohorts. Based on the result of a logistic regression model in the development phase (n = 1,805), the J-ERATO score was defined as the sum of the six binary components in the prehospital setting (respiratory rate≥22 /min, Glasgow coma scale<15, systolic blood pressure≤100 mmHg, heart rate≥100 bpm, body temperature≥38°C, and age≥65 y), for a total score ranging from 0 to 6. In the validation phase (n = 1,196), the score had excellent discrimination (C-statistic 0.84; 95% CI 0.79-0.89, p<0.0001) and calibration (P>0.2 by Hosmer-Lemeshow test). The observed proportion of hospital admission increased with increasing J-ERATO score (score = 0, 5.0%; score = 1, 15.0%; score = 2, 24.6%; score = 3, 38.6%; score = 4, 68.0%; score = 5, 85.2%; score = 6, 96.4%). Multivariate analyses showed that the J-ERATO score was an independent positive predictor of hospital admission (adjusted OR, 2.43; 95% CI, 2.06-2.87; P<0.001), intensive care unit (ICU) admission (3.73; 2.95-4.72; P<0.001) and in-hospital mortality (1.65; 1.18-2.32; P = 0.004). The J-ERATO score is simply assessed and can facilitate the identification of patients with higher risk of heat-related hospitalization. This scoring system is also significantly associated with the higher likelihood of ICU admission and in-hospital mortality after heat-related hospitalization.

The mortality risk score and the ADG score: two points-based scoring systems for the Johns Hopkins aggregated diagnosis groups to predict mortality in a general adult population cohort in Ontario, Canada.

PubMed

Austin, Peter C; Walraven, Carl van

2011-10-01

Logistic regression models that incorporated age, sex, and indicator variables for the Johns Hopkins' Aggregated Diagnosis Groups (ADGs) categories have been shown to accurately predict all-cause mortality in adults. To develop 2 different point-scoring systems using the ADGs. The Mortality Risk Score (MRS) collapses age, sex, and the ADGs to a single summary score that predicts the annual risk of all-cause death in adults. The ADG Score derives weights for the individual ADG diagnosis groups. : Retrospective cohort constructed using population-based administrative data. All 10,498,413 residents of Ontario, Canada, between the age of 20 and 100 years who were alive on their birthday in 2007, participated in this study. Participants were randomly divided into derivation and validation samples. : Death within 1 year. In the derivation cohort, the MRS ranged from -21 to 139 (median value 29, IQR 17 to 44). In the validation group, a logistic regression model with the MRS as the sole predictor significantly predicted the risk of 1-year mortality with a c-statistic of 0.917. A regression model with age, sex, and the ADG Score has similar performance. Both methods accurately predicted the risk of 1-year mortality across the 20 vigintiles of risk. The MRS combined values for a person's age, sex, and the John Hopkins ADGs to accurately predict 1-year mortality in adults. The ADG Score is a weighted score representing the presence or absence of the 32 ADG diagnosis groups. These scores will facilitate health services researchers conducting risk adjustment using administrative health care databases.

Two-Tiered Violence Risk Estimates: a validation study of an integrated-actuarial risk assessment instrument.

PubMed

Mills, Jeremy F; Gray, Andrew L

2013-11-01

This study is an initial validation study of the Two-Tiered Violence Risk Estimates instrument (TTV), a violence risk appraisal instrument designed to support an integrated-actuarial approach to violence risk assessment. The TTV was scored retrospectively from file information on a sample of violent offenders. Construct validity was examined by comparing the TTV with instruments that have shown utility to predict violence that were prospectively scored: The Historical-Clinical-Risk Management-20 (HCR-20) and Lifestyle Criminality Screening Form (LCSF). Predictive validity was examined through a long-term follow-up of 12.4 years with a sample of 78 incarcerated offenders. Results show the TTV to be highly correlated with the HCR-20 and LCSF. The base rate for violence over the follow-up period was 47.4%, and the TTV was equally predictive of violent recidivism relative to the HCR-20 and LCSF. Discussion centers on the advantages of an integrated-actuarial approach to the assessment of violence risk.

A score to predict and stratify risk of tuberculosis in adult contacts of tuberculosis index cases: a prospective derivation and external validation cohort study.

PubMed

Saunders, Matthew J; Wingfield, Tom; Tovar, Marco A; Baldwin, Matthew R; Datta, Sumona; Zevallos, Karine; Montoya, Rosario; Valencia, Teresa R; Friedland, Jon S; Moulton, Larry H; Gilman, Robert H; Evans, Carlton A

2017-11-01

Contacts of tuberculosis index cases are at increased risk of developing tuberculosis. Screening, preventive therapy, and surveillance for tuberculosis are underused interventions in contacts, particularly adults. We developed a score to predict risk of tuberculosis in adult contacts of tuberculosis index cases. In 2002-06, we recruited contacts aged 15 years or older of index cases with pulmonary tuberculosis who lived in desert shanty towns in Ventanilla, Peru. We followed up contacts for tuberculosis until February, 2016. We used a Cox proportional hazards model to identify index case, contact, and household risk factors for tuberculosis from which to derive a score and classify contacts as low, medium, or high risk. We validated the score in an urban community recruited in Callao, Peru, in 2014-15. In the derivation cohort, we identified 2017 contacts of 715 index cases, and median follow-up was 10·7 years (IQR 9·5-11·8). 178 (9%) of 2017 contacts developed tuberculosis during 19 147 person-years of follow-up (incidence 0·93 per 100 person-years, 95% CI 0·80-1·08). Risk factors for tuberculosis were body-mass index, previous tuberculosis, age, sustained exposure to the index case, the index case being in a male patient, lower community household socioeconomic position, indoor air pollution, previous tuberculosis among household members, and living in a household with a low number of windows per room. The 10-year risks of tuberculosis in the low-risk, medium-risk, and high-risk groups were, respectively, 2·8% (95% CI 1·7-4·4), 6·2% (4·8-8·1), and 20·6% (17·3-24·4). The 535 (27%) contacts classified as high risk accounted for 60% of the tuberculosis identified during follow-up. The score predicted tuberculosis independently of tuberculin skin test and index-case drug sensitivity results. In the external validation cohort, 65 (3%) of 1910 contacts developed tuberculosis during 3771 person-years of follow-up (incidence 1·7 per 100 person-years, 95

Risk factors and predictive clinical scores for asthma exacerbations in childhood.

PubMed

Forno, Erick; Fuhlbrigge, Anne; Soto-Quirós, Manuel E; Avila, Lydiana; Raby, Benjamin A; Brehm, John; Sylvia, Jody M; Weiss, Scott T; Celedón, Juan C

2010-11-01

Asthma is a major public health problem that affects millions of children worldwide, and exacerbations account for most of its morbidity and costs. Primary-care providers lack efficient tools to identify children at high risk for exacerbations. We aimed to construct a clinical score to help providers to identify such children. Our main outcome was severe asthma exacerbation, which was defined as any hospitalization, urgent visit, or systemic steroid course for asthma in the previous year, in children. A clinical score, consisting of a checklist questionnaire made up of 17 yes-no questions regarding asthma symptoms, use of medications and health-care services, and history, was built and validated in a cross-sectional study of Costa Rican children with asthma. It was then evaluated using data from the Childhood Asthma Management Program (CAMP), a longitudinal trial cohort of North American children. Compared with children at average risk for an exacerbation in the Costa Rican validation set, the odds of an exacerbation among children in the low-risk (OR, 0.2; 95% CI, 0.1-0.4) and high-risk (OR, 5.4; 95% CI, 1.5-19.2) score categories were significantly reduced and increased, respectively. In CAMP, the hazard ratios for an exacerbation after 1-year follow-up in the low-risk and high-risk groups were 0.6 (95% CI, 0.5-0.7) and 1.9 (95% CI, 1.4-2.4), respectively, with similar results at 2 years. The proposed Asthma Exacerbation Clinical Score is simple to use and effective at identifying children at high and low risk for asthma exacerbations. The tool can easily be used in primary-care settings.

A summary risk score for the prediction of Alzheimer disease in elderly persons.

PubMed

Reitz, Christiane; Tang, Ming-Xin; Schupf, Nicole; Manly, Jennifer J; Mayeux, Richard; Luchsinger, José A

2010-07-01

To develop a simple summary risk score for the prediction of Alzheimer disease in elderly persons based on their vascular risk profiles. A longitudinal, community-based study. New York, New York. Patients One thousand fifty-one Medicare recipients aged 65 years or older and residing in New York who were free of dementia or cognitive impairment at baseline. We separately explored the associations of several vascular risk factors with late-onset Alzheimer disease (LOAD) using Cox proportional hazards models to identify factors that would contribute to the risk score. Then we estimated the score values of each factor based on their beta coefficients and created the LOAD vascular risk score by summing these individual scores. Risk factors contributing to the risk score were age, sex, education, ethnicity, APOE epsilon4 genotype, history of diabetes, hypertension or smoking, high-density lipoprotein levels, and waist to hip ratio. The resulting risk score predicted dementia well. According to the vascular risk score quintiles, the risk to develop probable LOAD was 1.0 for persons with a score of 0 to 14 and increased 3.7-fold for persons with a score of 15 to 18, 3.6-fold for persons with a score of 19 to 22, 12.6-fold for persons with a score of 23 to 28, and 20.5-fold for persons with a score higher than 28. While additional studies in other populations are needed to validate and further develop the score, our study suggests that this vascular risk score could be a valuable tool to identify elderly individuals who might be at risk of LOAD. This risk score could be used to identify persons at risk of LOAD, but can also be used to adjust for confounders in epidemiologic studies.

A risk scoring system for prediction of haemorrhagic stroke.

PubMed

Zodpey, S P; Tiwari, R R

2005-01-01

The present pair-matched case control study was carried out at Government Medical College Hospital, Nagpur, India, a tertiary care hospital with the objective to devise and validate a risk scoring system for prediction of hemorrhagic stroke. The study consisted of 166 hospitalized CT scan proved cases of hemorrhagic stroke (ICD 9, 431-432), and a age and sex matched control per case. The controls were selected from patients who attended the study hospital for conditions other than stroke. On conditional multiple logistic regression five risk factors- hypertension (OR = 1.9. 95% Cl = 1.5-2.5). raised scrum total cholesterol (OR = 2.3, 95% Cl = 1.1-4.9). use of anticoagulants and antiplatelet agents (OR = 3.4, 95% Cl =1.1-10.4). past history of transient ischaemic attack (OR = 8.4, 95% Cl = 2.1- 33.6) and alcohol intake (OR = 2.1, 95% Cl = 1.3-3.6) were significant. These factors were ascribed statistical weights (based on regression coefficients) of 6, 8, 12, 21 and 8 respectively. The nonsignificant factors (diabetes mellitus, physical inactivity, obesity, smoking, type A personality, history of claudication, family history of stroke, history of cardiac diseases and oral contraceptive use in females) were not included in the development of scoring system. ROC curve suggested a total score of 21 to be the best cut-off for predicting haemorrhag stroke. At this cut-off the sensitivity, specificity, positive predictivity and Cohen's kappa were 0.74, 0.74, 0.74 and 0.48 respectively. The overall predictive accuracy of this additive risk scoring system (area under ROC curve by Wilcoxon statistic) was 0.79 (95% Cl = 0.73-0.84). Thus to conclude, if substantiated by further validation, this scorincy system can be used to predict haemorrhagic stroke, thereby helping to devise effective risk factor intervention strategy.

Cardiovascular risk scores for coronary atherosclerosis.

PubMed

Yalcin, Murat; Kardesoglu, Ejder; Aparci, Mustafa; Isilak, Zafer; Uz, Omer; Yiginer, Omer; Ozmen, Namik; Cingozbay, Bekir Yilmaz; Uzun, Mehmet; Cebeci, Bekir Sitki

2012-10-01

The objective of this study was to compare frequently used cardiovascular risk scores in predicting the presence of coronary artery disease (CAD) and 3-vessel disease. In 350 consecutive patients (218 men and 132 women) who underwent coronary angiography, the cardiovascular risk level was determined using the Framingham Risk Score (FRS), the Modified Framingham Risk Score (MFRS), the Prospective Cardiovascular Münster (PROCAM) score, and the Systematic Coronary Risk Evaluation (SCORE). The area under the curve for receiver operating characteristic curves showed that FRS had more predictive value than the other scores for CAD (area under curve, 0.76, P < or = 0.001), but all scores had good specificity and positive predictive value. For 3-vessel disease, the FRS had better predictive value than the other scores (area under curve, 0.74, P < or = 0.001), but all scores had good specificity and negative predictive value. The risk scores (FRS, MFRS, PROCAM, and SCORE) may predict the presence and severity of coronary atherosclerosis.The FRS had better predictive value than the other scores.

[Clinical scores for the risk of bleeding with or without anticoagulation].

PubMed

Junod, Alain

2016-09-14

The assessment of hemorragic risk related to therapeutic anticoagulation is made difficult because of the variety of existing drugs, the heterogeneity of treatment strategies and their duration. Six prognostic scores have been analyzed. For three of them, external validations have revealed a marked decrease in the discrimination power. One British study, Qbleed, based on the data of more than 1 million of ambulatory patients, has repeatedly satisfied quality criteria. Two scores have also studied the bleeding risk during hospital admission for acute medical disease. The development of new and effective anticoagulants with fewer side-effects is more likely to solve this problem than the production of new clinical scores.

Scores for post-myocardial infarction risk stratification in the community.

PubMed

Singh, Mandeep; Reeder, Guy S; Jacobsen, Steven J; Weston, Susan; Killian, Jill; Roger, Véronique L

2002-10-29

Several scores, most of which were derived from clinical trials, have been proposed for stratifying risk after myocardial infarctions (MIs). Little is known about their generalizability to the community, their respective advantages, and whether the ejection fraction (EF) adds prognostic information to the scores. The purpose of this study is to evaluate the Thrombolysis in Myocardial Infarction (TIMI) and Predicting Risk of Death in Cardiac Disease Tool (PREDICT) scores in a geographically defined MI cohort and determine the incremental value of EF for risk stratification. MIs occurring in Olmsted County were validated with the use of standardized criteria and stratified with the ECG into ST-segment elevation (STEMI) and non-ST-segment elevation (NSTEMI) MI. Logistic regression examined the discriminant accuracy of the TIMI and PREDICT scores to predict death and recurrent MI and assessed the incremental value of the EF. After 6.3+/-4.7 years, survival was similar for the 562 STEMIs and 717 NSTEMIs. The discriminant accuracy of the TIMI score was good in STEMI but only fair in NSTEMI. Across time and end points, irrespective of reperfusion therapy, the discriminant accuracy of the PREDICT score was consistently superior to that of the TIMI scores, largely because PREDICT includes comorbidity; EF provided incremental information over that provided by the scores and comorbidity. In the community, comorbidity and EF convey important prognostic information and should be included in approaches for stratifying risk after MI.

A Risk Prediction Score for Kidney Failure or Mortality in Rhabdomyolysis

PubMed Central

McMahon, Gearoid M.; Zeng, Xiaoxi; Waikar, Sushrut S.

2016-01-01

IMPORTANCE Rhabdomyolysis ranges in severity from asymptomatic elevations in creatine phosphokinase levels to a life-threatening disorder characterized by severe acute kidney injury requiring hemodialysis or continuous renal replacement therapy (RRT). OBJECTIVE To develop a risk prediction tool to identify patients at greatest risk of RRT or in-hospital mortality. DESIGN, SETTING, AND PARTICIPANTS Retrospective cohort study of 2371 patients admitted between January 1, 2000, and March 31, 2011, to 2 large teaching hospitals in Boston, Massachusetts, with creatine phosphokinase levels in excess of 5000 U/L within 3 days of admission. The derivation cohort consisted of 1397 patients from Massachusetts General Hospital, and the validation cohort comprised 974 patients from Brigham and Women’s Hospital. MAIN OUTCOMES AND MEASURES The composite of RRT or in-hospital mortality. RESULTS The causes and outcomes of rhabdomyolysis were similar between the derivation and validation cohorts. In total, the composite outcome occurred in 19.0% of patients (8.0% required RRT and 14.1% died during hospitalization). The highest rates of the composite outcome were from compartment syndrome (41.2%), sepsis (39.3%), and following cardiac arrest (58.5%). The lowest rates were from myositis (1.7%), exercise (3.2%), and seizures (6.0%). The independent predictors of the composite outcome were age, female sex, cause of rhabdomyolysis, and values of initial creatinine, creatine phosphokinase, phosphate, calcium, and bicarbonate. We developed a risk-prediction score from these variables in the derivation cohort and subsequently applied it in the validation cohort. The C statistic for the prediction model was 0.82 (95% CI, 0.80–0.85) in the derivation cohort and 0.83 (0.80–0.86) in the validation cohort. The Hosmer-Lemeshow P values were .14 and .28, respectively. In the validation cohort, among the patients with the lowest risk score (<5), 2.3% died or needed RRT. Among the patients

Validation of a polygenic risk score for dementia in black and white individuals

PubMed Central

Marden, Jessica R; Walter, Stefan; Tchetgen Tchetgen, Eric J; Kawachi, Ichiro; Glymour, M Maria

2014-01-01

Objective To determine whether a polygenic risk score for Alzheimer's disease (AD) predicts dementia probability and memory functioning in non-Hispanic black (NHB) and non-Hispanic white (NHW) participants from a sample not used in previous genome-wide association studies. Methods Non-Hispanic white and NHB Health and Retirement Study (HRS) participants provided genetic information and either a composite memory score (n = 10,401) or a dementia probability score (n = 7690). Dementia probability score was estimated for participants' age 65+ from 2006 to 2010, while memory score was available for participants age 50+. We calculated AD genetic risk scores (AD-GRS) based on 10 polymorphisms confirmed to predict AD, weighting alleles by beta coefficients reported in AlzGene meta-analyses. We used pooled logistic regression to estimate the association of the AD-GRS with dementia probability and generalized linear models to estimate its effect on memory score. Results Each 0.10 unit change in the AD-GRS was associated with larger relative effects on dementia among NHW aged 65+ (OR = 2.22; 95% CI: 1.79, 2.74; P < 0.001) than NHB (OR=1.33; 95% CI: 1.00, 1.77; P = 0.047), although additive effect estimates were similar. Each 0.10 unit change in the AD-GRS was associated with a −0.07 (95% CI: −0.09, −0.05; P < 0.001) SD difference in memory score among NHW aged 50+, but no significant differences among NHB (β = −0.01; 95% CI: −0.04, 0.01; P = 0.546). [Correction added on 29 July 2014, after first online publication: confidence intervalshave been amended.] The estimated effect of the GRS was significantly smaller among NHB than NHW (P < 0.05) for both outcomes. Conclusion This analysis provides evidence for differential relative effects of the GRS on dementia probability and memory score among NHW and NHB in a new, national data set. PMID:25328845

Clinical Risk Score for Persistent Postconcussion Symptoms Among Children With Acute Concussion in the ED.

PubMed

Zemek, Roger; Barrowman, Nick; Freedman, Stephen B; Gravel, Jocelyn; Gagnon, Isabelle; McGahern, Candice; Aglipay, Mary; Sangha, Gurinder; Boutis, Kathy; Beer, Darcy; Craig, William; Burns, Emma; Farion, Ken J; Mikrogianakis, Angelo; Barlow, Karen; Dubrovsky, Alexander S; Meeuwisse, Willem; Gioia, Gerard; Meehan, William P; Beauchamp, Miriam H; Kamil, Yael; Grool, Anne M; Hoshizaki, Blaine; Anderson, Peter; Brooks, Brian L; Yeates, Keith Owen; Vassilyadi, Michael; Klassen, Terry; Keightley, Michelle; Richer, Lawrence; DeMatteo, Carol; Osmond, Martin H

2016-03-08

Approximately one-third of children experiencing acute concussion experience ongoing somatic, cognitive, and psychological or behavioral symptoms, referred to as persistent postconcussion symptoms (PPCS). However, validated and pragmatic tools enabling clinicians to identify patients at risk for PPCS do not exist. To derive and validate a clinical risk score for PPCS among children presenting to the emergency department. Prospective, multicenter cohort study (Predicting and Preventing Postconcussive Problems in Pediatrics [5P]) enrolled young patients (aged 5-<18 years) who presented within 48 hours of an acute head injury at 1 of 9 pediatric emergency departments within the Pediatric Emergency Research Canada (PERC) network from August 2013 through September 2014 (derivation cohort) and from October 2014 through June 2015 (validation cohort). Participants completed follow-up 28 days after the injury. All eligible patients had concussions consistent with the Zurich consensus diagnostic criteria. The primary outcome was PPCS risk score at 28 days, which was defined as 3 or more new or worsening symptoms using the patient-reported Postconcussion Symptom Inventory compared with recalled state of being prior to the injury. In total, 3063 patients (median age, 12.0 years [interquartile range, 9.2-14.6 years]; 1205 [39.3%] girls) were enrolled (n = 2006 in the derivation cohort; n = 1057 in the validation cohort) and 2584 of whom (n = 1701 [85%] in the derivation cohort; n = 883 [84%] in the validation cohort) completed follow-up at 28 days after the injury. Persistent postconcussion symptoms were present in 801 patients (31.0%) (n = 510 [30.0%] in the derivation cohort and n = 291 [33.0%] in the validation cohort). The 12-point PPCS risk score model for the derivation cohort included the variables of female sex, age of 13 years or older, physician-diagnosed migraine history, prior concussion with symptoms lasting longer than 1 week, headache

Genetic assessment of age-associated Alzheimer disease risk: Development and validation of a polygenic hazard score

PubMed Central

Cupples, L. Adrienne; Thompson, Wesley K.; Besser, Lilah; Kukull, Walter A.; Holland, Dominic; Chen, Chi-Hua; Brewer, James B.; Karow, David S.; Kauppi, Karolina; Bonham, Luke W.; Rosen, Howard J.; Miller, Bruce L.; Dillon, William P.; Wilson, David M.; Pericak-Vance, Margaret; Haines, Jonathan L.; Farrer, Lindsay A.; Mayeux, Richard; Hardy, John; Goate, Alison M.; Schellenberg, Gerard D.; Andreassen, Ole A.

2017-01-01

Background Identifying individuals at risk for developing Alzheimer disease (AD) is of utmost importance. Although genetic studies have identified AD-associated SNPs in APOE and other genes, genetic information has not been integrated into an epidemiological framework for risk prediction. Methods and findings Using genotype data from 17,008 AD cases and 37,154 controls from the International Genomics of Alzheimer’s Project (IGAP Stage 1), we identified AD-associated SNPs (at p < 10−5). We then integrated these AD-associated SNPs into a Cox proportional hazard model using genotype data from a subset of 6,409 AD patients and 9,386 older controls from Phase 1 of the Alzheimer’s Disease Genetics Consortium (ADGC), providing a polygenic hazard score (PHS) for each participant. By combining population-based incidence rates and the genotype-derived PHS for each individual, we derived estimates of instantaneous risk for developing AD, based on genotype and age, and tested replication in multiple independent cohorts (ADGC Phase 2, National Institute on Aging Alzheimer’s Disease Center [NIA ADC], and Alzheimer’s Disease Neuroimaging Initiative [ADNI], total n = 20,680). Within the ADGC Phase 1 cohort, individuals in the highest PHS quartile developed AD at a considerably lower age and had the highest yearly AD incidence rate. Among APOE ε3/3 individuals, the PHS modified expected age of AD onset by more than 10 y between the lowest and highest deciles (hazard ratio 3.34, 95% CI 2.62–4.24, p = 1.0 × 10−22). In independent cohorts, the PHS strongly predicted empirical age of AD onset (ADGC Phase 2, r = 0.90, p = 1.1 × 10−26) and longitudinal progression from normal aging to AD (NIA ADC, Cochran–Armitage trend test, p = 1.5 × 10−10), and was associated with neuropathology (NIA ADC, Braak stage of neurofibrillary tangles, p = 3.9 × 10−6, and Consortium to Establish a Registry for Alzheimer’s Disease score for neuritic plaques, p = 6.8 × 10−6) and

Risk Factors and Predictive Clinical Scores for Asthma Exacerbations in Childhood

PubMed Central

Forno, Erick; Fuhlbrigge, Anne; Soto-Quirós, Manuel E.; Avila, Lydiana; Raby, Benjamin A.; Brehm, John; Sylvia, Jody M.; Weiss, Scott T.

2010-01-01

Background: Asthma is a major public health problem that affects millions of children worldwide, and exacerbations account for most of its morbidity and costs. Primary-care providers lack efficient tools to identify children at high risk for exacerbations. We aimed to construct a clinical score to help providers to identify such children. Methods: Our main outcome was severe asthma exacerbation, which was defined as any hospitalization, urgent visit, or systemic steroid course for asthma in the previous year, in children. A clinical score, consisting of a checklist questionnaire made up of 17 yes-no questions regarding asthma symptoms, use of medications and health-care services, and history, was built and validated in a cross-sectional study of Costa Rican children with asthma. It was then evaluated using data from the Childhood Asthma Management Program (CAMP), a longitudinal trial cohort of North American children. Results: Compared with children at average risk for an exacerbation in the Costa Rican validation set, the odds of an exacerbation among children in the low-risk (OR, 0.2; 95% CI, 0.1-0.4) and high-risk (OR, 5.4; 95% CI, 1.5-19.2) score categories were significantly reduced and increased, respectively. In CAMP, the hazard ratios for an exacerbation after 1-year follow-up in the low-risk and high-risk groups were 0.6 (95% CI, 0.5-0.7) and 1.9 (95% CI, 1.4-2.4), respectively, with similar results at 2 years. Conclusions: The proposed Asthma Exacerbation Clinical Score is simple to use and effective at identifying children at high and low risk for asthma exacerbations. The tool can easily be used in primary-care settings. PMID:20472862

A novel risk score model for prediction of contrast-induced nephropathy after emergent percutaneous coronary intervention.

PubMed

Lin, Kai-Yang; Zheng, Wei-Ping; Bei, Wei-Jie; Chen, Shi-Qun; Islam, Sheikh Mohammed Shariful; Liu, Yong; Xue, Lin; Tan, Ning; Chen, Ji-Yan

2017-03-01

A few studies developed simple risk model for predicting CIN with poor prognosis after emergent PCI. The study aimed to develop and validate a novel tool for predicting the risk of contrast-induced nephropathy (CIN) in patients undergoing emergent percutaneous coronary intervention (PCI). 692 consecutive patients undergoing emergent PCI between January 2010 and December 2013 were randomly (2:1) assigned to a development dataset (n=461) and a validation dataset (n=231). Multivariate logistic regression was applied to identify independent predictors of CIN, and established CIN predicting model, whose prognostic accuracy was assessed using the c-statistic for discrimination and the Hosmere Lemeshow test for calibration. The overall incidence of CIN was 55(7.9%). A total of 11 variables were analyzed, including age >75years old, baseline serum creatinine (SCr)>1.5mg/dl, hypotension and the use of intra-aortic balloon pump(IABP), which were identified to enter risk score model (Chen). The incidence of CIN was 32(6.9%) in the development dataset (in low risk (score=0), 1.0%, moderate risk (score:1-2), 13.4%, high risk (score≥3), 90.0%). Compared to the classical Mehran's and ACEF CIN risk score models, the risk score (Chen) across the subgroup of the study population exhibited similar discrimination and predictive ability on CIN (c-statistic:0.828, 0.776, 0.853, respectively), in-hospital mortality, 2, 3-years mortality (c-statistic:0.738.0.750, 0.845, respectively) in the validation population. Our data showed that this simple risk model exhibited good discrimination and predictive ability on CIN, similar to Mehran's and ACEF score, and even on long-term mortality after emergent PCI. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Development and evaluation of a composite risk score to predict kidney transplant failure.

PubMed

Moore, Jason; He, Xiang; Shabir, Shazia; Hanvesakul, Rajesh; Benavente, David; Cockwell, Paul; Little, Mark A; Ball, Simon; Inston, Nicholas; Johnston, Atholl; Borrows, Richard

2011-05-01

Although risk factors for kidney transplant failure are well described, prognostic risk scores to estimate risk in prevalent transplant recipients are limited. Development and validation of risk-prediction instruments. The development data set included 2,763 prevalent patients more than 12 months posttransplant enrolled into the LOTESS (Long Term Efficacy and Safety Surveillance) Study. The validation data set included 731 patients who underwent transplant at a single UK center. Estimated glomerular filtration rate (eGFR) and other risk factors were evaluated using Cox regression. Scores for death-censored and overall transplant failure were based on the summed hazard ratios for baseline predictor variables. Predictive performance was assessed using calibration (Hosmer-Lemeshow statistic), discrimination (C statistic), and clinical reclassification (net reclassification improvement) compared with eGFR alone. In the development data set, 196 patients died and another 225 experienced transplant failure. eGFR, recipient age, race, serum urea and albumin levels, declining eGFR, and prior acute rejection predicted death-censored transplant failure. eGFR, recipient age, sex, serum urea and albumin levels, and declining eGFR predicted overall transplant failure. In the validation data set, 44 patients died and another 101 experienced transplant failure. The weighted scores comprising these variables showed adequate discrimination and calibration for death-censored (C statistic, 0.83; 95% CI, 0.75-0.91; Hosmer-Lemeshow χ(2)P = 0.8) and overall (C statistic, 0.70; 95% CI, 0.64-0.77; Hosmer-Lemeshow χ(2)P = 0.5) transplant failure. However, the scores failed to reclassify risk compared with eGFR alone (net reclassification improvements of 7.6% [95% CI, -0.2 to 13.4; P = 0.09] and 4.3% [95% CI, -2.7 to 11.8; P = 0.3] for death-censored and overall transplant failure, respectively). Retrospective analysis of predominantly cyclosporine-treated patients; limited study size and

Bronchiolitis Score of Sant Joan de Déu: BROSJOD Score, validation and usefulness.

PubMed

Balaguer, Mònica; Alejandre, Carme; Vila, David; Esteban, Elisabeth; Carrasco, Josep L; Cambra, Francisco José; Jordan, Iolanda

2017-04-01

To validate the bronchiolitis score of Sant Joan de Déu (BROSJOD) and to examine the previously defined scoring cutoff. Prospective, observational study. BROSJOD scoring was done by two independent physicians (at admission, 24 and 48 hr). Internal consistency of the score was assessed using Cronbach's α. To determine inter-rater reliability, the concordance correlation coefficient estimated as an intraclass correlation coefficient (CCC) and limits of agreement estimated as the 90% total deviation index (TDI) were estimated. An expert opinion was used to classify patients according to clinical severity. A validity analysis was conducted comparing the 3-level classification score to that expert opinion. Volume under the surface (VUS), predictive values, and probability of correct classification (PCC) were measured to assess discriminant validity. About 112 patients were recruited, 62 of them (55.4%) males. Median age: 52.5 days (IQR: 32.75-115.25). The admission Cronbach's α was 0.77 (CI95%: 0.71; 0.82) and at 24 hr it was 0.65 (CI95%: 0.48; 0.7). The inter-rater reliability analysis was: CCC at admission 0.96 (95%CI 0.94-0.97), at 24 h 0.77 (95%CI 0.65-0.86), and at 48 hr 0.94 (95%CI 0.94-0.97); TDI 90%: 1.6, 2.9, and 1.57, respectively. The discriminant validity at admission: VUS of 0.8 (95%CI 0.70-0.90), at 24 h 0.92 (95%CI 0.85-0.99), and at 48 hr 0.93 (95%CI 0.87-0.99). The predictive values and PCC values were within 38-100% depending on the level of clinical severity. There is a high inter-rater reliability, showing the BROSJOD score to be reliable and valid, even when different observers apply it. Pediatr Pulmonol. 2017;52:533-539. © 2016 Wiley Periodicals, Inc. © 2016 Wiley Periodicals, Inc.

Further validation of the Internet-based Dementia Risk Assessment.

PubMed

Brandt, Jason; Blehar, Justin; Anderson, Allan; Gross, Alden L

2014-01-01

Most approaches to the detection of presymptomatic or prodromal Alzheimer's disease require the costly collection and analysis of biological samples or neuroimaging measurements. The Dementia Risk Assessment (DRA) was developed to facilitate this detection by collecting self-report and proxy-report of dementia risk variables and episodic memory performance on a free Internet website. We now report two validation studies. In Study 1, 130 community-residing older adults seeking memory screening at senior health fairs were tested using the Mini-Cog, and were then observed while taking the DRA. They were compared to a demographically-matched subsample from our anonymous Internet sample. Participants seeking memory screening had more dementia risk factors and obtained lower scores on the DRA's recognition memory test (RMT) than their Internet controls. In addition, those who failed the Mini-Cog obtained much lower scores on the RMT than those who passed the Mini-Cog. In Study 2, 160 older adults seeking evaluation of cognitive difficulties took the DRA prior to diagnostic evaluations at outpatient dementia clinics. Patients who ultimately received the diagnosis of a dementia syndrome scored significantly lower on the RMT than those diagnosed with other conditions or deemed normal. Lower education, family history of dementia, presence of hypercholesterolemia and diabetes, and memory test score distinguished the dementia and no-dementia groups with around 82% accuracy. In addition, score on the RMT correlated highly with scores on other instruments widely used to detect cognitive decline. These findings support the concurrent validity of the DRA for detecting prevalent cognitive impairment. Prospective studies of cognitively normal persons who subsequently develop dementia will be necessary to establish its predictive validity.

The New York State risk score for predicting in-hospital/30-day mortality following percutaneous coronary intervention.

PubMed

Hannan, Edward L; Farrell, Louise Szypulski; Walford, Gary; Jacobs, Alice K; Berger, Peter B; Holmes, David R; Stamato, Nicholas J; Sharma, Samin; King, Spencer B

2013-06-01

This study sought to develop a percutaneous coronary intervention (PCI) risk score for in-hospital/30-day mortality. Risk scores are simplified linear scores that provide clinicians with quick estimates of patients' short-term mortality rates for informed consent and to determine the appropriate intervention. Earlier PCI risk scores were based on in-hospital mortality. However, for PCI, a substantial percentage of patients die within 30 days of the procedure after discharge. New York's Percutaneous Coronary Interventions Reporting System was used to develop an in-hospital/30-day logistic regression model for patients undergoing PCI in 2010, and this model was converted into a simple linear risk score that estimates mortality rates. The score was validated by applying it to 2009 New York PCI data. Subsequent analyses evaluated the ability of the score to predict complications and length of stay. A total of 54,223 patients were used to develop the risk score. There are 11 risk factors that make up the score, with risk factor scores ranging from 1 to 9, and the highest total score is 34. The score was validated based on patients undergoing PCI in the previous year, and accurately predicted mortality for all patients as well as patients who recently suffered a myocardial infarction (MI). The PCI risk score developed here enables clinicians to estimate in-hospital/30-day mortality very quickly and quite accurately. It accurately predicts mortality for patients undergoing PCI in the previous year and for MI patients, and is also moderately related to perioperative complications and length of stay. Copyright © 2013 American College of Cardiology Foundation. Published by Elsevier Inc. All rights reserved.

Risk score to predict the outcome of patients with cerebral vein and dural sinus thrombosis.

PubMed

Ferro, José M; Bacelar-Nicolau, Helena; Rodrigues, Teresa; Bacelar-Nicolau, Leonor; Canhão, Patrícia; Crassard, Isabelle; Bousser, Marie-Germaine; Dutra, Aurélio Pimenta; Massaro, Ayrton; Mackowiack-Cordiolani, Marie-Anne; Leys, Didier; Fontes, João; Stam, Jan; Barinagarrementeria, Fernando

2009-01-01

Around 15% of patients die or become dependent after cerebral vein and dural sinus thrombosis (CVT). We used the International Study on Cerebral Vein and Dural Sinus Thrombosis (ISCVT) sample (624 patients, with a median follow-up time of 478 days) to develop a Cox proportional hazards regression model to predict outcome, dichotomised by a modified Rankin Scale score >2. From the model hazard ratios, a risk score was derived and a cut-off point selected. The model and the score were tested in 2 validation samples: (1) the prospective Cerebral Venous Thrombosis Portuguese Collaborative Study Group (VENOPORT) sample with 91 patients; (2) a sample of 169 consecutive CVT patients admitted to 5 ISCVT centres after the end of the ISCVT recruitment period. Sensitivity, specificity, c statistics and overall efficiency to predict outcome at 6 months were calculated. The model (hazard ratios: malignancy 4.53; coma 4.19; thrombosis of the deep venous system 3.03; mental status disturbance 2.18; male gender 1.60; intracranial haemorrhage 1.42) had overall efficiencies of 85.1, 84.4 and 90.0%, in the derivation sample and validation samples 1 and 2, respectively. Using the risk score (range from 0 to 9) with a cut-off of >or=3 points, overall efficiency was 85.4, 84.4 and 90.1% in the derivation sample and validation samples 1 and 2, respectively. Sensitivity and specificity in the combined samples were 96.1 and 13.6%, respectively. The CVT risk score has a good estimated overall rate of correct classifications in both validation samples, but its specificity is low. It can be used to avoid unnecessary or dangerous interventions in low-risk patients, and may help to identify high-risk CVT patients. (c) 2009 S. Karger AG, Basel.

Development and validation of a surgical-pathologic staging and scoring system for cervical cancer.

PubMed

Li, Shuang; Li, Xiong; Zhang, Yuan; Zhou, Hang; Tang, Fangxu; Jia, Yao; Hu, Ting; Sun, Haiying; Yang, Ru; Chen, Yile; Cheng, Xiaodong; Lv, Weiguo; Wu, Li; Zhou, Jin; Wang, Shaoshuai; Huang, Kecheng; Wang, Lin; Yao, Yuan; Yang, Qifeng; Yang, Xingsheng; Zhang, Qinghua; Han, Xiaobing; Lin, Zhongqiu; Xing, Hui; Qu, Pengpeng; Cai, Hongbing; Song, Xiaojie; Tian, Xiaoyu; Shen, Jian; Xi, Ling; Li, Kezhen; Deng, Dongrui; Wang, Hui; Wang, Changyu; Wu, Mingfu; Zhu, Tao; Chen, Gang; Gao, Qinglei; Wang, Shixuan; Hu, Junbo; Kong, Beihua; Xie, Xing; Ma, Ding

2016-04-12

Most cervical cancer patients worldwide receive surgical treatments, and yet the current International Federation of Gynecology and Obstetrics (FIGO) staging system do not consider surgical-pathologic data. We propose a more comprehensive and prognostically valuable surgical-pathologic staging and scoring system (SPSs). Records from 4,220 eligible cervical cancer cases (Cohort 1) were screened for surgical-pathologic risk factors. We constructed a surgical-pathologic staging and SPSs, which was subsequently validated in a prospective study of 1,104 cervical cancer patients (Cohort 2). In Cohort 1, seven independent risk factors were associated with patient outcome: lymph node metastasis (LNM), parametrial involvement, histological type, grade, tumor size, stromal invasion, and lymph-vascular space invasion (LVSI). The FIGO staging system was revised and expanded into a surgical-pathologic staging system by including additional criteria of LNM, stromal invasion, and LVSI. LNM was subdivided into three categories based on number and location of metastases. Inclusion of all seven prognostic risk factors improves practical applicability. Patients were stratified into three SPSs risk categories: zero-, low-, and high-score with scores of 0, 1 to 3, and ≥4 (P=1.08E-45; P=6.15E-55). In Cohort 2, 5-year overall survival (OS) and disease-free survival (DFS) outcomes decreased with increased SPSs scores (P=9.04E-15; P=3.23E-16), validating the approach. Surgical-pathologic staging and SPSs show greater homogeneity and discriminatory utility than FIGO staging. Surgical-pathologic staging and SPSs improve characterization of tumor severity and disease invasion, which may more accurately predict outcome and guide postoperative therapy.

Lung cancer in patients with chronic obstructive pulmonary disease. Development and validation of the COPD Lung Cancer Screening Score.

PubMed

de-Torres, Juan P; Wilson, David O; Sanchez-Salcedo, Pablo; Weissfeld, Joel L; Berto, Juan; Campo, Arantzazu; Alcaide, Ana B; García-Granero, Marta; Celli, Bartolome R; Zulueta, Javier J

2015-02-01

Patients with chronic obstructive pulmonary disease (COPD) are at high risk for lung cancer (LC) and represent a potential target to improve the diagnostic yield of screening programs. To develop a predictive score for LC risk for patients with COPD. The Pamplona International Early Lung Cancer Detection Program (P-IELCAP) and the Pittsburgh Lung Screening Study (PLuSS) databases were analyzed. Only patients with COPD on spirometry were included. By logistic regression we determined which factors were independently associated with LC in PLuSS and developed a COPD LC screening score (COPD-LUCSS) to be validated in P-IELCAP. By regression analysis, age greater than 60, body mass index less than 25 kg/m(2), pack-years history greater than 60, and emphysema presence were independently associated with LC diagnosis and integrated into the COPD-LUCSS, which ranges from 0 to 10 points. Two COPD-LUCSS risk categories were proposed: low risk (scores 0-6) and high risk (scores 7-10). In comparison with low-risk patients, in both cohorts LC risk increased 3.5-fold in the high-risk category. The COPD-LUCSS is a good predictor of LC risk in patients with COPD participating in LC screening programs. Validation in two different populations adds strength to the findings.

Development and validation of the Pediatric Anesthesia Behavior score--an objective measure of behavior during induction of anesthesia.

PubMed

Beringer, Richard M; Greenwood, Rosemary; Kilpatrick, Nicky

2014-02-01

Measuring perioperative behavior changes requires validated objective rating scales. We developed a simple score for children's behavior during induction of anesthesia (Pediatric Anesthesia Behavior score) and assessed its reliability, concurrent validity, and predictive validity. Data were collected as part of a wider observational study of perioperative behavior changes in children undergoing general anesthesia for elective dental extractions. One-hundred and two healthy children aged 2-12 were recruited. Previously validated behavioral scales were used as follows: the modified Yale Preoperative Anxiety Scale (m-YPAS); the induction compliance checklist (ICC); the Pediatric Anesthesia Emergence Delirium scale (PAED); and the Post-Hospitalization Behavior Questionnaire (PHBQ). Pediatric Anesthesia Behavior (PAB) score was independently measured by two investigators, to allow assessment of interobserver reliability. Concurrent validity was assessed by examining the correlation between the PAB score, the m-YPAS, and the ICC. Predictive validity was assessed by examining the association between the PAB score, the PAED scale, and the PHBQ. The PAB score correlated strongly with both the m-YPAS (P < 0.001) and the ICC (P < 0.001). PAB score was significantly associated with the PAED score (P = 0.031) and with the PHBQ (P = 0.034). Two independent investigators recorded identical PAB scores for 94% of children and overall, there was close agreement between scores (Kappa coefficient of 0.886 [P < 0.001]). The PAB score is simple to use and may predict which children are at increased risk of developing postoperative behavioral disturbance. This study provides evidence for its reliability and validity. © 2013 John Wiley & Sons Ltd.

Technical feasibility and validation of a coronary artery calcium scoring system using CT coronary angiography images.

PubMed

Pavitt, Christopher W; Harron, Katie; Lindsay, Alistair C; Zielke, Sayeh; Ray, Robin; Gordon, Daniel; Rubens, Michael B; Padley, Simon P; Nicol, Edward D

2016-05-01

We validate a novel CT coronary angiography (CCTA) coronary calcium scoring system. Calcium was quantified on CCTA images using a new patient-specific attenuation threshold: mean + 2SD of intra-coronary contrast density (HU). Using 335 patient data sets a conversion factor (CF) for predicting CACS from CCTA scores (CCTAS) was derived and validated in a separate cohort (n = 168). Bland-Altman analysis and weighted kappa for MESA centiles and Agatston risk groupings were calculated. Multivariable linear regression yielded a CF: CACS = (1.185 × CCTAS) + (0.002 × CCTAS × attenuation threshold). When applied to CCTA data sets there was excellent correlation (r = 0.95; p < 0.0001) and agreement (mean difference -10.4 [95% limits of agreement -258.9 to 238.1]) with traditional calcium scores. Agreement was better for calcium scores below 500; however, MESA percentile agreement was better for high risk patients. Risk stratification was excellent (Agatston groups k = 0.88 and MESA centiles k = 0.91). Eliminating the dedicated CACS scan decreased patient radiation exposure by approximately one-third. CCTA calcium scores can accurately predict CACS using a simple, individualized, semiautomated approach reducing acquisition time and radiation exposure when evaluating patients for CAD. This method is not affected by the ROI location, imaging protocol, or tube voltage strengthening its clinical applicability. • Coronary calcium scores can be reliably determined on contrast-enhanced cardiac CT • This score can accurately risk stratify patients • Elimination of a dedicated calcium scan reduces patient radiation by a third.

Development and validation of a prognostic scoring system for patients with chronic myelomonocytic leukemia.

PubMed

Such, Esperanza; Germing, Ulrich; Malcovati, Luca; Cervera, José; Kuendgen, Andrea; Della Porta, Matteo G; Nomdedeu, Benet; Arenillas, Leonor; Luño, Elisa; Xicoy, Blanca; Amigo, Mari L; Valcarcel, David; Nachtkamp, Kathrin; Ambaglio, Ilaria; Hildebrandt, Barbara; Lorenzo, Ignacio; Cazzola, Mario; Sanz, Guillermo

2013-04-11

The natural course of chronic myelomonocytic leukemia (CMML) is highly variable but a widely accepted prognostic scoring system for patients with CMML is not available. The main aim of this study was to develop a new CMML-specific prognostic scoring system (CPSS) in a large series of 558 patients with CMML (training cohort, Spanish Group of Myelodysplastic Syndromes) and to validate it in an independent series of 274 patients (validation cohort, Heinrich Heine University Hospital, Düsseldorf, Germany, and San Matteo Hospital, Pavia, Italy). The most relevant variables for overall survival (OS) and evolution to acute myeloblastic leukemia (AML) were FAB and WHO CMML subtypes, CMML-specific cytogenetic risk classification, and red blood cell (RBC) transfusion dependency. CPSS was able to segregate patients into 4 clearly different risk groups for OS (P < .001) and risk of AML evolution (P < .001) and its predictive capability was confirmed in the validation cohort. An alternative CPSS with hemoglobin instead of RBC transfusion dependency offered almost identical prognostic capability. This study confirms the prognostic impact of FAB and WHO subtypes, recognizes the importance of RBC transfusion dependency and cytogenetics, and offers a simple and powerful CPSS for accurately assessing prognosis and planning therapy in patients with CMML.

Paediatric nutrition risk scores in clinical practice: children with inflammatory bowel disease.

PubMed

Wiskin, A E; Owens, D R; Cornelius, V R; Wootton, S A; Beattie, R M

2012-08-01

There has been increasing interest in the use of nutrition risk assessment tools in paediatrics to identify those who need nutrition support. Four non-disease specific screening tools have been developed, although there is a paucity of data on their application in clinical practice and the degree of inter-tool agreement. The concurrent validity of four nutrition screening tools [Screening Tool for the Assessment of Malnutrition in Paediatrics (STAMP), Screening Tool for Risk On Nutritional status and Growth (STRONGkids), Paediatric Yorkhill Malnutrition Score (PYMS) and Simple Paediatric Nutrition Risk Score (PNRS)] was examined in 46 children with inflammatory bowel disease. Degree of malnutrition was determined by anthropometry alone using World Health Organization International Classification of Diseases (ICD-10) criteria. There was good agreement between STAMP, STRONGkids and PNRS (kappa > 0.6) but there was only modest agreement between PYMS and the other scores (kappa = 0.3). No children scored low risk with STAMP, STRONGkids or PNRS; however, 23 children scored low risk with PYMS. There was no agreement between the risk tools and the degree of malnutrition based on anthropometric data (kappa < 0.1). Three children had anthropometry consistent with malnutrition and these were all scored high risk. Four children had body mass index SD scores < -2, one of which was scored at low nutrition risk. The relevance of nutrition screening tools for children with chronic disease is unclear. In addition, there is the potential to under recognise nutritional impairment (and therefore nutritional risk) in children with inflammatory bowel disease. © 2012 The Authors. Journal of Human Nutrition and Dietetics © 2012 The British Dietetic Association Ltd.

Development and validation of a composite scoring system for robot-assisted surgical training--the Robotic Skills Assessment Score.

PubMed

Chowriappa, Ashirwad J; Shi, Yi; Raza, Syed Johar; Ahmed, Kamran; Stegemann, Andrew; Wilding, Gregory; Kaouk, Jihad; Peabody, James O; Menon, Mani; Hassett, James M; Kesavadas, Thenkurussi; Guru, Khurshid A

2013-12-01

A standardized scoring system does not exist in virtual reality-based assessment metrics to describe safe and crucial surgical skills in robot-assisted surgery. This study aims to develop an assessment score along with its construct validation. All subjects performed key tasks on previously validated Fundamental Skills of Robotic Surgery curriculum, which were recorded, and metrics were stored. After an expert consensus for the purpose of content validation (Delphi), critical safety determining procedural steps were identified from the Fundamental Skills of Robotic Surgery curriculum and a hierarchical task decomposition of multiple parameters using a variety of metrics was used to develop Robotic Skills Assessment Score (RSA-Score). Robotic Skills Assessment mainly focuses on safety in operative field, critical error, economy, bimanual dexterity, and time. Following, the RSA-Score was further evaluated for construct validation and feasibility. Spearman correlation tests performed between tasks using the RSA-Scores indicate no cross correlation. Wilcoxon rank sum tests were performed between the two groups. The proposed RSA-Score was evaluated on non-robotic surgeons (n = 15) and on expert-robotic surgeons (n = 12). The expert group demonstrated significantly better performance on all four tasks in comparison to the novice group. Validation of the RSA-Score in this study was carried out on the Robotic Surgical Simulator. The RSA-Score is a valid scoring system that could be incorporated in any virtual reality-based surgical simulator to achieve standardized assessment of fundamental surgical tents during robot-assisted surgery. Copyright © 2013 Elsevier Inc. All rights reserved.

A Danish diabetes risk score for targeted screening: the Inter99 study.

PubMed

Glümer, Charlotte; Carstensen, Bendix; Sandbaek, Annelli; Lauritzen, Torsten; Jørgensen, Torben; Borch-Johnsen, Knut

2004-03-01

To develop a simple self-administered questionnaire identifying individuals with undiagnosed diabetes with a sensitivity of 75% and minimizing the high-risk group needing subsequent testing. A population-based sample (Inter99 study) of 6,784 individuals aged 30-60 years completed a questionnaire on diabetes-related symptoms and risk factors. The participants underwent an oral glucose tolerance test. The risk score was derived from the first half and validated on the second half of the study population. External validation was performed based on the Danish Anglo-Danish-Dutch Study of Intensive Treatment in People with Screen Detected Diabetes in Primary Care (ADDITION) pilot study. The risk score was developed by stepwise backward multiple logistic regression. The final risk score included age, sex, BMI, known hypertension, physical activity at leisure time, and family history of diabetes, items independently and significantly (P<0.05) associated with the presence of previously undiagnosed diabetes. The area under the receiver operating curve was 0.804 (95% CI 0.765-0.838) for the first half of the Inter99 population, 0.761 (0.720-0.803) for the second half of the Inter99 population, and 0.803 (0.721-0.876) for the ADDITION pilot study. The sensitivity, specificity, and percentage that needed subsequent testing were 76, 72, and 29%, respectively. The false-negative individuals in the risk score had a lower absolute risk of ischemic heart disease compared with the true-positive individuals (11.3 vs. 20.4%; P<0.0001). We developed a questionnaire to be used in a stepwise screening strategy for type 2 diabetes, decreasing the numbers of subsequent tests and thereby possibly minimizing the economical and personal costs of the screening strategy.

Development and validation of a surgical-pathologic staging and scoring system for cervical cancer

PubMed Central

Zhou, Hang; Tang, Fangxu; Jia, Yao; Hu, Ting; Sun, Haiying; Yang, Ru; Chen, Yile; Cheng, Xiaodong; Lv, Weiguo; Wu, Li; Zhou, Jin; Wang, Shaoshuai; Huang, Kecheng; Wang, Lin; Yao, Yuan; Yang, Qifeng; Yang, Xingsheng; Zhang, Qinghua; Han, Xiaobing; Lin, Zhongqiu; Xing, Hui; Qu, Pengpeng; Cai, Hongbing; Song, Xiaojie; Tian, Xiaoyu; Shen, Jian; Xi, Ling; Li, Kezhen; Deng, Dongrui; Wang, Hui; Wang, Changyu; Wu, Mingfu; Zhu, Tao; Chen, Gang; Gao, Qinglei; Wang, Shixuan; Hu, Junbo; Kong, Beihua; Xie, Xing; Ma, Ding

2016-01-01

Background Most cervical cancer patients worldwide receive surgical treatments, and yet the current International Federation of Gynecology and Obstetrics (FIGO) staging system do not consider surgical-pathologic data. We propose a more comprehensive and prognostically valuable surgical-pathologic staging and scoring system (SPSs). Methods Records from 4,220 eligible cervical cancer cases (Cohort 1) were screened for surgical-pathologic risk factors. We constructed a surgical-pathologic staging and SPSs, which was subsequently validated in a prospective study of 1,104 cervical cancer patients (Cohort 2). Results In Cohort 1, seven independent risk factors were associated with patient outcome: lymph node metastasis (LNM), parametrial involvement, histological type, grade, tumor size, stromal invasion, and lymph-vascular space invasion (LVSI). The FIGO staging system was revised and expanded into a surgical-pathologic staging system by including additional criteria of LNM, stromal invasion, and LVSI. LNM was subdivided into three categories based on number and location of metastases. Inclusion of all seven prognostic risk factors improves practical applicability. Patients were stratified into three SPSs risk categories: zero-, low-, and high-score with scores of 0, 1 to 3, and ≥4 (P=1.08E-45; P=6.15E-55). In Cohort 2, 5-year overall survival (OS) and disease-free survival (DFS) outcomes decreased with increased SPSs scores (P=9.04E-15; P=3.23E-16), validating the approach. Surgical-pathologic staging and SPSs show greater homogeneity and discriminatory utility than FIGO staging. Conclusions Surgical-pathologic staging and SPSs improve characterization of tumor severity and disease invasion, which may more accurately predict outcome and guide postoperative therapy. PMID:27014971

Validation of cytogenetic risk groups according to International Prognostic Scoring Systems by peripheral blood CD34+FISH: results from a German diagnostic study in comparison with an international control group.

PubMed

Braulke, Friederike; Platzbecker, Uwe; Müller-Thomas, Catharina; Götze, Katharina; Germing, Ulrich; Brümmendorf, Tim H; Nolte, Florian; Hofmann, Wolf-Karsten; Giagounidis, Aristoteles A N; Lübbert, Michael; Greenberg, Peter L; Bennett, John M; Solé, Francesc; Mallo, Mar; Slovak, Marilyn L; Ohyashiki, Kazuma; Le Beau, Michelle M; Tüchler, Heinz; Pfeilstöcker, Michael; Nösslinger, Thomas; Hildebrandt, Barbara; Shirneshan, Katayoon; Aul, Carlo; Stauder, Reinhard; Sperr, Wolfgang R; Valent, Peter; Fonatsch, Christa; Trümper, Lorenz; Haase, Detlef; Schanz, Julie

2015-02-01

International Prognostic Scoring Systems are used to determine the individual risk profile of myelodysplastic syndrome patients. For the assessment of International Prognostic Scoring Systems, an adequate chromosome banding analysis of the bone marrow is essential. Cytogenetic information is not available for a substantial number of patients (5%-20%) with dry marrow or an insufficient number of metaphase cells. For these patients, a valid risk classification is impossible. In the study presented here, the International Prognostic Scoring Systems were validated based on fluorescence in situ hybridization analyses using extended probe panels applied to cluster of differentiation 34 positive (CD34(+)) peripheral blood cells of 328 MDS patients of our prospective multicenter German diagnostic study and compared to chromosome banding results of 2902 previously published patients with myelodysplastic syndromes. For cytogenetic risk classification by fluorescence in situ hybridization analyses of CD34(+) peripheral blood cells, the groups differed significantly for overall and leukemia-free survival by uni- and multivariate analyses without discrepancies between treated and untreated patients. Including cytogenetic data of fluorescence in situ hybridization analyses of peripheral CD34(+) blood cells (instead of bone marrow banding analysis) into the complete International Prognostic Scoring System assessment, the prognostic risk groups separated significantly for overall and leukemia-free survival. Our data show that a reliable stratification to the risk groups of the International Prognostic Scoring Systems is possible from peripheral blood in patients with missing chromosome banding analysis by using a comprehensive probe panel (clinicaltrials.gov identifier:01355913). Copyright© Ferrata Storti Foundation.

Validation of cytogenetic risk groups according to International Prognostic Scoring Systems by peripheral blood CD34+FISH: results from a German diagnostic study in comparison with an international control group

PubMed Central

Braulke, Friederike; Platzbecker, Uwe; Müller-Thomas, Catharina; Götze, Katharina; Germing, Ulrich; Brümmendorf, Tim H.; Nolte, Florian; Hofmann, Wolf-Karsten; Giagounidis, Aristoteles A. N.; Lübbert, Michael; Greenberg, Peter L.; Bennett, John M.; Solé, Francesc; Mallo, Mar; Slovak, Marilyn L.; Ohyashiki, Kazuma; Le Beau, Michelle M.; Tüchler, Heinz; Pfeilstöcker, Michael; Nösslinger, Thomas; Hildebrandt, Barbara; Shirneshan, Katayoon; Aul, Carlo; Stauder, Reinhard; Sperr, Wolfgang R.; Valent, Peter; Fonatsch, Christa; Trümper, Lorenz; Haase, Detlef; Schanz, Julie

2015-01-01

International Prognostic Scoring Systems are used to determine the individual risk profile of myelodysplastic syndrome patients. For the assessment of International Prognostic Scoring Systems, an adequate chromosome banding analysis of the bone marrow is essential. Cytogenetic information is not available for a substantial number of patients (5%–20%) with dry marrow or an insufficient number of metaphase cells. For these patients, a valid risk classification is impossible. In the study presented here, the International Prognostic Scoring Systems were validated based on fluorescence in situ hybridization analyses using extended probe panels applied to cluster of differentiation 34 positive (CD34+) peripheral blood cells of 328 MDS patients of our prospective multicenter German diagnostic study and compared to chromosome banding results of 2902 previously published patients with myelodysplastic syndromes. For cytogenetic risk classification by fluorescence in situ hybridization analyses of CD34+ peripheral blood cells, the groups differed significantly for overall and leukemia-free survival by uni- and multivariate analyses without discrepancies between treated and untreated patients. Including cytogenetic data of fluorescence in situ hybridization analyses of peripheral CD34+ blood cells (instead of bone marrow banding analysis) into the complete International Prognostic Scoring System assessment, the prognostic risk groups separated significantly for overall and leukemia-free survival. Our data show that a reliable stratification to the risk groups of the International Prognostic Scoring Systems is possible from peripheral blood in patients with missing chromosome banding analysis by using a comprehensive probe panel (clinicaltrials.gov identifier:01355913). PMID:25344522

Polygenic hazard score to guide screening for aggressive prostate cancer: development and validation in large scale cohorts.

PubMed

Seibert, Tyler M; Fan, Chun Chieh; Wang, Yunpeng; Zuber, Verena; Karunamuni, Roshan; Parsons, J Kellogg; Eeles, Rosalind A; Easton, Douglas F; Kote-Jarai, ZSofia; Al Olama, Ali Amin; Garcia, Sara Benlloch; Muir, Kenneth; Grönberg, Henrik; Wiklund, Fredrik; Aly, Markus; Schleutker, Johanna; Sipeky, Csilla; Tammela, Teuvo Lj; Nordestgaard, Børge G; Nielsen, Sune F; Weischer, Maren; Bisbjerg, Rasmus; Røder, M Andreas; Iversen, Peter; Key, Tim J; Travis, Ruth C; Neal, David E; Donovan, Jenny L; Hamdy, Freddie C; Pharoah, Paul; Pashayan, Nora; Khaw, Kay-Tee; Maier, Christiane; Vogel, Walther; Luedeke, Manuel; Herkommer, Kathleen; Kibel, Adam S; Cybulski, Cezary; Wokolorczyk, Dominika; Kluzniak, Wojciech; Cannon-Albright, Lisa; Brenner, Hermann; Cuk, Katarina; Saum, Kai-Uwe; Park, Jong Y; Sellers, Thomas A; Slavov, Chavdar; Kaneva, Radka; Mitev, Vanio; Batra, Jyotsna; Clements, Judith A; Spurdle, Amanda; Teixeira, Manuel R; Paulo, Paula; Maia, Sofia; Pandha, Hardev; Michael, Agnieszka; Kierzek, Andrzej; Karow, David S; Mills, Ian G; Andreassen, Ole A; Dale, Anders M

2018-01-10

To develop and validate a genetic tool to predict age of onset of aggressive prostate cancer (PCa) and to guide decisions of who to screen and at what age. Analysis of genotype, PCa status, and age to select single nucleotide polymorphisms (SNPs) associated with diagnosis. These polymorphisms were incorporated into a survival analysis to estimate their effects on age at diagnosis of aggressive PCa (that is, not eligible for surveillance according to National Comprehensive Cancer Network guidelines; any of Gleason score ≥7, stage T3-T4, PSA (prostate specific antigen) concentration ≥10 ng/L, nodal metastasis, distant metastasis). The resulting polygenic hazard score is an assessment of individual genetic risk. The final model was applied to an independent dataset containing genotype and PSA screening data. The hazard score was calculated for these men to test prediction of survival free from PCa. Multiple institutions that were members of international PRACTICAL consortium. All consortium participants of European ancestry with known age, PCa status, and quality assured custom (iCOGS) array genotype data. The development dataset comprised 31 747 men; the validation dataset comprised 6411 men. Prediction with hazard score of age of onset of aggressive cancer in validation set. In the independent validation set, the hazard score calculated from 54 single nucleotide polymorphisms was a highly significant predictor of age at diagnosis of aggressive cancer (z=11.2, P<10 -16 ). When men in the validation set with high scores (>98th centile) were compared with those with average scores (30th-70th centile), the hazard ratio for aggressive cancer was 2.9 (95% confidence interval 2.4 to 3.4). Inclusion of family history in a combined model did not improve prediction of onset of aggressive PCa (P=0.59), and polygenic hazard score performance remained high when family history was accounted for. Additionally, the positive predictive value of PSA screening for aggressive PCa

Development of a Middle-Age and Geriatric Trauma Mortality Risk Score A Tool to Guide Palliative Care Consultations.

PubMed

Konda, Sanjit R; Seymour, Rachel; Manoli, Arthur; Gales, Jordan; Karunakar, Madhav A

2016-11-01

This study aimed to develop a tool to quantify risk of inpatient mortality among geriatric and middleaged trauma patients. This study sought to demonstrate the ability of the novel risk score in the early identification of high risk trauma patients for resource-sparing interventions, including referral to palliative medicine. This retrospective cohort study utilized data from a single level 1 trauma center. Regression analysis was used to create a novel risk of inpatient mortality score. A total of 2,387 low energy and 1,201 high-energy middle-aged (range: 55 to 64 years of age) and geriatric (65 years of age or odler) trauma patients comprised the study cohort. Model validation was performed using 37,474 lowenergy and 97,034 high-energy patients from the National Trauma Databank (NTDB). Potential hospital cost reduction was calculated for early referral of high risk trauma patients to palliative medicine services in comparison to no palliative medicine referral. Factors predictive of inpatient mortality among the study and validation patient cohorts included; age, Glasgow Coma Scale, and Abbreviated Injury Scale for the head and neck and chest. Within the validation cohort, the novel mortality risk score demonstrated greater predictive capacity than existing trauma scores [STTGMALE-AUROC: 0.83 vs. TRISS 0.80, (p < 0.01), STTGMAHE-AUROC: 0.86 vs. TRISS 0.85, (p < 0.01)]. Our model demonstrated early palliative medicine evaluation could produce $1,083,082 in net hospital savings per year. This novel risk score for older trauma patients has shown fidelity in prediction of inpatient mortality; in the study and validation cohorts. This tool may be used for early intervention in the care of patients at high risk of mortality and resource expenditure.

Validation of the grown-ups with congenital heart disease score.

PubMed

Hörer, Jürgen; Roussin, Régine; LeBret, Emanuel; Ly, Mohamed; Abdullah, Jarrah; Marzullo, Rafaella; Pabst von Ohain, Jelena; Belli, Emre

2018-06-01

Adults with congenital heart disease in need of heart surgery frequently present with significant comorbidity. Furthermore, additional technical difficulties often related to redo operations increase the risk for postoperative mortality and morbidity. Hence, next to the type of the procedure, additional procedure-dependent and procedure-independent factors have to be considered for risk evaluation. The recently proposed grown-ups with congenital heart disease (GUCH) mortality and morbidity scores account for these additional risk factors. We sought to validate their predictive power in a large population operated in a single centre. Data of all consecutive patients aged 18 years or more, who underwent surgery for congenital heart disease between 2005 and 2016, were collected. Mortality was defined as hospital mortality or mortality within 30 days following surgery. Morbidity was defined as occurrence of one or more of the following complications: renal failure requiring dialysis, neurologic deficit persisting at discharge, atrioventricular block requiring permanent pacemaker implantation, mechanical circulatory support, phrenic nerve injury and unplanned reoperation. The discriminatory power of the GUCH scores was assessed using the area under the receiver operating characteristics curve (c-index, including 95% CI). Eight hundred and twenty-four operations were evaluated. Additional procedure-dependent and procedure-independent factors, as defined in the GUCH scores, were present in 165 patients (20.0%) and 544 patients (66.0%), respectively. Hospital mortality and morbidity was 3.4% and 10.0%, respectively. C-index for GUCH mortality score was 0.809 (0.742-0.877). C-index for GUCH morbidity score was 0.676 (0.619-0.734). We could confirm the good predictive power of the GUCH mortality score for postoperative mortality in a large population of adults with congenital heart disease. © Article author(s) (or their employer(s) unless otherwise stated in the text of the

Validation of Automated Scoring of Oral Reading

ERIC Educational Resources Information Center

Balogh, Jennifer; Bernstein, Jared; Cheng, Jian; Van Moere, Alistair; Townshend, Brent; Suzuki, Masanori

2012-01-01

A two-part experiment is presented that validates a new measurement tool for scoring oral reading ability. Data collected by the U.S. government in a large-scale literacy assessment of adults were analyzed by a system called VersaReader that uses automatic speech recognition and speech processing technologies to score oral reading fluency. In the…

A user-friendly risk-score for predicting in-hospital cardiac arrest among patients admitted with suspected non ST-elevation acute coronary syndrome - The SAFER-score.

PubMed

Faxén, Jonas; Hall, Marlous; Gale, Chris P; Sundström, Johan; Lindahl, Bertil; Jernberg, Tomas; Szummer, Karolina

2017-12-01

To develop a simple risk-score model for predicting in-hospital cardiac arrest (CA) among patients hospitalized with suspected non-ST elevation acute coronary syndrome (NSTE-ACS). Using the Swedish Web-system for Enhancement and Development of Evidence-based care in Heart disease Evaluated According to Recommended Therapies (SWEDEHEART), we identified patients (n=242 303) admitted with suspected NSTE-ACS between 2008 and 2014. Logistic regression was used to assess the association between 26 candidate variables and in-hospital CA. A risk-score model was developed and validated using a temporal cohort (n=126 073) comprising patients from SWEDEHEART between 2005 and 2007 and an external cohort (n=276 109) comprising patients from the Myocardial Ischaemia National Audit Project (MINAP) between 2008 and 2013. The incidence of in-hospital CA for NSTE-ACS and non-ACS was lower in the SWEDEHEART-derivation cohort than in MINAP (1.3% and 0.5% vs. 2.3% and 2.3%). A seven point, five variable risk score (age ≥60 years (1 point), ST-T abnormalities (2 points), Killip Class >1 (1 point), heart rate <50 or ≥100bpm (1 point), and systolic blood pressure <100mmHg (2 points) was developed. Model discrimination was good in the derivation cohort (c-statistic 0.72) and temporal validation cohort (c-statistic 0.74), and calibration was reasonable with a tendency towards overestimation of risk with a higher sum of score points. External validation showed moderate discrimination (c-statistic 0.65) and calibration showed a general underestimation of predicted risk. A simple points score containing five variables readily available on admission predicts in-hospital CA for patients with suspected NSTE-ACS. Copyright © 2017 Elsevier B.V. All rights reserved.

A simple risk score for identifying individuals with impaired fasting glucose in the Southern Chinese population.

PubMed

Wang, Hui; Liu, Tao; Qiu, Quan; Ding, Peng; He, Yan-Hui; Chen, Wei-Qing

2015-01-23

This study aimed to develop and validate a simple risk score for detecting individuals with impaired fasting glucose (IFG) among the Southern Chinese population. A sample of participants aged ≥20 years and without known diabetes from the 2006-2007 Guangzhou diabetes cross-sectional survey was used to develop separate risk scores for men and women. The participants completed a self-administered structured questionnaire and underwent simple clinical measurements. The risk scores were developed by multiple logistic regression analysis. External validation was performed based on three other studies: the 2007 Zhuhai rural population-based study, the 2008-2010 Guangzhou diabetes cross-sectional study and the 2007 Tibet population-based study. Performance of the scores was measured with the Hosmer-Lemeshow goodness-of-fit test and ROC c-statistic. Age, waist circumference, body mass index and family history of diabetes were included in the risk score for both men and women, with the additional factor of hypertension for men. The ROC c-statistic was 0.70 for both men and women in the derivation samples. Risk scores of ≥28 for men and ≥18 for women showed respective sensitivity, specificity, positive predictive value and negative predictive value of 56.6%, 71.7%, 13.0% and 96.0% for men and 68.7%, 60.2%, 11% and 96.0% for women in the derivation population. The scores performed comparably with the Zhuhai rural sample and the 2008-2010 Guangzhou urban samples but poorly in the Tibet sample. The performance of pre-existing USA, Shanghai, and Chengdu risk scores was poorer in our population than in their original study populations. The results suggest that the developed simple IFG risk scores can be generalized in Guangzhou city and nearby rural regions and may help primary health care workers to identify individuals with IFG in their practice.

A Simple Risk Score for Identifying Individuals with Impaired Fasting Glucose in the Southern Chinese Population

PubMed Central

Wang, Hui; Liu, Tao; Qiu, Quan; Ding, Peng; He, Yan-Hui; Chen, Wei-Qing

2015-01-01

This study aimed to develop and validate a simple risk score for detecting individuals with impaired fasting glucose (IFG) among the Southern Chinese population. A sample of participants aged ≥20 years and without known diabetes from the 2006–2007 Guangzhou diabetes cross-sectional survey was used to develop separate risk scores for men and women. The participants completed a self-administered structured questionnaire and underwent simple clinical measurements. The risk scores were developed by multiple logistic regression analysis. External validation was performed based on three other studies: the 2007 Zhuhai rural population-based study, the 2008–2010 Guangzhou diabetes cross-sectional study and the 2007 Tibet population-based study. Performance of the scores was measured with the Hosmer-Lemeshow goodness-of-fit test and ROC c-statistic. Age, waist circumference, body mass index and family history of diabetes were included in the risk score for both men and women, with the additional factor of hypertension for men. The ROC c-statistic was 0.70 for both men and women in the derivation samples. Risk scores of ≥28 for men and ≥18 for women showed respective sensitivity, specificity, positive predictive value and negative predictive value of 56.6%, 71.7%, 13.0% and 96.0% for men and 68.7%, 60.2%, 11% and 96.0% for women in the derivation population. The scores performed comparably with the Zhuhai rural sample and the 2008–2010 Guangzhou urban samples but poorly in the Tibet sample. The performance of pre-existing USA, Shanghai, and Chengdu risk scores was poorer in our population than in their original study populations. The results suggest that the developed simple IFG risk scores can be generalized in Guangzhou city and nearby rural regions and may help primary health care workers to identify individuals with IFG in their practice. PMID:25625405

Risk scoring for the primary prevention of cardiovascular disease.

PubMed

Karmali, Kunal N; Persell, Stephen D; Perel, Pablo; Lloyd-Jones, Donald M; Berendsen, Mark A; Huffman, Mark D

2017-03-14

The current paradigm for cardiovascular disease (CVD) emphasises absolute risk assessment to guide treatment decisions in primary prevention. Although the derivation and validation of multivariable risk assessment tools, or CVD risk scores, have attracted considerable attention, their effect on clinical outcomes is uncertain. To assess the effects of evaluating and providing CVD risk scores in adults without prevalent CVD on cardiovascular outcomes, risk factor levels, preventive medication prescribing, and health behaviours. We searched the Cochrane Central Register of Controlled Trials (CENTRAL) in the Cochrane Library (2016, Issue 2), MEDLINE Ovid (1946 to March week 1 2016), Embase (embase.com) (1974 to 15 March 2016), and Conference Proceedings Citation Index-Science (CPCI-S) (1990 to 15 March 2016). We imposed no language restrictions. We searched clinical trial registers in March 2016 and handsearched reference lists of primary studies to identify additional reports. We included randomised and quasi-randomised trials comparing the systematic provision of CVD risk scores by a clinician, healthcare professional, or healthcare system compared with usual care (i.e. no systematic provision of CVD risk scores) in adults without CVD. Three review authors independently selected studies, extracted data, and evaluated study quality. We used the Cochrane 'Risk of bias' tool to assess study limitations. The primary outcomes were: CVD events, change in CVD risk factor levels (total cholesterol, systolic blood pressure, and multivariable CVD risk), and adverse events. Secondary outcomes included: lipid-lowering and antihypertensive medication prescribing in higher-risk people. We calculated risk ratios (RR) for dichotomous data and mean differences (MD) or standardised mean differences (SMD) for continuous data using 95% confidence intervals. We used a fixed-effects model when heterogeneity (I²) was at least 50% and a random-effects model for substantial heterogeneity

Psoriasis and cardiovascular risk. Assessment by different cardiovascular risk scores.

PubMed

Fernández-Torres, R; Pita-Fernández, S; Fonseca, E

2013-12-01

Psoriasis is an inflammatory disease associated with an increased risk of cardiovascular morbidity and mortality. However, very few studies determine cardiovascular risk by means of Framingham risk score or other indices more appropriate for countries with lower prevalence of cardiovascular risk factors. To determine multiple cardiovascular risk scores in psoriasis patients, the relation between cardiovascular risk and psoriasis features and to compare our results with those in the literature. We assessed demographic data, smoking status, psoriasis features, blood pressure and analytical data. Cardiovascular risk was determined by means of Framingham, SCORE, DORICA and REGICOR scores. A total of 395 patients (59.7% men and 40.3% women) aged 18-86 years were included. The proportion of patients at intermediate and high risk of suffering a major cardiovascular event in the next 10 years was 30.5% and 11.4%, respectively, based on Framingham risk score; 26.9% and 2.2% according to DORICA and 6.8% and 0% using REGICOR score. According to the SCORE index, 22.1% of patients had a high risk of death due to a cardiovascular event over the next 10 years. Cardiovascular risk was not related to psoriasis characteristics, except for the Framingham index, with higher risk in patients with more severe psoriasis (P = 0.032). A considerable proportion of patients had intermediate or high cardiovascular risk, without relevant relationship with psoriasis characteristics and treatment schedules. Therefore, systematic evaluation of cardiovascular risk scores in all psoriasis patients could be useful to identify those with increased cardiovascular risk, subsidiary of lifestyle changes or therapeutic interventions. © 2012 The Authors. Journal of the European Academy of Dermatology and Venereology © 2012 European Academy of Dermatology and Venereology.

Concurrent Validity of LibQUAL+[TM] Scores: What Do LibQUAL+[TM] Scores Measure?

ERIC Educational Resources Information Center

Thompson, Bruce; Cook, Colleen; Kyrillidou, Martha

2005-01-01

The present study investigated the validity of LibQUAL+[TM] scores, and specifically how total and subscale LibQUAL+[TM] scores are associated with self-reported, library-related satisfaction and outcomes scores. Participants included 88,664 students and faculty who completed the American English (n[AE] = 69,494) or the British English (n[BE] =…

Validation of a literature-based adherence score to Mediterranean diet: the MEDI-LITE score.

PubMed

Sofi, Francesco; Dinu, Monica; Pagliai, Giuditta; Marcucci, Rossella; Casini, Alessandro

2017-09-01

Numerous studies have demonstrated a relationship between adherence to Mediterranean diet and prevention of chronic degenerative diseases. The aim of this study was to validate a novel instrument to measure adherence to Mediterranean diet based on the literature (the MEDI-LITE score). Two-hundred-and-four clinically healthy subjects completed both the MEDI-LITE score and the validated MedDietScore (MDS). Significant positive correlation between the MEDI-LITE and the MDS scores was found in the study population (R = .70; p < .0001). Furthermore, statistically significant positive correlations were found for all the nine different food groups. According to the receiver operating characteristic (ROC) curve analysis, MEDI-LITE evidenced a significant discriminative capacity between adherents and non-adherents to the Mediterranean diet pattern (optimal cut-off point = 8.50; sensitivity = 96%; specificity = 38%). In conclusion, our findings show that the MEDI-LITE score well correlate with MDS in both global score and in most of the items related to the specific food categories.

Examining the Predictive Validity of NIH Peer Review Scores

PubMed Central

Lindner, Mark D.; Nakamura, Richard K.

2015-01-01

The predictive validity of peer review at the National Institutes of Health (NIH) has not yet been demonstrated empirically. It might be assumed that the most efficient and expedient test of the predictive validity of NIH peer review would be an examination of the correlation between percentile scores from peer review and bibliometric indices of the publications produced from funded projects. The present study used a large dataset to examine the rationale for such a study, to determine if it would satisfy the requirements for a test of predictive validity. The results show significant restriction of range in the applications selected for funding. Furthermore, those few applications that are funded with slightly worse peer review scores are not selected at random or representative of other applications in the same range. The funding institutes also negotiate with applicants to address issues identified during peer review. Therefore, the peer review scores assigned to the submitted applications, especially for those few funded applications with slightly worse peer review scores, do not reflect the changed and improved projects that are eventually funded. In addition, citation metrics by themselves are not valid or appropriate measures of scientific impact. The use of bibliometric indices on their own to measure scientific impact would likely increase the inefficiencies and problems with replicability already largely attributed to the current over-emphasis on bibliometric indices. Therefore, retrospective analyses of the correlation between percentile scores from peer review and bibliometric indices of the publications resulting from funded grant applications are not valid tests of the predictive validity of peer review at the NIH. PMID:26039440

A Risk-Scoring System for Predicting Methicillin Resistance in Community-Onset Staphylococcus aureus Bacteremia in Korea.

PubMed

Suh, Hyeon Jeong; Park, Wan Beom; Jung, Sook-In; Song, Kyoung-Ho; Kwak, Yee Gyung; Kim, Kye-Hyung; Hwang, Jeong-Hwan; Yun, Na Ra; Jang, Hee-Chang; Kim, Young Keun; Kim, Nak-Hyun; Park, Kyung-Hwa; Kang, Seung Ji; Lee, Shinwon; Kim, Eu Suk; Kim, Hong Bin

2018-06-01

We aimed to develop a simple scoring system to predict risk for methicillin resistance in community-onset Staphylococcus aureus bacteremia (CO-SAB) by identifying the clinical and epidemiological risk factors for community-onset methicillin-resistant S. aureus (MRSA). We retrospectively analyzed data from three multicenter cohort studies in Korea in which patient information was prospectively collected and risk factors for methicillin resistance in CO-SAB were identified. We then developed and validated a risk-scoring system. To analyze the 1,802 cases of CO-SAB, we included the four most powerful predictors of methicillin resistance that we identified in the scoring system: underlying hematologic disease (-1 point), endovascular infection as the primary site of infection (-1 point), history of hospitalization or surgery in ≤1 year (+0.5 points), and previous isolation of MRSA in ≤6 months (+1.5 points). With this scoring system, cases were classified into low (less than -0.5), intermediate (-0.5-1.5), and high (≥1.5) risk groups. The proportions of MRSA cases in each group were 24.7% (22/89), 39.0% (607/1,557), and 78.8% (123/156), respectively, and 16.7% (1/6), 33.8% (112/331), and 76.9% (10/13) in a validation set. This risk-scoring system for methicillin resistance in CO-SAB may help physicians select appropriate empirical antibiotics more quickly.

Clostridium difficile Associated Risk of Death Score (CARDS): A novel severity score to predict mortality among hospitalized patients with Clostridium difficile infection

PubMed Central

Kassam, Zain; Fabersunne, Camila Cribb; Smith, Mark B.; Alm, Eric J.; Kaplan, Gilaad G.; Nguyen, Geoffrey C.; Ananthakrishnan, Ashwin N.

2016-01-01

Background Clostridium difficile infection (CDI) is public health threat and associated with significant mortality. However, there is a paucity of objectively derived CDI severity scoring systems to predict mortality. Aims To develop a novel CDI risk score to predict mortality entitled: Clostridium difficile Associated Risk of Death Score (CARDS). Methods We obtained data from the United States 2011 Nationwide Inpatient Sample (NIS) database. All CDI-associated hospitalizations were identified using discharge codes (ICD-9-CM, 008.45). Multivariate logistic regression was utilized to identify independent predictors of mortality. CARDS was calculated by assigning a numeric weight to each parameter based on their odds ratio in the final logistic model. Predictive properties of model discrimination were assessed using the c-statistic and validated in an independent sample using the 2010 NIS database. Results We identified 77,776 hospitalizations, yielding an estimate of 374,747 cases with an associated diagnosis of CDI in the United States, 8% of whom died in the hospital. The 8 severity score predictors were identified on multivariate analysis: age, cardiopulmonary disease, malignancy, diabetes, inflammatory bowel disease, acute renal failure, liver disease and ICU admission, with weights ranging from −1 (for diabetes) to 5 (for ICU admission). The overall risk score in the cohort ranged from 0 to 18. Mortality increased significantly as CARDS increased. CDI-associated mortality was 1.2% with a CARDS of 0 compared to 100% with CARDS of 18. The model performed equally well in our validation cohort. Conclusion CARDS is a promising simple severity score to predict mortality among those hospitalized with CDI. PMID:26849527

Validity of Indian Diabetes Risk Score and its association with body mass index and glycosylated hemoglobin for screening of diabetes in and around areas of Lucknow

PubMed Central

Khan, Mohammad Mustufa; Sonkar, Gyanendra Kumar; Alam, Roshan; Mehrotra, Sudhir; Khan, M. Salman; Kumar, Ajay; Sonkar, Satyendra Kumar

2017-01-01

Objectives: The present study aimed to assess the validity of Indian Diabetes Risk Score (IDRS) and its association with body mass index (BMI) and glycosylated hemoglobin (HbA1c) for screening of diabetes and obesity. Methodology: A cross-sectional study was designed, and samples were randomly enrolled from Lucknow and its adjoining areas. Totally, 405 subjects were included in the study. We used diabetes risk factors (age, waist circumference, physical activity, and family history of diabetes) for screening of diabetes and abdominal obesity (AO) and BMI for screening of general obesity. HbA1c was used for confirming the diabetes patients in this population. Statistical analysis was applied to all data using SPSS software (version 20.0). P < 0.05 was considered statistically significant. Results: All 405 subjects were assessed for diabetic risk factors, BMI, and glycated hemoglobin. Of these, 56.3% subjects were aged ≥50 years. 1° and 2° AO was found in 47.9% and 40% subjects, respectively. About 27.1% subjects were found to have sedentary lifestyle, and 72.6% were found to have no family history of diabetes. According to IDRS, 272 subjects (67.2%) were found at high risk of diabetes (score ≥60). Based on BMI calculation, 198 subjects were obese, of which 79.3% were found at high risk for diabetes. A significant association was found between subjects with higher risk score and BMI (P < 0.001). Assessment of HbA1c showed that 97 (23.9%) were prediabetic and 204 (50.4%) were diabetic, of which 63.9% and 77%, respectively was at high risk for diabetes as per IDRS. A significant association was found between subjects with higher risk score and HbA1c (P < 0.001). Conclusion: Our study fully supports the validity of IDRS, as it can be used as a cost-effective tool for primary mass screening of diabetes. Moreover, its combination with BMI value and HbA1c can be used for strict monitoring for diabetes and obesity at primary health care centers to reduce the early

Derivation and validation of the prolonged length of stay score in acute stroke patients.

PubMed

Koton, S; Bornstein, N M; Tsabari, R; Tanne, D

2010-05-11

Length of stay (LOS) is the main cost-determining factor of hospitalization of stroke patients. Our aim was to derive and validate a simple score for the assessment of the risk of prolonged LOS for acute stroke patients in a national setting. Ischemic stroke (IS) and intracerebral hemorrhage (ICH) patients in the National Acute Stroke Israeli Surveys (NASIS 2004 and 2007) were included. Predictors of prolonged LOS (LOS > or =7 days) in the NASIS 2004 (n = 1,700) were identified with logistic regression analysis and used for the derivation of the Prolonged Length of Stay (PLOS) score. The score was validated in the NASIS 2007 (n = 1,648). Median (interquartile range) LOS was 6 (3-10) days in the derivation cohort (42.3% prolonged LOS) and 5 (3-8) in the validation cohort (35.7% prolonged LOS). The derivation cohort included 54.8% men, 90.8% IS and 9.2% ICH, with a mean (SD) age of 71.2 (12.5) years. Stroke severity was the strongest multivariable predictor of prolonged LOS: odds ratio (95% confidence interval [CI]) increased from 2.6 (2.0-3.3) for NIH Stroke Scale score (NIHSS) 6-10 to 4.9 (3.0-8.0) for NIHSS 16-20, compared with NIHSS < or =5. Stroke severity and type, decreased level of consciousness on admission, history of congestive heart failure, and prior atrial fibrillation were used for the derivation of the PLOS score (c statistics 0.692, 95% CI 0.666-0.718). The score performed similarly well in the validation cohort (c statistics 0.680, 95% CI 0.653-0.707). A simple prolonged length of stay score, based on available baseline information, may be useful for tailoring policy aimed at better use of resources and optimal discharge planning of acute stroke patients.

Dutch validation of the low anterior resection syndrome score.

PubMed

Hupkens, B J P; Breukink, S O; Olde Reuver Of Briel, C; Tanis, P J; de Noo, M E; van Duijvendijk, P; van Westreenen, H L; Dekker, J W T; Chen, T Y T; Juul, T

2018-04-21

The aim of this study was to validate the Dutch translation of the low anterior resection syndrome (LARS) score in a population of Dutch rectal cancer patients. Patients who underwent surgery for rectal cancer received the LARS score questionnaire, a single quality of life (QoL) category question and the European Organization for Research and Treatment of Cancer (EORTC) QLQ-C30 questionnaire. A subgroup of patients received the LARS score twice to assess the test-retest reliability. A total of 165 patients were included in the analysis, identified in six Dutch centres. The response rate was 62.0%. The percentage of patients who reported 'major LARS' was 59.4%. There was a high proportion of patients with a perfect or moderate fit between the QoL category question and the LARS score, showing a good convergent validity. The LARS score was able to discriminate between patients with or without neoadjuvant radiotherapy (P = 0.003), between total and partial mesorectal excision (P = 0.008) and between age groups (P = 0.039). There was a statistically significant association between a higher LARS score and an impaired function on the global QoL subscale and the physical, role, emotional and social functioning subscales of the EORTC QLQ-C30 questionnaire. The test-retest reliability of the LARS score was good, with an interclass correlation coefficient of 0.79. The good psychometric properties of the Dutch version of the LARS score are comparable overall to the earlier validations in other countries. Therefore, the Dutch translation can be considered to be a valid tool for assessing LARS in Dutch rectal cancer patients. Colorectal Disease © 2018 The Association of Coloproctology of Great Britain and Ireland.

External validation of the HIT Expert Probability (HEP) score.

PubMed

Joseph, Lee; Gomes, Marcelo P V; Al Solaiman, Firas; St John, Julie; Ozaki, Asuka; Raju, Manjunath; Dhariwal, Manoj; Kim, Esther S H

2015-03-01

The diagnosis of heparin-induced thrombocytopenia (HIT) can be challenging. The HIT Expert Probability (HEP) Score has recently been proposed to aid in the diagnosis of HIT. We sought to externally and prospectively validate the HEP score. We prospectively assessed pre-test probability of HIT for 51 consecutive patients referred to our Consultative Service for evaluation of possible HIT between August 1, 2012 and February 1, 2013. Two Vascular Medicine fellows independently applied the 4T and HEP scores for each patient. Two independent HIT expert adjudicators rendered a diagnosis of HIT likely or unlikely. The median (interquartile range) of 4T and HEP scores were 4.5 (3.0, 6.0) and 5 (3.0, 8.5), respectively. There were no significant differences between area under receiver-operating characteristic curves of 4T and HEP scores against the gold standard, confirmed HIT [defined as positive serotonin release assay and positive anti-PF4/heparin ELISA] (0.74 vs 0.73, p = 0.97). HEP score ≥ 2 was 100 % sensitive and 16 % specific for determining the presence of confirmed HIT while a 4T score > 3 was 93 % sensitive and 35 % specific. In conclusion, the HEP and 4T scores are excellent screening pre-test probability models for HIT, however, in this prospective validation study, test characteristics for the diagnosis of HIT based on confirmatory laboratory testing and expert opinion are similar. Given the complexity of the HEP scoring model compared to that of the 4T score, further validation of the HEP score is warranted prior to widespread clinical acceptance.

Prediction of individual genetic risk to prostate cancer using a polygenic score.

PubMed

Szulkin, Robert; Whitington, Thomas; Eklund, Martin; Aly, Markus; Eeles, Rosalind A; Easton, Douglas; Kote-Jarai, Z Sofia; Amin Al Olama, Ali; Benlloch, Sara; Muir, Kenneth; Giles, Graham G; Southey, Melissa C; Fitzgerald, Liesel M; Henderson, Brian E; Schumacher, Fredrick; Haiman, Christopher A; Schleutker, Johanna; Wahlfors, Tiina; Tammela, Teuvo L J; Nordestgaard, Børge G; Key, Tim J; Travis, Ruth C; Neal, David E; Donovan, Jenny L; Hamdy, Freddie C; Pharoah, Paul; Pashayan, Nora; Khaw, Kay-Tee; Stanford, Janet L; Thibodeau, Stephen N; McDonnell, Shannon K; Schaid, Daniel J; Maier, Christiane; Vogel, Walther; Luedeke, Manuel; Herkommer, Kathleen; Kibel, Adam S; Cybulski, Cezary; Lubiński, Jan; Kluźniak, Wojciech; Cannon-Albright, Lisa; Brenner, Hermann; Butterbach, Katja; Stegmaier, Christa; Park, Jong Y; Sellers, Thomas; Lin, Hui-Yi; Lim, Hui-Yi; Slavov, Chavdar; Kaneva, Radka; Mitev, Vanio; Batra, Jyotsna; Clements, Judith A; Spurdle, Amanda; Teixeira, Manuel R; Paulo, Paula; Maia, Sofia; Pandha, Hardev; Michael, Agnieszka; Kierzek, Andrzej; Gronberg, Henrik; Wiklund, Fredrik

2015-09-01

Polygenic risk scores comprising established susceptibility variants have shown to be informative classifiers for several complex diseases including prostate cancer. For prostate cancer it is unknown if inclusion of genetic markers that have so far not been associated with prostate cancer risk at a genome-wide significant level will improve disease prediction. We built polygenic risk scores in a large training set comprising over 25,000 individuals. Initially 65 established prostate cancer susceptibility variants were selected. After LD pruning additional variants were prioritized based on their association with prostate cancer. Six-fold cross validation was performed to assess genetic risk scores and optimize the number of additional variants to be included. The final model was evaluated in an independent study population including 1,370 cases and 1,239 controls. The polygenic risk score with 65 established susceptibility variants provided an area under the curve (AUC) of 0.67. Adding an additional 68 novel variants significantly increased the AUC to 0.68 (P = 0.0012) and the net reclassification index with 0.21 (P = 8.5E-08). All novel variants were located in genomic regions established as associated with prostate cancer risk. Inclusion of additional genetic variants from established prostate cancer susceptibility regions improves disease prediction. © 2015 Wiley Periodicals, Inc.

Simplification of a scoring system maintained overall accuracy but decreased the proportion classified as low risk.

PubMed

Sanders, Sharon; Flaws, Dylan; Than, Martin; Pickering, John W; Doust, Jenny; Glasziou, Paul

2016-01-01

Scoring systems are developed to assist clinicians in making a diagnosis. However, their uptake is often limited because they are cumbersome to use, requiring information on many predictors, or complicated calculations. We examined whether, and how, simplifications affected the performance of a validated score for identifying adults with chest pain in an emergency department who have low risk of major adverse cardiac events. We simplified the Emergency Department Assessment of Chest pain Score (EDACS) by three methods: (1) giving equal weight to each predictor included in the score, (2) reducing the number of predictors, and (3) using both methods--giving equal weight to a reduced number of predictors. The diagnostic accuracy of the simplified scores was compared with the original score in the derivation (n = 1,974) and validation (n = 909) data sets. There was no difference in the overall accuracy of the simplified versions of the score compared with the original EDACS as measured by the area under the receiver operating characteristic curve (0.74 to 0.75 for simplified versions vs. 0.75 for the original score in the validation cohort). With score cut-offs set to maintain the sensitivity of the combination of score and tests (electrocardiogram and cardiac troponin) at a level acceptable to clinicians (99%), simplification reduced the proportion of patients classified as low risk from 50% with the original score to between 22% and 42%. Simplification of a clinical score resulted in similar overall accuracy but reduced the proportion classified as low risk and therefore eligible for early discharge compared with the original score. Whether the trade-off is acceptable, will depend on the context in which the score is to be used. Developers of clinical scores should consider simplification as a method to increase uptake, but further studies are needed to determine the best methods of deriving and evaluating simplified scores. Copyright © 2016 Elsevier Inc. All rights

Construction of an Exome-Wide Risk Score for Schizophrenia Based on a Weighted Burden Test.

PubMed

Curtis, David

2018-01-01

Polygenic risk scores obtained as a weighted sum of associated variants can be used to explore association in additional data sets and to assign risk scores to individuals. The methods used to derive polygenic risk scores from common SNPs are not suitable for variants detected in whole exome sequencing studies. Rare variants, which may have major effects, are seen too infrequently to judge whether they are associated and may not be shared between training and test subjects. A method is proposed whereby variants are weighted according to their frequency, their annotations and the genes they affect. A weighted sum across all variants provides an individual risk score. Scores constructed in this way are used in a weighted burden test and are shown to be significantly different between schizophrenia cases and controls using a five-way cross-validation procedure. This approach represents a first attempt to summarise exome sequence variation into a summary risk score, which could be combined with risk scores from common variants and from environmental factors. It is hoped that the method could be developed further. © 2017 John Wiley & Sons Ltd/University College London.

Development of a cardiovascular risk score for use in low- and middle-income countries

USDA-ARS?s Scientific Manuscript database

Summary measures of cardiovascular risk have long been used in public health, but few include nutritional predictors despite extensive evidence linking diet and heart disease. Study objectives were to develop and validate a novel risk score in a case-control study of myocardial infarction (MI) condu...

Predicting Long-Term Outcomes in Pleural Infections. RAPID Score for Risk Stratification.

PubMed

White, Heath D; Henry, Christopher; Stock, Eileen M; Arroliga, Alejandro C; Ghamande, Shekhar

2015-09-01

Pleural infections are associated with significant morbidity and mortality. The recently developed RAPID (renal, age, purulence, infection source, and dietary factors) score consists of five clinical factors that can identify patients at risk for increased mortality. The objective of this study was to further validate the RAPID score in a diverse cohort, identify factors associated with mortality, and provide long-term outcomes. We evaluated a single-center retrospective cohort of 187 patients with culture-positive pleural infections. Patients were classified by RAPID scores into low-risk (0-2), medium-risk (3-4), and high-risk (5-7) groups. The Social Security Death Index was used to determine date of death. All-cause mortality was assessed at 3 months, 1 year, 3 years, and 5 years. Clinical factors and comorbid conditions were evaluated for association. Three-month mortality for low-, medium-, and high-risk groups was 1.5, 17.8, and 47.8%, respectively. Increased odds were observed among medium-risk (odds ratio, 14.3; 95% confidence interval, 1.8-112.6; P = 0.01) and high-risk groups (odds ratio, 53.3; 95% confidence interval, 6.8-416.8; P < 0.01). This trend continued at 1, 3, and 5 years. Factors associated with high-risk scores include gram-negative rod infections, heart disease, diabetes, cancer, lung disease, and increased length of stay. When applied to a diverse patient cohort, the RAPID score predicts outcomes in patients up to 5 years and may aid in long-term risk stratification on presentation.

Simple Scoring System and Artificial Neural Network for Knee Osteoarthritis Risk Prediction: A Cross-Sectional Study

PubMed Central

Yoo, Tae Keun; Kim, Deok Won; Choi, Soo Beom; Oh, Ein; Park, Jee Soo

2016-01-01

Background Knee osteoarthritis (OA) is the most common joint disease of adults worldwide. Since the treatments for advanced radiographic knee OA are limited, clinicians face a significant challenge of identifying patients who are at high risk of OA in a timely and appropriate way. Therefore, we developed a simple self-assessment scoring system and an improved artificial neural network (ANN) model for knee OA. Methods The Fifth Korea National Health and Nutrition Examination Surveys (KNHANES V-1) data were used to develop a scoring system and ANN for radiographic knee OA. A logistic regression analysis was used to determine the predictors of the scoring system. The ANN was constructed using 1777 participants and validated internally on 888 participants in the KNHANES V-1. The predictors of the scoring system were selected as the inputs of the ANN. External validation was performed using 4731 participants in the Osteoarthritis Initiative (OAI). Area under the curve (AUC) of the receiver operating characteristic was calculated to compare the prediction models. Results The scoring system and ANN were built using the independent predictors including sex, age, body mass index, educational status, hypertension, moderate physical activity, and knee pain. In the internal validation, both scoring system and ANN predicted radiographic knee OA (AUC 0.73 versus 0.81, p<0.001) and symptomatic knee OA (AUC 0.88 versus 0.94, p<0.001) with good discriminative ability. In the external validation, both scoring system and ANN showed lower discriminative ability in predicting radiographic knee OA (AUC 0.62 versus 0.67, p<0.001) and symptomatic knee OA (AUC 0.70 versus 0.76, p<0.001). Conclusions The self-assessment scoring system may be useful for identifying the adults at high risk for knee OA. The performance of the scoring system is improved significantly by the ANN. We provided an ANN calculator to simply predict the knee OA risk. PMID:26859664

Validation of scores of use of inhalation devices: valoration of errors *

PubMed Central

Zambelli-Simões, Letícia; Martins, Maria Cleusa; Possari, Juliana Carneiro da Cunha; Carvalho, Greice Borges; Coelho, Ana Carla Carvalho; Cipriano, Sonia Lucena; de Carvalho-Pinto, Regina Maria; Cukier, Alberto; Stelmach, Rafael

2015-01-01

Abstract Objective: To validate two scores quantifying the ability of patients to use metered dose inhalers (MDIs) or dry powder inhalers (DPIs); to identify the most common errors made during their use; and to identify the patients in need of an educational program for the use of these devices. Methods: This study was conducted in three phases: validation of the reliability of the inhaler technique scores; validation of the contents of the two scores using a convenience sample; and testing for criterion validation and discriminant validation of these instruments in patients who met the inclusion criteria. Results: The convenience sample comprised 16 patients. Interobserver disagreement was found in 19% and 25% of the DPI and MDI scores, respectively. After expert analysis on the subject, the scores were modified and were applied in 72 patients. The most relevant difficulty encountered during the use of both types of devices was the maintenance of total lung capacity after a deep inhalation. The degree of correlation of the scores by observer was 0.97 (p < 0.0001). There was good interobserver agreement in the classification of patients as able/not able to use a DPI (50%/50% and 52%/58%; p < 0.01) and an MDI (49%/51% and 54%/46%; p < 0.05). Conclusions: The validated scores allow the identification and correction of inhaler technique errors during consultations and, as a result, improvement in the management of inhalation devices. PMID:26398751

Use and Customization of Risk Scores for Predicting Cardiovascular Events Using Electronic Health Record Data.

PubMed

Wolfson, Julian; Vock, David M; Bandyopadhyay, Sunayan; Kottke, Thomas; Vazquez-Benitez, Gabriela; Johnson, Paul; Adomavicius, Gediminas; O'Connor, Patrick J

2017-04-24

Clinicians who are using the Framingham Risk Score (FRS) or the American College of Cardiology/American Heart Association Pooled Cohort Equations (PCE) to estimate risk for their patients based on electronic health data (EHD) face 4 questions. (1) Do published risk scores applied to EHD yield accurate estimates of cardiovascular risk? (2) Are FRS risk estimates, which are based on data that are up to 45 years old, valid for a contemporary patient population seeking routine care? (3) Do the PCE make the FRS obsolete? (4) Does refitting the risk score using EHD improve the accuracy of risk estimates? Data were extracted from the EHD of 84 116 adults aged 40 to 79 years who received care at a large healthcare delivery and insurance organization between 2001 and 2011. We assessed calibration and discrimination for 4 risk scores: published versions of FRS and PCE and versions obtained by refitting models using a subset of the available EHD. The published FRS was well calibrated (calibration statistic K=9.1, miscalibration ranging from 0% to 17% across risk groups), but the PCE displayed modest evidence of miscalibration (calibration statistic K=43.7, miscalibration from 9% to 31%). Discrimination was similar in both models (C-index=0.740 for FRS, 0.747 for PCE). Refitting the published models using EHD did not substantially improve calibration or discrimination. We conclude that published cardiovascular risk models can be successfully applied to EHD to estimate cardiovascular risk; the FRS remains valid and is not obsolete; and model refitting does not meaningfully improve the accuracy of risk estimates. © 2017 The Authors. Published on behalf of the American Heart Association, Inc., by Wiley.

[Validating the Spanish version of the Nursing Activities Score].

PubMed

Sánchez-Sánchez, M M; Arias-Rivera, S; Fraile-Gamo, M P; Thuissard-Vasallo, I J; Frutos-Vivar, F

2015-01-01

Validating workload scores ensures that they are appropriate for the purpose for which they were developed. To validate the Nursing Activities Score (NAS) Spanish version. Observational and prospective study. 1,045 patients who were admitted to a medical-surgical unit and a serious burns unit in 2006 were included. The nurse in charge assessed patient workloads by Nine Equivalent of Nursing Manpower use Score and NAS. To assess the internal consistency of the measurements of NAS, item-test correlations, Cronbach's α and Cronbach's α corrected by omitting each of the items were calculated. The intraobserver and interobserver reliability were assessed with the intraclass correlation coefficient by viewing recordings and Kappa (interobserver reliability) was estimated. For the analysis of internal validity, a factorial principal components analysis was performed. Convergent validity was assessed using the Spearman correlation coefficient values obtained from the Nine Equivalent of Nursing Manpower use Score and Spanish-NAS scales. For internal consistency, 164 questionnaires were analysed and a Cronbach's α of 0.373 was calculated. The intraclass correlation coefficient for intraobserver reliability estimate was 0.837 (95% IC: 0.466-0.950) and 0.662 (95% IC: 0.033-0.882) for interobserver reliability. The estimated kappa was 0.371. For internal validity, exploratory factor analysis showed that the first item explained 58.9% of the variance of the questionnaire. For convergent validity 1006 questionnaires were included and a Spearman correlation coefficient of 0.746 was observed. The psychometric properties of Spanish-NAS are acceptable. Copyright © 2014 Elsevier España, S.L.U. y SEEIUC. All rights reserved.

Validation of the bacterial meningitis score in adults presenting to the ED with meningitis.

PubMed

McArthur, Robert; Edlow, Jonathan A; Nigrovic, Lise E

2016-07-01

The Bacterial Meningitis Score classifies children with meningitis and none of the following high-risk predictors at very low risk for bacterial meningitis: positive cerebrospinal fluid (CSF) Gram stain, CSF protein ≥80mg/dL, CSF absolute neutrophil count (ANC) ≥1000 cells/mm(3), peripheral ANC ≥10,000 cells/mm(3), and seizure at or prior to presentation. Although extensively validated in children, the Bacterial Meningitis Score has not been rigorously evaluated in adults. We performed a single-center cross-sectional retrospective study of adults presenting to the emergency department between 2003 and 2013 with meningitis (defined by CSF white blood cell count ≥10 cells/mm(3)). We defined a case of bacterial meningitis with either a positive CSF or blood culture. We report the performance of the Bacterial Meningitis Score in the study population. We identified 441 eligible patients of which, 4 (1%) had bacterial meningitis. The Bacterial Meningitis Score had a sensitivity of 100% [95% confidence interval (CI) 40%-100%], specificity 51% (95% CI, 46%-56%) and negative predictive value of 100% (95% CI, 98%-100%). None of the low risk adults had bacterial meningitis. If Bacterial Meningitis Score had been applied prospectively, the hospital admission rate would have dropped from 84% to 49% without missing any patients with bacterial meningitis. The Bacterial Meningitis Score accurately identified patients at low risk for bacterial meningitis and could assist clinical decision-making for adults with meningitis. Copyright © 2016 Elsevier Inc. All rights reserved.

Are Scores From NBME Subject Examinations Valid Measures of Knowledge Acquired During Clinical Clerkships?

PubMed

Ryan, Michael S; Bishop, Steven; Browning, Joel; Anand, Rahul J; Waterhouse, Elizabeth; Rigby, Fidelma; Al-Mateen, Cheryl S; Lee, Clifton; Bradner, Melissa; Colbert-Getz, Jorie M

2017-06-01

The National Board of Medical Examiners' Clinical Science Subject Examinations are a component used by most U.S. medical schools to determine clerkship grades. The purpose of this study was to examine the validity of this practice. This was a retrospective cohort study of medical students at the Virginia Commonwealth University School of Medicine who completed clerkships in 2012 through 2014. Linear regression was used to determine how well United States Medical Licensing Examination Step 1 scores predicted Subject Examination scores in seven clerkships. The authors then substituted each student's Subject Examination standard scores with his or her Step 1 standard score. Clerkship grades based on the Step 1 substitution were compared with actual grades with the Wilcoxon rank test. A total of 2,777 Subject Examination scores from 432 students were included in the analysis. Step 1 scores significantly predicted between 23% and 44% of the variance in Subject Examination scores, P < .001 for all clerkship regression equations. Mean differences between expected and actual Subject Examination scores were small (≤ 0.2 points). There was a match between 73% of Step 1 substituted final clerkship grades and actual final clerkship grades. The results of this study suggest that performance on Step 1 can be used to identify and counsel students at risk for poor performance on the Subject Examinations. In addition, these findings call into the question the validity of using scores from Subject Examinations as a high-stakes assessment of learning in individual clerkships.

External validation of the modified Glasgow prognostic score for renal cancer

PubMed Central

Tai, Caroline G.; Johnson, Timothy V.; Abbasi, Ammara; Herrell, Lindsey; Harris, Wayne B.; Kucuk, Omer; Canter, Daniel J.; Ogan, Kenneth; Pattaras, John G.; Nieh, Peter T.; Master, Viraj A.

2014-01-01

Purpose: The modified Glasgow prognostic Score (mGPS) incorporates C-reactive protein and albumin as a clinically useful marker of tumor behavior. The ability of the mGPS to predict metastasis in localized renal cell carcinoma (RCC) remains unknown in an external validation cohort. Patients and Methods: Patients with clinically localized clear cell RCC were followed for 1 year post-operatively. Metastases were identified radiologically. Patients were categorized by mGPS score as low-risk (mGPS = 0 points), intermediate-risk (mGPS = 1 point) and high-risk (mGPS = 2 points). Univariate, Kaplan-Meier and multivariate Cox regression analyses examined Recurrence -free survival (RFS) across patient and disease characteristics. Results: Of the 129 patients in this study, 23.3% developed metastases. Of low, intermediate and high risk patients, 10.1%, 38.9% and 89.9% recurred during the study. After accounting for various patient and tumor characteristics in multivariate analysis including stage and grade, only mGPS was significantly associated with RFS. Compared with low-risk patients, intermediate- and high-risk patients experienced a 4-fold (hazard ratios [HR]: 4.035, 95% confidence interval [CI]: 1.312-12.415, P = 0.015) and 7-fold (HR: 7.012, 95% CI: 2.126-23.123 P < 0.001) risk of metastasis, respectively. Conclusions: mGPS is a robust predictor of metastasis following potentially curative nephrectomy for localized RCC. Clinicians may consider mGPS as an adjunct to identify high-risk patients for possible enrollment into clinical trials or for patient counseling PMID:24497679

Derivation and validation of a diagnostic score based on case-mix groups to predict 30-day death or urgent readmission.

PubMed

van Walraven, Carl; Wong, Jenna; Forster, Alan J

2012-01-01

Between 5% and 10% of patients die or are urgently readmitted within 30 days of discharge from hospital. Readmission risk indexes have either excluded acute diagnoses or modelled them as multiple distinct variables. In this study, we derived and validated a score summarizing the influence of acute hospital diagnoses and procedures on death or urgent readmission within 30 days. From population-based hospital abstracts in Ontario, we randomly sampled 200 000 discharges between April 2003 and March 2009 and determined who had been readmitted urgently or died within 30 days of discharge. We used generalized estimating equation modelling, with a sample of 100 000 patients, to measure the adjusted association of various case-mix groups (CMGs-homogenous groups of acute care inpatients with similar clinical and resource-utilization characteristics) with 30-day death or urgent readmission. This final model was transformed into a scoring system that was validated in the remaining 100 000 patients. Patients in the derivation set belonged to 1 of 506 CMGs and had a 6.8% risk of 30-day death or urgent readmission. Forty-seven CMG codes (more than half of which were directly related to chronic diseases) were independently associated with this outcome, which led to a CMG score that ranged from -6 to 7 points. The CMG score was significantly associated with 30-day death or urgent readmission (unadjusted odds ratio for a 1-point increase in CMG score 1.52, 95% confidence interval [CI] 1.49-1.56). Alone, the CMG score was only moderately discriminative (C statistic 0.650, 95% CI 0.644-0.656). However, when the CMG score was added to a validated risk index for death or readmission, the C statistic increased to 0.759 (95% CI 0.753-0.765). The CMG score was well calibrated for 30-day death or readmission. In this study, we developed a scoring system for acute hospital diagnoses and procedures that could be used as part of a risk-adjustment methodology for analyses of postdischarge

Development and validation of a risk assessment tool for gastric cancer in a general Japanese population.

PubMed

Iida, Masahiro; Ikeda, Fumie; Hata, Jun; Hirakawa, Yoichiro; Ohara, Tomoyuki; Mukai, Naoko; Yoshida, Daigo; Yonemoto, Koji; Esaki, Motohiro; Kitazono, Takanari; Kiyohara, Yutaka; Ninomiya, Toshiharu

2018-05-01

There have been very few reports of risk score models for the development of gastric cancer. The aim of this study was to develop and validate a risk assessment tool for discerning future gastric cancer risk in Japanese. A total of 2444 subjects aged 40 years or over were followed up for 14 years from 1988 (derivation cohort), and 3204 subjects of the same age group were followed up for 5 years from 2002 (validation cohort). The weighting (risk score) of each risk factor for predicting future gastric cancer in the risk assessment tool was determined based on the coefficients of a Cox proportional hazards model in the derivation cohort. The goodness of fit of the established risk assessment tool was assessed using the c-statistic and the Hosmer-Lemeshow test in the validation cohort. During the follow-up, gastric cancer developed in 90 subjects in the derivation cohort and 35 subjects in the validation cohort. In the derivation cohort, the risk prediction model for gastric cancer was established using significant risk factors: age, sex, the combination of Helicobacter pylori antibody and pepsinogen status, hemoglobin A1c level, and smoking status. The incidence of gastric cancer increased significantly as the sum of risk scores increased (P trend < 0.001). The risk assessment tool was validated internally and showed good discrimination (c-statistic = 0.76) and calibration (Hosmer-Lemeshow test P = 0.43) in the validation cohort. We developed a risk assessment tool for gastric cancer that provides a useful guide for stratifying an individual's risk of future gastric cancer.

CRISP: Catheterization RISk score for Pediatrics: A Report from the Congenital Cardiac Interventional Study Consortium (CCISC).

PubMed

Nykanen, David G; Forbes, Thomas J; Du, Wei; Divekar, Abhay A; Reeves, Jaxk H; Hagler, Donald J; Fagan, Thomas E; Pedra, Carlos A C; Fleming, Gregory A; Khan, Danyal M; Javois, Alexander J; Gruenstein, Daniel H; Qureshi, Shakeel A; Moore, Phillip M; Wax, David H

2016-02-01

We sought to develop a scoring system that predicts the risk of serious adverse events (SAE's) for individual pediatric patients undergoing cardiac catheterization procedures. Systematic assessment of risk of SAE in pediatric catheterization can be challenging in view of a wide variation in procedure and patient complexity as well as rapidly evolving technology. A 10 component scoring system was originally developed based on expert consensus and review of the existing literature. Data from an international multi-institutional catheterization registry (CCISC) between 2008 and 2013 were used to validate this scoring system. In addition we used multivariate methods to further refine the original risk score to improve its predictive power of SAE's. Univariate analysis confirmed the strong correlation of each of the 10 components of the original risk score with SAE attributed to a pediatric cardiac catheterization (P < 0.001 for all variables). Multivariate analysis resulted in a modified risk score (CRISP) that corresponds to an increase in value of area under a receiver operating characteristic curve (AUC) from 0.715 to 0.741. The CRISP score predicts risk of occurrence of an SAE for individual patients undergoing pediatric cardiac catheterization procedures. © 2015 Wiley Periodicals, Inc.

Test Takers and the Validity of Score Interpretations

ERIC Educational Resources Information Center

Kopriva, Rebecca J.; Thurlow, Martha L.; Perie, Marianne; Lazarus, Sheryl S.; Clark, Amy

2016-01-01

This article argues that test takers are as integral to determining validity of test scores as defining target content and conditioning inferences on test use. A principled sustained attention to how students interact with assessment opportunities is essential, as is a principled sustained evaluation of evidence confirming the validity or calling…

Ventilator Dependence Risk Score for the Prediction of Prolonged Mechanical Ventilation in Patients Who Survive Sepsis/Septic Shock with Respiratory Failure.

PubMed

Chang, Ya-Chun; Huang, Kuo-Tung; Chen, Yu-Mu; Wang, Chin-Chou; Wang, Yi-Hsi; Tseng, Chia-Cheng; Lin, Meng-Chih; Fang, Wen-Feng

2018-04-04

We intended to develop a scoring system to predict mechanical ventilator dependence in patients who survive sepsis/septic shock with respiratory failure. This study evaluated 251 adult patients in medical intensive care units (ICUs) between August 2013 to October 2015, who had survived for over 21 days and received aggressive treatment. The risk factors for ventilator dependence were determined. We then constructed a ventilator dependence (VD) risk score using the identified risk factors. The ventilator dependence risk score was calculated as the sum of the following four variables after being adjusted by proportion to the beta coefficient. We assigned a history of previous stroke, a score of one point, platelet count less than 150,000/μL a score of one point, pH value less than 7.35 a score of two points, and the fraction of inspired oxygen on admission day 7 over 39% as two points. The area under the curve in the derivation group was 0.725 (p < 0.001). We then applied the VD risk score for validation on 175 patients. The area under the curve in the validation group was 0.658 (p = 0.001). VD risk score could be applied to predict prolonged mechanical ventilation in patients who survive sepsis/septic shock.

Development and testing of a DVT risk assessment tool: providing evidence of validity and reliability.

PubMed

McCaffrey, Ruth; Bishop, Mary; Adonis-Rizzo, Marie; Williamson, Ellen; McPherson, Melanie; Cruikshank, Alice; Carrier, Vicki Jo; Sands, Simone; Pigano, Diane; Girard, Patricia; Lauzon, Cathy

2007-01-01

Hospital-acquired deep vein thrombosis (DVT) and pulmonary embolisms (PE) are preventable problems that can increase mortality. Early assessment and recognition of risk as well as initiating appropriate prevention measures can prevent DVT or PE. The purpose of this research project was to develop a DVT risk assessment tool and test the tool for validity and reliability. Three phases were undertaken in developing and testing the JFK Medical Center DVT risk assessment tool. Investigation and clarification of risk and predisposing factors for DVT were identified from the literature, expert nursing knowledge, and medical staff input. Second, item development and weighting were undertaken. Third, parametric testing for content validity measured the differences in mean assessment tool scores between a group of patients who developed DVT in the hospital and a demographically similar group who did not develop DVT. Interrater reliability was measured by having three different nurses score each patient and compare the differences in scores among the three. The DVT group had significantly higher scores on the JFK DVT assessment scale than did those who did not experience DVT. Interrater reliability showed a strong correlation among the scores of the three nurses (.98). Providing a valid and reliable tool for measuring the risk for DVT or PE in hospitalized patients will enable nurses to intervene early in patients at risk. Basing DVT risk assessment on the evidence provided in this study will assist nurses in becoming more confident in recognizing the necessity for interventions in hospitalized patients and decreasing risk. Nurses can now evaluate patients at risk for DVT or PE using the JFK Medial Center's risk assessment tool.

Risk score to predict hospital-acquired pneumonia after spontaneous intracerebral hemorrhage.

PubMed

Ji, Ruijun; Shen, Haipeng; Pan, Yuesong; Du, Wanliang; Wang, Penglian; Liu, Gaifen; Wang, Yilong; Li, Hao; Zhao, Xingquan; Wang, Yongjun

2014-09-01

We aimed to develop a risk score (intracerebral hemorrhage-associated pneumonia score, ICH-APS) for predicting hospital-acquired stroke-associated pneumonia (SAP) after ICH. The ICH-APS was developed based on the China National Stroke Registry (CNSR), in which eligible patients were randomly divided into derivation (60%) and validation (40%) cohorts. Variables routinely collected at presentation were used for predicting SAP after ICH. For testing the added value of hematoma volume measure, we separately developed 2 models with (ICH-APS-B) and without (ICH-APS-A) hematoma volume included. Multivariable logistic regression was performed to identify independent predictors. The area under the receiver operating characteristic curve (AUROC), Hosmer-Lemeshow goodness-of-fit test, and integrated discrimination index were used to assess model discrimination, calibration, and reclassification, respectively. The SAP was 16.4% and 17.7% in the overall derivation (n=2998) and validation (n=2000) cohorts, respectively. A 23-point ICH-APS-A was developed based on a set of predictors and showed good discrimination in the overall derivation (AUROC, 0.75; 95% confidence interval, 0.72-0.77) and validation (AUROC, 0.76; 95% confidence interval, 0.71-0.79) cohorts. The ICH-APS-A was more sensitive for patients with length of stay >48 hours (AUROC, 0.78; 95% confidence interval, 0.75-0.81) than those with length of stay <48 hours (AUROC, 0.64; 95% confidence interval, 0.55-0.73). The ICH-APS-A was well calibrated (Hosmer-Lemeshow test) in the derivation (P=0.20) and validation (P=0.66) cohorts. Similarly, a 26-point ICH-APS-B was established. The ICH-APS-A and ICH-APS-B were not significantly different in discrimination and reclassification for SAP after ICH. The ICH-APSs are valid risk scores for predicting SAP after ICH, especially for patients with length of stay >48 hours. © 2014 American Heart Association, Inc.

Does Test Preparation Work? Implications for Score Validity

ERIC Educational Resources Information Center

Xie, Qin

2013-01-01

This article reports an empirical study that examined the pattern of test preparation for College English Test Band 4 (CET4) and the differential effects of test preparation practices on its scores, thereby drawing implications for CET4 score validity. Data collection involved 1,003 test takers of CET4. A pretest was administered at the beginning…

Validating the TeleStroke Mimic Score: A Prediction Rule for Identifying Stroke Mimics Evaluated Over Telestroke Networks.

PubMed

Ali, Syed F; Hubert, Gordian J; Switzer, Jeffrey A; Majersik, Jennifer J; Backhaus, Roland; Shepard, L Wylie; Vedala, Kishore; Schwamm, Lee H

2018-03-01

Up to 30% of acute stroke evaluations are deemed stroke mimics, and these are common in telestroke as well. We recently published a risk prediction score for use during telestroke encounters to differentiate stroke mimics from ischemic cerebrovascular disease derived and validated in the Partners TeleStroke Network. Using data from 3 distinct US and European telestroke networks, we sought to externally validate the TeleStroke Mimic (TM) score in a broader population. We evaluated the TM score in 1930 telestroke consults from the University of Utah, Georgia Regents University, and the German TeleMedical Project for Integrative Stroke Care Network. We report the area under the curve in receiver-operating characteristic curve analysis with 95% confidence interval for our previously derived TM score in which lower TM scores correspond with a higher likelihood of being a stroke mimic. Based on final diagnosis at the end of the telestroke consultation, there were 630 of 1930 (32.6%) stroke mimics in the external validation cohort. All 6 variables included in the score were significantly different between patients with ischemic cerebrovascular disease versus stroke mimics. The TM score performed well (area under curve, 0.72; 95% confidence interval, 0.70-0.73; P <0.001), similar to our prior external validation in the Partners National Telestroke Network. The TM score's ability to predict the presence of a stroke mimic during telestroke consultation in these diverse cohorts was similar to its performance in our original cohort. Predictive decision-support tools like the TM score may help highlight key clinical differences between mimics and patients with stroke during complex, time-critical telestroke evaluations. © 2018 American Heart Association, Inc.

Risk analysis of analytical validations by probabilistic modification of FMEA.

PubMed

Barends, D M; Oldenhof, M T; Vredenbregt, M J; Nauta, M J

2012-05-01

Risk analysis is a valuable addition to validation of an analytical chemistry process, enabling not only detecting technical risks, but also risks related to human failures. Failure Mode and Effect Analysis (FMEA) can be applied, using a categorical risk scoring of the occurrence, detection and severity of failure modes, and calculating the Risk Priority Number (RPN) to select failure modes for correction. We propose a probabilistic modification of FMEA, replacing the categorical scoring of occurrence and detection by their estimated relative frequency and maintaining the categorical scoring of severity. In an example, the results of traditional FMEA of a Near Infrared (NIR) analytical procedure used for the screening of suspected counterfeited tablets are re-interpretated by this probabilistic modification of FMEA. Using this probabilistic modification of FMEA, the frequency of occurrence of undetected failure mode(s) can be estimated quantitatively, for each individual failure mode, for a set of failure modes, and the full analytical procedure. Copyright © 2012 Elsevier B.V. All rights reserved.

Development and Validation of a Scoring System to Predict Outcomes of Patients With Primary Biliary Cirrhosis Receiving Ursodeoxycholic Acid Therapy.

PubMed

Lammers, Willem J; Hirschfield, Gideon M; Corpechot, Christophe; Nevens, Frederik; Lindor, Keith D; Janssen, Harry L A; Floreani, Annarosa; Ponsioen, Cyriel Y; Mayo, Marlyn J; Invernizzi, Pietro; Battezzati, Pier M; Parés, Albert; Burroughs, Andrew K; Mason, Andrew L; Kowdley, Kris V; Kumagi, Teru; Harms, Maren H; Trivedi, Palak J; Poupon, Raoul; Cheung, Angela; Lleo, Ana; Caballeria, Llorenç; Hansen, Bettina E; van Buuren, Henk R

2015-12-01

Approaches to risk stratification for patients with primary biliary cirrhosis (PBC) are limited, single-center based, and often dichotomous. We aimed to develop and validate a better model for determining prognoses of patients with PBC. We performed an international, multicenter meta-analysis of 4119 patients with PBC treated with ursodeoxycholic acid at liver centers in 8 European and North American countries. Patients were randomly assigned to derivation (n = 2488 [60%]) and validation cohorts (n = 1631 [40%]). A risk score (GLOBE score) to predict transplantation-free survival was developed and validated with univariate and multivariable Cox regression analyses using clinical and biochemical variables obtained after 1 year of ursodeoxycholic acid therapy. Risk score outcomes were compared with the survival of age-, sex-, and calendar time-matched members of the general population. The prognostic ability of the GLOBE score was evaluated alongside those of the Barcelona, Paris-1, Rotterdam, Toronto, and Paris-2 criteria. Age (hazard ratio = 1.05; 95% confidence interval [CI]: 1.04-1.06; P < .0001); levels of bilirubin (hazard ratio = 2.56; 95% CI: 2.22-2.95; P < .0001), albumin (hazard ratio = 0.10; 95% CI: 0.05-0.24; P < .0001), and alkaline phosphatase (hazard ratio = 1.40; 95% CI: 1.18-1.67; P = .0002); and platelet count (hazard ratio/10 units decrease = 0.97; 95% CI: 0.96-0.99; P < .0001) were all independently associated with death or liver transplantation (C-statistic derivation, 0.81; 95% CI: 0.79-0.83, and validation cohort, 0.82; 95% CI: 0.79-0.84). Patients with risk scores >0.30 had significantly shorter times of transplant-free survival than matched healthy individuals (P < .0001). The GLOBE score identified patients who would survive for 5 years and 10 years (responders) with positive predictive values of 98% and 88%, respectively. Up to 22% and 21% of events and nonevents, respectively, 10 years after initiation of treatment were correctly

Development of a claims-based risk score to identify obese individuals.

PubMed

Clark, Jeanne M; Chang, Hsien-Yen; Bolen, Shari D; Shore, Andrew D; Goodwin, Suzanne M; Weiner, Jonathan P

2010-08-01

Obesity is underdiagnosed, hampering system-based health promotion and research. Our objective was to develop and validate a claims-based risk model to identify obese persons using medical diagnosis and prescription records. We conducted a cross-sectional analysis of de-identified claims data from enrollees of 3 Blue Cross Blue Shield plans who completed a health risk assessment capturing height and weight. The final sample of 71,057 enrollees was randomly split into 2 subsamples for development and validation of the obesity risk model. Using the Johns Hopkins Adjusted Clinical Groups case-mix/predictive risk methodology, we categorized study members' diagnosis (ICD) codes. Logistic regression was used to determine which claims-based risk markers were associated with a body mass index (BMI) > or = 35 kg/m(2). The sensitivities of the scores > or =90(th) percentile to detect obesity were 26% to 33%, while the specificities were >90%. The areas under the receiver operator curve ranged from 0.67 to 0.73. In contrast, a diagnosis of obesity or an obesity medication alone had very poor sensitivity (10% and 1%, respectively); the obesity risk model identified an additional 22% of obese members. Varying the percentile cut-point from the 70(th) to the 99(th) percentile resulted in positive predictive values ranging from 15.5 to 59.2. An obesity risk score was highly specific for detecting a BMI > or = 35 kg/m(2) and substantially increased the detection of obese members beyond a provider-coded obesity diagnosis or medication claim. This model could be used for obesity care management and health promotion or for obesity-related research.

Assessing Risk for Sexual Offenders in New Zealand: Development and Validation of a Computer-Scored Risk Measure

ERIC Educational Resources Information Center

Skelton, Alexander; Riley, David; Wales, David; Vess, James

2006-01-01

A growing research base supports the predictive validity of actuarial methods of risk assessment with sexual offenders. These methods use clearly defined variables with demonstrated empirical association with re-offending. The advantages of actuarial measures for screening large numbers of offenders quickly and economically are further enhanced…

[German validation of the Acute Cystitis Symptom Score].

PubMed

Alidjanov, J F; Pilatz, A; Abdufattaev, U A; Wiltink, J; Weidner, W; Naber, K G; Wagenlehner, F

2015-09-01

The Uzbek version of the Acute Cystitis Symptom Score (ACSS) was developed as a simple self-reporting questionnaire to improve diagnosis and therapy of women with acute cystitis (AC). The purpose of this work was to validate the ACSS in the German language. The ACSS consists of 18 questions in four subscales: (1) typical symptoms, (2) differential diagnosis, (3) quality of life, and (4) additional circumstances. Translation of the ACSS into German was performed according to international guidelines. For the validation process 36 German-speaking women (age: 18-90 years), with and without symptoms of AC, were included in the study. Classification of participants into two groups (patients or controls) was based on the presence or absence of typical symptoms and significant bacteriuria (≥ 10(3) CFU/ml). Statistical evaluations of reliability, validity, and predictive ability were performed. ROC curve analysis was performed to assess sensitivity and specificity of ACSS and its subscales. The Mann-Whitney's U test and t-test were used to compare the scores of the groups. Of the 36 German-speaking women (age: 40 ± 19 years), 19 were diagnosed with AC (patient group), while 17 women served as controls. Cronbach's α for the German ACSS total scale was 0.87. A threshold score of ≥ 6 points in category 1 (typical symptoms) significantly predicted AC (sensitivity 94.7%, specificity 82.4%). There were no significant differences in ACSS scores in patients and controls compared to the original Uzbek version of the ACSS. The German version of the ACSS showed a high reliability and validity. Therefore, the German version of the ACSS can be reliably used in clinical practice and research for diagnosis and therapeutic monitoring of patients suffering from AC.

Limitations of the Parsonnet score for measuring risk stratified mortality in the north west of England

PubMed Central

Wynne-Jones, K; Jackson, M; Grotte, G; Bridgewater, B; North, W

2000-01-01

OBJECTIVE—To study the use of the Parsonnet score to predict mortality following adult cardiac surgery.
DESIGN—Prospective study.
SETTING—All centres performing adult cardiac surgery in the north west of England.
SUBJECTS—8210 patients undergoing surgery between April 1997 and March 1999.
MAIN OUTCOME MEASURES—Risk factors and in-hospital mortality were recorded according to agreed definitions. Ten per cent of cases from each centre were selected at random for validation. A Parsonnet score was derived for each patient and its predictive ability was studied.
RESULTS—Data collection was complete. The operative mortality was 3.5% (95% confidence interval 3.1% to 3.9%), ranging from 2.7% to 3.8% across the centres. On validation, the incidence of discrepancies ranged from 0% to 13% for the different risk factors. The predictive ability of the Parsonnet score measured by area under the receiver operating characteristic curve was 0.74. The mean Parsonnet score for the region was 7.0, giving an observed to expected mortality ratio of 0.51 (range 0.4 to 0.64 across the centres). A new predictive model was derived from the data by multivariate analysis which includes nine objective risk factors, all with a significant association with mortality, which highlights some of the deficits of the Parsonnet score.
CONCLUSIONS—Risk stratified mortality data were collected on 100% of patients undergoing adult cardiac surgery in two years within a defined geographical region and were used to set an audit standard. Problems with the Parsonnet score of subjectivity, inclusion of many items not associated with mortality, and the overprediction of mortality have been highlighted.


Keywords: risk stratification; cardiac surgery; Parsonnet score; audit PMID:10862595

Pediatric Heart Donor Assessment Tool (PH-DAT): A novel donor risk scoring system to predict 1-year mortality in pediatric heart transplantation.

PubMed

Zafar, Farhan; Jaquiss, Robert D; Almond, Christopher S; Lorts, Angela; Chin, Clifford; Rizwan, Raheel; Bryant, Roosevelt; Tweddell, James S; Morales, David L S

2018-03-01

In this study we sought to quantify hazards associated with various donor factors into a cumulative risk scoring system (the Pediatric Heart Donor Assessment Tool, or PH-DAT) to predict 1-year mortality after pediatric heart transplantation (PHT). PHT data with complete donor information (5,732) were randomly divided into a derivation cohort and a validation cohort (3:1). From the derivation cohort, donor-specific variables associated with 1-year mortality (exploratory p-value < 0.2) were incorporated into a multivariate logistic regression model. Scores were assigned to independent predictors (p < 0.05) based on relative odds ratios (ORs). The final model had an acceptable predictive value (c-statistic = 0.62). The significant 5 variables (ischemic time, stroke as the cause of death, donor-to-recipient height ratio, donor left ventricular ejection fraction, glomerular filtration rate) were used for the scoring system. The validation cohort demonstrated a strong correlation between the observed and expected rates of 1-year mortality (r = 0.87). The risk of 1-year mortality increases by 11% (OR 1.11 [1.08 to 1.14]; p < 0.001) in the derivation cohort and 9% (OR 1.09 [1.04 to 1.14]; p = 0.001) in the validation cohort with an increase of 1-point in score. Mortality risk increased 5 times from the lowest to the highest donor score in this cohort. Based on this model, a donor score range of 10 to 28 predicted 1-year recipient mortality of 11% to 31%. This novel pediatric-specific, donor risk scoring system appears capable of predicting post-transplant mortality. Although the PH-DAT may benefit organ allocation and assessment of recipient risk while controlling for donor risk, prospective validation of this model is warranted. Copyright © 2018 International Society for the Heart and Lung Transplantation. Published by Elsevier Inc. All rights reserved.

Validity and reliability of Nintendo Wii Fit balance scores.

PubMed

Wikstrom, Erik A

2012-01-01

Interactive gaming systems have the potential to help rehabilitate patients with musculoskeletal conditions. The Nintendo Wii Balance Board, which is part of the Wii Fit game, could be an effective tool to monitor progress during rehabilitation because the board and game can provide objective measures of balance. However, the validity and reliability of Wii Fit balance scores remain unknown. To determine the concurrent validity of balance scores produced by the Wii Fit game and the intrasession and intersession reliability of Wii Fit balance scores. Descriptive laboratory study. Sports medicine research laboratory. Forty-five recreationally active participants (age = 27.0 ± 9.8 years, height = 170.9 ± 9.2 cm, mass = 72.4 ± 11.8 kg) with a heterogeneous history of lower extremity injury. Participants completed a single-limb-stance task on a force plate and the Star Excursion Balance Test (SEBT) during the first test session. Twelve Wii Fit balance activities were completed during 2 test sessions separated by 1 week. Postural sway in the anteroposterior (AP) and mediolateral (ML) directions and the AP, ML, and resultant center-of-pressure (COP) excursions were calculated from the single-limb stance. The normalized reach distance was recorded for the anterior, posteromedial, and posterolateral directions of the SEBT. Wii Fit balance scores that the game software generated also were recorded. All 96 of the calculated correlation coefficients among Wii Fit activity outcomes and established balance outcomes were interpreted as poor (r < 0.50). Intrasession reliability for Wii Fit balance activity scores ranged from good (intraclass correlation coefficient [ICC] = 0.80) to poor (ICC = 0.39), with 8 activities having poor intrasession reliability. Similarly, 11 of the 12 Wii Fit balance activity scores demonstrated poor intersession reliability, with scores ranging from fair (ICC = 0.74) to poor (ICC = 0.29). Wii Fit balance activity scores had poor concurrent validity

Perioperative Respiratory Adverse Events in Pediatric Ambulatory Anesthesia: Development and Validation of a Risk Prediction Tool.

PubMed

Subramanyam, Rajeev; Yeramaneni, Samrat; Hossain, Mohamed Monir; Anneken, Amy M; Varughese, Anna M

2016-05-01

Perioperative respiratory adverse events (PRAEs) are the most common cause of serious adverse events in children receiving anesthesia. Our primary aim of this study was to develop and validate a risk prediction tool for the occurrence of PRAE from the onset of anesthesia induction until discharge from the postanesthesia care unit in children younger than 18 years undergoing elective ambulatory anesthesia for surgery and radiology. The incidence of PRAE was studied. We analyzed data from 19,059 patients from our department's quality improvement database. The predictor variables were age, sex, ASA physical status, morbid obesity, preexisting pulmonary disorder, preexisting neurologic disorder, and location of ambulatory anesthesia (surgery or radiology). Composite PRAE was defined as the presence of any 1 of the following events: intraoperative bronchospasm, intraoperative laryngospasm, postoperative apnea, postoperative laryngospasm, postoperative bronchospasm, or postoperative prolonged oxygen requirement. Development and validation of the risk prediction tool for PRAE were performed using a split sampling technique to split the database into 2 independent cohorts based on the year when the patient received ambulatory anesthesia for surgery and radiology using logistic regression. A risk score was developed based on the regression coefficients from the validation tool. The performance of the risk prediction tool was assessed by using tests of discrimination and calibration. The overall incidence of composite PRAE was 2.8%. The derivation cohort included 8904 patients, and the validation cohort included 10,155 patients. The risk of PRAE was 3.9% in the development cohort and 1.8% in the validation cohort. Age ≤ 3 years (versus >3 years), ASA physical status II or III (versus ASA physical status I), morbid obesity, preexisting pulmonary disorder, and surgery (versus radiology) significantly predicted the occurrence of PRAE in a multivariable logistic regression

Development of Risk Score for Predicting 3-Year Incidence of Type 2 Diabetes: Japan Epidemiology Collaboration on Occupational Health Study

PubMed Central

Nanri, Akiko; Nakagawa, Tohru; Kuwahara, Keisuke; Yamamoto, Shuichiro; Honda, Toru; Okazaki, Hiroko; Uehara, Akihiko; Yamamoto, Makoto; Miyamoto, Toshiaki; Kochi, Takeshi; Eguchi, Masafumi; Murakami, Taizo; Shimizu, Chii; Shimizu, Makiko; Tomita, Kentaro; Nagahama, Satsue; Imai, Teppei; Nishihara, Akiko; Sasaki, Naoko; Hori, Ai; Sakamoto, Nobuaki; Nishiura, Chihiro; Totsuzaki, Takafumi; Kato, Noritada; Fukasawa, Kenji; Huanhuan, Hu; Akter, Shamima; Kurotani, Kayo; Kabe, Isamu; Mizoue, Tetsuya; Sone, Tomofumi; Dohi, Seitaro

2015-01-01

Objective Risk models and scores have been developed to predict incidence of type 2 diabetes in Western populations, but their performance may differ when applied to non-Western populations. We developed and validated a risk score for predicting 3-year incidence of type 2 diabetes in a Japanese population. Methods Participants were 37,416 men and women, aged 30 or older, who received periodic health checkup in 2008–2009 in eight companies. Diabetes was defined as fasting plasma glucose (FPG) ≥126 mg/dl, random plasma glucose ≥200 mg/dl, glycated hemoglobin (HbA1c) ≥6.5%, or receiving medical treatment for diabetes. Risk scores on non-invasive and invasive models including FPG and HbA1c were developed using logistic regression in a derivation cohort and validated in the remaining cohort. Results The area under the curve (AUC) for the non-invasive model including age, sex, body mass index, waist circumference, hypertension, and smoking status was 0.717 (95% CI, 0.703–0.731). In the invasive model in which both FPG and HbA1c were added to the non-invasive model, AUC was increased to 0.893 (95% CI, 0.883–0.902). When the risk scores were applied to the validation cohort, AUCs (95% CI) for the non-invasive and invasive model were 0.734 (0.715–0.753) and 0.882 (0.868–0.895), respectively. Participants with a non-invasive score of ≥15 and invasive score of ≥19 were projected to have >20% and >50% risk, respectively, of developing type 2 diabetes within 3 years. Conclusions The simple risk score of the non-invasive model might be useful for predicting incident type 2 diabetes, and its predictive performance may be markedly improved by incorporating FPG and HbA1c. PMID:26558900

Development of Risk Score for Predicting 3-Year Incidence of Type 2 Diabetes: Japan Epidemiology Collaboration on Occupational Health Study.

PubMed

Nanri, Akiko; Nakagawa, Tohru; Kuwahara, Keisuke; Yamamoto, Shuichiro; Honda, Toru; Okazaki, Hiroko; Uehara, Akihiko; Yamamoto, Makoto; Miyamoto, Toshiaki; Kochi, Takeshi; Eguchi, Masafumi; Murakami, Taizo; Shimizu, Chii; Shimizu, Makiko; Tomita, Kentaro; Nagahama, Satsue; Imai, Teppei; Nishihara, Akiko; Sasaki, Naoko; Hori, Ai; Sakamoto, Nobuaki; Nishiura, Chihiro; Totsuzaki, Takafumi; Kato, Noritada; Fukasawa, Kenji; Huanhuan, Hu; Akter, Shamima; Kurotani, Kayo; Kabe, Isamu; Mizoue, Tetsuya; Sone, Tomofumi; Dohi, Seitaro

2015-01-01

Risk models and scores have been developed to predict incidence of type 2 diabetes in Western populations, but their performance may differ when applied to non-Western populations. We developed and validated a risk score for predicting 3-year incidence of type 2 diabetes in a Japanese population. Participants were 37,416 men and women, aged 30 or older, who received periodic health checkup in 2008-2009 in eight companies. Diabetes was defined as fasting plasma glucose (FPG) ≥ 126 mg/dl, random plasma glucose ≥ 200 mg/dl, glycated hemoglobin (HbA1c) ≥ 6.5%, or receiving medical treatment for diabetes. Risk scores on non-invasive and invasive models including FPG and HbA1c were developed using logistic regression in a derivation cohort and validated in the remaining cohort. The area under the curve (AUC) for the non-invasive model including age, sex, body mass index, waist circumference, hypertension, and smoking status was 0.717 (95% CI, 0.703-0.731). In the invasive model in which both FPG and HbA1c were added to the non-invasive model, AUC was increased to 0.893 (95% CI, 0.883-0.902). When the risk scores were applied to the validation cohort, AUCs (95% CI) for the non-invasive and invasive model were 0.734 (0.715-0.753) and 0.882 (0.868-0.895), respectively. Participants with a non-invasive score of ≥ 15 and invasive score of ≥ 19 were projected to have >20% and >50% risk, respectively, of developing type 2 diabetes within 3 years. The simple risk score of the non-invasive model might be useful for predicting incident type 2 diabetes, and its predictive performance may be markedly improved by incorporating FPG and HbA1c.

Simple new risk score model for adult cardiac extracorporeal membrane oxygenation: simple cardiac ECMO score.

PubMed

Peigh, Graham; Cavarocchi, Nicholas; Keith, Scott W; Hirose, Hitoshi

2015-10-01

Although the use of cardiac extracorporeal membrane oxygenation (ECMO) is increasing in adult patients, the field lacks understanding of associated risk factors. While standard intensive care unit risk scores such as SAPS II (simplified acute physiology score II), SOFA (sequential organ failure assessment), and APACHE II (acute physiology and chronic health evaluation II), or disease-specific scores such as MELD (model for end-stage liver disease) and RIFLE (kidney risk, injury, failure, loss of function, ESRD) exist, they may not apply to adult cardiac ECMO patients as their risk factors differ from variables used in these scores. Between 2010 and 2014, 73 ECMOs were performed for cardiac support at our institution. Patient demographics and survival were retrospectively analyzed. A new easily calculated score for predicting ECMO mortality was created using identified risk factors from univariate and multivariate analyses, and model discrimination was compared with other scoring systems. Cardiac ECMO was performed on 73 patients (47 males and 26 females) with a mean age of 48 ± 14 y. Sixty-four percent of patients (47/73) survived ECMO support. Pre-ECMO SAPS II, SOFA, APACHE II, MELD, RIFLE, PRESERVE, and ECMOnet scores, were not correlated with survival. Univariate analysis of pre-ECMO risk factors demonstrated that increased lactate, renal dysfunction, and postcardiotomy cardiogenic shock were risk factors for death. Applying these data into a new simplified cardiac ECMO score (minimal risk = 0, maximal = 5) predicted patient survival. Survivors had a lower risk score (1.8 ± 1.2) versus the nonsurvivors (3.0 ± 0.99), P < 0.0001. Common intensive care unit or disease-specific risk scores calculated for cardiac ECMO patients did not correlate with ECMO survival, whereas a new simplified cardiac ECMO score provides survival predictability. Copyright © 2015 Elsevier Inc. All rights reserved.

Predicting Readmission at Early Hospitalization Using Electronic Clinical Data: An Early Readmission Risk Score.

PubMed

Tabak, Ying P; Sun, Xiaowu; Nunez, Carlos M; Gupta, Vikas; Johannes, Richard S

2017-03-01

Identifying patients at high risk for readmission early during hospitalization may aid efforts in reducing readmissions. We sought to develop an early readmission risk predictive model using automated clinical data available at hospital admission. We developed an early readmission risk model using a derivation cohort and validated the model with a validation cohort. We used a published Acute Laboratory Risk of Mortality Score as an aggregated measure of clinical severity at admission and the number of hospital discharges in the previous 90 days as a measure of disease progression. We then evaluated the administrative data-enhanced model by adding principal and secondary diagnoses and other variables. We examined the c-statistic change when additional variables were added to the model. There were 1,195,640 adult discharges from 70 hospitals with 39.8% male and the median age of 63 years (first and third quartile: 43, 78). The 30-day readmission rate was 11.9% (n=142,211). The early readmission model yielded a graded relationship of readmission and the Acute Laboratory Risk of Mortality Score and the number of previous discharges within 90 days. The model c-statistic was 0.697 with good calibration. When administrative variables were added to the model, the c-statistic increased to 0.722. Automated clinical data can generate a readmission risk score early at hospitalization with fair discrimination. It may have applied value to aid early care transition. Adding administrative data increases predictive accuracy. The administrative data-enhanced model may be used for hospital comparison and outcome research.

Associations of CAIDE Dementia Risk Score with MRI, PIB-PET measures, and cognition

PubMed Central

Stephen, Ruth; Liu, Yawu; Ngandu, Tiia; Rinne, Juha O.; Kemppainen, Nina; Parkkola, Riitta; Laatikainen, Tiina; Paajanen, Teemu; Hänninen, Tuomo; Strandberg, Timo; Antikainen, Riitta; Tuomilehto, Jaakko; Keinänen Kiukaanniemi, Sirkka; Vanninen, Ritva; Helisalmi, Seppo; Levälahti, Esko; Kivipelto, Miia; Soininen, Hilkka; Solomon, Alina

2017-01-01

Background: CAIDE Dementia Risk Score is the first validated tool for estimating dementia risk based on a midlife risk profile. Objectives: This observational study investigated longitudinal associations of CAIDE Dementia Risk Score with brain MRI, amyloid burden evaluated with PIB-PET, and detailed cognition measures. Methods: FINGER participants were at-risk elderly without dementia. CAIDE Risk Score was calculated using data from previous national surveys (mean age 52.4 years). In connection to baseline FINGER visit (on average 17.6 years later, mean age 70.1 years), 132 participants underwent MRI scans, and 48 underwent PIB-PET scans. All 1,260 participants were cognitively assessed (Neuropsychological Test Battery, NTB). Neuroimaging assessments included brain cortical thickness and volumes (Freesurfer 5.0.3), visually rated medial temporal atrophy (MTA), white matter lesions (WML), and amyloid accumulation. Results: Higher CAIDE Dementia Risk Score was related to more pronounced deep WML (OR 1.22, 95% CI 1.05–1.43), lower total gray matter (β-coefficient –0.29, p = 0.001) and hippocampal volume (β-coefficient –0.28, p = 0.003), lower cortical thickness (β-coefficient –0.19, p = 0.042), and poorer cognition (β-coefficients –0.31 for total NTB score, –0.25 for executive functioning, –0.33 for processing speed, and –0.20 for memory, all p < 0.001). Higher CAIDE Dementia Risk Score including APOE genotype was additionally related to more pronounced MTA (OR 1.15, 95% CI 1.00–1.30). No associations were found with periventricular WML or amyloid accumulation. Conclusions: The CAIDE Dementia Risk Score was related to indicators of cerebrovascular changes and neurodegeneration on MRI, and cognition. The lack of association with brain amyloid accumulation needs to be verified in studies with larger sample sizes. PMID:28671114

Associations of CAIDE Dementia Risk Score with MRI, PIB-PET measures, and cognition.

PubMed

Stephen, Ruth; Liu, Yawu; Ngandu, Tiia; Rinne, Juha O; Kemppainen, Nina; Parkkola, Riitta; Laatikainen, Tiina; Paajanen, Teemu; Hänninen, Tuomo; Strandberg, Timo; Antikainen, Riitta; Tuomilehto, Jaakko; Keinänen Kiukaanniemi, Sirkka; Vanninen, Ritva; Helisalmi, Seppo; Levälahti, Esko; Kivipelto, Miia; Soininen, Hilkka; Solomon, Alina

2017-01-01

CAIDE Dementia Risk Score is the first validated tool for estimating dementia risk based on a midlife risk profile. This observational study investigated longitudinal associations of CAIDE Dementia Risk Score with brain MRI, amyloid burden evaluated with PIB-PET, and detailed cognition measures. FINGER participants were at-risk elderly without dementia. CAIDE Risk Score was calculated using data from previous national surveys (mean age 52.4 years). In connection to baseline FINGER visit (on average 17.6 years later, mean age 70.1 years), 132 participants underwent MRI scans, and 48 underwent PIB-PET scans. All 1,260 participants were cognitively assessed (Neuropsychological Test Battery, NTB). Neuroimaging assessments included brain cortical thickness and volumes (Freesurfer 5.0.3), visually rated medial temporal atrophy (MTA), white matter lesions (WML), and amyloid accumulation. Higher CAIDE Dementia Risk Score was related to more pronounced deep WML (OR 1.22, 95% CI 1.05-1.43), lower total gray matter (β-coefficient -0.29, p = 0.001) and hippocampal volume (β-coefficient -0.28, p = 0.003), lower cortical thickness (β-coefficient -0.19, p = 0.042), and poorer cognition (β-coefficients -0.31 for total NTB score, -0.25 for executive functioning, -0.33 for processing speed, and -0.20 for memory, all p < 0.001). Higher CAIDE Dementia Risk Score including APOE genotype was additionally related to more pronounced MTA (OR 1.15, 95% CI 1.00-1.30). No associations were found with periventricular WML or amyloid accumulation. The CAIDE Dementia Risk Score was related to indicators of cerebrovascular changes and neurodegeneration on MRI, and cognition. The lack of association with brain amyloid accumulation needs to be verified in studies with larger sample sizes.

Translation and validation of the new version of the Knee Society Score - The 2011 KS Score - into Brazilian Portuguese.

PubMed

Silva, Adriana Lucia Pastore E; Croci, Alberto Tesconi; Gobbi, Riccardo Gomes; Hinckel, Betina Bremer; Pecora, José Ricardo; Demange, Marco Kawamura

2017-01-01

Translation, cultural adaptation, and validation of the new version of the Knee Society Score - The 2011 KS Score - into Brazilian Portuguese and verification of its measurement properties, reproducibility, and validity. In 2012, the new version of the Knee Society Score was developed and validated. This scale comprises four separate subscales: (a) objective knee score (seven items: 100 points); (b) patient satisfaction score (five items: 40 points); (c) patient expectations score (three items: 15 points); and (d) functional activity score (19 items: 100 points). A total of 90 patients aged 55-85 years were evaluated in a clinical cross-sectional study. The pre-operative translated version was applied to patients with TKA referral, and the post-operative translated version was applied to patients who underwent TKA. Each patient answered the same questionnaire twice and was evaluated by two experts in orthopedic knee surgery. Evaluations were performed pre-operatively and three, six, or 12 months post-operatively. The reliability of the questionnaire was evaluated using the intraclass correlation coefficient (ICC) between the two applications. Internal consistency was evaluated using Cronbach's alpha. The ICC found no difference between the means of the pre-operative, three-month, and six-month post-operative evaluations between sub-scale items. The Brazilian Portuguese version of The 2011 KS Score is a valid and reliable instrument for objective and subjective evaluation of the functionality of Brazilian patients who undergo TKA and revision TKA.

Predictive validity of clinical AUDIT-C alcohol screening scores and changes in scores for three objective alcohol-related outcomes in a Veterans Affairs population.

PubMed

Bradley, Katharine A; Rubinsky, Anna D; Lapham, Gwen T; Berger, Douglas; Bryson, Christopher; Achtmeyer, Carol; Hawkins, Eric J; Chavez, Laura J; Williams, Emily C; Kivlahan, Daniel R

2016-11-01

To evaluate the association between Alcohol Use Disorder Identification Test-Consumption (AUDIT-C) alcohol screening scores, collected as part of routine clinical care, and three outcomes in the following year (Aim 1), and the association between changes in AUDIT-C risk group at 1-year follow-up and the same outcomes in the subsequent year (Aim 2). Cohort study. Twenty-four US Veterans Affairs (VA) healthcare systems (2004-07), before systematic implementation of brief intervention. A total of 486 115 out-patients with AUDIT-Cs documented in their electronic health records (EHRs) on two occasions ≥ 12 months apart ('baseline' and 'follow-up'). Independent measures were baseline AUDIT-C scores and change in standard AUDIT-C risk groups (no use, low-risk use and mild, moderate, severe misuse) from baseline to follow-up. Outcome measures were (1) high-density lipoprotein cholesterol (HDL), (2) alcohol-related gastrointestinal hospitalizations ('GI hospitalizations') and (3) physical trauma, each in the years after baseline and follow-up. Baseline AUDIT-C scores had a positive association with outcomes in the following year. Across AUDIT-C scores 0-12, mean HDL ranged from 41.4 [95% confidence interval (CI) = 41.3-41.5] to 53.5 (95% CI = 51.4-55.6) mg/l, and probabilities of GI hospitalizations from 0.49% (95% CI = 0.48-0.51%) to 1.8% (95% CI = 1.3-2.3%) and trauma from 3.0% (95% CI = 2.95-3.06%) to 6.0% (95% CI = 5.2-6.8%). At follow-up, patients who increased to moderate or severe alcohol misuse had consistently higher mean HDL and probabilities of subsequent GI hospitalizations or trauma compared with those who did not (P-values all < 0.05). For example, among those with baseline low-risk use, in those with persistent low-risk use versus severe misuse at follow-up, the probabilities of subsequent trauma were 2.65% (95% CI = 2.54-2.75%) versus 5.15% (95% CI = 3.86-6.45%), respectively. However, for patients who decreased to lower AUDIT-C risk

Validation of the Canada Acute Coronary Syndrome Risk Score for Hospital Mortality in the Gulf Registry of Acute Coronary Events-2.

PubMed

AlFaleh, Hussam F; Alsheikh-Ali, Alawi A; Ullah, Anhar; AlHabib, Khalid F; Hersi, Ahmad; Suwaidi, Jassim Al; Sulaiman, Kadhim; Saif, Shukri Al; Almahmeed, Wael; Asaad, Nidal; Amin, Haitham; Al-Motarreb, Ahmed; Kashour, Tarek

2015-09-01

Several risk scores have been developed for acute coronary syndrome (ACS) patients, but their use is limited by their complexity. The new Canada Acute Coronary Syndrome (C-ACS) risk score is a simple risk-assessment tool for ACS patients. This study assessed the performance of the C-ACS risk score in predicting hospital mortality in a contemporary Middle Eastern ACS cohort. The C-ACS score accurately predicts hospital mortality in ACS patients. The baseline risk of 7929 patients from 6 Arab countries who were enrolled in the Gulf RACE-2 registry was assessed using the C-ACS risk score. The score ranged from 0 to 4, with 1 point assigned for the presence of each of the following variables: age ≥75 years, Killip class >1, systolic blood pressure <100 mm Hg, and heart rate >100 bpm. The discriminative ability and calibration of the score were assessed using C statistics and goodness-of-fit tests, respectively. The C-ACS score demonstrated good predictive values for hospital mortality in all ACS patients with a C statistic of 0.77 (95% confidence interval [CI]: 0.74-0.80) and in ST-segment elevation myocardial infarction and non-ST-segment elevation acute coronary syndrome patients (C statistic: 0.76, 95% CI: 0.73-0.79; and C statistic: 0.80, 95% CI: 0.75-0.84, respectively). The discriminative ability of the score was moderate regardless of age category, nationality, and diabetic status. Overall, calibration was optimal in all subgroups. The new C-ACS score performed well in predicting hospital mortality in a contemporary ACS population outside North America. © 2015 Wiley Periodicals, Inc.

Validation of the Risk Prediction Models STATE-Score and START-Strategy to Guide TACE Treatment in Patients with Hepatocellular Carcinoma.

PubMed

Mähringer-Kunz, Aline; Kloeckner, Roman; Pitton, Michael B; Düber, Christoph; Schmidtmann, Irene; Galle, Peter R; Koch, Sandra; Weinmann, Arndt

2017-07-01

Several scoring systems that guide patients' treatment regimen for transarterial chemoembolization (TACE) of hepatocellular carcinoma (HCC) have been introduced, but none have gained widespread acceptance in clinical practice. The purpose of this study is to externally validate the Selection for TrAnsarterial chemoembolization TrEatment (STATE)-score and START-strategy [i.e., sequential use of the STATE-score and Assessment for Retreatment with TACE (ART)-score]. From January 2000 to September 2015, 933 patients with HCC underwent TACE at our institution. All variables needed to calculate the STATE-score and implement the START-strategy were determined. STATE comprised serum albumin, up-to-seven criteria, and C-reactive protein (CRP). ART comprised an increase in aspartate aminotransferase, the Child-Pugh score, and a radiological tumor response. Overall survival was calculated, and multivariate analysis performed. In addition, the STATE-score and START-strategy were validated using the Harrell's C-index and integrated Brier score (IBS). The STATE-score was calculated in 228 patients. Low and high STATE-scores corresponded to median survival of 14.3 and 20.2 months, respectively. Harrell's C was 0.558 and IBS 0.133. For the STATE-score, significant predictors of survival were up-to-seven criteria (p = 0.006) and albumin (p = 0.022). CRP values were not predictive (p = 0.367). The ART-score was calculated in 207 patients. Combining the STATE-score and ART-score led to a Harrell's C of 0.580 and IBS of 0.132. The STATE-score was unable to reliably determine the suitability for initial TACE. The START-strategy only slightly improved the predictive ability compared to the ART-score alone. Therefore, neither the STATE-score nor START-strategy alone provides sufficient certainty for clear-cut clinical decisions.

A simplified clinical risk score predicts the need for early endoscopy in non-variceal upper gastrointestinal bleeding.

PubMed

Tammaro, Leonardo; Buda, Andrea; Di Paolo, Maria Carla; Zullo, Angelo; Hassan, Cesare; Riccio, Elisabetta; Vassallo, Roberto; Caserta, Luigi; Anderloni, Andrea; Natali, Alessandro

2014-09-01

Pre-endoscopic triage of patients who require an early upper endoscopy can improve management of patients with non-variceal upper gastrointestinal bleeding. To validate a new simplified clinical score (T-score) to assess the need of an early upper endoscopy in non variceal bleeding patients. Secondary outcomes were re-bleeding rate, 30-day bleeding-related mortality. In this prospective, multicentre study patients with bleeding who underwent upper endoscopy were enrolled. The accuracy for high risk endoscopic stigmata of the T-score was compared with that of the Glasgow Blatchford risk score. Overall, 602 patients underwent early upper endoscopy, and 472 presented with non-variceal bleeding. High risk endoscopic stigmata were detected in 145 (30.7%) cases. T-score sensitivity and specificity for high risk endoscopic stigmata and bleeding-related mortality was 96% and 30%, and 80% and 71%, respectively. No statistically difference in predicting high risk endoscopic stigmata between T-score and Glasgow Blatchford risk score was observed (ROC curve: 0.72 vs. 0.69, p=0.11). The two scores were also similar in predicting re-bleeding (ROC curve: 0.64 vs. 0.63, p=0.4) and 30-day bleeding-related mortality (ROC curve: 0.78 vs. 0.76, p=0.3). The T-score appeared to predict high risk endoscopic stigmata, re-bleeding and mortality with similar accuracy to Glasgow Blatchford risk score. Such a score may be helpful for the prediction of high-risk patients who need a very early therapeutic endoscopy. Copyright © 2014 Editrice Gastroenterologica Italiana S.r.l. Published by Elsevier Ltd. All rights reserved.

Emergency Heart Failure Mortality Risk Grade score performance for 7-day mortality prediction in patients with heart failure attended at the emergency department: validation in a Spanish cohort.

PubMed

Gil, Víctor; Miró, Òscar; Schull, Michael J; Llorens, Pere; Herrero-Puente, Pablo; Jacob, Javier; Ríos, José; Lee, Douglas S; Martín-Sánchez, Francisco J

2018-06-01

The Emergency Heart Failure Mortality Risk Grade (EHMRG) scale, derived in 86 Canadian emergency departments (EDs), stratifies patients with acute-decompensated heart failure (ADHF) according to their 7-day mortality risk. We evaluated its external validity in a Spanish cohort. We applied the EHMRG scale to ADHF patients consecutively included in the Epidemiology of Acute Heart Failure in Emergency departments (EAHFE) registry (29 Spanish EDs) and measured its performance. Patients were distributed into quintiles according to the original and their self-defined score cutoffs. The 7-day mortality rates were compared internally among different categories and with categories of Canadian cohorts. The EAHFE group [n: 1553 patients; 80 (10) years; 55.6% women] had a 5.5% 7-day mortality rate and the EHMRG scale c-statistic was 0.741 (95% confidence interval: 0.688-0.793) compared with 0.807 (0.761-0.842) and 0.804 (0.763-0.840) obtained in the Canadian derivation and validation cohorts. The mortality rate of the EAHFE group mortality increased progressively as the quintile categories increased using intervals defined by either the Canadian or the Spanish EHMRG score cutoffs, although with more regular increments with the EAHFE-defined intervals; using the latter, patients at quintiles 2, 3, 4, 5a and 5b had (compared with quintile 1) odds ratios of 1.77, 3.36, 4.44, 9.39 and 16.19, respectively. The EHMRG scale stratified risk in an ADHF cohort that included both palliative and nonpalliative patients in Spanish EDs, showing an extrapolation to a higher mortality risk cohort than the original derivation sample. Stratification improved when the score was recalibrated in the Spanish cohort.

Assessing fracture risk in people with MS: a service development study comparing three fracture risk scoring systems

PubMed Central

Dobson, Ruth; Leddy, Sara Geraldine; Gangadharan, Sunay; Giovannoni, Gavin

2013-01-01

Objectives Suboptimal bone health is increasingly recognised as an important cause of morbidity. Multiple sclerosis (MS) has been consistently associated with an increased risk of osteoporosis and fracture. Various fracture risk screening tools have been developed, two of which are in routine use and a further one is MS-specific. We set out to compare the results obtained by these in the MS clinic population. Design This was a service development study. The 10-year risk estimates of any fracture and hip fracture generated by each of the algorithms were compared. Setting The MS clinic at the Royal London Hospital. Participants 88 patients with a confirmed diagnosis of MS. Outcome measures Mean 10-year overall fracture risk and hip fracture risk were calculated using each of the three fracture risk calculators. The number of interventions that would be required as a result of using each of these tools was also compared. Results Mean 10-year fracture risk was 4.7%, 2.3% and 7.6% using FRAX, QFracture and the MS-specific calculator, respectively (p<0.0001 for difference). The agreement between risk scoring tools was poor at all levels of fracture risk. Conclusions The agreement between these three fracture risk scoring tools is poor in the MS population. Further work is required to develop and validate an accurate fracture risk scoring system for use in MS. Trial registration This service development study was approved by the Clinical Effectiveness Department at Barts Health NHS Trust (project registration number 156/12). PMID:23482989

Validation and comparison of imaging-based scores for prediction of early stroke risk after transient ischaemic attack: a pooled analysis of individual-patient data from cohort studies.

PubMed

Kelly, Peter J; Albers, Gregory W; Chatzikonstantinou, Anastasios; De Marchis, Gian Marco; Ferrari, Julia; George, Paul; Katan, Mira; Knoflach, Michael; Kim, Jong S; Li, Linxin; Lee, Eun-Jae; Olivot, Jean-Marc; Purroy, Francisco; Raposo, Nicolas; Rothwell, Peter M; Sharma, Vijay K; Song, Bo; Tsivgoulis, Georgios; Walsh, Cathal; Xu, Yuming; Merwick, Aine

2016-11-01

Identification of patients at highest risk of early stroke after transient ischaemic attack has been improved with imaging based scores. We aimed to compare the validity and prognostic utility of imaging-based stroke risk scores in patients after transient ischaemic attack. We did a pooled analysis of published and unpublished individual-patient data from 16 cohort studies of transient ischaemic attack done in Asia, Europe, and the USA, with early brain and vascular imaging and follow up. All patients were assessed by stroke specialists in hospital settings as inpatients, in emergency departments, or in transient ischaemic attack clinics. Inclusion criteria were stroke-specialist confirmed transient ischaemic attack, age of 18 years or older, and MRI done within 7 days of index transient ischaemic attack and before stroke recurrence. Multivariable logistic regression was done to analyse the predictive utility of abnormal diffusion-weighted MRI, carotid stenosis, and transient ischaemic attack within 1 week of index transient ischaemic attack (dual transient ischaemic attack) after adjusting for ABCD2 score. We compared the prognostic utility of the ABCD2, ABCD2-I, and ABCD3-I scores using discrimination, calibration, and risk reclassification. In 2176 patients from 16 cohort studies done between 2005 and 2015, after adjusting for ABCD2 score, positive diffusion-weighted imaging (odds ratio [OR] 3·8, 95% CI 2·1-7·0), dual transient ischaemic attack (OR 3·3, 95% CI 1·8-5·8), and ipsilateral carotid stenosis (OR 4·7, 95% CI 2·6-8·6) were associated with 7 day stroke after index transient ischaemic attack (p<0·001 for all). 7 day stroke risk increased with increasing ABCD2-I and ABCD3-I scores (both p<0·001). Discrimination to identify early stroke risk was improved for ABCD2-I versus ABCD2 (2 day c statistic 0·74 vs 0·64; p=0·006). However, discrimination was further improved by ABCD3-I compared with ABCD2 (2 day c statistic 0·84 vs 0·64; p<0·001) and

Development and validation of the "Pediatric Risk of Nosocomial Sepsis (PRiNS)" score for health care-associated infections in a medical pediatric intensive care unit of a developing economy--a prospective observational cohort study.

PubMed

Saptharishi, L G; Jayashree, Muralidharan; Singhi, Sunit

2016-04-01

Given the high burden of health care-associated infections (HAIs) in resource-limited settings, there is a tendency toward overdiagnosis/treatment. This study was designed to create an easy-to-use, dynamic, bedside risk stratification model for classifying children based on their risk of developing HAIs during their pediatric intensive care unit (PICU) stay, to aid judicious resource utilization. A prospective, observational cohort study was conducted in the 12-bed PICU of a large Indian tertiary care hospital between January and October 2011. A total of 412 consecutive admissions, aged 1 month to 12 years with PICU stay greater than 48 hours were enrolled. Independent predictors for HAIs identified using multivariate regression analysis were combined to create a novel scoring system. Performance and calibration of score were assessed using receiver operating characteristic curves and Hosmer-Lemeshow statistic, respectively. Internal validation was done. Age (<5 years), Pediatric Risk of Mortality III (24 hours) score, presence of indwelling catheters, need for intubation, albumin infusion, immunomodulator, and prior antibiotic use (≥4) were independent predictors of HAIs. This model, with area under the ROC curve of 0.87, at a cutoff of 15, had a negative predictive value of 89.9% with overall accuracy of 79.3%. It reduced classification errors from 29.8% to 20.7%. All 7 predictors retained their statistical significance after bootstrapping, confirming the internal validity of the score. The "Pediatric Risk of Nosocomial Sepsis" score can reliably classify children into high- and low-risk groups, based on their risk of developing HAIs in the PICU of a resource-limited setting. In view of its high sensitivity and specificity, diagnostic and therapeutic interventions may be directed away from the low-risk group, ensuring effective utilization of limited resources. Copyright © 2015 Elsevier Inc. All rights reserved.

Development and validation of a scoring index to predict the presence of lesions in capsule endoscopy in patients with suspected Crohn's disease of the small bowel: a Spanish multicenter study.

PubMed

Egea-Valenzuela, Juan; González Suárez, Begoña; Sierra Bernal, Cristian; Juanmartiñena Fernández, José Francisco; Luján-Sanchís, Marisol; San Juan Acosta, Mileidis; Martínez Andrés, Blanca; Pons Beltrán, Vicente; Sastre Lozano, Violeta; Carretero Ribón, Cristina; de Vera Almenar, Félix; Sánchez Cuenca, Joaquín; Alberca de Las Parras, Fernando; Rodríguez de Miguel, Cristina; Valle Muñoz, Julio; Férnandez-Urién Sainz, Ignacio; Torres González, Carolina; Borque Barrera, Pilar; Pérez-Cuadrado Robles, Enrique; Alonso Lázaro, Noelia; Martínez García, Pilar; Prieto de Frías, César; Carballo Álvarez, Fernando

2018-05-01

Capsule endoscopy (CE) is the first-line investigation in cases of suspected Crohn's disease (CD) of the small bowel, but the factors associated with a higher diagnostic yield remain unclear. Our aim is to develop and validate a scoring index to assess the risk of the patients in this setting on the basis of biomarkers. Data on fecal calprotectin, C-reactive protein, and other biomarkers from a population of 124 patients with suspected CD of the small bowel studied by CE and included in a PhD study were used to build a scoring index. This was first used on this population (internal validation process) and after that on a different set of patients from a multicenter study (external validation process). An index was designed in which every biomarker is assigned a score. Three risk groups have been established (low, intermediate, and high). In the internal validation analysis (124 individuals), patients had a 10, 46.5, and 81% probability of showing inflammatory lesions in CE in the low-risk, intermediate-risk, and high-risk groups, respectively. In the external validation analysis, including 410 patients from 12 Spanish hospitals, this probability was 15.8, 49.7, and 80.6% for the low-risk, intermediate-risk, and high-risk groups, respectively. Results from the internal validation process show that the scoring index is coherent, and results from the external validation process confirm its reliability. This index can be a useful tool for selecting patients before CE studies in cases of suspected CD of the small bowel.

Multilocus genetic risk scores for venous thromboembolism risk assessment.

PubMed

Soria, José Manuel; Morange, Pierre-Emmanuel; Vila, Joan; Souto, Juan Carlos; Moyano, Manel; Trégouët, David-Alexandre; Mateo, José; Saut, Noémi; Salas, Eduardo; Elosua, Roberto

2014-10-23

Genetics plays an important role in venous thromboembolism (VTE). Factor V Leiden (FVL or rs6025) and prothrombin gene G20210A (PT or rs1799963) are the genetic variants currently tested for VTE risk assessment. We hypothesized that primary VTE risk assessment can be improved by using genetic risk scores with more genetic markers than just FVL-rs6025 and prothrombin gene PT-rs1799963. To this end, we have designed a new genetic risk score called Thrombo inCode (TiC). TiC was evaluated in terms of discrimination (Δ of the area under the receiver operating characteristic curve) and reclassification (integrated discrimination improvement and net reclassification improvement). This evaluation was performed using 2 age- and sex-matched case-control populations: SANTPAU (248 cases, 249 controls) and the Marseille Thrombosis Association study (MARTHA; 477 cases, 477 controls). TiC was compared with other literature-based genetic risk scores. TiC including F5 rs6025/rs118203906/rs118203905, F2 rs1799963, F12 rs1801020, F13 rs5985, SERPINC1 rs121909548, and SERPINA10 rs2232698 plus the A1 blood group (rs8176719, rs7853989, rs8176743, rs8176750) improved the area under the curve compared with a model based only on F5-rs6025 and F2-rs1799963 in SANTPAU (0.677 versus 0.575, P<0.001) and MARTHA (0.605 versus 0.576, P=0.008). TiC showed good integrated discrimination improvement of 5.49 (P<0.001) for SANTPAU and 0.96 (P=0.045) for MARTHA. Among the genetic risk scores evaluated, the proportion of VTE risk variance explained by TiC was the highest. We conclude that TiC greatly improves prediction of VTE risk compared with other genetic risk scores. TiC should improve prevention, diagnosis, and treatment of VTE. © 2014 The Authors. Published on behalf of the American Heart Association, Inc., by Wiley Blackwell.

Multilocus Genetic Risk Scores for Venous Thromboembolism Risk Assessment

PubMed Central

Soria, José Manuel; Morange, Pierre‐Emmanuel; Vila, Joan; Souto, Juan Carlos; Moyano, Manel; Trégouët, David‐Alexandre; Mateo, José; Saut, Noémi; Salas, Eduardo; Elosua, Roberto

2014-01-01

Background Genetics plays an important role in venous thromboembolism (VTE). Factor V Leiden (FVL or rs6025) and prothrombin gene G20210A (PT or rs1799963) are the genetic variants currently tested for VTE risk assessment. We hypothesized that primary VTE risk assessment can be improved by using genetic risk scores with more genetic markers than just FVL‐rs6025 and prothrombin gene PT‐rs1799963. To this end, we have designed a new genetic risk score called Thrombo inCode (TiC). Methods and Results TiC was evaluated in terms of discrimination (Δ of the area under the receiver operating characteristic curve) and reclassification (integrated discrimination improvement and net reclassification improvement). This evaluation was performed using 2 age‐ and sex‐matched case–control populations: SANTPAU (248 cases, 249 controls) and the Marseille Thrombosis Association study (MARTHA; 477 cases, 477 controls). TiC was compared with other literature‐based genetic risk scores. TiC including F5 rs6025/rs118203906/rs118203905, F2 rs1799963, F12 rs1801020, F13 rs5985, SERPINC1 rs121909548, and SERPINA10 rs2232698 plus the A1 blood group (rs8176719, rs7853989, rs8176743, rs8176750) improved the area under the curve compared with a model based only on F5‐rs6025 and F2‐rs1799963 in SANTPAU (0.677 versus 0.575, P<0.001) and MARTHA (0.605 versus 0.576, P=0.008). TiC showed good integrated discrimination improvement of 5.49 (P<0.001) for SANTPAU and 0.96 (P=0.045) for MARTHA. Among the genetic risk scores evaluated, the proportion of VTE risk variance explained by TiC was the highest. Conclusions We conclude that TiC greatly improves prediction of VTE risk compared with other genetic risk scores. TiC should improve prevention, diagnosis, and treatment of VTE. PMID:25341889

Validity of GRE General Test Scores and TOEFL Scores for Graduate Admission to a Technical University in Western Europe

ERIC Educational Resources Information Center

Zimmermann, Judith; von Davier, Alina A.; Buhmann, Joachim M.; Heinimann, Hans R.

2018-01-01

Graduate admission has become a critical process in tertiary education, whereby selecting valid admissions instruments is key. This study assessed the validity of Graduate Record Examination (GRE) General Test scores for admission to Master's programmes at a technical university in Europe. We investigated the indicative value of GRE scores for the…

Development of a Korean Fracture Risk Score (KFRS) for Predicting Osteoporotic Fracture Risk: Analysis of Data from the Korean National Health Insurance Service

PubMed Central

Jang, Eun Jin; Park, ByeongJu; Kim, Tae-Young; Shin, Soon-Ae

2016-01-01

Background Asian-specific prediction models for estimating individual risk of osteoporotic fractures are rare. We developed a Korean fracture risk prediction model using clinical risk factors and assessed validity of the final model. Methods A total of 718,306 Korean men and women aged 50–90 years were followed for 7 years in a national system-based cohort study. In total, 50% of the subjects were assigned randomly to the development dataset and 50% were assigned to the validation dataset. Clinical risk factors for osteoporotic fracture were assessed at the biennial health check. Data on osteoporotic fractures during the follow-up period were identified by ICD-10 codes and the nationwide database of the National Health Insurance Service (NHIS). Results During the follow-up period, 19,840 osteoporotic fractures were reported (4,889 in men and 14,951 in women) in the development dataset. The assessment tool called the Korean Fracture Risk Score (KFRS) is comprised of a set of nine variables, including age, body mass index, recent fragility fracture, current smoking, high alcohol intake, lack of regular exercise, recent use of oral glucocorticoid, rheumatoid arthritis, and other causes of secondary osteoporosis. The KFRS predicted osteoporotic fractures over the 7 years. This score was validated using an independent dataset. A close relationship with overall fracture rate was observed when we compared the mean predicted scores after applying the KFRS with the observed risks after 7 years within each 10th of predicted risk. Conclusion We developed a Korean specific prediction model for osteoporotic fractures. The KFRS was able to predict risk of fracture in the primary population without bone mineral density testing and is therefore suitable for use in both clinical setting and self-assessment. The website is available at http://www.nhis.or.kr. PMID:27399597

Development of a Korean Fracture Risk Score (KFRS) for Predicting Osteoporotic Fracture Risk: Analysis of Data from the Korean National Health Insurance Service.

PubMed

Kim, Ha Young; Jang, Eun Jin; Park, ByeongJu; Kim, Tae-Young; Shin, Soon-Ae; Ha, Yong-Chan; Jang, Sunmee

2016-01-01

Asian-specific prediction models for estimating individual risk of osteoporotic fractures are rare. We developed a Korean fracture risk prediction model using clinical risk factors and assessed validity of the final model. A total of 718,306 Korean men and women aged 50-90 years were followed for 7 years in a national system-based cohort study. In total, 50% of the subjects were assigned randomly to the development dataset and 50% were assigned to the validation dataset. Clinical risk factors for osteoporotic fracture were assessed at the biennial health check. Data on osteoporotic fractures during the follow-up period were identified by ICD-10 codes and the nationwide database of the National Health Insurance Service (NHIS). During the follow-up period, 19,840 osteoporotic fractures were reported (4,889 in men and 14,951 in women) in the development dataset. The assessment tool called the Korean Fracture Risk Score (KFRS) is comprised of a set of nine variables, including age, body mass index, recent fragility fracture, current smoking, high alcohol intake, lack of regular exercise, recent use of oral glucocorticoid, rheumatoid arthritis, and other causes of secondary osteoporosis. The KFRS predicted osteoporotic fractures over the 7 years. This score was validated using an independent dataset. A close relationship with overall fracture rate was observed when we compared the mean predicted scores after applying the KFRS with the observed risks after 7 years within each 10th of predicted risk. We developed a Korean specific prediction model for osteoporotic fractures. The KFRS was able to predict risk of fracture in the primary population without bone mineral density testing and is therefore suitable for use in both clinical setting and self-assessment. The website is available at http://www.nhis.or.kr.

Credit scores, cardiovascular disease risk, and human capital.

PubMed

Israel, Salomon; Caspi, Avshalom; Belsky, Daniel W; Harrington, HonaLee; Hogan, Sean; Houts, Renate; Ramrakha, Sandhya; Sanders, Seth; Poulton, Richie; Moffitt, Terrie E

2014-12-02

Credit scores are the most widely used instruments to assess whether or not a person is a financial risk. Credit scoring has been so successful that it has expanded beyond lending and into our everyday lives, even to inform how insurers evaluate our health. The pervasive application of credit scoring has outpaced knowledge about why credit scores are such useful indicators of individual behavior. Here we test if the same factors that lead to poor credit scores also lead to poor health. Following the Dunedin (New Zealand) Longitudinal Study cohort of 1,037 study members, we examined the association between credit scores and cardiovascular disease risk and the underlying factors that account for this association. We find that credit scores are negatively correlated with cardiovascular disease risk. Variation in household income was not sufficient to account for this association. Rather, individual differences in human capital factors—educational attainment, cognitive ability, and self-control—predicted both credit scores and cardiovascular disease risk and accounted for ∼45% of the correlation between credit scores and cardiovascular disease risk. Tracing human capital factors back to their childhood antecedents revealed that the characteristic attitudes, behaviors, and competencies children develop in their first decade of life account for a significant portion (∼22%) of the link between credit scores and cardiovascular disease risk at midlife. We discuss the implications of these findings for policy debates about data privacy, financial literacy, and early childhood interventions.

Credit scores, cardiovascular disease risk, and human capital

PubMed Central

Israel, Salomon; Caspi, Avshalom; Belsky, Daniel W.; Harrington, HonaLee; Hogan, Sean; Houts, Renate; Ramrakha, Sandhya; Sanders, Seth; Poulton, Richie; Moffitt, Terrie E.

2014-01-01

Credit scores are the most widely used instruments to assess whether or not a person is a financial risk. Credit scoring has been so successful that it has expanded beyond lending and into our everyday lives, even to inform how insurers evaluate our health. The pervasive application of credit scoring has outpaced knowledge about why credit scores are such useful indicators of individual behavior. Here we test if the same factors that lead to poor credit scores also lead to poor health. Following the Dunedin (New Zealand) Longitudinal Study cohort of 1,037 study members, we examined the association between credit scores and cardiovascular disease risk and the underlying factors that account for this association. We find that credit scores are negatively correlated with cardiovascular disease risk. Variation in household income was not sufficient to account for this association. Rather, individual differences in human capital factors—educational attainment, cognitive ability, and self-control—predicted both credit scores and cardiovascular disease risk and accounted for ∼45% of the correlation between credit scores and cardiovascular disease risk. Tracing human capital factors back to their childhood antecedents revealed that the characteristic attitudes, behaviors, and competencies children develop in their first decade of life account for a significant portion (∼22%) of the link between credit scores and cardiovascular disease risk at midlife. We discuss the implications of these findings for policy debates about data privacy, financial literacy, and early childhood interventions. PMID:25404329

Development and validation of immune dysfunction score to predict 28-day mortality of sepsis patients

PubMed Central

Fang, Wen-Feng; Douglas, Ivor S.; Chen, Yu-Mu; Lin, Chiung-Yu; Kao, Hsu-Ching; Fang, Ying-Tang; Huang, Chi-Han; Chang, Ya-Ting; Huang, Kuo-Tung; Wang, Yi-His; Wang, Chin-Chou

2017-01-01

Background Sepsis-induced immune dysfunction ranging from cytokines storm to immunoparalysis impacts outcomes. Monitoring immune dysfunction enables better risk stratification and mortality prediction and is mandatory before widely application of immunoadjuvant therapies. We aimed to develop and validate a scoring system according to patients’ immune dysfunction status for 28-day mortality prediction. Methods A prospective observational study from a cohort of adult sepsis patients admitted to ICU between August 2013 and June 2016 at Kaohsiung Chang Gung Memorial Hospital in Taiwan. We evaluated immune dysfunction status through measurement of baseline plasma Cytokine levels, Monocyte human leukocyte-DR expression by flow cytometry, and stimulated immune response using post LPS stimulated cytokine elevation ratio. An immune dysfunction score was created for 28-day mortality prediction and was validated. Results A total of 151 patients were enrolled. Data of the first consecutive 106 septic patients comprised the training cohort, and of other 45 patients comprised the validation cohort. Among the 106 patients, 21 died and 85 were still alive on day 28 after ICU admission. (mortality rate, 19.8%). Independent predictive factors revealed via multivariate logistic regression analysis included segmented neutrophil-to-monocyte ratio, granulocyte-colony stimulating factor, interleukin-10, and monocyte human leukocyte antigen-antigen D–related levels, all of which were selected to construct the score, which predicted 28-day mortality with area under the curve of 0.853 and 0.789 in the training and validation cohorts, respectively. Conclusions The immune dysfunction scoring system developed here included plasma granulocyte-colony stimulating factor level, interleukin-10 level, serum segmented neutrophil-to-monocyte ratio, and monocyte human leukocyte antigen-antigen D–related expression appears valid and reproducible for predicting 28-day mortality. PMID:29073262

A Retrospective Analysis of Pressure Ulcer Incidence and Modified Braden Scale Score Risk Classifications.

PubMed

Chen, Hong-Lin; Cao, Ying-Juan; Wang, Jing; Huai, Bao-Sha

2015-09-01

The Braden Scale is the most widely used pressure ulcer risk assessment in the world, but the currently used 5 risk classification groups do not accurately discriminate among their risk categories. To optimize risk classification based on Braden Scale scores, a retrospective analysis of all consecutively admitted patients in an acute care facility who were at risk for pressure ulcer development was performed between January 2013 and December 2013. Predicted pressure ulcer incidence first was calculated by logistic regression model based on original Braden score. Risk classification then was modified based on the predicted pressure ulcer incidence and compared between different risk categories in the modified (3-group) classification and the traditional (5-group) classification using chi-square test. Two thousand, six hundred, twenty-five (2,625) patients (mean age 59.8 ± 16.5, range 1 month to 98 years, 1,601 of whom were men) were included in the study; 81 patients (3.1%) developed a pressure ulcer. The predicted pressure ulcer incidence ranged from 0.1% to 49.7%. When the predicted pressure ulcer incidence was greater than 10.0% (high risk), the corresponding Braden scores were less than 11; when the predicted incidence ranged from 1.0% to 10.0% (moderate risk), the corresponding Braden scores ranged from 12 to 16; and when the predicted incidence was less than 1.0% (mild risk), the corresponding Braden scores were greater than 17. In the modified classification, observed pressure ulcer incidence was significantly different between each of the 3 risk categories (P less than 0.05). However, in the traditional classification, the observed incidence was not significantly different between the high-risk category and moderate-risk category (P less than 0.05) and between the mild-risk category and no-risk category (P less than 0.05). If future studies confirm the validity of these findings, pressure ulcer prevention protocols of care based on Braden Scale scores can

Predicting 10-Year Risk of Fatal Cardiovascular Disease in Germany: An Update Based on the SCORE-Deutschland Risk Charts

PubMed Central

Rücker, Viktoria; Keil, Ulrich; Fitzgerald, Anthony P; Malzahn, Uwe; Prugger, Christof; Ertl, Georg; Heuschmann, Peter U; Neuhauser, Hannelore

2016-01-01

Estimation of absolute risk of cardiovascular disease (CVD), preferably with population-specific risk charts, has become a cornerstone of CVD primary prevention. Regular recalibration of risk charts may be necessary due to decreasing CVD rates and CVD risk factor levels. The SCORE risk charts for fatal CVD risk assessment were first calibrated for Germany with 1998 risk factor level data and 1999 mortality statistics. We present an update of these risk charts based on the SCORE methodology including estimates of relative risks from SCORE, risk factor levels from the German Health Interview and Examination Survey for Adults 2008–11 (DEGS1) and official mortality statistics from 2012. Competing risks methods were applied and estimates were independently validated. Updated risk charts were calculated based on cholesterol, smoking, systolic blood pressure risk factor levels, sex and 5-year age-groups. The absolute 10-year risk estimates of fatal CVD were lower according to the updated risk charts compared to the first calibration for Germany. In a nationwide sample of 3062 adults aged 40–65 years free of major CVD from DEGS1, the mean 10-year risk of fatal CVD estimated by the updated charts was lower by 29% and the estimated proportion of high risk people (10-year risk > = 5%) by 50% compared to the older risk charts. This recalibration shows a need for regular updates of risk charts according to changes in mortality and risk factor levels in order to sustain the identification of people with a high CVD risk. PMID:27612145

Validity of GRE General Test scores and TOEFL scores for graduate admission to a technical university in Western Europe

NASA Astrophysics Data System (ADS)

Zimmermann, Judith; von Davier, Alina A.; Buhmann, Joachim M.; Heinimann, Hans R.

2018-01-01

Graduate admission has become a critical process in tertiary education, whereby selecting valid admissions instruments is key. This study assessed the validity of Graduate Record Examination (GRE) General Test scores for admission to Master's programmes at a technical university in Europe. We investigated the indicative value of GRE scores for the Master's programme grade point average (GGPA) with and without the addition of the undergraduate GPA (UGPA) and the TOEFL score, and of GRE scores for study completion and Master's thesis performance. GRE scores explained 20% of the variation in the GGPA, while additional 7% were explained by the TOEFL score and 3% by the UGPA. Contrary to common belief, the GRE quantitative reasoning score showed only little explanatory power. GRE scores were also weakly related to study progress but not to thesis performance. Nevertheless, GRE and TOEFL scores were found to be sensible admissions instruments. Rigorous methodology was used to obtain highly reliable results.

Validity and Reliability of Nintendo Wii Fit Balance Scores

PubMed Central

Wikstrom, Erik A.

2012-01-01

Context: Interactive gaming systems have the potential to help rehabilitate patients with musculoskeletal conditions. The Nintendo Wii Balance Board, which is part of the Wii Fit game, could be an effective tool to monitor progress during rehabilitation because the board and game can provide objective measures of balance. However, the validity and reliability of Wii Fit balance scores remain unknown. Objective: To determine the concurrent validity of balance scores produced by the Wii Fit game and the intrasession and intersession reliability of Wii Fit balance scores. Design: Descriptive laboratory study. Setting: Sports medicine research laboratory. Patients or Other Participants: Forty-five recreationally active participants (age  =  27.0 ± 9.8 years, height  =  170.9 ± 9.2 cm, mass  =  72.4 ± 11.8 kg) with a heterogeneous history of lower extremity injury. Intervention(s): Participants completed a single-limb–stance task on a force plate and the Star Excursion Balance Test (SEBT) during the first test session. Twelve Wii Fit balance activities were completed during 2 test sessions separated by 1 week. Main Outcome Measure(s): Postural sway in the anteroposterior (AP) and mediolateral (ML) directions and the AP, ML, and resultant center-of-pressure (COP) excursions were calculated from the single-limb stance. The normalized reach distance was recorded for the anterior, posteromedial, and posterolateral directions of the SEBT. Wii Fit balance scores that the game software generated also were recorded. Results: All 96 of the calculated correlation coefficients among Wii Fit activity outcomes and established balance outcomes were interpreted as poor (r < 0.50). Intrasession reliability for Wii Fit balance activity scores ranged from good (intraclass correlation coefficient [ICC]  =  0.80) to poor (ICC  =  0.39), with 8 activities having poor intrasession reliability. Similarly, 11 of the 12 Wii Fit balance activity scores demonstrated

Prenatal High Risk Scoring: How Family Doctors Do It

PubMed Central

Shea, Philip

1978-01-01

Assessment of risk factors is an integral part of family medicine and of prenatal care. A strong positive relationship has been demonstrated between a high risk score and higher incidence of maternal or perinatal morbidity and mortality. The family physician, because of his previous knowledge of the patient, and his familiarity with a broad range of normals, is in a good position to use his clinical judgement in high risk scoring in pregnancy. We must also be cautious that high risk scoring does not become a self fulfilling prophecy. Risk scoring is simply risk scoring, not a plan of management and intervention. PMID:21301562

Validation of a Predictive Scoring System for Deep Sternal Wound Infection after Bilateral Internal Thoracic Artery Grafting in a Cohort of French Patients.

PubMed

Perrotti, Andrea; Gatti, Giuseppe; Dorigo, Enrica; Sinagra, Gianfranco; Pappalardo, Aniello; Chocron, Sidney

The Gatti score is a weighted scoring system based on risk factors for deep sternal wound infection (DSWI) that was created in an Italian center to predict DSWI risk after bilateral internal thoracic artery (BITA) grafting. No external evaluation based on validation samples derived from other surgical centers has been performed. The aim of this study is to perform this validation. During 2015, BITA grafts were used as skeletonized conduits in all 255 consecutive patients with multi-vessel coronary disease who underwent isolated coronary bypass surgery at the Department of Thoracic and Cardio-Vascular Surgery, University Hospital Jean Minjoz, Besançon, France. Baseline characteristics, operative data, and immediate outcomes of every patient were collected prospectively. A DSWI risk score was assigned to each patient pre-operatively. The discrimination power of both models, pre-operative and combined, of the Gatti score was assessed with the calculation of the area under the receiver operating characteristic curve. Fourteen (5.5%) patients had DSWI. Major differences both as the baseline characteristics of patients and surgical techniques were found between this series and the original series from which the Gatti score was derived. The area under the receiver operating characteristic curve was 0.78 (95% confidence interval: 0.64-0.92) for the pre-operative model and 0.84 (95% confidence interval: 0.69-0.98) for the combined model. The Gatti score has proven to be effective even in a cohort of French patients despite major differences from the original Italian series. Multi-center validation studies must be performed before introducing the score into clinical practice.

Commentary on "Validating the Interpretations and Uses of Test Scores"

ERIC Educational Resources Information Center

Brennan, Robert L.

2013-01-01

Kane's paper "Validating the Interpretations and Uses of Test Scores" is the most complete and clearest discussion yet available of the argument-based approach to validation. At its most basic level, validation as formulated by Kane is fundamentally a simply-stated two-step enterprise: (1) specify the claims inherent in a particular interpretation…

Mortality risk score prediction in an elderly population using machine learning.

PubMed

Rose, Sherri

2013-03-01

Standard practice for prediction often relies on parametric regression methods. Interesting new methods from the machine learning literature have been introduced in epidemiologic studies, such as random forest and neural networks. However, a priori, an investigator will not know which algorithm to select and may wish to try several. Here I apply the super learner, an ensembling machine learning approach that combines multiple algorithms into a single algorithm and returns a prediction function with the best cross-validated mean squared error. Super learning is a generalization of stacking methods. I used super learning in the Study of Physical Performance and Age-Related Changes in Sonomans (SPPARCS) to predict death among 2,066 residents of Sonoma, California, aged 54 years or more during the period 1993-1999. The super learner for predicting death (risk score) improved upon all single algorithms in the collection of algorithms, although its performance was similar to that of several algorithms. Super learner outperformed the worst algorithm (neural networks) by 44% with respect to estimated cross-validated mean squared error and had an R2 value of 0.201. The improvement of super learner over random forest with respect to R2 was approximately 2-fold. Alternatives for risk score prediction include the super learner, which can provide improved performance.

Test Score Stability and Construct Validity of the Adult Manifest Anxiety Scale-College Version Scores among College Students: A Brief Report

ERIC Educational Resources Information Center

Lowe, Patricia A.; Papanastasiou, Elena C.; DeRuyck, Kimberly A.; Reynolds, Cecil R.

2005-01-01

In this study, the authors investigated the temporal stability and construct validity of the Adult Manifest Anxiety Scale-College Version (AMAS-C; C. R. Reynolds, B. O. Richmond, & P. A. Lowe, 2003b) scores. Results indicated that the AMAS-C scores had adequate to excellent test score stability, and evidence supported the construct validity of the…

Risk scores-the modern Oracle of Delphi?

PubMed

Kronenberg, Florian; Schwaiger, Johannes P

2017-03-01

Recently, 4 new risk scores for the prediction of mortality and cardiovascular events were especially tailored for hemodialysis patients; these scores performed much better than previous scores. Tripepi et al. found that these risk scores were even more predictive for all-cause and cardiovascular death than the measurement of the left ventricular mass index was. Nevertheless, the investigation of left ventricular mass and function has its own place for other reasons. Copyright © 2016 International Society of Nephrology. Published by Elsevier Inc. All rights reserved.

Surrogate endpoints in clinical trials of chronic kidney disease progression: moving from single to multiple risk marker response scores.

PubMed

Schievink, Bauke; Mol, Peter G M; Lambers Heerspink, Hiddo J

2015-11-01

There is increased interest in developing surrogate endpoints for clinical trials of chronic kidney disease progression, as the established clinically meaningful endpoint end-stage renal disease requires large and lengthy trials to assess drug efficacy. We describe recent developments in the search for novel surrogate endpoints. Declines in estimated glomerular filtration rate (eGFR) of 30% or 40% and albuminuria have been proposed as surrogates for end-stage renal disease. However, changes in eGFR or albuminuria may not be valid under all circumstances as drugs always have effects on multiple renal risk markers. Changes in each of these other 'off-target' risk markers can alter renal risk (either beneficially or adversely), and can thereby confound the relationship between surrogates that are based on single risk markers and renal outcome. Risk algorithms that integrate the short-term drug effects on multiple risk markers to predict drug effects on hard renal outcomes may therefore be more accurate. The validity of these risk algorithms is currently investigated. Given that drugs affect multiple renal risk markers, risk scores that integrate these effects are a promising alternative to using eGFR decline or albuminuria. Proper validation is required before these risk scores can be implemented.

Translation and validation of the Dutch new Knee Society Scoring System ©.

PubMed

Van Der Straeten, Catherine; Witvrouw, Erik; Willems, Tine; Bellemans, Johan; Victor, Jan

2013-11-01

A new version of The Knee Society Knee Scoring System(©) (KSS) has recently been developed. Before this scale can be used in non-English-speaking populations, it has to be translated and validated for a particular population. We evaluated the construct and content validity, the test-retest reliability, and the internal consistency of the Dutch version of the New Knee Society KSS. A Dutch translation was performed using a forward-backward translation protocol. We tested the construct validity of the Dutch New KSS by comparing it with the Dutch versions of the WOMAC, Knee Injury and Osteoarthritis Outcome Score (KOOS), and SF-12 scores in 137 patients undergoing total knee arthroplasty (TKA). Content validity was assessed by comparing pre- and postoperative scores and by checking floor and ceiling effects. To evaluate test-retest reliability and consistency, 47 patients completed the questionnaire a second time with a mean of 8 days interval (range, 2-20 days) between tests. Construct validity was demonstrated because the Dutch New KSS correlated well with the Dutch WOMAC (r = -0.751; p < 0.001), Dutch KOOS (r = -0.723; p < 0.001), and Dutch SF-12 (r = 0.569; p < 0.001). There was a significant difference between pre- and postoperative scores (p < 0.001) in line with the other scores. Test-retest reliability proved excellent with an intraclass correlation coefficient between 0.73 and 0.92 depending on the domain tested. Consistency as indicated by Cronbach's alpha ranging from 0.84 to 0.96 was good to excellent. As demonstrated by the validation procedure, the Dutch New KSS is an excellent instrument to evaluate TKA outcome in Dutch-speaking patients.

Risk analysis by FMEA as an element of analytical validation.

PubMed

van Leeuwen, J F; Nauta, M J; de Kaste, D; Odekerken-Rombouts, Y M C F; Oldenhof, M T; Vredenbregt, M J; Barends, D M

2009-12-05

We subjected a Near-Infrared (NIR) analytical procedure used for screening drugs on authenticity to a Failure Mode and Effects Analysis (FMEA), including technical risks as well as risks related to human failure. An FMEA team broke down the NIR analytical method into process steps and identified possible failure modes for each step. Each failure mode was ranked on estimated frequency of occurrence (O), probability that the failure would remain undetected later in the process (D) and severity (S), each on a scale of 1-10. Human errors turned out to be the most common cause of failure modes. Failure risks were calculated by Risk Priority Numbers (RPNs)=O x D x S. Failure modes with the highest RPN scores were subjected to corrective actions and the FMEA was repeated, showing reductions in RPN scores and resulting in improvement indices up to 5.0. We recommend risk analysis as an addition to the usual analytical validation, as the FMEA enabled us to detect previously unidentified risks.

The New York risk score for in-hospital and 30-day mortality for coronary artery bypass graft surgery.

PubMed

Hannan, Edward L; Farrell, Louise Szypulski; Wechsler, Andrew; Jordan, Desmond; Lahey, Stephen J; Culliford, Alfred T; Gold, Jeffrey P; Higgins, Robert S D; Smith, Craig R

2013-01-01

Simplified risk scores for coronary artery bypass graft surgery are frequently in lieu of more complicated statistical models and are valuable for informed consent and choice of intervention. Previous risk scores have been based on in-hospital mortality, but a substantial number of patients die within 30 days of the procedure. These deaths should also be accounted for, so we have developed a risk score based on in-hospital and 30-day mortality. New York's Cardiac Surgery Reporting System was used to develop an in-hospital and 30-day logistic regression model for patients undergoing coronary artery bypass graft surgery in 2009, and this model was converted into a simple linear risk score that provides estimated in-hospital and 30-day mortality rates for different values of the score. The accuracy of the risk score in predicting mortality was tested. This score was also validated by applying it to 2008 New York coronary artery bypass graft data. Subsequent analyses evaluated the ability of the risk score to predict complications and length of stay. The overall in-hospital and 30-day mortality rate for the 10,148 patients in the study was 1.79%. There are seven risk factors comprising the score, with risk factor scores ranging from 1 to 5, and the highest possible total score is 23. The score accurately predicted mortality in 2009 as well as in 2008, and was strongly correlated with complications and length of stay. The risk score is a simple way of estimating short-term mortality that accurately predicts mortality in the year the model was developed as well as in the previous year. Perioperative complications and length of stay are also well predicted by the risk score. Copyright © 2013 The Society of Thoracic Surgeons. Published by Elsevier Inc. All rights reserved.

A risk score for predicting near-term incidence of hypertension: the Framingham Heart Study.

PubMed

Parikh, Nisha I; Pencina, Michael J; Wang, Thomas J; Benjamin, Emelia J; Lanier, Katherine J; Levy, Daniel; D'Agostino, Ralph B; Kannel, William B; Vasan, Ramachandran S

2008-01-15

Studies suggest that targeting high-risk, nonhypertensive individuals for treatment may delay hypertension onset, thereby possibly mitigating vascular complications. Risk stratification may facilitate cost-effective approaches to management. To develop a simple risk score for predicting hypertension incidence by using measures readily obtained in the physician's office. Longitudinal cohort study. Framingham Heart Study, Framingham, Massachusetts. 1717 nonhypertensive white individuals 20 to 69 years of age (mean age, 42 years; 54% women), without diabetes and with both parents in the original cohort of the Framingham Heart Study, contributed 5814 person-examinations. Scores were developed for predicting the 1-, 2-, and 4-year risk for new-onset hypertension, and performance characteristics of the prediction algorithm were assessed by using calibration and discrimination measures. Parental hypertension was ascertained from examinations of the original cohort of the Framingham Heart Study. During follow-up (median time over all person-examinations, 3.8 years), 796 persons (52% women) developed new-onset hypertension. In multivariable analyses, age, sex, systolic and diastolic blood pressure, body mass index, parental hypertension, and cigarette smoking were significant predictors of hypertension. According to the risk score based on these factors, the 4-year risk for incident hypertension was classified as low (<5%) in 34% of participants, medium (5% to 10%) in 19%, and high (>10%) in 47%. The c-statistic for the prediction model was 0.788, and calibration was very good. The risk score findings may not be generalizable to persons of nonwhite race or ethnicity or to persons with diabetes. The risk score algorithm has not been validated in an independent cohort and is based on single measurements of risk factors and blood pressure. The hypertension risk prediction score can be used to estimate an individual's absolute risk for hypertension on short-term follow-up, and

Development and validation of a risk stratification score for ventral incisional hernia after abdominal surgery: hernia expectation rates in intra-abdominal surgery (the HERNIA Project).

PubMed

Goodenough, Christopher J; Ko, Tien C; Kao, Lillian S; Nguyen, Mylan T; Holihan, Julie L; Alawadi, Zeinab; Nguyen, Duyen H; Flores, Juan R; Arita, Nestor T; Roth, J Scott; Liang, Mike K

2015-04-01

Ventral incisional hernias (VIH) develop in up to 20% of patients after abdominal surgery. No widely applicable preoperative risk-assessment tool exists. We aimed to develop and validate a risk-assessment tool to predict VIH after abdominal surgery. A prospective study of all patients undergoing abdominal surgery was conducted at a single institution from 2008 to 2010. Variables were defined in accordance with the National Surgical Quality Improvement Project, and VIH was determined through clinical and radiographic evaluation. A multivariate Cox proportional hazard model was built from a development cohort (2008 to 2009) to identify predictors of VIH. The HERNIAscore was created by converting the hazards ratios (HR) to points. The predictive accuracy was assessed on the validation cohort (2010) using a receiver operator characteristic curve and calculating the area under the curve (AUC). Of 625 patients followed for a median of 41 months (range 0.3 to 64 months), 93 (13.9%) developed a VIH. The training cohort (n = 428, VIH = 70, 16.4%) identified 4 independent predictors: laparotomy (HR 4.77, 95% CI 2.61 to 8.70) or hand-assisted laparoscopy (HAL, HR 4.00, 95% CI 2.08 to 7.70), COPD (HR 2.35; 95% CI 1.44 to 3.83), and BMI ≥ 25 kg/m(2) (HR1.74; 95% CI 1.04 to 2.91). Factors that were not predictive included age, sex, American Society of Anesthesiologists (ASA) score, albumin, immunosuppression, previous surgery, and suture material or technique. The predictive score had an AUC = 0.77 (95% CI 0.68 to 0.86) using the validation cohort (n = 197, VIH = 23, 11.6%). Using the HERNIAscore: HERNIAscore = 4(∗)Laparotomy+3(∗)HAL+1(∗)COPD+1(∗) BMI ≥ 25, 3 classes stratified the risk of VIH: class I (0 to 3 points),5.2%; class II (4 to 5 points),19.6%; and class III (6 points), 55.0%. The HERNIAscore accurately identifies patients at increased risk for VIH. Although external validation is needed, this provides a starting point to counsel patients and guide

The scoring of arousal in sleep: reliability, validity, and alternatives.

PubMed

Bonnet, Michael H; Doghramji, Karl; Roehrs, Timothy; Stepanski, Edward J; Sheldon, Stephen H; Walters, Arthur S; Wise, Merrill; Chesson, Andrew L

2007-03-15

The reliability and validity of EEG arousals and other types of arousal are reviewed. Brief arousals during sleep had been observed for many years, but the evolution of sleep medicine in the 1980s directed new attention to these events. Early studies at that time in animals and humans linked brief EEG arousals and associated fragmentation of sleep to daytime sleepiness and degraded performance. Increasing interest in scoring of EEG arousals led the ASDA to publish a scoring manual in 1992. The current review summarizes numerous studies that have examined scoring reliability for these EEG arousals. Validity of EEG arousals was explored by review of studies that empirically varied arousals and found deficits similar to those found after total sleep deprivation depending upon the rate and extent of sleep fragmentation. Additional data from patients with clinical sleep disorders prior to and after effective treatment has also shown a continuing relationship between reduction in pathology-related arousals and improved sleep and daytime function. Finally, many suggestions have been made to refine arousal scoring to include additional elements (e.g., CAP), change the time frame, or focus on other physiological responses such as heart rate or blood pressure changes. Evidence to support the reliability and validity of these measures is presented. It was concluded that the scoring of EEG arousals has added much to our understanding of the sleep process but that significant work on the neurophysiology of arousal needs to be done. Additional refinement of arousal scoring will provide improved insight into sleep pathology and recovery.

Does my patient have chronic Chagas disease? Development and temporal validation of a diagnostic risk score.

PubMed

Brasil, Pedro Emmanuel Alvarenga Americano do; Xavier, Sergio Salles; Holanda, Marcelo Teixeira; Hasslocher-Moreno, Alejandro Marcel; Braga, José Ueleres

2016-01-01

With the globalization of Chagas disease, unexperienced health care providers may have difficulties in identifying which patients should be examined for this condition. This study aimed to develop and validate a diagnostic clinical prediction model for chronic Chagas disease. This diagnostic cohort study included consecutive volunteers suspected to have chronic Chagas disease. The clinical information was blindly compared to serological tests results, and a logistic regression model was fit and validated. The development cohort included 602 patients, and the validation cohort included 138 patients. The Chagas disease prevalence was 19.9%. Sex, age, referral from blood bank, history of living in a rural area, recognizing the kissing bug, systemic hypertension, number of siblings with Chagas disease, number of relatives with a history of stroke, ECG with low voltage, anterosuperior divisional block, pathologic Q wave, right bundle branch block, and any kind of extrasystole were included in the final model. Calibration and discrimination in the development and validation cohorts (ROC AUC 0.904 and 0.912, respectively) were good. Sensitivity and specificity analyses showed that specificity reaches at least 95% above the predicted 43% risk, while sensitivity is at least 95% below the predicted 7% risk. Net benefit decision curves favor the model across all thresholds. A nomogram and an online calculator (available at http://shiny.ipec.fiocruz.br:3838/pedrobrasil/chronic_chagas_disease_prediction/) were developed to aid in individual risk estimation.

Ward mortality after ICU discharge: a multicenter validation of the Sabadell score.

PubMed

Fernandez, Rafael; Serrano, Jose Manuel; Umaran, Isabel; Abizanda, Ricard; Carrillo, Andres; Lopez-Pueyo, Maria Jesus; Rascado, Pedro; Balerdi, Begoña; Suberviola, Borja; Hernandez, Gonzalo

2010-07-01

Tools for predicting post-ICU patients' outcomes are scarce. A single-center study showed that the Sabadell score classified patients into four groups with clear-cut differences in ward mortality. To validate the Sabadell score using a prospective multicenter approach. Thirty-one ICUs in Spain. All patients admitted in the 3-month study period. We recorded variables at ICU admission (age, sex, severity of illness, and do-not-resuscitate orders), during the ICU stay (ICU-specific treatments, ICU-acquired infection, and acute renal failure), and at ICU discharge (Sabadell score). Statistical analyses included one-way ANOVA and multiple regression analysis with ward mortality as the dependent variable. We admitted 4,132 patients (mean age 61.5 +/- 16.7 years) with mean predicted mortality of 23.8 +/- 22.7%; 545 patients (13%) died in the ICU and 3,587 (87%) were discharged to the ward. Overall ward mortality was 6.7%; ward mortality was 1.5% (36/2,422) in patients with score 0 (good prognosis), 9% (64/725) in patients with score 1 (long-term poor prognosis), 23% (79/341) in patients with score 2 (short-term poor prognosis), and 64% (63/99) in patients with score 3 (expected hospital death). Variables associated with ward mortality in the multivariate analysis were predicted risk of death (OR 1.016), ICU readmission (OR 5.9), Sabadell score 1 (OR 4.7), Sabadell score 2 (OR 15.7), and Sabadell score 3 (OR 107.2). We confirm the ability of the Sabadell score at ICU discharge to define four groups of patients with very different likelihoods of hospital survival.

Comparison of the Framingham Risk Score, UKPDS Risk Engine, and SCORE for Predicting Carotid Atherosclerosis and Peripheral Arterial Disease in Korean Type 2 Diabetic Patients.

PubMed

Ahn, Hye-Ran; Shin, Min-Ho; Yun, Woo-Jun; Kim, Hye-Yeon; Lee, Young-Hoon; Kweon, Sun-Seog; Rhee, Jung-Ae; Choi, Jin-Su; Choi, Seong-Woo

2011-03-01

To compare the predictability of the Framingham Risk Score (FRS), United Kingdom Prospective Diabetes Study (UKPDS) risk engine, and the Systematic Coronary Risk Evaluation (SCORE) for carotid atherosclerosis and peripheral arterial disease in Korean type 2 diabetic patients. Among 1,275 registered type 2 diabetes patients in the health center, 621 subjects with type 2 diabetes participated in the study. Well-trained examiners measured the carotid intima-media thickness (IMT), carotid plaque, and ankle brachial index (ABI). The subject's 10-year risk of coronary heart disease was calculated according to the FRS, UKPDS, and SCORE risk scores. These three risk scores were compared to the areas under the curve (AUC). The odds ratios (ORs) of all risk scores increased as the quartiles increased for plaque, IMT, and ABI. For plaque and IMT, the UKPDS risk score provided the highest OR (95% confidence interval) at 3.82 (2.36, 6.17) and at 6.21 (3.37, 11.45). For ABI, the SCORE risk estimation provided the highest OR at 7.41 (3.20, 17.18). However, no significant difference was detected for plaque, IMT, or ABI (P = 0.839, 0.313, and 0.113, respectively) when the AUCs of the three risk scores were compared. When we graphed the Kernel density distribution of these three risk scores, UKPDS had a higher distribution than FRS and SCORE. No significant difference was observed when comparing the predictability of the FRS, UKPDS risk engine, and SCORE risk estimation for carotid atherosclerosis and peripheral arterial disease in Korean type 2 diabetic patients.

'Prostate Cancer Risk Calculator' mobile applications (Apps): a systematic review and scoring using the validated user version of the Mobile Application Rating Scale (uMARS).

PubMed

Adam, Ahmed; Hellig, Julian C; Perera, Marlon; Bolton, Damien; Lawrentschuk, Nathan

2018-04-01

The use of mobile phone applications (Apps) has modernised the conventional practice of medicine. The diagnostic ability of the current Apps in prostate specific antigen monitoring, and its diagnostic ability within prostate cancer (PCa) risk calculators have not yet been appraised. We aimed to review, rate and assess the everyday functionality, and utility of all the currently available PCa risk calculator Apps. A systematic search on iTunes, Google Play Store, Blackberry World and Windows Apps Store, was performed on 23/11/2017, using the search term 'prostate cancer risk calculator'. After applying the exclusion criteria, each App was individually assessed and rated using pre-set criteria and grading was performed using the validated uMARS scale. In total, 83 Apps were retrieved. After applying our exclusion criteria, only 9 Apps were relevant, with 2 duplicated, and the remaining 7 were suitable for critical review. Data sizes ranged from 414 kb to 10.1 Mb. The cost of the Apps ranged from South African rand (ZAR) 0.00 to ZAR 29.99. The overall mean category uMARS scores ranged from 2.8/5 to 4.5/5. Apps such as Rotterdam Prostate Cancer Risk Calculator, Coral-Prostate Cancer Nomogram Calculator and CPC Risk Calculator, performed the best. The current PCa risk calculator mobile Apps available may be beneficial in counselling the concerned at risk patient. These Apps have potential to assist both the patient and the urologist alike. The PCa risk calculator App 'predictability' may be further enhanced by the incorporation of newly validated risk factors and predictors for PCa.

Developing points-based risk-scoring systems in the presence of competing risks.

PubMed

Austin, Peter C; Lee, Douglas S; D'Agostino, Ralph B; Fine, Jason P

2016-09-30

Predicting the occurrence of an adverse event over time is an important issue in clinical medicine. Clinical prediction models and associated points-based risk-scoring systems are popular statistical methods for summarizing the relationship between a multivariable set of patient risk factors and the risk of the occurrence of an adverse event. Points-based risk-scoring systems are popular amongst physicians as they permit a rapid assessment of patient risk without the use of computers or other electronic devices. The use of such points-based risk-scoring systems facilitates evidence-based clinical decision making. There is a growing interest in cause-specific mortality and in non-fatal outcomes. However, when considering these types of outcomes, one must account for competing risks whose occurrence precludes the occurrence of the event of interest. We describe how points-based risk-scoring systems can be developed in the presence of competing events. We illustrate the application of these methods by developing risk-scoring systems for predicting cardiovascular mortality in patients hospitalized with acute myocardial infarction. Code in the R statistical programming language is provided for the implementation of the described methods. © 2016 The Authors. Statistics in Medicine published by John Wiley & Sons Ltd. © 2016 The Authors. Statistics in Medicine published by John Wiley & Sons Ltd.

Development of the SaFETy Score: A Clinical Screening Tool for Predicting Future Firearm Violence Risk

PubMed Central

Goldstick, Jason E.; Carter, Patrick M.; Walton, Maureen A.; Dahlberg, Linda L.; Sumner, Steven A.; Zimmerman, Marc A.; Cunningham, Rebecca M.

2017-01-01

Background Interpersonal firearm violence among youth is a substantial public health problem, and emergency department (ED) physicians require a clinical screening tool to identify high-risk youth. Objective To derive a clinically feasible risk index for firearm violence. Design 24-month prospective cohort study. Setting Urban, level 1 ED. Participants Substance-using youths, aged 14 to 24 years, seeking ED care for an assault-related injury and a proportionately sampled group of non–assault-injured youth enrolled from September 2009 through December 2011. Measurements Firearm violence (victimization/perpetration) and validated questionnaire items. Results A total of 599 youths were enrolled, and presence/absence of future firearm violence during follow-up could be ascertained in 483 (52.2% were positive). The sample was randomly split into training (75%) and post–score-construction validation (25%) sets. Using elastic-net penalized logistic regression, 118 baseline predictors were jointly analyzed; the most predictive variables fell predominantly into 4 domains: violence victimization, community exposure, peer influences, and fighting. By selection of 1 item from each domain, the 10-point SaFETy (Serious fighting, Friend weapon carrying, community Environment, and firearm Threats) score was derived. SaFETy was associated with firearm violence in the validation set (odds ratio [OR], 1.47 [95% CI, 1.23 to 1.79]); this association remained (OR, 1.44 [CI, 1.20 to 1.76]) after adjustment for reason for ED visit. In 5 risk strata observed in the training data, firearm violence rates in the validation set were 18.2% (2 of 11), 40.0% (18 of 45), 55.8% (24 of 43), 81.3% (13 of 16), and 100.0% (6 of 6), respectively. Limitations The study was conducted in a single ED and involved substance-using youths. SaFETy was not externally validated. Conclusion The SaFETy score is a 4-item score based on clinically feasible questionnaire items and is associated with firearm

A risk score for in-hospital death in patients admitted with ischemic or hemorrhagic stroke.

PubMed

Smith, Eric E; Shobha, Nandavar; Dai, David; Olson, DaiWai M; Reeves, Mathew J; Saver, Jeffrey L; Hernandez, Adrian F; Peterson, Eric D; Fonarow, Gregg C; Schwamm, Lee H

2013-01-28

We aimed to derive and validate a single risk score for predicting death from ischemic stroke (IS), intracerebral hemorrhage (ICH), and subarachnoid hemorrhage (SAH). Data from 333 865 stroke patients (IS, 82.4%; ICH, 11.2%; SAH, 2.6%; uncertain type, 3.8%) in the Get With The Guidelines-Stroke database were used. In-hospital mortality varied greatly according to stroke type (IS, 5.5%; ICH, 27.2%; SAH, 25.1%; unknown type, 6.0%; P<0.001). The patients were randomly divided into derivation (60%) and validation (40%) samples. Logistic regression was used to determine the independent predictors of mortality and to assign point scores for a prediction model in the overall population and in the subset with the National Institutes of Health Stroke Scale (NIHSS) recorded (37.1%). The c statistic, a measure of how well the models discriminate the risk of death, was 0.78 in the overall validation sample and 0.86 in the model including NIHSS. The model with NIHSS performed nearly as well in each stroke type as in the overall model including all types (c statistics for IS alone, 0.85; for ICH alone, 0.83; for SAH alone, 0.83; uncertain type alone, 0.86). The calibration of the model was excellent, as demonstrated by plots of observed versus predicted mortality. A single prediction score for all stroke types can be used to predict risk of in-hospital death following stroke admission. Incorporation of NIHSS information substantially improves this predictive accuracy.

Multicentre validation of the bedside paediatric early warning system score: a severity of illness score to detect evolving critical illness in hospitalised children

PubMed Central

2011-01-01

Introduction The timely provision of critical care to hospitalised patients at risk for cardiopulmonary arrest is contingent upon identification and referral by frontline providers. Current approaches require improvement. In a single-centre study, we developed the Bedside Paediatric Early Warning System (Bedside PEWS) score to identify patients at risk. The objective of this study was to validate the Bedside PEWS score in a large patient population at multiple hospitals. Methods We performed an international, multicentre, case-control study of children admitted to hospital inpatient units with no limitations on care. Case patients had experienced a clinical deterioration event involving either an immediate call to a resuscitation team or urgent admission to a paediatric intensive care unit. Control patients had no events. The scores ranged from 0 to 26 and were assessed in the 24 hours prior to the clinical deterioration event. Score performance was assessed using the area under the receiver operating characteristic (AUCROC) curve by comparison with the retrospective rating of nurses and the temporal progression of scores in case patients. Results A total of 2,074 patients were evaluated at 4 participating hospitals. The median (interquartile range) maximum Bedside PEWS scores for the 12 hours ending 1 hour before the clinical deterioration event were 8 (5 to 12) in case patients and 2 (1 to 4) in control patients (P < 0.0001). The AUCROC curve (95% confidence interval) was 0.87 (0.85 to 0.89). In case patients, mean scores were 5.3 at 20 to 24 hours and 8.4 at 0 to 4 hours before the event (P < 0.0001). The AUCROC curve (95% CI) of the retrospective nurse ratings was 0.83 (0.81 to 0.86). This was significantly lower than that of the Bedside PEWS score (P < 0.0001). Conclusions The Bedside PEWS score identified children at risk for cardiopulmonary arrest. Scores were elevated and continued to increase in the 24 hours before the clinical deterioration event

AFSS: athlete's foot severity score. A proposal and validation.

PubMed

Cohen, A D; Wolak, A; Alkan, M; Shalev, R; Vardy, D A

2002-04-01

We developed a simple scoring system to evaluate the severity of tinea pedis (Athlete's foot severity score, AFSS). The AFSS consists of a clinical evaluation, using a three-point scale, of erythema and scaling in the plantar and interdigital spaces of the feet, and counts of interdigital spaces involved. Each foot is evaluated separately. The validity of the AFSS was assessed in 224 soldiers of the Israel Defense Force using mycological cultures as the main outcome measure and subjective assessment of pruritus as the secondary outcome measure. Mycological examinations were performed in 106 patients who had clinical evidence of tinea pedis. AFSS was significantly associated with culture results (P<0.0001), as well as with the presence of pruritus (P=0.002), and pruritus scores (P=0.025). We conclude the AFSS is valid for the clinical evaluation of tinea pedis severity in military settings. The application of AFSS to civilian morbidity should be subjected to further evaluation. AFSS: Schweregrad-Beurteilung des Athletenfusses. Ein Vorschlag

French Multicenter Study Evaluating the Risk of Lymph Node Metastases in Early-Stage Endometrial Cancer: Contribution of a Risk Scoring System.

PubMed

Bendifallah, Sofiane; Canlorbe, Geoffroy; Arsène, Emmanuelle; Collinet, Pierre; Huguet, Florence; Coutant, Charles; Hudry, Delphine; Graesslin, Olivier; Raimond, Emilie; Touboul, Cyril; Daraï, Emile; Ballester, Marcos

2015-08-01

This study was designed to develop a risk scoring system (RSS) for predicting lymph node (LN) metastases in patients with early-stage endometrial cancer (EC). Data of 457 patients with early-stage EC who received primary surgical treatment between January 2001 and December 2012 were abstracted from a prospective, multicentre database (training set). A risk model based on factors impacting LN metastases was developed. To assess the discrimination of the RSS, both internal by the bootstrap approach and external validation (validation set) were adopted. Overall the LN metastasis rate was 11.8 % (54/457). LN metastases were associated with five variables: age ≥60 years, histological grade 3 and/or type 2, primary tumor diameter ≥1.5 cm, depth of myometrial invasion ≥50 %, and the positive lymphovascular space involvement status. These variables were included in the RSS and assigned scores ranging from 0 to 9. The discrimination of the RSS was 0.81 [95 % confidence interval (CI) 0.78-0.84] in the training set. The area under the curve of the receiver-operating characteristics for predicting LN metastases after internal and external validation was 0.80 (95 % CI 0.77-0.83) and 0.85 (95 % CI 0.81-0.89), respectively. A total score of 6 points corresponded to the optimal threshold of the RSS with a rate of LN metastases of 7.5 % (29/385) and 34.7 % (25/72) for low-risk (≤6 points) and high-risk patients (>6 points), respectively. At this threshold, the diagnostic accuracy was 83 %. This RSS could be useful in clinical practice to determine which patients with early-stage EC should benefit from secondary surgical staging including complete lymphadenectomy.

Evidence of Concurrent Validity of SII Scores for Asian American College Students

ERIC Educational Resources Information Center

Hansen, Jo-Ida C.; Lee, W. Vanessa

2007-01-01

The validity of scores on the Strong Interest Inventory (SII) for Asian American college students has not been thoroughly investigated. This study examined the evidence of validity of the SII Occupational Scale scores for predicting college major choices of Asian American women and men and White women and men. The sample included 186 female and…

Derivation and Validation of a New Cardiovascular Risk Score for People With Type 2 Diabetes

PubMed Central

Elley, C. Raina; Robinson, Elizabeth; Kenealy, Tim; Bramley, Dale; Drury, Paul L.

2010-01-01

OBJECTIVE To derive a 5-year cardiovascular disease (CVD) risk equation from usual-care data that is appropriate for people with type 2 diabetes from a wide range of ethnic groups, variable glycemic control, and high rates of albuminuria in New Zealand. RESEARCH DESIGN AND METHODS This prospective open-cohort study used primary-care data from 36,127 people with type 2 diabetes without previous CVD to derive a CVD equation using Cox proportional hazards regression models. Data from 12,626 people from a geographically different area were used for validation. Outcome measure was time to first fatal or nonfatal cardiovascular event, derived from national hospitalization and mortality records. Risk factors were age at diagnosis, diabetes duration, sex, systolic blood pressure, smoking status, total cholesterol–to–HDL ratio, ethnicity, glycated hemoglobin (A1C), and urine albumin-to-creatinine ratio. RESULTS Baseline median age was 59 years, 51% were women, 55% were of non-European ethnicity, and 33% had micro- or macroalbuminuria. Median follow-up was 3.9 years (141,169 person-years), including 10,030 individuals followed for at least 5 years. At total of 6,479 first cardiovascular events occurred during follow-up. The 5-year observed risk was 20.8% (95% CI 20.3–21.3). Risk increased with each 1% A1C (adjusted hazard ratio 1.06 [95% CI 1.05–1.08]), when macroalbuminuria was present (2.04 [1.89–2.21]), and in Indo-Asians (1.29 [1.14–1.46]) and Maori (1.23 [1.14–1.32]) compared with Europeans. The derived risk equations performed well on the validation cohort compared with other risk equations. CONCLUSIONS Renal function, ethnicity, and glycemic control contribute significantly to cardiovascular risk prediction. Population-appropriate risk equations can be derived from routinely collected data. PMID:20299482

An internally validated new clinical and inflammation-based prognostic score for patients with advanced hepatocellular carcinoma treated with sorafenib.

PubMed

Diaz-Beveridge, R; Bruixola, G; Lorente, D; Caballero, J; Rodrigo, E; Segura, Á; Akhoundova, D; Giménez, A; Aparicio, J

2018-03-01

Sorafenib is a standard treatment for patients (pts) with advanced hepatocellular carcinoma (aHCC), although the clinical benefit is heterogeneous between different pts groups. Among novel prognostic factors, a low baseline neutrophil-to-lymphocyte ratio (bNLR) and early-onset diarrhoea have been linked with a better prognosis. To identify prognostic factors in pts with aHCC treated with 1st-line sorafenib and to develop a new prognostic score to guide management. Retrospective review of 145 pts bNLR, overall toxicity, early toxicity rates and overall survival (OS) were assessed. Univariate and multivariate analysis of prognostic factors for OS was performed. The prognostic score was calculated from the coefficients found in the Cox analysis. ROC curves and pseudoR2 index were used for internal validation. Discrimination ability and calibration were tested by Harrel's c-index (HCI) and Akaike criteria (AIC). The optimal bNLR cut-off for the prediction of OS was 4 (AUC 0.62). Independent prognostic factors in multivariate analysis for OS were performance status (PS) (p < .0001), Child-Pugh (C-P) score (p = 0.005), early-onset diarrhoea (p = 0.006) and BNLR (0.011). The prognostic score based on these four variables was found efficient (HCI = 0.659; AIC = 1.180). Four risk groups for OS could be identified: a very low-risk (median OS = 48.6 months), a low-risk (median OS = 11.6 months), an intermediate-risk (median OS = 8.3 months) and a high-risk group (median OS = 4.4 months). PS and C-P score were the main prognostic factors for OS, followed by early-onset diarrhoea and bNLR. We identified four risk groups for OS depending on these parameters. This prognostic model could be useful for patient stratification, but an external validation is needed.

Derivation and Validation of a Renal Risk Score for People With Type 2 Diabetes

PubMed Central

Elley, C. Raina; Robinson, Tom; Moyes, Simon A.; Kenealy, Tim; Collins, John; Robinson, Elizabeth; Orr-Walker, Brandon; Drury, Paul L.

2013-01-01

OBJECTIVE Diabetes has become the leading cause of end-stage renal disease (ESRD). Renal risk stratification could assist in earlier identification and targeted prevention. This study aimed to derive risk models to predict ESRD events in type 2 diabetes in primary care. RESEARCH DESIGN AND METHODS The nationwide derivation cohort included adults with type 2 diabetes from the New Zealand Diabetes Cohort Study initially assessed during 2000–2006 and followed until December 2010, excluding those with pre-existing ESRD. The outcome was fatal or nonfatal ESRD event (peritoneal dialysis or hemodialysis for ESRD, renal transplantation, or death from ESRD). Risk models were developed using Cox proportional hazards models, and their performance was assessed in a separate validation cohort. RESULTS The derivation cohort included 25,736 individuals followed for up to 11 years (180,497 person-years; 86% followed for ≥5 years). At baseline, mean age was 62 years, median diabetes duration 5 years, and median HbA1c 7.2% (55 mmol/mol); 37% had albuminuria; and median estimated glomerular filtration rate (eGFR) was 77 mL/min/1.73 m2. There were 637 ESRD events (2.5%) during follow-up. Models that included sex, ethnicity, age, diabetes duration, albuminuria, serum creatinine, systolic blood pressure, HbA1c, smoking status, and previous cardiovascular disease status performed well with good discrimination and calibration in the derivation cohort and the validation cohort (n = 5,877) (C-statistics 0.89–0.92), improving predictive performance compared with previous models. CONCLUSIONS These 5-year renal risk models performed very well in two large primary care populations with type 2 diabetes. More accurate risk stratification could facilitate earlier intervention than using eGFR and/or albuminuria alone. PMID:23801726

Validity of the Microcomputer Evaluation Screening and Assessment Aptitude Scores.

ERIC Educational Resources Information Center

Janikowski, Timothy P.; And Others

1991-01-01

Examined validity of Microcomputer Evaluation Screening and Assessment (MESA) aptitude scores relative to General Aptitude Test Battery (GATB) using multitrait-multimethod correlational analyses. Findings from 54 rehabilitation clients and 29 displaced workers revealed no evidence to support the construct validity of the MESA. (Author/NB)

Validation of an automatically generated screening score for frailty: the care assessment need (CAN) score.

PubMed

Ruiz, Jorge G; Priyadarshni, Shivani; Rahaman, Zubair; Cabrera, Kimberly; Dang, Stuti; Valencia, Willy M; Mintzer, Michael J

2018-05-04

Frailty is a state of vulnerability to stressors that is prevalent in older adults and is associated with higher morbidity, mortality and healthcare utilization. Multiple instruments are used to measure frailty; most are time-consuming. The Care Assessment Need (CAN) score is automatically generated from electronic health record data using a statistical model. The methodology for calculation of the CAN score is consistent with the deficit accumulation model of frailty. At a 95 percentile, the CAN score is a predictor of hospitalization and mortality in Veteran populations. The purpose of this study was to validate the CAN score as a screening tool for frailty in primary care. This is a cross-sectional, validation study compared the CAN score with a 40-item Frailty Index reference standard based on a comprehensive geriatric assessment. We included community-dwelling male patients over age 65 from an outpatient geriatric medicine clinic. We calculated the sensitivity, specificity, positive predictive value, negative predictive value and diagnostic accuracy of the CAN score. 184 patients over age 65 were included in the study: 97.3% male, 64.2% White, 80.9% non-Hispanic. The CGA-based Frailty Index defined 14.1% as robust, 53.3% as prefrail and 32.6% as frail. For the frail, statistical analysis demonstrated that a CAN score of 55 provides sensitivity, specificity, PPV and NPV of 91.67, 40.32, 42.64 and 90.91% respectively whereas at a score of 95 the sensitivity, specificity, PPV and NPV were 43.33, 88.81, 63.41, 77.78% respectively. Area under the receiver operating characteristics curve was 0.736 (95% CI = .661-.811). CAN score is a potential screening tool for frailty among older adults; it is generated automatically and provides acceptable diagnostic accuracy. Hence, the CAN score may be a useful tool to primary care providers for detection of frailty in their patient panels.

Derivation, Validation and Application of a Pragmatic Risk Prediction Index for Benchmarking of Surgical Outcomes.

PubMed

Spence, Richard T; Chang, David C; Kaafarani, Haytham M A; Panieri, Eugenio; Anderson, Geoffrey A; Hutter, Matthew M

2018-02-01

Despite the existence of multiple validated risk assessment and quality benchmarking tools in surgery, their utility outside of high-income countries is limited. We sought to derive, validate and apply a scoring system that is both (1) feasible, and (2) reliably predicts mortality in a middle-income country (MIC) context. A 5-step methodology was used: (1) development of a de novo surgical outcomes database modeled around the American College of Surgeons' National Surgical Quality Improvement Program (ACS-NSQIP) in South Africa (SA dataset), (2) use of the resultant data to identify all predictors of in-hospital death with more than 90% capture indicating feasibility of collection, (3) use these predictors to derive and validate an integer-based score that reliably predicts in-hospital death in the 2012 ACS-NSQIP, (4) apply the score in the original SA dataset and demonstrate its performance, (5) identify threshold cutoffs of the score to prompt action and drive quality improvement. Following step one-three above, the 13 point Codman's score was derived and validated on 211,737 and 109,079 patients, respectively, and includes: age 65 (1), partially or completely dependent functional status (1), preoperative transfusions ≥4 units (1), emergency operation (2), sepsis or septic shock (2) American Society of Anesthesia score ≥3 (3) and operative procedure (1-3). Application of the score to 373 patients in the SA dataset showed good discrimination and calibration to predict an in-hospital death. A Codman Score of 8 is an optimal cutoff point for defining expected and unexpected deaths. We have designed a novel risk prediction score specific for a MIC context. The Codman Score can prove useful for both (1) preoperative decision-making and (2) benchmarking the quality of surgical care in MIC's.

Clinical Validity, Understandability, and Actionability of Online Cardiovascular Disease Risk Calculators: Systematic Review.

PubMed

Bonner, Carissa; Fajardo, Michael Anthony; Hui, Samuel; Stubbs, Renee; Trevena, Lyndal

2018-02-01

Online health information is particularly important for cardiovascular disease (CVD) prevention, where lifestyle changes are recommended until risk becomes high enough to warrant pharmacological intervention. Online information is abundant, but the quality is often poor and many people do not have adequate health literacy to access, understand, and use it effectively. This project aimed to review and evaluate the suitability of online CVD risk calculators for use by low health literate consumers in terms of clinical validity, understandability, and actionability. This systematic review of public websites from August to November 2016 used evaluation of clinical validity based on a high-risk patient profile and assessment of understandability and actionability using Patient Education Material Evaluation Tool for Print Materials. A total of 67 unique webpages and 73 unique CVD risk calculators were identified. The same high-risk patient profile produced widely variable CVD risk estimates, ranging from as little as 3% to as high as a 43% risk of a CVD event over the next 10 years. One-quarter (25%) of risk calculators did not specify what model these estimates were based on. The most common clinical model was Framingham (44%), and most calculators (77%) provided a 10-year CVD risk estimate. The calculators scored moderately on understandability (mean score 64%) and poorly on actionability (mean score 19%). The absolute percentage risk was stated in most (but not all) calculators (79%), and only 18% included graphical formats consistent with recommended risk communication guidelines. There is a plethora of online CVD risk calculators available, but they are not readily understandable and their actionability is poor. Entering the same clinical information produces widely varying results with little explanation. Developers need to address actionability as well as clinical validity and understandability to improve usefulness to consumers with low health literacy. �

Cardiac risk stratification: Role of the coronary calcium score

PubMed Central

Sharma, Rakesh K; Sharma, Rajiv K; Voelker, Donald J; Singh, Vibhuti N; Pahuja, Deepak; Nash, Teresa; Reddy, Hanumanth K

2010-01-01

Coronary artery calcium (CAC) is an integral part of atherosclerotic coronary heart disease (CHD). CHD is the leading cause of death in industrialized nations and there is a constant effort to develop preventative strategies. The emphasis is on risk stratification and primary risk prevention in asymptomatic patients to decrease cardiovascular mortality and morbidity. The Framingham Risk Score predicts CHD events only moderately well where family history is not included as a risk factor. There has been an exploration for new tests for better risk stratification and risk factor modification. While the Framingham Risk Score, European Systematic Coronary Risk Evaluation Project, and European Prospective Cardiovascular Munster study remain excellent tools for risk factor modification, the CAC score may have additional benefit in risk assessment. There have been several studies supporting the role of CAC score for prediction of myocardial infarction and cardiovascular mortality. It has been shown to have great scope in risk stratification of asymptomatic patients in the emergency room. Additionally, it may help in assessment of progression or regression of coronary artery disease. Furthermore, the CAC score may help differentiate ischemic from nonischemic cardiomyopathy. PMID:20730016

The development and validation of a scoring tool to predict the operative duration of elective laparoscopic cholecystectomy.

PubMed

Bharamgoudar, Reshma; Sonsale, Aniket; Hodson, James; Griffiths, Ewen

2018-07-01

The ability to accurately predict operative duration has the potential to optimise theatre efficiency and utilisation, thus reducing costs and increasing staff and patient satisfaction. With laparoscopic cholecystectomy being one of the most commonly performed procedures worldwide, a tool to predict operative duration could be extremely beneficial to healthcare organisations. Data collected from the CholeS study on patients undergoing cholecystectomy in UK and Irish hospitals between 04/2014 and 05/2014 were used to study operative duration. A multivariable binary logistic regression model was produced in order to identify significant independent predictors of long (> 90 min) operations. The resulting model was converted to a risk score, which was subsequently validated on second cohort of patients using ROC curves. After exclusions, data were available for 7227 patients in the derivation (CholeS) cohort. The median operative duration was 60 min (interquartile range 45-85), with 17.7% of operations lasting longer than 90 min. Ten factors were found to be significant independent predictors of operative durations > 90 min, including ASA, age, previous surgical admissions, BMI, gallbladder wall thickness and CBD diameter. A risk score was then produced from these factors, and applied to a cohort of 2405 patients from a tertiary centre for external validation. This returned an area under the ROC curve of 0.708 (SE = 0.013, p < 0.001), with the proportions of operations lasting > 90 min increasing more than eightfold from 5.1 to 41.8% in the extremes of the score. The scoring tool produced in this study was found to be significantly predictive of long operative durations on validation in an external cohort. As such, the tool may have the potential to enable organisations to better organise theatre lists and deliver greater efficiencies in care.

Development and validation of a prognostic score to predict mortality in patients with acute-on-chronic liver failure.

PubMed

Jalan, Rajiv; Saliba, Faouzi; Pavesi, Marco; Amoros, Alex; Moreau, Richard; Ginès, Pere; Levesque, Eric; Durand, Francois; Angeli, Paolo; Caraceni, Paolo; Hopf, Corinna; Alessandria, Carlo; Rodriguez, Ezequiel; Solis-Muñoz, Pablo; Laleman, Wim; Trebicka, Jonel; Zeuzem, Stefan; Gustot, Thierry; Mookerjee, Rajeshwar; Elkrief, Laure; Soriano, German; Cordoba, Joan; Morando, Filippo; Gerbes, Alexander; Agarwal, Banwari; Samuel, Didier; Bernardi, Mauro; Arroyo, Vicente

2014-11-01

Acute-on-chronic liver failure (ACLF) is a frequent syndrome (30% prevalence), characterized by acute decompensation of cirrhosis, organ failure(s) and high short-term mortality. This study develops and validates a specific prognostic score for ACLF patients. Data from 1349 patients included in the CANONIC study were used. First, a simplified organ function scoring system (CLIF Consortium Organ Failure score, CLIF-C OFs) was developed to diagnose ACLF using data from all patients. Subsequently, in 275 patients with ACLF, CLIF-C OFs and two other independent predictors of mortality (age and white blood cell count) were combined to develop a specific prognostic score for ACLF (CLIF Consortium ACLF score [CLIF-C ACLFs]). A concordance index (C-index) was used to compare the discrimination abilities of CLIF-C ACLF, MELD, MELD-sodium (MELD-Na), and Child-Pugh (CPs) scores. The CLIF-C ACLFs was validated in an external cohort and assessed for sequential use. The CLIF-C ACLFs showed a significantly higher predictive accuracy than MELDs, MELD-Nas, and CPs, reducing (19-28%) the corresponding prediction error rates at all main time points after ACLF diagnosis (28, 90, 180, and 365 days) in both the CANONIC and the external validation cohort. CLIF-C ACLFs computed at 48 h, 3-7 days, and 8-15 days after ACLF diagnosis predicted the 28-day mortality significantly better than at diagnosis. The CLIF-C ACLFs at ACLF diagnosis is superior to the MELDs and MELD-Nas in predicting mortality. The CLIF-C ACLFs is a clinically relevant, validated scoring system that can be used sequentially to stratify the risk of mortality in ACLF patients. Copyright © 2014 European Association for the Study of the Liver. Published by Elsevier B.V. All rights reserved.

Predictive accuracy of combined genetic and environmental risk scores.

PubMed

Dudbridge, Frank; Pashayan, Nora; Yang, Jian

2018-02-01

The substantial heritability of most complex diseases suggests that genetic data could provide useful risk prediction. To date the performance of genetic risk scores has fallen short of the potential implied by heritability, but this can be explained by insufficient sample sizes for estimating highly polygenic models. When risk predictors already exist based on environment or lifestyle, two key questions are to what extent can they be improved by adding genetic information, and what is the ultimate potential of combined genetic and environmental risk scores? Here, we extend previous work on the predictive accuracy of polygenic scores to allow for an environmental score that may be correlated with the polygenic score, for example when the environmental factors mediate the genetic risk. We derive common measures of predictive accuracy and improvement as functions of the training sample size, chip heritabilities of disease and environmental score, and genetic correlation between disease and environmental risk factors. We consider simple addition of the two scores and a weighted sum that accounts for their correlation. Using examples from studies of cardiovascular disease and breast cancer, we show that improvements in discrimination are generally small but reasonable degrees of reclassification could be obtained with current sample sizes. Correlation between genetic and environmental scores has only minor effects on numerical results in realistic scenarios. In the longer term, as the accuracy of polygenic scores improves they will come to dominate the predictive accuracy compared to environmental scores. © 2017 WILEY PERIODICALS, INC.

Predictive accuracy of combined genetic and environmental risk scores

PubMed Central

Pashayan, Nora; Yang, Jian

2017-01-01

ABSTRACT The substantial heritability of most complex diseases suggests that genetic data could provide useful risk prediction. To date the performance of genetic risk scores has fallen short of the potential implied by heritability, but this can be explained by insufficient sample sizes for estimating highly polygenic models. When risk predictors already exist based on environment or lifestyle, two key questions are to what extent can they be improved by adding genetic information, and what is the ultimate potential of combined genetic and environmental risk scores? Here, we extend previous work on the predictive accuracy of polygenic scores to allow for an environmental score that may be correlated with the polygenic score, for example when the environmental factors mediate the genetic risk. We derive common measures of predictive accuracy and improvement as functions of the training sample size, chip heritabilities of disease and environmental score, and genetic correlation between disease and environmental risk factors. We consider simple addition of the two scores and a weighted sum that accounts for their correlation. Using examples from studies of cardiovascular disease and breast cancer, we show that improvements in discrimination are generally small but reasonable degrees of reclassification could be obtained with current sample sizes. Correlation between genetic and environmental scores has only minor effects on numerical results in realistic scenarios. In the longer term, as the accuracy of polygenic scores improves they will come to dominate the predictive accuracy compared to environmental scores. PMID:29178508

Predicting Long-term Ischemic Events Using Routine Clinical Parameters in Patients with Coronary Artery Disease: The OPT-CAD Risk Score.

PubMed

Han, Yaling; Chen, Jiyan; Qiu, Miaohan; Li, Yi; Li, Jing; Feng, Yingqing; Qiu, Jian; Meng, Liang; Sun, Yihong; Tao, Guizhou; Wu, Zhaohui; Yang, Chunyu; Guo, Jincheng; Pu, Kui; Chen, Shaoliang; Wang, Xiaozeng

2018-06-05

The prognosis of patients with coronary artery disease (CAD) at hospital discharge was constantly varying, and post-discharge risk of ischemic events remain a concern. However, risk prediction tools to identify risk of ischemia for these patients has not yet been reported. We sought to develop a scoring system for predicting long-term ischemic events in CAD patients receiving antiplatelet therapy that would be beneficial in appropriate personalized decision-making for these patients. In this prospective Optimal antiPlatelet Therapy for Chinese patients with Coronary Artery Disease (OPT-CAD, NCT01735305) registry, a total of 14,032 patients with CAD receiving at least one kind of antiplatelet agent were enrolled from 107 centers across China, from January 2012 to March 2014. The risk scoring system was developed in a derivation cohort (enrolled initially 10,000 patients in the database) using a logistic regression model and was subsequently tested in a validation cohort (the last 4,032 patients). Points in risk score was assigned based on the multivariable odds ratio of each factor. Ischemic events were defined as the composite of cardiac death, myocardial infarction or stroke. Ischemic events occurred in 342 (3.4%) patients in the derivation cohort and 160 (4.0%) patients in the validation cohort during 1-year follow-up. The OPT-CAD score, ranging from 0-257 points, consist of 10 independent risk factors, including age (0-71 points), heart rates (0-36 points), hypertension (0-20 points), prior myocardial infarction (16 points), prior stroke (16 points), renal insufficient (21 points), anemia (19 points), low ejection fraction (22 points), positive cardiac troponin (23 points) and ST-segment deviation (13 points). In predicting 1-year ischemic events, the area under receiver operating characteristics curve were 0.73 and 0.72 in derivation and validation cohort, respectively. The incidences of ischemic events in low- (0-90 points), medium- (91-150 points) and

Application of the FOUR Score in Intracerebral Hemorrhage Risk Analysis.

PubMed

Braksick, Sherri A; Hemphill, J Claude; Mandrekar, Jay; Wijdicks, Eelco F M; Fugate, Jennifer E

2018-06-01

The Full Outline of Unresponsiveness (FOUR) Score is a validated scale describing the essentials of a coma examination, including motor response, eye opening and eye movements, brainstem reflexes, and respiratory pattern. We incorporated the FOUR Score into the existing ICH Score and evaluated its accuracy of risk assessment in spontaneous intracerebral hemorrhage (ICH). Consecutive patients admitted to our institution from 2009 to 2012 with spontaneous ICH were reviewed. The ICH Score was calculated using patient age, hemorrhage location, hemorrhage volume, evidence of intraventricular extension, and Glasgow Coma Scale (GCS). The FOUR Score was then incorporated into the ICH Score as a substitute for the GCS (ICH Score FS ). The ability of the 2 scores to predict mortality at 1 month was then compared. In total, 274 patients met the inclusion criteria. The median age was 73 years (interquartile range 60-82) and 138 (50.4%) were male. Overall mortality at 1 month was 28.8% (n = 79). The area under the receiver operating characteristic curve was .91 for the ICH Score and .89 for the ICH Score FS . For ICH Scores of 1, 2, 3, 4, and 5, 1-month mortality was 4.2%, 29.9%, 62.5%, 95.0%, and 100%. In the ICH Score FS model, mortality was 10.7%, 26.5%, 64.5%, 88.9%, and 100% for scores of 1, 2, 3, 4, and 5, respectively. The ICH Score and the ICH Score FS predict 1-month mortality with comparable accuracy. As the FOUR Score provides additional clinical information regarding patient status, it may be a reasonable substitute for the GCS into the ICH Score. Copyright © 2018 National Stroke Association. Published by Elsevier Inc. All rights reserved.

The Validity of IQ Scores Derived from Readiness Screening Tests

ERIC Educational Resources Information Center

Telegdy, Gabriel A.

1976-01-01

The Screening Test of Academic Readiness (STAR) and the Peabody Picture Vocabulary Test (PPVT) were administered to 52 kindergarten children to reveal the convergent validity of IQ scores derived from the STAR. The findings raise doubts about the validity of the deviation IQs derived from the STAR. (Author)

Predicting death from kala-azar: construction, development, and validation of a score set and accompanying software.

PubMed

Costa, Dorcas Lamounier; Rocha, Regina Lunardi; Chaves, Eldo de Brito Ferreira; Batista, Vivianny Gonçalves de Vasconcelos; Costa, Henrique Lamounier; Costa, Carlos Henrique Nery

2016-01-01

Early identification of patients at higher risk of progressing to severe disease and death is crucial for implementing therapeutic and preventive measures; this could reduce the morbidity and mortality from kala-azar. We describe a score set composed of four scales in addition to software for quick assessment of the probability of death from kala-azar at the point of care. Data from 883 patients diagnosed between September 2005 and August 2008 were used to derive the score set, and data from 1,031 patients diagnosed between September 2008 and November 2013 were used to validate the models. Stepwise logistic regression analyses were used to derive the optimal multivariate prediction models. Model performance was assessed by its discriminatory accuracy. A computational specialist system (Kala-Cal(r)) was developed to speed up the calculation of the probability of death based on clinical scores. The clinical prediction score showed high discrimination (area under the curve [AUC] 0.90) for distinguishing death from survival for children ≤2 years old. Performance improved after adding laboratory variables (AUC 0.93). The clinical score showed equivalent discrimination (AUC 0.89) for older children and adults, which also improved after including laboratory data (AUC 0.92). The score set also showed a high, although lower, discrimination when applied to the validation cohort. This score set and Kala-Cal(r) software may help identify individuals with the greatest probability of death. The associated software may speed up the calculation of the probability of death based on clinical scores and assist physicians in decision-making.

Validation of risk stratification for children with febrile neutropenia in a pediatric oncology unit in India.

PubMed

Das, Anirban; Trehan, Amita; Oberoi, Sapna; Bansal, Deepak

2017-06-01

The study aims to validate a score predicting risk of complications in pediatric patients with chemotherapy-related febrile neutropenia (FN) and evaluate the performance of previously published models for risk stratification. Children diagnosed with cancer and presenting with FN were evaluated in a prospective single-center study. A score predicting the risk of complications, previously derived in the unit, was validated on a prospective cohort. Performance of six predictive models published from geographically distinct settings was assessed on the same cohort. Complications were observed in 109 (26.3%) of 414 episodes of FN over 15 months. A risk score based on undernutrition (two points), time from last chemotherapy (<7 days = two points), presence of a nonupper respiratory focus of infection (two points), C-reactive protein (>60 mg/l = five points), and absolute neutrophil count (<100 per μl = two points) was used to stratify patients into "low risk" (score <7, n = 208) and assessed using the following parameters: overall performance (Nagelkerke R 2 = 34.4%), calibration (calibration slope = 0.39; P = 0.25 in Hosmer-Lemeshow test), discrimination (c-statistic = 0.81), overall sensitivity (86%), negative predictive value (93%), and clinical net benefit (0.43). Six previously published rules demonstrated inferior performance in this cohort. An indigenous decision rule using five simple predefined variables was successful in identifying children at risk for complications. Prediction models derived in developed nations may not be appropriate for low-middle-income settings and need to be validated before use. © 2016 Wiley Periodicals, Inc.

Association of a Dietary Score with Incident Type 2 Diabetes: The Dietary-Based Diabetes-Risk Score (DDS)

PubMed Central

Dominguez, Ligia J.; Bes-Rastrollo, Maira; Basterra-Gortari, Francisco Javier; Gea, Alfredo; Barbagallo, Mario; Martínez-González, Miguel A.

2015-01-01

Background Strong evidence supports that dietary modifications may decrease incident type 2 diabetes mellitus (T2DM). Numerous diabetes risk models/scores have been developed, but most do not rely specifically on dietary variables or do not fully capture the overall dietary pattern. We prospectively assessed the association of a dietary-based diabetes-risk score (DDS), which integrates optimal food patterns, with the risk of developing T2DM in the SUN (“Seguimiento Universidad de Navarra”) longitudinal study. Methods We assessed 17,292 participants initially free of diabetes, followed-up for a mean of 9.2 years. A validated 136-item FFQ was administered at baseline. Taking into account previous literature, the DDS positively weighted vegetables, fruit, whole cereals, nuts, coffee, low-fat dairy, fiber, PUFA, and alcohol in moderate amounts; while it negatively weighted red meat, processed meats and sugar-sweetened beverages. Energy-adjusted quintiles of each item (with exception of moderate alcohol consumption that received either 0 or 5 points) were used to build the DDS (maximum: 60 points). Incident T2DM was confirmed through additional detailed questionnaires and review of medical records of participants. We used Cox proportional hazards models adjusted for socio-demographic and anthropometric parameters, health-related habits, and clinical variables to estimate hazard ratios (HR) of T2DM. Results We observed 143 T2DM confirmed cases during follow-up. Better baseline conformity with the DDS was associated with lower incidence of T2DM (multivariable-adjusted HR for intermediate (25–39 points) vs. low (11–24) category 0.43 [95% confidence interval (CI) 0.21, 0.89]; and for high (40–60) vs. low category 0.32 [95% CI: 0.14, 0.69]; p for linear trend: 0.019). Conclusions The DDS, a simple score exclusively based on dietary components, showed a strong inverse association with incident T2DM. This score may be applicable in clinical practice to improve

Concurrent validity and reliability of the Alberta Infant Motor Scale in infants at dual risk for motor delays.

PubMed

Snyder, Patricia; Eason, Jane M; Philibert, Darbi; Ridgway, Andrea; McCaughey, Tiffany

2008-01-01

Concurrent validity of scores for the Alberta Infant Motor Scale (AIMS) and the Peabody Developmental Gross Motor Scale-2 (PDGMS-2) was examined with a sample of 35 infants at dual risk for motor delays or disabilities. Dual risk was defined as low birthweight (risk (children from low-income families). Measures were administered to participants during one visit to a high-risk, follow-up program. Pearson product-moment correlation coefficients were high (r= .90 to .97), with the highest correlation between PDGMS-2 locomotion subscale and AIMS total score. Correlation coefficients were lower for infants > 9 months of age. Novice examiners' scores on both measures closely approximated those of experienced examiners (ICC range = .98 to .99). The results support concurrent validity of the AIMS and PDGMS-2 for infants at dual risk and have implications for using the AIMS in high-risk follow-up programs, particularly in relation to evaluating functional components of motor performance and ease of administration.

Use of disease risk scores in pharmacoepidemiologic studies.

PubMed

Arbogast, Patrick G; Ray, Wayne A

2009-02-01

Automated databases are increasingly used in pharmacoepidemiologic studies. These databases include records of prescribed medications and encounters with medical care providers from which one can construct very detailed surrogate measures for both drug exposure and covariates that are potential confounders. Often it is possible to track day-by-day changes in these variables. However, while this information is often critical for study success, its volume can pose challenges for statistical analysis. One common approach is the use of propensity scores. An alternative approach is to construct a disease risk score. This is analogous to the propensity score in that it calculates a summary measure from the covariates. However, the disease risk score estimates the probability or rate of disease occurrence conditional on being unexposed. The association between exposure and disease is then estimated adjusting for the disease risk score in place of the individual covariates. This review describes the use of disease risk scores in pharmacoepidemiologic studies, and includes a brief discussion of their history, a more detailed description of their construction and use, a summary of simulation studies comparing their performance vis-á-vis traditional models, a comparison of their utility with that of propensity scores, and some further topics for future research.

Clinical score to predict the risk of bile leakage after liver resection.

PubMed

Kajiwara, Takahiro; Midorikawa, Yutaka; Yamazaki, Shintaro; Higaki, Tokio; Nakayama, Hisashi; Moriguchi, Masamichi; Tsuji, Shingo; Takayama, Tadatoshi

2016-05-06

In liver resection, bile leakage remains the most common cause of operative morbidity. In order to predict the risk of this complication on the basis of various factors, we developed a clinical score system to predict the potential risk of bile leakage after liver resection. We analyzed the postoperative course in 518 patients who underwent liver resection for malignancy to identify independent predictors of bile leakage, which was defined as "a drain fluid bilirubin concentration at least three times the serum bilirubin concentration on or after postoperative day 3," as proposed by the International Study Group of Liver Surgery. To confirm the robustness of the risk score system for bile leakage, we analyzed the independent series of 289 patients undergoing liver resection for malignancy. Among 81 (15.6 %) patients with bile leakage, 76 had grade A bile leakage, and five had grade C leakage and underwent reoperation. The median postoperative hospital stay was significantly longer in patients with bile leakage (median, 14 days; range, 8 to 34) than in those without bile leakage (11 days; 5 to 62; P = 0.001). There was no hepatic insufficiency or in-hospital death. The risk score model was based on the four independent predictors of postoperative bile leakage: non-anatomical resection (odds ratio, 3.16; 95 % confidence interval [CI], 1.72 to 6.07; P < 0.001), indocyanine green clearance rate (2.43; 1.32 to 7.76; P = 0.004), albumin level (2.29; 1.23 to 4.22; P = 0.01), and weight of resected specimen (1.97; 1.11 to 3.51; P = 0.02). When this risk score system was used to assign patients to low-, middle-, and high-risk groups, the frequency of bile leakage in the high-risk group was 2.64 (95 % CI, 1.12 to 6.41; P = 0.04) than that in the low-risk group. Among the independent series for validation, 4 (5.7 %), 16 (10.0 %), and 10 (16.6 %) patients in low-, middle, and high-risk groups were given a diagnosis of bile leakage after

Value of adding the renal pathological score to the kidney failure risk equation in advanced diabetic nephropathy.

PubMed

Yamanouchi, Masayuki; Hoshino, Junichi; Ubara, Yoshifumi; Takaichi, Kenmei; Kinowaki, Keiichi; Fujii, Takeshi; Ohashi, Kenichi; Mise, Koki; Toyama, Tadashi; Hara, Akinori; Kitagawa, Kiyoki; Shimizu, Miho; Furuichi, Kengo; Wada, Takashi

2018-01-01

There have been a limited number of biopsy-based studies on diabetic nephropathy, and therefore the clinical importance of renal biopsy in patients with diabetes in late-stage chronic kidney disease (CKD) is still debated. We aimed to clarify the renal prognostic value of pathological information to clinical information in patients with diabetes and advanced CKD. We retrospectively assessed 493 type 2 diabetics with biopsy-proven diabetic nephropathy in four centers in Japan. 296 patients with stage 3-5 CKD at the time of biopsy were identified and assigned two risk prediction scores for end-stage renal disease (ESRD): the Kidney Failure Risk Equation (KFRE, a score composed of clinical parameters) and the Diabetic Nephropathy Score (D-score, a score integrated pathological parameters of the Diabetic Nephropathy Classification by the Renal Pathology Society (RPS DN Classification)). They were randomized 2:1 to development and validation cohort. Hazard Ratios (HR) of incident ESRD were reported with 95% confidence interval (CI) of the KFRE, D-score and KFRE+D-score in Cox regression model. Improvement of risk prediction with the addition of D-score to the KFRE was assessed using c-statistics, continuous net reclassification improvement (NRI), and integrated discrimination improvement (IDI). During median follow-up of 1.9 years, 194 patients developed ESRD. The cox regression analysis showed that the KFRE,D-score and KFRE+D-score were significant predictors of ESRD both in the development cohort and in the validation cohort. The c-statistics of the D-score was 0.67. The c-statistics of the KFRE was good, but its predictive value was weaker than that in the miscellaneous CKD cohort originally reported (c-statistics, 0.78 vs. 0.90) and was not significantly improved by adding the D-score (0.78 vs. 0.79, p = 0.83). Only continuous NRI was positive after adding the D-score to the KFRE (0.4%; CI: 0.0-0.8%). We found that the predict values of the KFRE and the D-score were

The first Latin-American risk stratification system for cardiac surgery: can be used as a graphic pocket-card score.

PubMed

Carosella, Victorio C; Navia, Jose L; Al-Ruzzeh, Sharif; Grancelli, Hugo; Rodriguez, Walter; Cardenas, Cesar; Bilbao, Jorge; Nojek, Carlos

2009-08-01

This study aims to develop the first Latin-American risk model that can be used as a simple, pocket-card graphic score at bedside. The risk model was developed on 2903 patients who underwent cardiac surgery at the Spanish Hospital of Buenos Aires, Argentina, between June 1994 and December 1999. Internal validation was performed on 708 patients between January 2000 and June 2001 at the same center. External validation was performed on 1087 patients between February 2000 and January 2007 at three other centers in Argentina. In the development dataset the area under receiver operating characteristics (ROC) curve was 0.73 and the Hosmer-Lemeshow (HL) test was P=0.88. In the internal validation ROC curve was 0.77. In the external validation ROC curve was 0.81, but imperfect calibration was detected because the observed in-hospital mortality (3.96%) was significantly lower than the development dataset (8.20%) (P<0.0001). Recalibration was done in 2007, showing excellent level of agreement between the observed and predicted mortality rates on all patients (P=0.92). This is the first risk model for cardiac surgery developed in a population of Latin-America with both internal and external validation. A simple graphic pocket-card score allows an easy bedside application with acceptable statistic precision.

Validity of Childhood Career Development Scale Scores in South Africa

ERIC Educational Resources Information Center

Stead, Graham B.; Schultheiss, Donna E. Palladino

2010-01-01

The purpose of this study was to provide evidence of the construct and concurrent validity of the Childhood Career Development Scale's (CCDS) scores among South African primary school children. Using a sample of 808 children in grades four through seven, evidence for the CCDS's construct validity was provided using confirmatory factor analysis,…

Validating MMI Scores: Are We Measuring Multiple Attributes?

ERIC Educational Resources Information Center

Oliver, Tom; Hecker, Kent; Hausdorf, Peter A.; Conlon, Peter

2014-01-01

The multiple mini-interview (MMI) used in health professional schools' admission processes is reported to assess multiple non-cognitive constructs such as ethical reasoning, oral communication, or problem evaluation. Though validation studies have been performed with total MMI scores, there is a paucity of information regarding how well MMI…

[Development and validation of the Visual Analogue Scale (VAS) Spine Score].

PubMed

Knop, C; Oeser, M; Bastian, L; Lange, U; Zdichavsky, M; Blauth, M

2001-06-01

The aim of the study was the development and validation of a new subjective rating scale for assessment of outcome in patients with thoracolumbar fractures and fracture dislocations. The VAS spine score consists of 19 score items, using 100-mm visual analogue scales. The items are answered by the patients independently of rater assessment. To measure the analogue scales and calculate the score, a computer-aided system was evolved consisting of self-developed software and digitizer board. The overall score is the mean of all items answered with values between 0 and 100. The individual score loss is calculated as the difference between the preinjury score and at follow-up with values between 0 and 100. The VAS spine score was tested for reliability with a group of 136 healthy volunteers. We performed a test-retest study with an interval of 24 h. For statistical analysis of the validity, we prospectively followed a group of 53 patients with the new outcome score. We chose patients with injuries of the thoracolumbar spine, all having been operatively treated by combined posterior-anterior stabilization and fusion between 1994 and 1996. In the reference group, the average test score was 91.95 (58-100) and 92.10 (58-100) at retest. The mean individual difference between test and retest scored 1.037 (0-8). A high reliability was proved by a strong correlation with a coefficient of 0.976 (p < 0.001). A high internal consistency of the VAS spine score was shown by a Cronbach-alpha of 0.9117. The mean score for the preinjury status of the patients was comparable to the reference group, amounting to 89.60 (21-100). The mean score at the time of implant removal was significantly (p < 0.001) decreased to 58.25 (13-97). Until the time of follow-up a significant (p < 0.001) increase was noted, and the group scored 66.08 (15-100) at follow-up. This was a significant (p < 0.001) difference compared with the preinjury status. The individual score loss averaged 24.1 (0-80). In the

External validation of scoring instruments for evaluating pediatric resuscitation.

PubMed

Levy, Arielle; Donoghue, Aaron; Bailey, Benoit; Thompson, Nathan; Jamoulle, Olivier; Gagnon, Robert; Gravel, Jocelyn

2014-12-01

Although many methods have been proposed to assess clinical performance during resuscitation, robust and generalizable metrics are still lacking. Further research is necessary to develop validated clinical performance assessment tools and show an improvement in outcomes after training. We aimed to establish evidence for validity of a previously published scoring instrument--the Clinical Performance Tool (CPT)--designed to evaluate clinical performance during simulated pediatric resuscitations. This was a prospective experimental trial performed in the simulation laboratory of a pediatric tertiary care facility, with a pretest/posttest design that assessed residents before and after pediatric advanced life support (PALS) certification. Thirteen postgraduate year 1 (PGY1) and 11 PGY3 pediatric residents completed 5 simulated pediatric resuscitation scenarios each during 2 consecutive sessions; between the 2 sessions, they completed a full PALS certification course. All sessions were video recorded. Sessions were scored by raters using the CPT; total scores were expressed as a percentage of maximum points possible for each scenario. Validity evidence was established and interpreted according to Messick's framework. Evidence regarding relations to other variables was assessed by calculating differences in scores between pre-PALS and post-PALS certification and PGY1 and PGY3 using a repeated-measures analysis of variance test. Internal structure evidence was established by assessing interrater reliability using intraclass correlation coefficients (ICCs) for each scenario, a G-study, and a variance component analysis of individual measurement facets (scenarios, raters, and occasions) and associated interactions. Overall scores for the entire study cohort improved by 10% after PALS training. Scores improved by 9.9% (95% confidence interval [CI], 4.5-15.4) for the pulseless nonshockable arrest (ICC, 0.85; 95% CI, 0.74-0.92), 14.6% (95% CI, 6.7-22.4) for the pulseless

The Reliability and Predictive Validity of the Stalking Risk Profile.

PubMed

McEwan, Troy E; Shea, Daniel E; Daffern, Michael; MacKenzie, Rachel D; Ogloff, James R P; Mullen, Paul E

2018-03-01

This study assessed the reliability and validity of the Stalking Risk Profile (SRP), a structured measure for assessing stalking risks. The SRP was administered at the point of assessment or retrospectively from file review for 241 adult stalkers (91% male) referred to a community-based forensic mental health service. Interrater reliability was high for stalker type, and moderate-to-substantial for risk judgments and domain scores. Evidence for predictive validity and discrimination between stalking recidivists and nonrecidivists for risk judgments depended on follow-up duration. Discrimination was moderate (area under the curve = 0.66-0.68) and positive and negative predictive values good over the full follow-up period ( Mdn = 170.43 weeks). At 6 months, discrimination was better than chance only for judgments related to stalking of new victims (area under the curve = 0.75); however, high-risk stalkers still reoffended against their original victim(s) 2 to 4 times as often as low-risk stalkers. Implications for the clinical utility and refinement of the SRP are discussed.

Development and Validation of a Chronic Pancreatitis Prognosis Score in 2 Independent Cohorts.

PubMed

Beyer, Georg; Mahajan, Ujjwal M; Budde, Christoph; Bulla, Thomas J; Kohlmann, Thomas; Kuhlmann, Louise; Schütte, Kerstin; Aghdassi, Ali A; Weber, Eckhard; Weiss, F Ulrich; Drewes, Asbjørn M; Olesen, Søren S; Lerch, Markus M; Mayerle, Julia

2017-12-01

The clinical course of chronic pancreatitis is unpredictable. There is no model to assess disease severity or progression or predict patient outcomes. We performed a prospective study of 91 patients with chronic pancreatitis; data were collected from patients seen at academic centers in Europe from January 2011 through April 2014. We analyzed correlations between clinical, laboratory, and imaging data with number of hospital readmissions and in-hospital days over the next 12 months; the parameters with the highest degree of correlation were used to develop a 3-stage chronic pancreatitis prognosis score (COPPS). The predictive strength was validated in 129 independent subjects identified from 2 prospective databases. The mean number of hospital admissions was 1.9 (95% confidence interval [CI], 1.39-2.44) and 15.2 for hospital days (95% CI, 10.76-19.71) for the development cohort and 10.9 for the validation cohort (95% CI, 7.54-14.30) (P = .08). Based on bivariate correlations, pain (numeric rating scale), level of glycated hemoglobin A1c, level of C-reactive protein, body mass index, and platelet count were used to develop the COPPS system. The patients' median COPPS was 8.9 points (range, 5-14). The system accurately discriminated stages of disease severity (low to high): A (5-6 points), B (7-9), and C (10-15). In Pearson correlation analysis of the development cohort, the COPPS correlated with hospital admissions (0.39; P < .01) and number of hospital days (0.33; P < .01). The correlation was validated in the validation set (Pearson correlation values of 0.36 and 0.44; P < .01). COPPS did not correlate with results from the Cambridge classification system. We developed and validated an easy to use dynamic multivariate scoring system, similar to the Child-Pugh-Score for liver cirrhosis. The COPPS allows objective monitoring of patients with chronic pancreatitis, determining risk for readmission to hospital and potential length of hospital stay. Copyright �

Derivation and Cross-Validation of Cutoff Scores for Patients With Schizophrenia Spectrum Disorders on WAIS-IV Digit Span-Based Performance Validity Measures.

PubMed

Glassmire, David M; Toofanian Ross, Parnian; Kinney, Dominique I; Nitch, Stephen R

2016-06-01

Two studies were conducted to identify and cross-validate cutoff scores on the Wechsler Adult Intelligence Scale-Fourth Edition Digit Span-based embedded performance validity (PV) measures for individuals with schizophrenia spectrum disorders. In Study 1, normative scores were identified on Digit Span-embedded PV measures among a sample of patients (n = 84) with schizophrenia spectrum diagnoses who had no known incentive to perform poorly and who put forth valid effort on external PV tests. Previously identified cutoff scores resulted in unacceptable false positive rates and lower cutoff scores were adopted to maintain specificity levels ≥90%. In Study 2, the revised cutoff scores were cross-validated within a sample of schizophrenia spectrum patients (n = 96) committed as incompetent to stand trial. Performance on Digit Span PV measures was significantly related to Full Scale IQ in both studies, indicating the need to consider the intellectual functioning of examinees with psychotic spectrum disorders when interpreting scores on Digit Span PV measures. © The Author(s) 2015.

Association of polygenic risk score with the risk of chronic lymphocytic leukemia and monoclonal B-cell lymphocytosis.

PubMed

Kleinstern, Geffen; Camp, Nicola J; Goldin, Lynn R; Vachon, Celine M; Vajdic, Claire M; de Sanjose, Silvia; Weinberg, J Brice; Benavente, Yolanda; Casabonne, Delphine; Liebow, Mark; Nieters, Alexandra; Hjalgrim, Henrik; Melbye, Mads; Glimelius, Bengt; Adami, Hans-Olov; Boffetta, Paolo; Brennan, Paul; Maynadie, Marc; McKay, James; Cocco, Pier Luigi; Shanafelt, Tait D; Call, Timothy G; Norman, Aaron D; Hanson, Curtis; Robinson, Dennis; Chaffee, Kari G; Brooks-Wilson, Angela R; Monnereau, Alain; Clavel, Jacqueline; Glenn, Martha; Curtin, Karen; Conde, Lucia; Bracci, Paige M; Morton, Lindsay M; Cozen, Wendy; Severson, Richard K; Chanock, Stephen J; Spinelli, John J; Johnston, James B; Rothman, Nathaniel; Skibola, Christine F; Leis, Jose F; Kay, Neil E; Smedby, Karin E; Berndt, Sonja I; Cerhan, James R; Caporaso, Neil; Slager, Susan L

2018-06-07

Inherited loci have been found to be associated with risk of chronic lymphocytic leukemia (CLL). A combined polygenic risk score (PRS) of representative single nucleotide polymorphisms (SNPs) from these loci may improve risk prediction over individual SNPs. Herein, we evaluated the association of a PRS with CLL risk and its precursor, monoclonal B-cell lymphocytosis (MBL). We assessed its validity and discriminative ability in an independent sample and evaluated effect modification and confounding by family history (FH) of hematological cancers. For discovery, we pooled genotype data on 41 representative SNPs from 1499 CLL and 2459 controls from the InterLymph Consortium. For validation, we used data from 1267 controls from Mayo Clinic and 201 CLL, 95 MBL, and 144 controls with a FH of CLL from the Genetic Epidemiology of CLL Consortium. We used odds ratios (ORs) to estimate disease associations with PRS and c-statistics to assess discriminatory accuracy. In InterLymph, the continuous PRS was strongly associated with CLL risk (OR, 2.49; P = 4.4 × 10 -94 ). We replicated these findings in the Genetic Epidemiology of CLL Consortium and Mayo controls (OR, 3.02; P = 7.8 × 10 -30 ) and observed high discrimination (c-statistic = 0.78). When jointly modeled with FH, PRS retained its significance, along with FH status. Finally, we found a highly significant association of the continuous PRS with MBL risk (OR, 2.81; P = 9.8 × 10 -16 ). In conclusion, our validated PRS was strongly associated with CLL risk, adding information beyond FH. The PRS provides a means of identifying those individuals at greater risk for CLL as well as those at increased risk of MBL, a condition that has potential clinical impact beyond CLL.

Derivation and Validation of the Surgical Site Infections Risk Model Using Health Administrative Data.

PubMed

van Walraven, Carl; Jackson, Timothy D; Daneman, Nick

2016-04-01

OBJECTIVE Surgical site infections (SSIs) are common hospital-acquired infections. Tracking SSIs is important to monitor their incidence, and this process requires primary data collection. In this study, we derived and validated a method using health administrative data to predict the probability that a person who had surgery would develop an SSI within 30 days. METHODS All patients enrolled in the National Surgical Quality Improvement Program (NSQIP) from 2 sites were linked to population-based administrative datasets in Ontario, Canada. We derived a multivariate model, stratified by surgical specialty, to determine the independent association of SSI status with patient and hospitalization covariates as well as physician claim codes. This SSI risk model was validated in 2 cohorts. RESULTS The derivation cohort included 5,359 patients with a 30-day SSI incidence of 6.0% (n=118). The SSI risk model predicted the probability that a person had an SSI based on 7 covariates: index hospitalization diagnostic score; physician claims score; emergency visit diagnostic score; operation duration; surgical service; and potential SSI codes. More than 90% of patients had predicted SSI risks lower than 10%. In the derivation group, model discrimination and calibration was excellent (C statistic, 0.912; Hosmer-Lemeshow [H-L] statistic, P=.47). In the 2 validation groups, performance decreased slightly (C statistics, 0.853 and 0.812; H-L statistics, 26.4 [P=.0009] and 8.0 [P=.42]), but low-risk patients were accurately identified. CONCLUSION Health administrative data can effectively identify postoperative patients with a very low risk of surgical site infection within 30 days of their procedure. Records of higher-risk patients can be reviewed to confirm SSI status.

Building and validating a prediction model for paediatric type 1 diabetes risk using next generation targeted sequencing of class II HLA genes.

PubMed

Zhao, Lue Ping; Carlsson, Annelie; Larsson, Helena Elding; Forsander, Gun; Ivarsson, Sten A; Kockum, Ingrid; Ludvigsson, Johnny; Marcus, Claude; Persson, Martina; Samuelsson, Ulf; Örtqvist, Eva; Pyo, Chul-Woo; Bolouri, Hamid; Zhao, Michael; Nelson, Wyatt C; Geraghty, Daniel E; Lernmark, Åke

2017-11-01

It is of interest to predict possible lifetime risk of type 1 diabetes (T1D) in young children for recruiting high-risk subjects into longitudinal studies of effective prevention strategies. Utilizing a case-control study in Sweden, we applied a recently developed next generation targeted sequencing technology to genotype class II genes and applied an object-oriented regression to build and validate a prediction model for T1D. In the training set, estimated risk scores were significantly different between patients and controls (P = 8.12 × 10 -92 ), and the area under the curve (AUC) from the receiver operating characteristic (ROC) analysis was 0.917. Using the validation data set, we validated the result with AUC of 0.886. Combining both training and validation data resulted in a predictive model with AUC of 0.903. Further, we performed a "biological validation" by correlating risk scores with 6 islet autoantibodies, and found that the risk score was significantly correlated with IA-2A (Z-score = 3.628, P < 0.001). When applying this prediction model to the Swedish population, where the lifetime T1D risk ranges from 0.5% to 2%, we anticipate identifying approximately 20 000 high-risk subjects after testing all newborns, and this calculation would identify approximately 80% of all patients expected to develop T1D in their lifetime. Through both empirical and biological validation, we have established a prediction model for estimating lifetime T1D risk, using class II HLA. This prediction model should prove useful for future investigations to identify high-risk subjects for prevention research in high-risk populations. Copyright © 2017 John Wiley & Sons, Ltd.

Cross-cultural validity of a dietary questionnaire for studies of dental caries risk in Japanese.

PubMed

Shinga-Ishihara, Chikako; Nakai, Yukie; Milgrom, Peter; Murakami, Kaori; Matsumoto-Nakano, Michiyo

2014-01-02

Diet is a major modifiable contributing factor in the etiology of dental caries. The purpose of this paper is to examine the reliability and cross-cultural validity of the Japanese version of the Food Frequency Questionnaire to assess dietary intake in relation to dental caries risk in Japanese. The 38-item Food Frequency Questionnaire, in which Japanese food items were added to increase content validity, was translated into Japanese, and administered to two samples. The first sample comprised 355 pregnant women with mean age of 29.2 ± 4.2 years for the internal consistency and criterion validity analyses. Factor analysis (principal components with Varimax rotation) was used to determine dimensionality. The dietary cariogenicity score was calculated from the Food Frequency Questionnaire and used for the analyses. Salivary mutans streptococci level was used as a semi-quantitative assessment of dental caries risk and measured by Dentocult SM. Dentocult SM scores were compared with the dietary cariogenicity score computed from the Food Frequency Questionnaire to examine criterion validity, and assessed by Spearman's correlation coefficient (rs) and Kruskal-Wallis test. Test-retest reliability of the Food Frequency Questionnaire was assessed with a second sample of 25 adults with mean age of 34.0 ± 3.0 years by using the intraclass correlation coefficient analysis. The Japanese language version of the Food Frequency Questionnaire showed high test-retest reliability (ICC = 0.70) and good criterion validity assessed by relationship with salivary mutans streptococci levels (rs = 0.22; p < 0.001). Factor analysis revealed four subscales that construct the questionnaire (solid sugars, solid and starchy sugars, liquid and semisolid sugars, sticky and slowly dissolving sugars). Internal consistency were low to acceptable (Cronbach's alpha = 0.67 for the total scale, 0.46-0.61 for each subscale). Mean dietary cariogenicity scores were 50.8 ± 19.5 in the first sample, 47.4 �

The Veterans Affairs Cardiac Risk Score: Recalibrating the Atherosclerotic Cardiovascular Disease Score for Applied Use.

PubMed

Sussman, Jeremy B; Wiitala, Wyndy L; Zawistowski, Matthew; Hofer, Timothy P; Bentley, Douglas; Hayward, Rodney A

2017-09-01

Accurately estimating cardiovascular risk is fundamental to good decision-making in cardiovascular disease (CVD) prevention, but risk scores developed in one population often perform poorly in dissimilar populations. We sought to examine whether a large integrated health system can use their electronic health data to better predict individual patients' risk of developing CVD. We created a cohort using all patients ages 45-80 who used Department of Veterans Affairs (VA) ambulatory care services in 2006 with no history of CVD, heart failure, or loop diuretics. Our outcome variable was new-onset CVD in 2007-2011. We then developed a series of recalibrated scores, including a fully refit "VA Risk Score-CVD (VARS-CVD)." We tested the different scores using standard measures of prediction quality. For the 1,512,092 patients in the study, the Atherosclerotic cardiovascular disease risk score had similar discrimination as the VARS-CVD (c-statistic of 0.66 in men and 0.73 in women), but the Atherosclerotic cardiovascular disease model had poor calibration, predicting 63% more events than observed. Calibration was excellent in the fully recalibrated VARS-CVD tool, but simpler techniques tested proved less reliable. We found that local electronic health record data can be used to estimate CVD better than an established risk score based on research populations. Recalibration improved estimates dramatically, and the type of recalibration was important. Such tools can also easily be integrated into health system's electronic health record and can be more readily updated.

Using Dynamic Risk and Protective Factors to Predict Inpatient Aggression: Reliability and Validity of START Assessments

PubMed Central

Desmarais, Sarah L.; Nicholls, Tonia L.; Wilson, Catherine M.; Brink, Johann

2012-01-01

The Short-Term Assessment of Risk and Treatability (START) is a relatively new structured professional judgment guide for the assessment and management of short-term risks associated with mental, substance use, and personality disorders. The scheme may be distinguished from other violence risk instruments because of its inclusion of 20 dynamic factors that are rated in terms of both vulnerability and strength. This study examined the reliability and validity of START assessments in predicting inpatient aggression. Research assistants completed START assessments for 120 male forensic psychiatric patients through review of hospital files. They additionally completed Historical-Clinical-Risk Management – 20 (HCR-20) and the Hare Psychopathy Checklist: Screening Version (PCL:SV) assessments. Outcome data was coded from hospital files for a 12-month follow-up period using the Overt Aggression Scale (OAS). START assessments evidenced excellent interrater reliability and demonstrated both predictive and incremental validity over the HCR-20 Historical subscale scores and PCL:SV total scores. Overall, results support the reliability and validity of START assessments, and use of the structured professional judgment approach more broadly, as well as the value of using dynamic risk and protective factors to assess violence risk. PMID:22250595

Predicting stroke through genetic risk functions: the CHARGE Risk Score Project.

PubMed

Ibrahim-Verbaas, Carla A; Fornage, Myriam; Bis, Joshua C; Choi, Seung Hoan; Psaty, Bruce M; Meigs, James B; Rao, Madhu; Nalls, Mike; Fontes, Joao D; O'Donnell, Christopher J; Kathiresan, Sekar; Ehret, Georg B; Fox, Caroline S; Malik, Rainer; Dichgans, Martin; Schmidt, Helena; Lahti, Jari; Heckbert, Susan R; Lumley, Thomas; Rice, Kenneth; Rotter, Jerome I; Taylor, Kent D; Folsom, Aaron R; Boerwinkle, Eric; Rosamond, Wayne D; Shahar, Eyal; Gottesman, Rebecca F; Koudstaal, Peter J; Amin, Najaf; Wieberdink, Renske G; Dehghan, Abbas; Hofman, Albert; Uitterlinden, André G; Destefano, Anita L; Debette, Stephanie; Xue, Luting; Beiser, Alexa; Wolf, Philip A; Decarli, Charles; Ikram, M Arfan; Seshadri, Sudha; Mosley, Thomas H; Longstreth, W T; van Duijn, Cornelia M; Launer, Lenore J

2014-02-01

Beyond the Framingham Stroke Risk Score, prediction of future stroke may improve with a genetic risk score (GRS) based on single-nucleotide polymorphisms associated with stroke and its risk factors. The study includes 4 population-based cohorts with 2047 first incident strokes from 22,720 initially stroke-free European origin participants aged ≥55 years, who were followed for up to 20 years. GRSs were constructed with 324 single-nucleotide polymorphisms implicated in stroke and 9 risk factors. The association of the GRS to first incident stroke was tested using Cox regression; the GRS predictive properties were assessed with area under the curve statistics comparing the GRS with age and sex, Framingham Stroke Risk Score models, and reclassification statistics. These analyses were performed per cohort and in a meta-analysis of pooled data. Replication was sought in a case-control study of ischemic stroke. In the meta-analysis, adding the GRS to the Framingham Stroke Risk Score, age and sex model resulted in a significant improvement in discrimination (all stroke: Δjoint area under the curve=0.016, P=2.3×10(-6); ischemic stroke: Δjoint area under the curve=0.021, P=3.7×10(-7)), although the overall area under the curve remained low. In all the studies, there was a highly significantly improved net reclassification index (P<10(-4)). The single-nucleotide polymorphisms associated with stroke and its risk factors result only in a small improvement in prediction of future stroke compared with the classical epidemiological risk factors for stroke.

[Validation of an instrument for screening cases of type 2 diabetes and monitoring at-risk individuals in Mexico].

PubMed

Guerrero-Romero, Fernando; Rodríguez-Morán, Martha

2010-03-01

To validate a method for screening cases of type 2 diabetes and monitoring at-risk people in a community in northern Mexico. The screening instrument for type 2 diabetes (ITD, for its Spanish acronym) was developed using a multiple logistic regression analysis that made it possible to determine the association between a new diagnosis of diabetes (a dependent variable) and 11 known risk factors. Internal validations were performed (through v-fold cross-validation), together with external validations (through the monitoring of a cohort of healthy individuals). In order to estimate the relative risk (RR) of developing type 2 diabetes, the total ITD score is calculated on the basis of an individual's risk factors and compared against a curve that shows the probability of that individual developing the disease. Of the 525 people in the cohort, 438 (83.4%) were followed for an average of 7 years (4.5 to 10 years), for a total of 2 696 person-years; 62 (14.2%) people developed diabetes during the time they were followed. Individuals scoring 55 points based on their risk factors demonstrated a significantly higher risk of developing diabetes in 7 years (RR = 6.1; IC95%: 1.7 to 11.1); the risk was even higher for those with a score of 75 points (RR = 9.4; IC95%: 2.1 to 11.5). The ITD is easy to use and a valid screening alternative for type 2 diabetes. Its use will allow more individuals to benefit from disease prevention methods and early diagnosis without substantially increasing costs and with minimal use of laboratory resources.

Reliability, Validity, and Sensitivity to Change Overtime of the Modified Melasma Area and Severity Index Score.

PubMed

Abou-Taleb, Doaa A E; Ibrahim, Ahmed K; Youssef, Eman M K; Moubasher, Alaa E A

2017-02-01

The new modified Melasma Area and Severity Index (mMASI) score, the recently used outcome measure for melasma, has not been tested to determine its sensitivity to change in melasma. To determine the reliability, validity, and sensitivity to change overtime of the mMASI score in assessment of the severity of melasma. Pearson correlation, Cronbach alpha, and intraclass correlation coefficient were calculated to assess the reliability of the mMASI score. Validity of the mMASI scale was carried out using Spearman correlation between mMASI total score (before and after treatment), clinical data, and patient's responses. The mMASI score showed excellent reliability and good validity for assessment of the severity of melasma. The authors also determined that the mMASI score demonstrated sensitivity to change over time. An excellent degree of agreement between the mMSAI and MASI scores was revealed. The mMASI score is reliable, valid, and responsive to change in the assessment of severity of melasma. Moreover, the mMASI score was found to be easier to learn and perform and simpler in calculation compared with the MASI score. Overall, the mMASI score can effectively replace the MASI score.

Risk assessment using a novel score to predict anastomotic leak and major complications after oesophageal resection.

PubMed

Noble, Fergus; Curtis, Nathan; Harris, Scott; Kelly, Jamie J; Bailey, Ian S; Byrne, James P; Underwood, Timothy J

2012-06-01

Oesophagectomy is associated with significant morbidity and mortality. A simple score to define a patient's risk of developing major complications would be beneficial. Patients who underwent upper gastrointestinal resections with an oesophageal anastomosis between 2005 and 2010 were reviewed and formed the development dataset with resections performed in 2011 forming a prospective validation dataset. The association between post-operative C-reactive protein (CRP), white cell count (WCC) and albumin levels with anastomotic leak (AL) or major complication including death using the Clavien-Dindo (CD) classification were analysed by receiver operating characteristic curves. After multivariate analysis, from the development dataset, these factors were combined to create a novel score which was subsequently tested on the validation dataset. Two hundred fifty-eight patients were assessed to develop the score. Sixty-three patients (25%) developed a major complication, and there were seven (2.7%) in-patient deaths. Twenty-six (10%) patients were diagnosed with AL at median post-operative day 7 (range: 5-15). CRP (p = 0.002), WCC (p < 0.0001) and albumin (p = 0.001) were predictors of AL. Combining these markers improved prediction of AL (NUn score > 10: sensitivity 95%, specificity 49%, diagnostic accuracy 0.801 (95% confidence interval: 0.692-0.909, p < 0.0001)). The validation dataset confirmed these findings (NUn score > 10: sensitivity 100%, specificity 57%, diagnostic accuracy 0.879 (95% CI 0.763-0.994, p = 0.014)) and a major complication or death (NUn > 10: sensitivity 89%, specificity 63%, diagnostic accuracy 0.856 (95% CI 0.709-1, p = 0.001)). Blood-borne markers of the systemic inflammatory response are predictors of AL and major complications after oesophageal resection. When combined they may categorise a patient's risk of developing a serious complication with higher sensitivity and specificity.

Validity of the AUDIT-C screen for at-risk drinking among students utilizing university primary care.

PubMed

Campbell, Clare E; Maisto, Stephen A

2018-03-22

Research is needed to establish the psychometric properties of brief screens in university primary care settings. This study aimed to assess the construct validity of one such screen, the Alcohol Use Disorders Identification Test-Consumption (AUDIT-C), for detecting at-risk drinking among students who have utilized on-campus primary care. 389 students recently seen in university primary care completed a confidential online survey in December 2014. Bivariate correlations between the AUDIT-C and measures of alcohol consumption and negative drinking consequences provided concurrent evidence for construct validity. Receiver Operating Characteristic curve analyses determined optimal cut-off scores for at-risk drinking. The AUDIT-C significantly correlated with measures of alcohol consumption and negative drinking consequences (p < .001). Analyses support optimal AUDIT-C cut-off scores of 5 for females and 7 for males. The AUDIT-C is a valid screen for at-risk drinking among students who utilize university primary care.

Validation of an early childhood caries risk assessment tool in a low-income Hispanic population.

PubMed

Custodio-Lumsden, Christie L; Wolf, Randi L; Contento, Isobel R; Basch, Charles E; Zybert, Patricia A; Koch, Pamela A; Edelstein, Burton L

2016-03-01

There is a recognized need for valid risk assessment tools for use by both dental and nondental personnel to identify young children at risk for, or with, precavitated stages of early childhood caries (i.e., early stage decalcifications or white spot lesions).The aim of this study is to establish concurrent criterion validity of "MySmileBuddy" (MSB), a novel technology-assisted ECC risk assessment and behavioral intervention tool against four measures of ECC activity: semi-quantitative assays of salivary mutans streptococci levels, visible quantity of dental plaque, visual evidence of enamel decalcifications, and cavitation status (none, ECC, severe ECC). One hundred eight children 2-6 years of age presenting to a pediatric dental clinic were recruited from a predominantly Spanish-speaking, low-income, urban population. All children received a comprehensive oral examination and saliva culture for assessment of ECC indicators. Their caregivers completed the iPad-based MSB assessment in its entirety (15-20 minutes). MSB calculated both diet and comprehensive ECC risk scores. Associations between all variables were determined using ordinal logistic regression. MSB diet risk scores were significantly positively associated with salivary mutans (P < 0.05), and approached significance with visible plaque levels (P < 0.1). MSB comprehensive risk scores were significantly associated with both oral mutans and visible plaque (P < 0.05). Neither was associated with visually evident decalcifications or cavitations. Findings suggest that MSB may have clinical utility as a valid risk assessment tool for identifying children with early precursors of cavitations but does not add value in identifying children with extant lesions. © 2015 American Association of Public Health Dentistry.

The PRONE score: an algorithm for predicting doctors’ risks of formal patient complaints using routinely collected administrative data

PubMed Central

Spittal, Matthew J; Bismark, Marie M; Studdert, David M

2015-01-01

Background Medicolegal agencies—such as malpractice insurers, medical boards and complaints bodies—are mostly passive regulators; they react to episodes of substandard care, rather than intervening to prevent them. At least part of the explanation for this reactive role lies in the widely recognised difficulty of making robust predictions about medicolegal risk at the individual clinician level. We aimed to develop a simple, reliable scoring system for predicting Australian doctors’ risks of becoming the subject of repeated patient complaints. Methods Using routinely collected administrative data, we constructed a national sample of 13 849 formal complaints against 8424 doctors. The complaints were lodged by patients with state health service commissions in Australia over a 12-year period. We used multivariate logistic regression analysis to identify predictors of subsequent complaints, defined as another complaint occurring within 2 years of an index complaint. Model estimates were then used to derive a simple predictive algorithm, designed for application at the doctor level. Results The PRONE (Predicted Risk Of New Event) score is a 22-point scoring system that indicates a doctor's future complaint risk based on four variables: a doctor's specialty and sex, the number of previous complaints and the time since the last complaint. The PRONE score performed well in predicting subsequent complaints, exhibiting strong validity and reliability and reasonable goodness of fit (c-statistic=0.70). Conclusions The PRONE score appears to be a valid method for assessing individual doctors’ risks of attracting recurrent complaints. Regulators could harness such information to target quality improvement interventions, and prevent substandard care and patient dissatisfaction. The approach we describe should be replicable in other agencies that handle large numbers of patient complaints or malpractice claims. PMID:25855664