To t-Test or Not to t-Test? A p-Values-Based Point of View in the Receiver Operating Characteristic Curve Framework.

PubMed

Vexler, Albert; Yu, Jihnhee

2018-04-13

A common statistical doctrine supported by many introductory courses and textbooks is that t-test type procedures based on normally distributed data points are anticipated to provide a standard in decision-making. In order to motivate scholars to examine this convention, we introduce a simple approach based on graphical tools of receiver operating characteristic (ROC) curve analysis, a well-established biostatistical methodology. In this context, we propose employing a p-values-based method, taking into account the stochastic nature of p-values. We focus on the modern statistical literature to address the expected p-value (EPV) as a measure of the performance of decision-making rules. During the course of our study, we extend the EPV concept to be considered in terms of the ROC curve technique. This provides expressive evaluations and visualizations of a wide spectrum of testing mechanisms' properties. We show that the conventional power characterization of tests is a partial aspect of the presented EPV/ROC technique. We desire that this explanation of the EPV/ROC approach convinces researchers of the usefulness of the EPV/ROC approach for depicting different characteristics of decision-making procedures, in light of the growing interest regarding correct p-values-based applications.

How Does One Assess the Accuracy of Academic Success Predictors? ROC Analysis Applied to University Entrance Factors

ERIC Educational Resources Information Center

Vivo, Juana-Maria; Franco, Manuel

2008-01-01

This article attempts to present a novel application of a method of measuring accuracy for academic success predictors that could be used as a standard. This procedure is known as the receiver operating characteristic (ROC) curve, which comes from statistical decision techniques. The statistical prediction techniques provide predictor models and…

THE VALIDITY OF USING ROC SOFTWARE FOR ANALYSING VISUAL GRADING CHARACTERISTICS DATA: AN INVESTIGATION BASED ON THE NOVEL SOFTWARE VGC ANALYZER.

PubMed

Hansson, Jonny; Månsson, Lars Gunnar; Båth, Magnus

2016-06-01

The purpose of the present work was to investigate the validity of using single-reader-adapted receiver operating characteristics (ROC) software for analysis of visual grading characteristics (VGC) data. VGC data from four published VGC studies on optimisation of X-ray examinations, previously analysed using ROCFIT, were reanalysed using a recently developed software dedicated to VGC analysis (VGC Analyzer), and the outcomes [the mean and 95 % confidence interval (CI) of the area under the VGC curve (AUCVGC) and the p-value] were compared. The studies included both paired and non-paired data and were reanalysed both for the fixed-reader and the random-reader situations. The results showed good agreement between the softwares for the mean AUCVGC For non-paired data, wider CIs were obtained with VGC Analyzer than previously reported, whereas for paired data, the previously reported CIs were similar or even broader. Similar observations were made for the p-values. The results indicate that the use of single-reader-adapted ROC software such as ROCFIT for analysing non-paired VGC data may lead to an increased risk of committing Type I errors, especially in the random-reader situation. On the other hand, the use of ROC software for analysis of paired VGC data may lead to an increased risk of committing Type II errors, especially in the fixed-reader situation. © The Author 2016. Published by Oxford University Press. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Evaluating risk assessments using receiver operating characteristic analysis: rationale, advantages, insights, and limitations.

PubMed

Mossman, Douglas

2013-01-01

The last two decades have witnessed major changes in the way that mental health professionals assess, describe, and think about persons' risk for future violence. Psychiatrists and psychologists have gone from believing that they could not predict violence to feeling certain they can assess violence risk with well-above-chance accuracy. Receiver operating characteristic (ROC) analysis has played a central role in changing this view. This article reviews the key concepts underlying ROC methods, the meaning of the area under the ROC curve (AUC), the relationship between AUC and effect size d, and what these two indices tell us about evaluations of violence risk. The area under the ROC curve and d provide succinct but incomplete descriptions of discrimination capacity. These indices do not provide details about sensitivity-specificity trade-offs; they do not tell us how to balance false-positive and false-negative errors; and they do not determine whether a diagnostic system is accurate enough to make practically useful distinctions between violent and non-violent subject groups. Justifying choices or clinical practices requires a contextual investigation of outcomes, a process that takes us beyond simply knowing global indices of accuracy. Copyright © 2013 John Wiley & Sons, Ltd.

Recent developments in imaging system assessment methodology, FROC analysis and the search model.

PubMed

Chakraborty, Dev P

2011-08-21

A frequent problem in imaging is assessing whether a new imaging system is an improvement over an existing standard. Observer performance methods, in particular the receiver operating characteristic (ROC) paradigm, are widely used in this context. In ROC analysis lesion location information is not used and consequently scoring ambiguities can arise in tasks, such as nodule detection, involving finding localized lesions. This paper reviews progress in the free-response ROC (FROC) paradigm in which the observer marks and rates suspicious regions and the location information is used to determine whether lesions were correctly localized. Reviewed are FROC data analysis, a search-model for simulating FROC data, predictions of the model and a method for estimating the parameters. The search model parameters are physically meaningful quantities that can guide system optimization.

The ROC Toolbox: A toolbox for analyzing receiver-operating characteristics derived from confidence ratings.

PubMed

Koen, Joshua D; Barrett, Frederick S; Harlow, Iain M; Yonelinas, Andrew P

2017-08-01

Signal-detection theory, and the analysis of receiver-operating characteristics (ROCs), has played a critical role in the development of theories of episodic memory and perception. The purpose of the current paper is to present the ROC Toolbox. This toolbox is a set of functions written in the Matlab programming language that can be used to fit various common signal detection models to ROC data obtained from confidence rating experiments. The goals for developing the ROC Toolbox were to create a tool (1) that is easy to use and easy for researchers to implement with their own data, (2) that can flexibly define models based on varying study parameters, such as the number of response options (e.g., confidence ratings) and experimental conditions, and (3) that provides optimal routines (e.g., Maximum Likelihood estimation) to obtain parameter estimates and numerous goodness-of-fit measures.The ROC toolbox allows for various different confidence scales and currently includes the models commonly used in recognition memory and perception: (1) the unequal variance signal detection (UVSD) model, (2) the dual process signal detection (DPSD) model, and (3) the mixture signal detection (MSD) model. For each model fit to a given data set the ROC toolbox plots summary information about the best fitting model parameters and various goodness-of-fit measures. Here, we present an overview of the ROC Toolbox, illustrate how it can be used to input and analyse real data, and finish with a brief discussion on features that can be added to the toolbox.

[Comparative Study of Patient Identifications for Conventional and Portable Chest Radiographs Utilizing ROC Analysis].

PubMed

Kawashima, Hiroki; Hayashi, Norio; Ohno, Naoki; Matsuura, Yukihiro; Sanada, Shigeru

2015-08-01

To evaluate the patient identification ability of radiographers, previous and current chest radiographs were assessed with observer study utilizing a receiver operating characteristics (ROCs) analysis. This study included portable and conventional chest radiographs from 43 same and 43 different patients. The dataset used in this study was divided into the three following groups: (1) a pair of portable radiographs, (2) a pair of conventional radiographs, and (3) a combination of each type of radiograph. Seven observers participated in this ROC study, which aimed to identify same or different patients, using these datasets. ROC analysis was conducted to calculate the average area under ROC curve obtained by each observer (AUCave), and a statistical test was performed using the multi-reader multi-case method. Comparable results were obtained with pairs of portable (AUCave: 0.949) and conventional radiographs (AUCave: 0.951). In a comparison between the same modality, there were no significant differences. In contrast, the ability to identify patients by comparing a portable and conventional radiograph (AUCave: 0.873) was lower than with the matching datasets (p=0.002 and p=0.004, respectively). In conclusion, the use of different imaging modalities reduces radiographers' ability to identify their patients.

A tutorial on the use of ROC analysis for computer-aided diagnostic systems.

PubMed

Scheipers, Ulrich; Perrey, Christian; Siebers, Stefan; Hansen, Christian; Ermert, Helmut

2005-07-01

The application of the receiver operating characteristic (ROC) curve for computer-aided diagnostic systems is reviewed. A statistical framework is presented and different methods of evaluating the classification performance of computer-aided diagnostic systems, and, in particular, systems for ultrasonic tissue characterization, are derived. Most classifiers that are used today are dependent on a separation threshold, which can be chosen freely in many cases. The separation threshold separates the range of output values of the classification system into different target groups, thus conducting the actual classification process. In the first part of this paper, threshold specific performance measures, e.g., sensitivity and specificity, are presented. In the second part, a threshold-independent performance measure, the area under the ROC curve, is reviewed. Only the use of separation threshold-independent performance measures provides classification results that are overall representative for computer-aided diagnostic systems. The following text was motivated by the lack of a complete and definite discussion of the underlying subject in available textbooks, references and publications. Most manuscripts published so far address the theme of performance evaluation using ROC analysis in a manner too general to be practical for everyday use in the development of computer-aided diagnostic systems. Nowadays, the user of computer-aided diagnostic systems typically handles huge amounts of numerical data, not always distributed normally. Many assumptions made in more or less theoretical works on ROC analysis are no longer valid for real-life data. The paper aims at closing the gap between theoretical works and real-life data. The review provides the interested scientist with information needed to conduct ROC analysis and to integrate algorithms performing ROC analysis into classification systems while understanding the basic principles of classification.

Rocker: Open source, easy-to-use tool for AUC and enrichment calculations and ROC visualization.

PubMed

Lätti, Sakari; Niinivehmas, Sanna; Pentikäinen, Olli T

2016-01-01

Receiver operating characteristics (ROC) curve with the calculation of area under curve (AUC) is a useful tool to evaluate the performance of biomedical and chemoinformatics data. For example, in virtual drug screening ROC curves are very often used to visualize the efficiency of the used application to separate active ligands from inactive molecules. Unfortunately, most of the available tools for ROC analysis are implemented into commercially available software packages, or are plugins in statistical software, which are not always the easiest to use. Here, we present Rocker, a simple ROC curve visualization tool that can be used for the generation of publication quality images. Rocker also includes an automatic calculation of the AUC for the ROC curve and Boltzmann-enhanced discrimination of ROC (BEDROC). Furthermore, in virtual screening campaigns it is often important to understand the early enrichment of active ligand identification, for this Rocker offers automated calculation routine. To enable further development of Rocker, it is freely available (MIT-GPL license) for use and modifications from our web-site (http://www.jyu.fi/rocker).

CombiROC: an interactive web tool for selecting accurate marker combinations of omics data.

PubMed

Mazzara, Saveria; Rossi, Riccardo L; Grifantini, Renata; Donizetti, Simone; Abrignani, Sergio; Bombaci, Mauro

2017-03-30

Diagnostic accuracy can be improved considerably by combining multiple markers, whose performance in identifying diseased subjects is usually assessed via receiver operating characteristic (ROC) curves. The selection of multimarker signatures is a complicated process that requires integration of data signatures with sophisticated statistical methods. We developed a user-friendly tool, called CombiROC, to help researchers accurately determine optimal markers combinations from diverse omics methods. With CombiROC data from different domains, such as proteomics and transcriptomics, can be analyzed using sensitivity/specificity filters: the number of candidate marker panels rising from combinatorial analysis is easily optimized bypassing limitations imposed by the nature of different experimental approaches. Leaving to the user full control on initial selection stringency, CombiROC computes sensitivity and specificity for all markers combinations, performances of best combinations and ROC curves for automatic comparisons, all visualized in a graphic interface. CombiROC was designed without hard-coded thresholds, allowing a custom fit to each specific data: this dramatically reduces the computational burden and lowers the false negative rates given by fixed thresholds. The application was validated with published data, confirming the marker combination already originally described or even finding new ones. CombiROC is a novel tool for the scientific community freely available at http://CombiROC.eu.

DTI measures identify mild and moderate TBI cases among patients with complex health problems: A receiver operating characteristic analysis of U.S. veterans.

PubMed

Main, Keith L; Soman, Salil; Pestilli, Franco; Furst, Ansgar; Noda, Art; Hernandez, Beatriz; Kong, Jennifer; Cheng, Jauhtai; Fairchild, Jennifer K; Taylor, Joy; Yesavage, Jerome; Wesson Ashford, J; Kraemer, Helena; Adamson, Maheen M

2017-01-01

Standard MRI methods are often inadequate for identifying mild traumatic brain injury (TBI). Advances in diffusion tensor imaging now provide potential biomarkers of TBI among white matter fascicles (tracts). However, it is still unclear which tracts are most pertinent to TBI diagnosis. This study ranked fiber tracts on their ability to discriminate patients with and without TBI. We acquired diffusion tensor imaging data from military veterans admitted to a polytrauma clinic (Overall n  = 109; Age: M  = 47.2, SD  = 11.3; Male: 88%; TBI: 67%). TBI diagnosis was based on self-report and neurological examination. Fiber tractography analysis produced 20 fiber tracts per patient. Each tract yielded four clinically relevant measures (fractional anisotropy, mean diffusivity, radial diffusivity, and axial diffusivity). We applied receiver operating characteristic (ROC) analyses to identify the most diagnostic tract for each measure. The analyses produced an optimal cutpoint for each tract. We then used kappa coefficients to rate the agreement of each cutpoint with the neurologist's diagnosis. The tract with the highest kappa was most diagnostic. As a check on the ROC results, we performed a stepwise logistic regression on each measure using all 20 tracts as predictors. We also bootstrapped the ROC analyses to compute the 95% confidence intervals for sensitivity, specificity, and the highest kappa coefficients. The ROC analyses identified two fiber tracts as most diagnostic of TBI: the left cingulum (LCG) and the left inferior fronto-occipital fasciculus (LIF). Like ROC, logistic regression identified LCG as most predictive for the FA measure but identified the right anterior thalamic tract (RAT) for the MD, RD, and AD measures. These findings are potentially relevant to the development of TBI biomarkers. Our methods also demonstrate how ROC analysis may be used to identify clinically relevant variables in the TBI population.

bcROCsurface: an R package for correcting verification bias in estimation of the ROC surface and its volume for continuous diagnostic tests.

PubMed

To Duc, Khanh

2017-11-18

Receiver operating characteristic (ROC) surface analysis is usually employed to assess the accuracy of a medical diagnostic test when there are three ordered disease status (e.g. non-diseased, intermediate, diseased). In practice, verification bias can occur due to missingness of the true disease status and can lead to a distorted conclusion on diagnostic accuracy. In such situations, bias-corrected inference tools are required. This paper introduce an R package, named bcROCsurface, which provides utility functions for verification bias-corrected ROC surface analysis. The shiny web application of the correction for verification bias in estimation of the ROC surface analysis is also developed. bcROCsurface may become an important tool for the statistical evaluation of three-class diagnostic markers in presence of verification bias. The R package, readme and example data are available on CRAN. The web interface enables users less familiar with R to evaluate the accuracy of diagnostic tests, and can be found at http://khanhtoduc.shinyapps.io/bcROCsurface_shiny/ .

The role of stenosis ratio as a predictor of surgical satisfaction in patients with lumbar spinal canal stenosis: a receiver-operator characteristic (ROC) curve analysis.

PubMed

Mohammadi, Hassanreza R; Azimi, Parisa; Benzel, Edward C; Shahzadi, Sohrab; Azhari, Shirzad

2016-09-01

The aim of this study was to elucidate independent factors that predict surgical satisfaction in lumbar spinal canal stenosis (LSCS) patients. Patients who underwent surgery were grouped based on the age, gender, duration of symptoms, walking distance, Neurogenic Claudication Outcome Score (NCOS) and the stenosis ratio (SR) described by Lurencin. We recorded on 2-year patient satisfaction using standardized measure. The optimal cut-off points in SR, NCOS and walking distance for predicting surgical satisfaction were estimated from sensitivity and specificity calculations and receiver operator characteristic (ROC) curves. One hundred fifty consecutive patients (51 male, 99 female, mean age 62.4±10.9 years) were followed up for 34±13 months (range 24-49). One, two, three and four level stenosis was observed in 10.7%, 39.3%, 36.0 % and 14.0% of patients, respectively. Post-surgical satisfaction was 78.5% at the 2 years follow up. In ROC curve analysis, the asymptotic significance is less than 0.05 in SR and the optimal cut-off value of SR to predict worsening surgical satisfaction was measured as more than 0.52, with 85.4% sensitivity and 77.4% specificity (AUC 0.798, 95% CI 0.73-0.90; P<0.01). The present study suggests that the SR, with a cut-off set a 0.52 cross-sectional area, may be superior to walking distance and NCOS in patients with degenerative lumbar stenosis considered for surgical treatment. Using a ROC curve analysis, a radiological feature, the SR, demonstrated superiority in predicting patient satisfaction, compared to functional and clinical characteristics such as walking distance and NCOS.

A comparison of ROC inferred from FROC and conventional ROC

NASA Astrophysics Data System (ADS)

McEntee, Mark F.; Littlefair, Stephen; Pietrzyk, Mariusz W.

2014-03-01

This study aims to determine whether receiver operating characteristic (ROC) scores inferred from free-response receiver operating characteristic (FROC) were equivalent to conventional ROC scores for the same readers and cases. Forty-five examining radiologists of the American Board of Radiology independently reviewed 47 PA chest radiographs under at least two conditions. Thirty-seven cases had abnormal findings and 10 cases had normal findings. Half the readers were asked to first locate any visualized lung nodules, mark them and assign a level of confidence [the FROC mark-rating pair] and second give an overall to the entire image on the same scale [the ROC score]. The second half of readers gave the ROC rating first followed by the FROC mark-rating pairs. A normal image was represented with number 1 and malignant lesions with numbers 2-5. A jackknife free-response receiver operating characteristic (JAFROC), and inferred ROC (infROC) was calculated from the mark-rating pairs using JAFROC V4.1 software. ROC based on the overall rating of the image calculated using DBM MRMC software, which was also used to compare infROC and ROC AUCs treating the methods as modalities. Pearson's correlations coefficient and linear regression were used to examine their relationship using SPSS, version 21.0; (SPSS, Chicago, IL). The results of this study showed no significant difference between the ROC and Inferred ROC AUCs (p≤0.25). While Pearson's correlation coefficient was 0.7 (p≤0.01). Inter-reader correlation calculated from Obuchowski- Rockette covariance's ranged from 0.43-0.86 while intra-reader agreement was greater than previously reported ranging from 0.68-0.82.

Exploration of Analysis Methods for Diagnostic Imaging Tests: Problems with ROC AUC and Confidence Scores in CT Colonography

PubMed Central

Mallett, Susan; Halligan, Steve; Collins, Gary S.; Altman, Doug G.

2014-01-01

Background Different methods of evaluating diagnostic performance when comparing diagnostic tests may lead to different results. We compared two such approaches, sensitivity and specificity with area under the Receiver Operating Characteristic Curve (ROC AUC) for the evaluation of CT colonography for the detection of polyps, either with or without computer assisted detection. Methods In a multireader multicase study of 10 readers and 107 cases we compared sensitivity and specificity, using radiological reporting of the presence or absence of polyps, to ROC AUC calculated from confidence scores concerning the presence of polyps. Both methods were assessed against a reference standard. Here we focus on five readers, selected to illustrate issues in design and analysis. We compared diagnostic measures within readers, showing that differences in results are due to statistical methods. Results Reader performance varied widely depending on whether sensitivity and specificity or ROC AUC was used. There were problems using confidence scores; in assigning scores to all cases; in use of zero scores when no polyps were identified; the bimodal non-normal distribution of scores; fitting ROC curves due to extrapolation beyond the study data; and the undue influence of a few false positive results. Variation due to use of different ROC methods exceeded differences between test results for ROC AUC. Conclusions The confidence scores recorded in our study violated many assumptions of ROC AUC methods, rendering these methods inappropriate. The problems we identified will apply to other detection studies using confidence scores. We found sensitivity and specificity were a more reliable and clinically appropriate method to compare diagnostic tests. PMID:25353643

Exploration of analysis methods for diagnostic imaging tests: problems with ROC AUC and confidence scores in CT colonography.

PubMed

Mallett, Susan; Halligan, Steve; Collins, Gary S; Altman, Doug G

2014-01-01

Different methods of evaluating diagnostic performance when comparing diagnostic tests may lead to different results. We compared two such approaches, sensitivity and specificity with area under the Receiver Operating Characteristic Curve (ROC AUC) for the evaluation of CT colonography for the detection of polyps, either with or without computer assisted detection. In a multireader multicase study of 10 readers and 107 cases we compared sensitivity and specificity, using radiological reporting of the presence or absence of polyps, to ROC AUC calculated from confidence scores concerning the presence of polyps. Both methods were assessed against a reference standard. Here we focus on five readers, selected to illustrate issues in design and analysis. We compared diagnostic measures within readers, showing that differences in results are due to statistical methods. Reader performance varied widely depending on whether sensitivity and specificity or ROC AUC was used. There were problems using confidence scores; in assigning scores to all cases; in use of zero scores when no polyps were identified; the bimodal non-normal distribution of scores; fitting ROC curves due to extrapolation beyond the study data; and the undue influence of a few false positive results. Variation due to use of different ROC methods exceeded differences between test results for ROC AUC. The confidence scores recorded in our study violated many assumptions of ROC AUC methods, rendering these methods inappropriate. The problems we identified will apply to other detection studies using confidence scores. We found sensitivity and specificity were a more reliable and clinically appropriate method to compare diagnostic tests.

Receiver operating characteristic analysis of age-related changes in lineup performance.

PubMed

Humphries, Joyce E; Flowe, Heather D

2015-04-01

In the basic face memory literature, support has been found for the late maturation hypothesis, which holds that face recognition ability is not fully developed until at least adolescence. Support for the late maturation hypothesis in the criminal lineup identification literature, however, has been equivocal because of the analytic approach that has been used to examine age-related changes in identification performance. Recently, receiver operator characteristic (ROC) analysis was applied for the first time in the adult eyewitness memory literature to examine whether memory sensitivity differs across different types of lineup tests. ROC analysis allows for the separation of memory sensitivity from response bias in the analysis of recognition data. Here, we have made the first ROC-based comparison of adults' and children's (5- and 6-year-olds and 9- and 10-year-olds) memory performance on lineups by reanalyzing data from Humphries, Holliday, and Flowe (2012). In line with the late maturation hypothesis, memory sensitivity was significantly greater for adults compared with young children. Memory sensitivity for older children was similar to that for adults. The results indicate that the late maturation hypothesis can be generalized to account for age-related performance differences on an eyewitness memory task. The implications for developmental eyewitness memory research are discussed. Copyright © 2014 Elsevier Inc. All rights reserved.

Determination of glucose-6-phosphate dehydrogenase cut-off values in a Tunisian population.

PubMed

Laouini, Naouel; Sahli, Chaima Abdelhafidh; Jouini, Latifa; Haloui, Sabrine; Fredj, Sondes Hadj; Daboubi, Rym; Siala, Hajer; Ouali, Faida; Becher, Meriam; Toumi, Nourelhouda; Bibi, Amina; Messsaoud, Taieb

2017-07-26

Glucose-6-phosphate dehydrogenase (G6PD) deficiency is the commonest enzymopathy worldwide. The incidence depends essentially on the methods used for the assessment. In this respect, we attempted in this study to set cut-off values of G6PD activity to discriminate among normal, heterozygous, and deficient individuals using the World Health Organization (WHO) classification and the receiver operating characteristics (ROC) curve analysis. Blood samples from 250 female and 302 male subjects were enrolled in this study. The G6PD activity was determined using a quantitative assay. The common G6PD mutations in Tunisia were determined using the amplification refractory mutation system (ARMS-PCR) method. The ROC curve was used to choice the best cut-off. Normal G6PD values were 7.69±2.37, 7.86±2.39, and 7.51±2.35 U/g Hb for the entire, male, and female groups, respectively. Cut-off values for the total, male, and female were determined using the WHO classification and ROC curves analysis. In the male population, both cut-offs established using ROC curve analysis (4.00 U/g Hb) and the 60% level (3.82 U/g Hb), respectively are sensitive and specific resulting in a good efficiency of discrimination between deficient and normal males. For the female group the ROC cut-off (5.84 U/g Hb) seems better than the 60% level cut-off (3.88 U/g Hb) to discriminate between normal and heterozygote or homozygote women with higher Youden Index. The establishment of the normal values for a population is important for a better evaluation of the assay result. The ROC curve analysis is an alternative method to determine the status of patients since it correlates DNA analysis and G6PD activity.

Assessment of insulin sensitivity by the hyperinsulinemic euglycemic clamp: Comparison with the spectral analysis of photoplethysmography.

PubMed

De Souza, Aglecio Luiz; Batista, Gisele Almeida; Alegre, Sarah Monte

2017-01-01

We compare spectral analysis of photoplethysmography (PTG) with insulin resistance measured by the hyperinsulinemic euglycemic clamp (HEC) technique. A total of 100 nondiabetic subjects, 43 men and 57 women aged 20-63years, 30 lean, 42 overweight and 28 obese were enrolled in the study. These patients underwent an examination with HEC, and an examination with the PTG spectral analysis and calculation of the PTG Total Power (PTG-TP). Receiver-operating characteristic (ROC) curves were constructed to determine the specificity and sensitivity of PTG-TP in the assessment of insulin resistance. There is a moderate correlation between insulin sensitivity (M-value) and PTG-TP (r=- 0.64, p<0.0001). The ROC curves showed that the most relevant cutoff to the whole study group was a PTG-TP>406.2. This cut-off had a sensitivity=95.7%, specificity =84,4% and the area under the ROC curve (AUC)=0.929 for identifying insulin resistance. All AUC ROC curve analysis were significant (p<0.0001). The use of the PTG-TP marker measured from the PTG spectral analysis is a useful tool in screening and follow up of IR, especially in large-scale studies. Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.

Can technical characteristics predict clinical performance in PET/CT imaging? A correlation study for thyroid cancer diagnosis

NASA Astrophysics Data System (ADS)

Kallergi, Maria; Menychtas, Dimitrios; Georgakopoulos, Alexandros; Pianou, Nikoletta; Metaxas, Marinos; Chatziioannou, Sofia

2013-03-01

The purpose of this study was to determine whether image characteristics could be used to predict the outcome of ROC studies in PET/CT imaging. Patients suspected for recurrent thyroid cancer underwent a standard whole body (WB) examination and an additional high-resolution head-and-neck (HN) F18-FDG PET/CT scan. The value of the latter was determined with an ROC study, the results of which showed that the WB+HN combination was better than WB alone for thyroid cancer detection and diagnosis. Following the ROC experiment, the WB and HN images of confirmed benign or malignant thyroid disease were analyzed and first and second order textural features were determined. Features included minimum, mean, and maximum intensity, as well as contrast in regions of interest encircling the thyroid lesions. Lesion size and standard uptake values (SUV) were also determined. Bivariate analysis was applied to determine relationships between WB and HN features and between observer ROC responses and the various feature values. The two sets showed significant associations in the values of SUV, contrast, and lesion size. They were completely different when the intensities were considered; no relationship was found between the WB minimum, maximum, and mean ROI values and their HN counterparts. SUV and contrast were the strongest predictors of ROC performance on PET/CT examinations of thyroid cancer. The high resolution HN images seem to enhance these relationships but without a single dramatic effect as was projected from the ROC results. A combination of features from both WB and HN datasets may possibly be a more robust predictor of ROC performance.

Meta-analysis of Diagnostic Accuracy and ROC Curves with Covariate Adjusted Semiparametric Mixtures.

PubMed

Doebler, Philipp; Holling, Heinz

2015-12-01

Many screening tests dichotomize a measurement to classify subjects. Typically a cut-off value is chosen in a way that allows identification of an acceptable number of cases relative to a reference procedure, but does not produce too many false positives at the same time. Thus for the same sample many pairs of sensitivities and false positive rates result as the cut-off is varied. The curve of these points is called the receiver operating characteristic (ROC) curve. One goal of diagnostic meta-analysis is to integrate ROC curves and arrive at a summary ROC (SROC) curve. Holling, Böhning, and Böhning (Psychometrika 77:106-126, 2012a) demonstrated that finite semiparametric mixtures can describe the heterogeneity in a sample of Lehmann ROC curves well; this approach leads to clusters of SROC curves of a particular shape. We extend this work with the help of the [Formula: see text] transformation, a flexible family of transformations for proportions. A collection of SROC curves is constructed that approximately contains the Lehmann family but in addition allows the modeling of shapes beyond the Lehmann ROC curves. We introduce two rationales for determining the shape from the data. Using the fact that each curve corresponds to a natural univariate measure of diagnostic accuracy, we show how covariate adjusted mixtures lead to a meta-regression on SROC curves. Three worked examples illustrate the method.

Assessing the Classification Accuracy of Early Numeracy Curriculum-Based Measures Using Receiver Operating Characteristic Curve Analysis

ERIC Educational Resources Information Center

Laracy, Seth D.; Hojnoski, Robin L.; Dever, Bridget V.

2016-01-01

Receiver operating characteristic curve (ROC) analysis was used to investigate the ability of early numeracy curriculum-based measures (EN-CBM) administered in preschool to predict performance below the 25th and 40th percentiles on a quantity discrimination measure in kindergarten. Areas under the curve derived from a sample of 279 students ranged…

Software for illustrative presentation of basic clinical characteristics of laboratory tests--GraphROC for Windows.

PubMed

Kairisto, V; Poola, A

1995-01-01

GraphROC for Windows is a program for clinical test evaluation. It was designed for the handling of large datasets obtained from clinical laboratory databases. In the user interface, graphical and numerical presentations are combined. For simplicity, numerical data is not shown unless requested. Relevant numbers can be "picked up" from the graph by simple mouse operations. Reference distributions can be displayed by using automatically optimized bin widths. Any percentile of the distribution with corresponding confidence limits can be chosen for display. In sensitivity-specificity analysis, both illness- and health-related distributions are shown in the same graph. The following data for any cutoff limit can be shown in a separate click window: clinical sensitivity and specificity with corresponding confidence limits, positive and negative likelihood ratios, positive and negative predictive values and efficiency. Predictive values and clinical efficiency of the cutoff limit can be updated for any prior probability of disease. Receiver Operating Characteristics (ROC) curves can be generated and combined into the same graph for comparison of several different tests. The area under the curve with corresponding confidence interval is calculated for each ROC curve. Numerical results of analyses and graphs can be printed or exported to other Microsoft Windows programs. GraphROC for Windows also employs a new method, developed by us, for the indirect estimation of health-related limits and change limits from mixed distributions of clinical laboratory data.

Three-class ROC analysis--the equal error utility assumption and the optimality of three-class ROC surface using the ideal observer.

PubMed

He, Xin; Frey, Eric C

2006-08-01

Previously, we have developed a decision model for three-class receiver operating characteristic (ROC) analysis based on decision theory. The proposed decision model maximizes the expected decision utility under the assumption that incorrect decisions have equal utilities under the same hypothesis (equal error utility assumption). This assumption reduced the dimensionality of the "general" three-class ROC analysis and provided a practical figure-of-merit to evaluate the three-class task performance. However, it also limits the generality of the resulting model because the equal error utility assumption will not apply for all clinical three-class decision tasks. The goal of this study was to investigate the optimality of the proposed three-class decision model with respect to several other decision criteria. In particular, besides the maximum expected utility (MEU) criterion used in the previous study, we investigated the maximum-correctness (MC) (or minimum-error), maximum likelihood (ML), and Nyman-Pearson (N-P) criteria. We found that by making assumptions for both MEU and N-P criteria, all decision criteria lead to the previously-proposed three-class decision model. As a result, this model maximizes the expected utility under the equal error utility assumption, maximizes the probability of making correct decisions, satisfies the N-P criterion in the sense that it maximizes the sensitivity of one class given the sensitivities of the other two classes, and the resulting ROC surface contains the maximum likelihood decision operating point. While the proposed three-class ROC analysis model is not optimal in the general sense due to the use of the equal error utility assumption, the range of criteria for which it is optimal increases its applicability for evaluating and comparing a range of diagnostic systems.

ROC curve analyses of eyewitness identification decisions: An analysis of the recent debate.

PubMed

Rotello, Caren M; Chen, Tina

2016-01-01

How should the accuracy of eyewitness identification decisions be measured, so that best practices for identification can be determined? This fundamental question is under intense debate. One side advocates for continued use of a traditional measure of identification accuracy, known as the diagnosticity ratio , whereas the other side argues that receiver operating characteristic curves (ROCs) should be used instead because diagnosticity is confounded with response bias. Diagnosticity proponents have offered several criticisms of ROCs, which we show are either false or irrelevant to the assessment of eyewitness accuracy. We also show that, like diagnosticity, Bayesian measures of identification accuracy confound response bias with witnesses' ability to discriminate guilty from innocent suspects. ROCs are an essential tool for distinguishing memory-based processes from decisional aspects of a response; simulations of different possible identification tasks and response strategies show that they offer important constraints on theory development.

Validating the Injury Severity Score (ISS) in different populations: ISS predicts mortality better among Hispanics and females.

PubMed

Bolorunduro, O B; Villegas, C; Oyetunji, T A; Haut, E R; Stevens, K A; Chang, D C; Cornwell, E E; Efron, D T; Haider, A H

2011-03-01

The Injury Severity Score (ISS) is the most commonly used measure of injury severity. The score has been shown to have excellent predictive capability for trauma mortality and has been validated in multiple data sets. However, the score has never been tested to see if its discriminatory ability is affected by differences in race and gender. This study is aimed at validating the ISS in men and women and in three different race/ethnic groups using a nationwide database. Retrospective analysis of patients age 18-64 y in the National Trauma Data Bank 7.0 with blunt trauma was performed. ISS was categorized as mild (<9,) moderate (9-15), severe (16-25), and profound (>25). Logistic regression was done to measure the relative odds of mortality associated with a change in ISS categories. The discriminatory ability was compared using the receiver operating characteristics curves (ROC). A P value testing the equality of the ROC curves was calculated. Age stratified analyses were also conducted. A total of 872,102 patients had complete data for the analysis on ethnicity, while 763,549 patients were included in the gender analysis. The overall mortality rate was 3.7%. ROC in Whites was 0.8617, in Blacks 0.8586, and in Hispanics 0.8869. Hispanics have a statistically significant higher ROC (P value < 0.001). Similar results were observed within each age category. ROC curves were also significantly higher in females than in males. The ISS possesses excellent discriminatory ability in all populations as indicated by the high ROCs. Copyright © 2011 Elsevier Inc. All rights reserved.

A better way to evaluate remote monitoring programs in chronic disease care: receiver operating characteristic analysis.

PubMed

Brown Connolly, Nancy E

2014-12-01

This foundational study applies the process of receiver operating characteristic (ROC) analysis to evaluate utility and predictive value of a disease management (DM) model that uses RM devices for chronic obstructive pulmonary disease (COPD). The literature identifies a need for a more rigorous method to validate and quantify evidence-based value for remote monitoring (RM) systems being used to monitor persons with a chronic disease. ROC analysis is an engineering approach widely applied in medical testing, but that has not been evaluated for its utility in RM. Classifiers (saturated peripheral oxygen [SPO2], blood pressure [BP], and pulse), optimum threshold, and predictive accuracy are evaluated based on patient outcomes. Parametric and nonparametric methods were used. Event-based patient outcomes included inpatient hospitalization, accident and emergency, and home health visits. Statistical analysis tools included Microsoft (Redmond, WA) Excel(®) and MedCalc(®) (MedCalc Software, Ostend, Belgium) version 12 © 1993-2013 to generate ROC curves and statistics. Persons with COPD were monitored a minimum of 183 days, with at least one inpatient hospitalization within 12 months prior to monitoring. Retrospective, de-identified patient data from a United Kingdom National Health System COPD program were used. Datasets included biometric readings, alerts, and resource utilization. SPO2 was identified as a predictive classifier, with an optimal average threshold setting of 85-86%. BP and pulse were failed classifiers, and areas of design were identified that may improve utility and predictive capacity. Cost avoidance methodology was developed. RESULTS can be applied to health services planning decisions. Methods can be applied to system design and evaluation based on patient outcomes. This study validated the use of ROC in RM program evaluation.

Predictive value of pulse pressure variation for fluid responsiveness in septic patients using lung-protective ventilation strategies.

PubMed

Freitas, F G R; Bafi, A T; Nascente, A P M; Assunção, M; Mazza, B; Azevedo, L C P; Machado, F R

2013-03-01

The applicability of pulse pressure variation (ΔPP) to predict fluid responsiveness using lung-protective ventilation strategies is uncertain in clinical practice. We designed this study to evaluate the accuracy of this parameter in predicting the fluid responsiveness of septic patients ventilated with low tidal volumes (TV) (6 ml kg(-1)). Forty patients after the resuscitation phase of severe sepsis and septic shock who were mechanically ventilated with 6 ml kg(-1) were included. The ΔPP was obtained automatically at baseline and after a standardized fluid challenge (7 ml kg(-1)). Patients whose cardiac output increased by more than 15% were considered fluid responders. The predictive values of ΔPP and static variables [right atrial pressure (RAP) and pulmonary artery occlusion pressure (PAOP)] were evaluated through a receiver operating characteristic (ROC) curve analysis. Thirty-four patients had characteristics consistent with acute lung injury or acute respiratory distress syndrome and were ventilated with high levels of PEEP [median (inter-quartile range) 10.0 (10.0-13.5)]. Nineteen patients were considered fluid responders. The RAP and PAOP significantly increased, and ΔPP significantly decreased after volume expansion. The ΔPP performance [ROC curve area: 0.91 (0.82-1.0)] was better than that of the RAP [ROC curve area: 0.73 (0.59-0.90)] and pulmonary artery occlusion pressure [ROC curve area: 0.58 (0.40-0.76)]. The ROC curve analysis revealed that the best cut-off for ΔPP was 6.5%, with a sensitivity of 0.89, specificity of 0.90, positive predictive value of 0.89, and negative predictive value of 0.90. Automatized ΔPP accurately predicted fluid responsiveness in septic patients ventilated with low TV.

Comparison of Paired ROC Curves through a Two-Stage Test.

PubMed

Yu, Wenbao; Park, Eunsik; Chang, Yuan-Chin Ivan

2015-01-01

The area under the receiver operating characteristic (ROC) curve (AUC) is a popularly used index when comparing two ROC curves. Statistical tests based on it for analyzing the difference have been well developed. However, this index is less informative when two ROC curves cross and have similar AUCs. In order to detect differences between ROC curves in such situations, a two-stage nonparametric test that uses a shifted area under the ROC curve (sAUC), along with AUCs, is proposed for paired designs. The new procedure is shown, numerically, to be effective in terms of power under a wide range of scenarios; additionally, it outperforms two conventional ROC-type tests, especially when two ROC curves cross each other and have similar AUCs. Larger sAUC implies larger partial AUC at the range of low false-positive rates in this case. Because high specificity is important in many classification tasks, such as medical diagnosis, this is an appealing characteristic. The test also implicitly analyzes the equality of two commonly used binormal ROC curves at every operating point. We also apply the proposed method to synthesized data and two real examples to illustrate its usefulness in practice.

PRROC: computing and visualizing precision-recall and receiver operating characteristic curves in R.

PubMed

Grau, Jan; Grosse, Ivo; Keilwagen, Jens

2015-08-01

Precision-recall (PR) and receiver operating characteristic (ROC) curves are valuable measures of classifier performance. Here, we present the R-package PRROC, which allows for computing and visualizing both PR and ROC curves. In contrast to available R-packages, PRROC allows for computing PR and ROC curves and areas under these curves for soft-labeled data using a continuous interpolation between the points of PR curves. In addition, PRROC provides a generic plot function for generating publication-quality graphics of PR and ROC curves. © The Author 2015. Published by Oxford University Press.

Mixture models in diagnostic meta-analyses--clustering summary receiver operating characteristic curves accounted for heterogeneity and correlation.

PubMed

Schlattmann, Peter; Verba, Maryna; Dewey, Marc; Walther, Mario

2015-01-01

Bivariate linear and generalized linear random effects are frequently used to perform a diagnostic meta-analysis. The objective of this article was to apply a finite mixture model of bivariate normal distributions that can be used for the construction of componentwise summary receiver operating characteristic (sROC) curves. Bivariate linear random effects and a bivariate finite mixture model are used. The latter model is developed as an extension of a univariate finite mixture model. Two examples, computed tomography (CT) angiography for ruling out coronary artery disease and procalcitonin as a diagnostic marker for sepsis, are used to estimate mean sensitivity and mean specificity and to construct sROC curves. The suggested approach of a bivariate finite mixture model identifies two latent classes of diagnostic accuracy for the CT angiography example. Both classes show high sensitivity but mainly two different levels of specificity. For the procalcitonin example, this approach identifies three latent classes of diagnostic accuracy. Here, sensitivities and specificities are quite different as such that sensitivity increases with decreasing specificity. Additionally, the model is used to construct componentwise sROC curves and to classify individual studies. The proposed method offers an alternative approach to model between-study heterogeneity in a diagnostic meta-analysis. Furthermore, it is possible to construct sROC curves even if a positive correlation between sensitivity and specificity is present. Copyright © 2015 Elsevier Inc. All rights reserved.

Recognition ROCS Are Curvilinear--Or Are They? On Premature Arguments against the Two-High-Threshold Model of Recognition

ERIC Educational Resources Information Center

Broder, Arndt; Schutz, Julia

2009-01-01

Recent reviews of recognition receiver operating characteristics (ROCs) claim that their curvilinear shape rules out threshold models of recognition. However, the shape of ROCs based on confidence ratings is not diagnostic to refute threshold models, whereas ROCs based on experimental bias manipulations are. Also, fitting predicted frequencies to…

Variations in Recollection: The Effects of Complexity on Source Recognition

ERIC Educational Resources Information Center

Parks, Colleen M.; Murray, Linda J.; Elfman, Kane; Yonelinas, Andrew P.

2011-01-01

Whether recollection is a threshold or signal detection process is highly controversial, and the controversy has centered in part on the shape of receiver operating characteristics (ROCs) and z-transformed ROCs (zROCs). U-shaped zROCs observed in tests thought to rely heavily on recollection, such as source memory tests, have provided evidence in…

Inverse probability weighting estimation of the volume under the ROC surface in the presence of verification bias.

PubMed

Zhang, Ying; Alonzo, Todd A

2016-11-01

In diagnostic medicine, the volume under the receiver operating characteristic (ROC) surface (VUS) is a commonly used index to quantify the ability of a continuous diagnostic test to discriminate between three disease states. In practice, verification of the true disease status may be performed only for a subset of subjects under study since the verification procedure is invasive, risky, or expensive. The selection for disease examination might depend on the results of the diagnostic test and other clinical characteristics of the patients, which in turn can cause bias in estimates of the VUS. This bias is referred to as verification bias. Existing verification bias correction in three-way ROC analysis focuses on ordinal tests. We propose verification bias-correction methods to construct ROC surface and estimate the VUS for a continuous diagnostic test, based on inverse probability weighting. By applying U-statistics theory, we develop asymptotic properties for the estimator. A Jackknife estimator of variance is also derived. Extensive simulation studies are performed to evaluate the performance of the new estimators in terms of bias correction and variance. The proposed methods are used to assess the ability of a biomarker to accurately identify stages of Alzheimer's disease. © 2016 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.

Improvement of shallow landslide prediction accuracy using soil parameterisation for a granite area in South Korea

NASA Astrophysics Data System (ADS)

Kim, M. S.; Onda, Y.; Kim, J. K.

2015-01-01

SHALSTAB model applied to shallow landslides induced by rainfall to evaluate soil properties related with the effect of soil depth for a granite area in Jinbu region, Republic of Korea. Soil depth measured by a knocking pole test and two soil parameters from direct shear test (a and b) as well as one soil parameters from a triaxial compression test (c) were collected to determine the input parameters for the model. Experimental soil data were used for the first simulation (Case I) and, soil data represented the effect of measured soil depth and average soil depth from soil data of Case I were used in the second (Case II) and third simulations (Case III), respectively. All simulations were analysed using receiver operating characteristic (ROC) analysis to determine the accuracy of prediction. ROC analysis results for first simulation showed the low ROC values under 0.75 may be due to the internal friction angle and particularly the cohesion value. Soil parameters calculated from a stochastic hydro-geomorphological model were applied to the SHALSTAB model. The accuracy of Case II and Case III using ROC analysis showed higher accuracy values rather than first simulation. Our results clearly demonstrate that the accuracy of shallow landslide prediction can be improved when soil parameters represented the effect of soil thickness.

The average receiver operating characteristic curve in multireader multicase imaging studies

PubMed Central

Samuelson, F W

2014-01-01

Objective: In multireader, multicase (MRMC) receiver operating characteristic (ROC) studies for evaluating medical imaging systems, the area under the ROC curve (AUC) is often used as a summary metric. Owing to the limitations of AUC, plotting the average ROC curve to accompany the rigorous statistical inference on AUC is recommended. The objective of this article is to investigate methods for generating the average ROC curve from ROC curves of individual readers. Methods: We present both a non-parametric method and a parametric method for averaging ROC curves that produce a ROC curve, the area under which is equal to the average AUC of individual readers (a property we call area preserving). We use hypothetical examples, simulated data and a real-world imaging data set to illustrate these methods and their properties. Results: We show that our proposed methods are area preserving. We also show that the method of averaging the ROC parameters, either the conventional bi-normal parameters (a, b) or the proper bi-normal parameters (c, da), is generally not area preserving and may produce a ROC curve that is intuitively not an average of multiple curves. Conclusion: Our proposed methods are useful for making plots of average ROC curves in MRMC studies as a companion to the rigorous statistical inference on the AUC end point. The software implementing these methods is freely available from the authors. Advances in knowledge: Methods for generating the average ROC curve in MRMC ROC studies are formally investigated. The area-preserving criterion we defined is useful to evaluate such methods. PMID:24884728

A Three-Dimensional Receiver Operator Characteristic Surface Diagnostic Metric

NASA Technical Reports Server (NTRS)

Simon, Donald L.

2011-01-01

Receiver Operator Characteristic (ROC) curves are commonly applied as metrics for quantifying the performance of binary fault detection systems. An ROC curve provides a visual representation of a detection system s True Positive Rate versus False Positive Rate sensitivity as the detection threshold is varied. The area under the curve provides a measure of fault detection performance independent of the applied detection threshold. While the standard ROC curve is well suited for quantifying binary fault detection performance, it is not suitable for quantifying the classification performance of multi-fault classification problems. Furthermore, it does not provide a measure of diagnostic latency. To address these shortcomings, a novel three-dimensional receiver operator characteristic (3D ROC) surface metric has been developed. This is done by generating and applying two separate curves: the standard ROC curve reflecting fault detection performance, and a second curve reflecting fault classification performance. A third dimension, diagnostic latency, is added giving rise to 3D ROC surfaces. Applying numerical integration techniques, the volumes under and between the surfaces are calculated to produce metrics of the diagnostic system s detection and classification performance. This paper will describe the 3D ROC surface metric in detail, and present an example of its application for quantifying the performance of aircraft engine gas path diagnostic methods. Metric limitations and potential enhancements are also discussed

Multicenter external validation of two malignancy risk prediction models in patients undergoing 18F-FDG-PET for solitary pulmonary nodule evaluation.

PubMed

Perandini, Simone; Soardi, G A; Larici, A R; Del Ciello, A; Rizzardi, G; Solazzo, A; Mancino, L; Zeraj, F; Bernhart, M; Signorini, M; Motton, M; Montemezzi, S

2017-05-01

To achieve multicentre external validation of the Herder and Bayesian Inference Malignancy Calculator (BIMC) models. Two hundred and fifty-nine solitary pulmonary nodules (SPNs) collected from four major hospitals which underwent 18-FDG-PET characterization were included in this multicentre retrospective study. The Herder model was tested on all available lesions (group A). A subgroup of 180 SPNs (group B) was used to provide unbiased comparison between the Herder and BIMC models. Receiver operating characteristic (ROC) area under the curve (AUC) analysis was performed to assess diagnostic accuracy. Decision analysis was performed by adopting the risk threshold stated in British Thoracic Society (BTS) guidelines. Unbiased comparison performed In Group B showed a ROC AUC for the Herder model of 0.807 (95 % CI 0.742-0.862) and for the BIMC model of 0.822 (95 % CI 0.758-0.875). Both the Herder and the BIMC models were proven to accurately predict the risk of malignancy when tested on a large multicentre external case series. The BIMC model seems advantageous on the basis of a more favourable decision analysis. • The Herder model showed a ROC AUC of 0.807 on 180 SPNs. • The BIMC model showed a ROC AUC of 0.822 on 180 SPNs. • Decision analysis is more favourable to the BIMC model.

Inflammatory Asthma Phenotype Discrimination Using an Electronic Nose Breath Analyzer.

PubMed

Plaza, V; Crespo, A; Giner, J; Merino, J L; Ramos-Barbón, D; Mateus, E F; Torrego, A; Cosio, B G; Agustí, A; Sibila, O

2015-01-01

Patients with persistent asthma have different inflammatory phenotypes. The electronic nose is a new technology capable of distinguishing volatile organic compound (VOC) breath-prints in exhaled breath. The aim of the study was to investigate the capacity of electronic nose breath-print analysis to discriminate between different inflammatory asthma phenotypes (eosinophilic, neutrophilic, paucigranulocytic) determined by induced sputum in patients with persistent asthma. Fifty-two patients with persistent asthma were consecutively included in a cross-sectional proof-of-concept study. Inflammatory asthma phenotypes (eosinophilic, neutrophilic and paucigranulocytic) were recognized by inflammatory cell counts in induced sputum. VOC breath-prints were analyzed using the electronic nose Cyranose 320 and assessed by discriminant analysis on principal component reduction, resulting in cross-validated accuracy values. Receiver operating characteristic (ROC) curves were calculated. VOC breath-prints were different in eosinophilic asthmatics compared with both neutrophilic asthmatics (accuracy 73%; P=.008; area under ROC, 0.92) and paucigranulocytic asthmatics (accuracy 74%; P=.004; area under ROC, 0.79). Likewise, neutrophilic and paucigranulocytic breath-prints were also different (accuracy 89%; P=.001; area under ROC, 0.88). An electronic nose can discriminate inflammatory phenotypes in patients with persistent asthma in a regular clinical setting. ClinicalTrials.gov identifier: NCT02026336.

CNV-ROC: A cost effective, computer-aided analytical performance evaluator of chromosomal microarrays

PubMed Central

Goodman, Corey W.; Major, Heather J.; Walls, William D.; Sheffield, Val C.; Casavant, Thomas L.; Darbro, Benjamin W.

2016-01-01

Chromosomal microarrays (CMAs) are routinely used in both research and clinical laboratories; yet, little attention has been given to the estimation of genome-wide true and false negatives during the assessment of these assays and how such information could be used to calibrate various algorithmic metrics to improve performance. Low-throughput, locus-specific methods such as fluorescence in situ hybridization (FISH), quantitative PCR (qPCR), or multiplex ligation-dependent probe amplification (MLPA) preclude rigorous calibration of various metrics used by copy number variant (CNV) detection algorithms. To aid this task, we have established a comparative methodology, CNV-ROC, which is capable of performing a high throughput, low cost, analysis of CMAs that takes into consideration genome-wide true and false negatives. CNV-ROC uses a higher resolution microarray to confirm calls from a lower resolution microarray and provides for a true measure of genome-wide performance metrics at the resolution offered by microarray testing. CNV-ROC also provides for a very precise comparison of CNV calls between two microarray platforms without the need to establish an arbitrary degree of overlap. Comparison of CNVs across microarrays is done on a per-probe basis and receiver operator characteristic (ROC) analysis is used to calibrate algorithmic metrics, such as log2 ratio threshold, to enhance CNV calling performance. CNV-ROC addresses a critical and consistently overlooked aspect of analytical assessments of genome-wide techniques like CMAs which is the measurement and use of genome-wide true and false negative data for the calculation of performance metrics and comparison of CNV profiles between different microarray experiments. PMID:25595567

Measuring diagnostic and predictive accuracy in disease management: an introduction to receiver operating characteristic (ROC) analysis.

PubMed

Linden, Ariel

2006-04-01

Diagnostic or predictive accuracy concerns are common in all phases of a disease management (DM) programme, and ultimately play an influential role in the assessment of programme effectiveness. Areas, such as the identification of diseased patients, predictive modelling of future health status and costs and risk stratification, are just a few of the domains in which assessment of accuracy is beneficial, if not critical. The most commonly used analytical model for this purpose is the standard 2 x 2 table method in which sensitivity and specificity are calculated. However, there are several limitations to this approach, including the reliance on a single defined criterion or cut-off for determining a true-positive result, use of non-standardized measurement instruments and sensitivity to outcome prevalence. This paper introduces the receiver operator characteristic (ROC) analysis as a more appropriate and useful technique for assessing diagnostic and predictive accuracy in DM. Its advantages include; testing accuracy across the entire range of scores and thereby not requiring a predetermined cut-off point, easily examined visual and statistical comparisons across tests or scores, and independence from outcome prevalence. Therefore the implementation of ROC as an evaluation tool should be strongly considered in the various phases of a DM programme.

Receiver Operating Characteristic Curve Analysis of Beach Water Quality Indicator Variables

PubMed Central

Morrison, Ann Michelle; Coughlin, Kelly; Shine, James P.; Coull, Brent A.; Rex, Andrea C.

2003-01-01

Receiver operating characteristic (ROC) curve analysis is a simple and effective means to compare the accuracies of indicator variables of bacterial beach water quality. The indicator variables examined in this study were previous day's Enterococcus density and antecedent rainfall at 24, 48, and 96 h. Daily Enterococcus densities and 15-min rainfall values were collected during a 5-year (1996 to 2000) study of four Boston Harbor beaches. The indicator variables were assessed for their ability to correctly classify water as suitable or unsuitable for swimming at a maximum threshold Enterococcus density of 104 CFU/100 ml. Sensitivity and specificity values were determined for each unique previous day's Enterococcus density and antecedent rainfall volume and used to construct ROC curves. The area under the ROC curve was used to compare the accuracies of the indicator variables. Twenty-four-hour antecedent rainfall classified elevated Enterococcus densities more accurately than previous day's Enterococcus density (P = 0.079). An empirically derived threshold for 48-h antecedent rainfall, corresponding to a sensitivity of 0.75, was determined from the 1996 to 2000 data and evaluated to ascertain if the threshold would produce a 0.75 sensitivity with independent water quality data collected in 2001 from the same beaches. PMID:14602593

Evaluation of computer-aided detection of lesions in mammograms obtained with a digital phase-contrast mammography system.

PubMed

Tanaka, Toyohiko; Nitta, Norihisa; Ohta, Shinichi; Kobayashi, Tsuyoshi; Kano, Akiko; Tsuchiya, Keiko; Murakami, Yoko; Kitahara, Sawako; Wakamiya, Makoto; Furukawa, Akira; Takahashi, Masashi; Murata, Kiyoshi

2009-12-01

A computer-aided detection (CAD) system was evaluated for its ability to detect microcalcifications and masses on images obtained with a digital phase-contrast mammography (PCM) system, a system characterised by the sharp images provided by phase contrast and by the high resolution of 25-μm-pixel mammograms. Fifty abnormal and 50 normal mammograms were collected from about 3,500 mammograms and printed on film for reading on a light box. Seven qualified radiologists participated in an observer study based on receiver operating characteristic (ROC) analysis. The average of the areas under ROC curve (AUC) values for the ROC analysis with and without CAD were 0.927 and 0.897 respectively (P = 0.015). The AUC values improved from 0.840 to 0.888 for microcalcifications (P = 0.034) and from 0.947 to 0.962 for masses (P = 0.025) respectively. The application of CAD to the PCM system is a promising approach for the detection of breast cancer in its early stages.

First trimester prediction of maternal glycemic status.

PubMed

Gabbay-Benziv, Rinat; Doyle, Lauren E; Blitzer, Miriam; Baschat, Ahmet A

2015-05-01

To predict gestational diabetes mellitus (GDM) or normoglycemic status using first trimester maternal characteristics. We used data from a prospective cohort study. First trimester maternal characteristics were compared between women with and without GDM. Association of these variables with sugar values at glucose challenge test (GCT) and subsequent GDM was tested to identify key parameters. A predictive algorithm for GDM was developed and receiver operating characteristics (ROC) statistics was used to derive the optimal risk score. We defined normoglycemic state, when GCT and all four sugar values at oral glucose tolerance test, whenever obtained, were normal. Using same statistical approach, we developed an algorithm to predict the normoglycemic state. Maternal age, race, prior GDM, first trimester BMI, and systolic blood pressure (SBP) were all significantly associated with GDM. Age, BMI, and SBP were also associated with GCT values. The logistic regression analysis constructed equation and the calculated risk score yielded sensitivity, specificity, positive predictive value, and negative predictive value of 85%, 62%, 13.8%, and 98.3% for a cut-off value of 0.042, respectively (ROC-AUC - area under the curve 0.819, CI - confidence interval 0.769-0.868). The model constructed for normoglycemia prediction demonstrated lower performance (ROC-AUC 0.707, CI 0.668-0.746). GDM prediction can be achieved during the first trimester encounter by integration of maternal characteristics and basic measurements while normoglycemic status prediction is less effective.

Impact of Wisteria floribunda Agglutinin-Positive Mac-2-Binding Protein in Patients with Hepatitis C Virus-Related Compensated Liver Cirrhosis.

PubMed

Hasegawa, Kunihiro; Takata, Ryo; Nishikawa, Hiroki; Enomoto, Hirayuki; Ishii, Akio; Iwata, Yoshinori; Miyamoto, Yuho; Ishii, Noriko; Yuri, Yukihisa; Nakano, Chikage; Nishimura, Takashi; Yoh, Kazunori; Aizawa, Nobuhiro; Sakai, Yoshiyuki; Ikeda, Naoto; Takashima, Tomoyuki; Iijima, Hiroko; Nishiguchi, Shuhei

2016-09-12

We aimed to examine the effect of Wisteria floribunda agglutinin-positive Mac-2-binding protein (WFA⁺-M2BP) level on survival comparing with other laboratory liver fibrosis markers in hepatitis C virus (HCV)-related compensated liver cirrhosis (LC) (n = 165). For assessing prognostic performance of continuous fibrosis markers, we adapted time-dependent receiver operating characteristics (ROC) curves for clinical outcome. In time-dependent ROC analysis, annual area under the ROCs (AUROCs) were plotted. We also calculated the total sum of AUROCs in all time-points (TAAT score) in each fibrosis marker. WFA⁺-M2BP value ranged from 0.66 cutoff index (COI) to 19.95 COI (median value, 5.29 COI). Using ROC analysis for survival, the optimal cutoff point for WFA⁺-M2BP was 6.15 COI (AUROC = 0.79348, sensitivity = 80.0%, specificity = 74.78%). The cumulative five-year survival rate in patients with WFA⁺-M2BP ≥ 6.15 COI (n = 69) was 43.99%, while that in patients with WFA⁺-M2BP < 6.15 COI (n = 96) was 88.40% (p < 0.0001). In the multivariate analysis, absence of hepatocellular carcinoma (p = 0.0008), WFA⁺-M2BP < 6.15 COI (p = 0.0132), achievement of sustained virological response (p < 0.0001) and des-γ-carboxy prothrombin < 41 mAU/mL (p = 0.0018) were significant favorable predictors linked to survival. In time-dependent ROC analysis in all cases, WFA⁺-M2BP had the highest TAAT score among liver fibrosis markers. In conclusion, WFA⁺-M2BP can be a useful predictor in HCV-related compensated LC.

Validation of a Brief PTSD Scale for Clients with Severe Mental Illnesses

ERIC Educational Resources Information Center

O'Hare, Thomas; Shen, Ce; Sherrer, Margaret

2012-01-01

Trauma and Posttraumatic Stress Disorder (PTSD) are more common in severe mental illnesses (SMI) clients than in the general population, yet brief screens for detecting probable PTSD in SMI clients are nonexistent. In a two-part study, the authors used correlation analysis and receiver operating characteristics (ROC) analysis to develop and…

The use of intraoperative triggered electromyography to detect misplaced pedicle screws: a systematic review and meta-analysis.

PubMed

Mikula, Anthony L; Williams, Seth K; Anderson, Paul A

2016-04-01

Insertion of instruments or implants into the spine carries a risk for injury to neural tissue. Triggered electromyography (tEMG) is an intraoperative neuromonitoring technique that involves electrical stimulation of a tool or screw and subsequent measurement of muscle action potentials from myotomes innervated by nerve roots near the stimulated instrument. The authors of this study sought to determine the ability of tEMG to detect misplaced pedicle screws (PSs). The authors searched the U.S. National Library of Medicine, the Web of Science Core Collection database, and the Cochrane Central Register of Controlled Trials for PS studies. A meta-analysis of these studies was performed on a per-screw basis to determine the ability of tEMG to detect misplaced PSs. Sensitivity, specificity, and receiver operating characteristic (ROC) area under the curve (AUC) were calculated overall and in subgroups. Twenty-six studies were included in the systematic review. The authors analyzed 18 studies in which tEMG was used during PS placement in the meta-analysis, representing data from 2932 patients and 15,065 screws. The overall sensitivity of tEMG for detecting misplaced PSs was 0.78, and the specificity was 0.94. The overall ROC AUC was 0.96. A tEMG current threshold of 10-12 mA (ROC AUC 0.99) and a pulse duration of 300 µsec (ROC AUC 0.97) provided the most accurate testing parameters for detecting misplaced screws. Screws most accurately conducted EMG signals (ROC AUC 0.98). Triggered electromyography has very high specificity but only fair sensitivity for detecting malpositioned PSs.

The Obsessive Compulsive Scale of the Child Behavior Checklist Predicts Obsessive-Compulsive Disorder: A Receiver Operating Characteristic Curve Analysis

ERIC Educational Resources Information Center

Hudziak, James J.; Althoff, Robert R.; Stanger, Catherine; van Beijsterveldt, C. E. M.; Nelson, Elliot C.; Hanna, Gregory L.; Boomsma, Dorret I.; Todd, Richard D.

2006-01-01

Background: The purpose of this study was to determine a score on the Obsessive Compulsive Scale (OCS) from the Child Behavior Checklist (CBCL) to screen for obsessive compulsive disorder (OCD) in children and to rigorously test the specificity and sensitivity of a single cutpoint. Methods: A receiver operating characteristic (ROC) curve analysis…

Predictive factors in patients with hepatocellular carcinoma receiving sorafenib therapy using time-dependent receiver operating characteristic analysis.

PubMed

Nishikawa, Hiroki; Nishijima, Norihiro; Enomoto, Hirayuki; Sakamoto, Azusa; Nasu, Akihiro; Komekado, Hideyuki; Nishimura, Takashi; Kita, Ryuichi; Kimura, Toru; Iijima, Hiroko; Nishiguchi, Shuhei; Osaki, Yukio

2017-01-01

To investigate variables before sorafenib therapy on the clinical outcomes in hepatocellular carcinoma (HCC) patients receiving sorafenib and to further assess and compare the predictive performance of continuous parameters using time-dependent receiver operating characteristics (ROC) analysis. A total of 225 HCC patients were analyzed. We retrospectively examined factors related to overall survival (OS) and progression free survival (PFS) using univariate and multivariate analyses. Subsequently, we performed time-dependent ROC analysis of continuous parameters which were significant in the multivariate analysis in terms of OS and PFS. Total sum of area under the ROC in all time points (defined as TAAT score) in each case was calculated. Our cohort included 175 male and 50 female patients (median age, 72 years) and included 158 Child-Pugh A and 67 Child-Pugh B patients. The median OS time was 0.68 years, while the median PFS time was 0.24 years. On multivariate analysis, gender, body mass index (BMI), Child-Pugh classification, extrahepatic metastases, tumor burden, aspartate aminotransferase (AST) and alpha-fetoprotein (AFP) were identified as significant predictors of OS and ECOG-performance status, Child-Pugh classification and extrahepatic metastases were identified as significant predictors of PFS. Among three continuous variables (i.e., BMI, AST and AFP), AFP had the highest TAAT score for the entire cohort. In subgroup analyses, AFP had the highest TAAT score except for Child-Pugh B and female among three continuous variables. In continuous variables, AFP could have higher predictive accuracy for survival in HCC patients undergoing sorafenib therapy.

The influence of averaging and noisy decision strategies on the recognition memory ROC.

PubMed

Malmberg, Kenneth J; Xu, Jing

2006-02-01

Many single- and dual-process models of recognition memory predict that the ratings and remember-know receiver operating characteristics (ROCs) are the same, but Rotello, Macmillan, and Reeder (2004) reported that the slopes of the remember-know and ratings z-transformed ROCs (zROCs) are different The authors show that averaging introduces nonlinearities to the form of the zROC and that ratings and remember-know zROCs are indistinguishable when constructed in a conventional manner. The authors show, further, that some nonoptimal decision strategies have a distinctive, nonlinear effect on the form of the single-process continuous-state zROC. The conclusion is that many factors having nothing to do with the nature of recognition memory can affect the shape of zROCs, and that therefore, the shape of the zROC does not, alone, characterize different memory models.

Proximal caries detection: Sirona Sidexis versus Kodak Ektaspeed Plus.

PubMed

Khan, Emad A; Tyndall, Donald A; Ludlow, John B; Caplan, Daniel

2005-01-01

This study compared the accuracy of intraoral film and a charge-coupled device (CCD) receptor for proximal caries detection. Four observers evaluated images of the proximal surfaces of 40 extracted posterior teeth. The presence or absence of caries was scored using a five-point confidence scale. The actual status of each surface was determined from ground section histology. Responses were evaluated by means of receiver operating characteristic (ROC) analysis. Areas under ROC curves (Az) were assessed through a paired t-test. The performance of the CCD-based intraoral sensor was not different statistically from Ektaspeed Plus film in detecting proximal caries.

Analysis of ROC on chest direct digital radiography (DR) after image processing in diagnosis of SARS

NASA Astrophysics Data System (ADS)

Lv, Guozheng; Lan, Rihui; Zeng, Qingsi; Zheng, Zhong

2004-05-01

The Severe Acute Respiratory Syndrome (SARS, also called Infectious Atypical Pneumonia), which initially broke out in late 2002, has threatened the public"s health seriously. How to confirm the patients contracting SARS becomes an urgent issue in diagnosis. This paper intends to evaluate the importance of Image Processing in the diagnosis on SARS at the early stage. Receiver Operating Characteristics (ROC) analysis has been employed in this study to compare the value of DR images in the diagnosis of SARS patients before and after image processing by Symphony Software supplied by E-Com Technology Ltd., and DR image study of 72 confirmed or suspected SARS patients were reviewed respectively. All the images taken from the studied patients were processed by Symphony. Both the original and processed images were taken into ROC analysis, based on which the ROC graph for each group of images has been produced as described below: For processed images: a = 1.9745, b = 1.4275, SA = 0.8714; For original images: a = 0.9066, b = 0.8310, SA = 0.7572; (a - intercept, b - slop, SA - Area below the curve). The result shows significant difference between the original images and processed images (P<0.01). In summary, the images processed by Symphony are superior to the original ones in detecting the opacity lesion, and increases the accuracy of SARS diagnosis.

Binary ROCs in Perception and Recognition Memory Are Curved

ERIC Educational Resources Information Center

Dube, Chad; Rotello, Caren M.

2012-01-01

In recognition memory, a classic finding is that receiver operating characteristics (ROCs) are curvilinear. This has been taken to support the fundamental assumptions of signal detection theory (SDT) over discrete-state models such as the double high-threshold model (2HTM), which predicts linear ROCs. Recently, however, Broder and Schutz (2009)…

Use of Multiple Metabolic and Genetic Markers to Improve the Prediction of Type 2 Diabetes: the EPIC-Potsdam Study

PubMed Central

Schulze, Matthias B.; Weikert, Cornelia; Pischon, Tobias; Bergmann, Manuela M.; Al-Hasani, Hadi; Schleicher, Erwin; Fritsche, Andreas; Häring, Hans-Ulrich; Boeing, Heiner; Joost, Hans-Georg

2009-01-01

OBJECTIVE We investigated whether metabolic biomarkers and single nucleotide polymorphisms (SNPs) improve diabetes prediction beyond age, anthropometry, and lifestyle risk factors. RESEARCH DESIGN AND METHODS A case-cohort study within a prospective study was designed. We randomly selected a subcohort (n = 2,500) from 26,444 participants, of whom 1,962 were diabetes free at baseline. Of the 801 incident type 2 diabetes cases identified in the cohort during 7 years of follow-up, 579 remained for analyses after exclusions. Prediction models were compared by receiver operatoring characteristic (ROC) curve and integrated discrimination improvement. RESULTS Case-control discrimination by the lifestyle characteristics (ROC-AUC: 0.8465) improved with plasma glucose (ROC-AUC: 0.8672, P < 0.001) and A1C (ROC-AUC: 0.8859, P < 0.001). ROC-AUC further improved with HDL cholesterol, triglycerides, γ-glutamyltransferase, and alanine aminotransferase (0.9000, P = 0.002). Twenty SNPs did not improve discrimination beyond these characteristics (P = 0.69). CONCLUSIONS Metabolic markers, but not genotyping for 20 diabetogenic SNPs, improve discrimination of incident type 2 diabetes beyond lifestyle risk factors. PMID:19720844

CNV-ROC: A cost effective, computer-aided analytical performance evaluator of chromosomal microarrays.

PubMed

Goodman, Corey W; Major, Heather J; Walls, William D; Sheffield, Val C; Casavant, Thomas L; Darbro, Benjamin W

2015-04-01

Chromosomal microarrays (CMAs) are routinely used in both research and clinical laboratories; yet, little attention has been given to the estimation of genome-wide true and false negatives during the assessment of these assays and how such information could be used to calibrate various algorithmic metrics to improve performance. Low-throughput, locus-specific methods such as fluorescence in situ hybridization (FISH), quantitative PCR (qPCR), or multiplex ligation-dependent probe amplification (MLPA) preclude rigorous calibration of various metrics used by copy number variant (CNV) detection algorithms. To aid this task, we have established a comparative methodology, CNV-ROC, which is capable of performing a high throughput, low cost, analysis of CMAs that takes into consideration genome-wide true and false negatives. CNV-ROC uses a higher resolution microarray to confirm calls from a lower resolution microarray and provides for a true measure of genome-wide performance metrics at the resolution offered by microarray testing. CNV-ROC also provides for a very precise comparison of CNV calls between two microarray platforms without the need to establish an arbitrary degree of overlap. Comparison of CNVs across microarrays is done on a per-probe basis and receiver operator characteristic (ROC) analysis is used to calibrate algorithmic metrics, such as log2 ratio threshold, to enhance CNV calling performance. CNV-ROC addresses a critical and consistently overlooked aspect of analytical assessments of genome-wide techniques like CMAs which is the measurement and use of genome-wide true and false negative data for the calculation of performance metrics and comparison of CNV profiles between different microarray experiments. Copyright © 2015 Elsevier Inc. All rights reserved.

Clinical diagnostic accuracy of acute colonic diverticulitis in patients admitted with acute abdominal pain, a receiver operating characteristic curve analysis.

PubMed

Jamal Talabani, A; Endreseth, B H; Lydersen, S; Edna, T-H

2017-01-01

The study investigated the capability of clinical findings, temperature, C-reactive protein (CRP), and white blood cell (WBC) count to discern patients with acute colonic diverticulitis from all other patients admitted with acute abdominal pain. The probability of acute diverticulitis was assessed by the examining doctor, using a scale from 0 (zero probability) to 10 (100 % probability). Receiver operating characteristic (ROC) curves were used to assess the clinical diagnostic accuracy of acute colonic diverticulitis in patients admitted with acute abdominal pain. Of 833 patients admitted with acute abdominal pain, 95 had acute colonic diverticulitis. ROC curve analysis gave an area under the ROC curve (AUC) of 0.95 (CI 0.92 to 0.97) for ages <65 years, AUC = 0.86 (CI 0.78 to 0.93) in older patients. Separate analysis showed an AUC = 0.83 (CI 0.80 to 0.86) of CRP alone. White blood cell count and temperature were almost useless to discriminate acute colonic diverticulitis from other types of acute abdominal pain, AUC = 0.59 (CI 0.53 to 0.65) for white blood cell count and AUC = 0.57 (0.50 to 0.63) for temperature, respectively. This prospective study demonstrates that standard clinical evaluation by non-specialist doctors based on history, physical examination, and initial blood tests on admission provides a high degree of diagnostic precision in patients with acute colonic diverticulitis.

Universal School Readiness Screening at Kindergarten Entry

ERIC Educational Resources Information Center

Quirk, Matthew; Dowdy, Erin; Dever, Bridget; Carnazzo, Katherine; Bolton, Courtney

2018-01-01

Researchers examined the concurrent and predictive validity of a brief (12-item) teacher-rated school readiness screener, the Kindergarten Student Entrance Profile (KSEP), using receiver operating characteristic (ROC) curve analysis to examine associations between (N = 78) children's social-emotional (SE) and cognitive (COG) readiness with…

Iodine concentration: a new, important characteristic of the spot sign that predicts haematoma expansion.

PubMed

Fu, Fan; Sun, Shengjun; Liu, Liping; Li, Jianying; Su, Yaping; Li, Yingying

2018-04-19

The computed tomography angiography (CTA) spot sign is a validated predictor of haematoma expansion (HE) in spontaneous intracerebral haemorrhage (SICH). We investigated whether defining the iodine concentration (IC) inside the spot sign and the haematoma on Gemstone spectral imaging (GSI) would improve its sensitivity and specificity for predicting HE. From 2014 to 2016, we prospectively enrolled 65 SICH patients who underwent single-phase spectral CTA within 6 h. Logistic regression was performed to assess the risk factors for HE. The predictive performance of individual spot sign characteristics was examined via receiver operating characteristic (ROC) analysis. The spot sign was detected in 46.1% (30/65) of patients. ROC analysis indicated that IC inside the spot sign had the greatest area under the ROC curve for HE (0.858; 95% confidence interval, 0.727-0.989; p = 0.003). Multivariate analysis found that spot sign with higher IC (i.e. IC > 7.82 100 μg/ml) was an independent predictor of HE (odds ratio = 34.27; 95% confidence interval, 5.608-209.41; p < 0.001) with sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) of 0.81, 0.75, 0.90 and 0.60, respectively; while the spot sign showed sensitivity, specificity, PPV and NPV of 0.81, 0.79, 0.73 and 0.86. Logistic regression analysis indicated that the IC in haematomas was independently associated with HE (odds ratio = 1.525; 95% confidence interval, 1.041-2.235; p = 0.030). ICs in haematoma and in spot sign were all independently associated with HE. IC analysis in spectral imaging may help to identify SICH patients for targeted haemostatic therapy. • Iodine concentration in spot sign and haematoma can predict haematoma expansion • Spectral imaging could measure the IC inside the spot sign and haematoma • IC in spot sign improved the positive predictive value (PPV) cf. CTA.

Verification of a model for the detection of intrauterine growth restriction (IUGR) by receiver operating characteristics (ROC)

NASA Astrophysics Data System (ADS)

Liu, Pengbo; Mongelli, Max; Mondry, Adrian

2004-07-01

The purpose of this study is to verify by Receiver Operating Characteristics (ROC) a mathematical model supporting the hypothesis that IUGR can be diagnosed by estimating growth velocity. The ROC compare computerized simulation results with clinical data from 325 pregnant British women. Each patient had 6 consecutive ultrasound examinations for fetal abdominal circumference (fac). Customized and un-customized fetal weights were calculated according to Hadlock"s formula. IUGR was diagnosed by the clinical standard, i.e. estimated weight below the tenth percentile. Growth velocity was estimated by calculating the changes of fac (Dzfac/dt) at various time intervals from 3 to 10 weeks. Finally, ROC was used to compare the methods. At 3~4 weeks scan interval, the area under the ROC curve is 0.68 for customized data and 0.66 for the uncustomized data with 95% confidence interval. Comparison between simulation data and real pregnancies verified that the model is clinically acceptable.

Transformation-invariant and nonparametric monotone smooth estimation of ROC curves.

PubMed

Du, Pang; Tang, Liansheng

2009-01-30

When a new diagnostic test is developed, it is of interest to evaluate its accuracy in distinguishing diseased subjects from non-diseased subjects. The accuracy of the test is often evaluated by receiver operating characteristic (ROC) curves. Smooth ROC estimates are often preferable for continuous test results when the underlying ROC curves are in fact continuous. Nonparametric and parametric methods have been proposed by various authors to obtain smooth ROC curve estimates. However, there are certain drawbacks with the existing methods. Parametric methods need specific model assumptions. Nonparametric methods do not always satisfy the inherent properties of the ROC curves, such as monotonicity and transformation invariance. In this paper we propose a monotone spline approach to obtain smooth monotone ROC curves. Our method ensures important inherent properties of the underlying ROC curves, which include monotonicity, transformation invariance, and boundary constraints. We compare the finite sample performance of the newly proposed ROC method with other ROC smoothing methods in large-scale simulation studies. We illustrate our method through a real life example. Copyright (c) 2008 John Wiley & Sons, Ltd.

The Belief Bias Effect Is Aptly Named: A Reply to Klauer and Kellen (2011)

ERIC Educational Resources Information Center

Dube, Chad; Rotello, Caren M.; Heit, Evan

2011-01-01

In "Assessing the Belief Bias Effect With ROCs: It's a Response Bias Effect," Dube, Rotello, and Heit (2010) examined the form of receiver operating characteristic (ROC) curves for reasoning and the effects of belief bias on measurement indices that differ in whether they imply a curved or linear ROC function. We concluded that the ROC…

Evaluation and simplification of the occupational slip, trip and fall risk-assessment test

PubMed Central

NAKAMURA, Takehiro; OYAMA, Ichiro; FUJINO, Yoshihisa; KUBO, Tatsuhiko; KADOWAKI, Koji; KUNIMOTO, Masamizu; ODOI, Haruka; TABATA, Hidetoshi; MATSUDA, Shinya

2016-01-01

Objective: The purpose of this investigation is to evaluate the efficacy of the occupational slip, trip and fall (STF) risk assessment test developed by the Japan Industrial Safety and Health Association (JISHA). We further intended to simplify the test to improve efficiency. Methods: A previous cohort study was performed using 540 employees aged ≥50 years who took the JISHA’s STF risk assessment test. We conducted multivariate analysis using these previous results as baseline values and answers to questionnaire items or score on physical fitness tests as variables. The screening efficiency of each model was evaluated based on the obtained receiver operating characteristic (ROC) curve. Results: The area under the ROC obtained in multivariate analysis was 0.79 when using all items. Six of the 25 questionnaire items were selected for stepwise analysis, giving an area under the ROC curve of 0.77. Conclusion: Based on the results of follow-up performed one year after the initial examination, we successfully determined the usefulness of the STF risk assessment test. Administering a questionnaire alone is sufficient for screening subjects at risk of STF during the subsequent one-year period. PMID:27021057

Adaptive histogram equalization in digital radiography of destructive skeletal lesions.

PubMed

Braunstein, E M; Capek, P; Buckwalter, K; Bland, P; Meyer, C R

1988-03-01

Adaptive histogram equalization, an image-processing technique that distributes pixel values of an image uniformly throughout the gray scale, was applied to 28 plain radiographs of bone lesions, after they had been digitized. The non-equalized and equalized digital images were compared by two skeletal radiologists with respect to lesion margins, internal matrix, soft-tissue mass, cortical breakthrough, and periosteal reaction. Receiver operating characteristic (ROC) curves were constructed on the basis of the responses. Equalized images were superior to nonequalized images in determination of cortical breakthrough and presence or absence of periosteal reaction. ROC analysis showed no significant difference in determination of margins, matrix, or soft-tissue masses.

Receiver Operating Characteristic Analysis for Classification Based on Various Prior Probabilities of Groups with an Application to Breath Analysis

NASA Astrophysics Data System (ADS)

Cimermanová, K.

2009-01-01

In this paper we illustrate the influence of prior probabilities of diseases on diagnostic reasoning. For various prior probabilities of classified groups characterized by volatile organic compounds of breath profile, smokers and non-smokers, we constructed the ROC curve and the Youden index with related asymptotic pointwise confidence intervals.

Development and optimization of SPECT gated blood pool cluster analysis for the prediction of CRT outcome.

PubMed

Lalonde, Michel; Wells, R Glenn; Birnie, David; Ruddy, Terrence D; Wassenaar, Richard

2014-07-01

Phase analysis of single photon emission computed tomography (SPECT) radionuclide angiography (RNA) has been investigated for its potential to predict the outcome of cardiac resynchronization therapy (CRT). However, phase analysis may be limited in its potential at predicting CRT outcome as valuable information may be lost by assuming that time-activity curves (TAC) follow a simple sinusoidal shape. A new method, cluster analysis, is proposed which directly evaluates the TACs and may lead to a better understanding of dyssynchrony patterns and CRT outcome. Cluster analysis algorithms were developed and optimized to maximize their ability to predict CRT response. About 49 patients (N = 27 ischemic etiology) received a SPECT RNA scan as well as positron emission tomography (PET) perfusion and viability scans prior to undergoing CRT. A semiautomated algorithm sampled the left ventricle wall to produce 568 TACs from SPECT RNA data. The TACs were then subjected to two different cluster analysis techniques, K-means, and normal average, where several input metrics were also varied to determine the optimal settings for the prediction of CRT outcome. Each TAC was assigned to a cluster group based on the comparison criteria and global and segmental cluster size and scores were used as measures of dyssynchrony and used to predict response to CRT. A repeated random twofold cross-validation technique was used to train and validate the cluster algorithm. Receiver operating characteristic (ROC) analysis was used to calculate the area under the curve (AUC) and compare results to those obtained for SPECT RNA phase analysis and PET scar size analysis methods. Using the normal average cluster analysis approach, the septal wall produced statistically significant results for predicting CRT results in the ischemic population (ROC AUC = 0.73;p < 0.05 vs. equal chance ROC AUC = 0.50) with an optimal operating point of 71% sensitivity and 60% specificity. Cluster analysis results were similar to SPECT RNA phase analysis (ROC AUC = 0.78, p = 0.73 vs cluster AUC; sensitivity/specificity = 59%/89%) and PET scar size analysis (ROC AUC = 0.73, p = 1.0 vs cluster AUC; sensitivity/specificity = 76%/67%). A SPECT RNA cluster analysis algorithm was developed for the prediction of CRT outcome. Cluster analysis results produced results equivalent to those obtained from Fourier and scar analysis.

Development and optimization of SPECT gated blood pool cluster analysis for the prediction of CRT outcome

DOE Office of Scientific and Technical Information (OSTI.GOV)

Lalonde, Michel, E-mail: mlalonde15@rogers.com; Wassenaar, Richard; Wells, R. Glenn

2014-07-15

Purpose: Phase analysis of single photon emission computed tomography (SPECT) radionuclide angiography (RNA) has been investigated for its potential to predict the outcome of cardiac resynchronization therapy (CRT). However, phase analysis may be limited in its potential at predicting CRT outcome as valuable information may be lost by assuming that time-activity curves (TAC) follow a simple sinusoidal shape. A new method, cluster analysis, is proposed which directly evaluates the TACs and may lead to a better understanding of dyssynchrony patterns and CRT outcome. Cluster analysis algorithms were developed and optimized to maximize their ability to predict CRT response. Methods: Aboutmore » 49 patients (N = 27 ischemic etiology) received a SPECT RNA scan as well as positron emission tomography (PET) perfusion and viability scans prior to undergoing CRT. A semiautomated algorithm sampled the left ventricle wall to produce 568 TACs from SPECT RNA data. The TACs were then subjected to two different cluster analysis techniques, K-means, and normal average, where several input metrics were also varied to determine the optimal settings for the prediction of CRT outcome. Each TAC was assigned to a cluster group based on the comparison criteria and global and segmental cluster size and scores were used as measures of dyssynchrony and used to predict response to CRT. A repeated random twofold cross-validation technique was used to train and validate the cluster algorithm. Receiver operating characteristic (ROC) analysis was used to calculate the area under the curve (AUC) and compare results to those obtained for SPECT RNA phase analysis and PET scar size analysis methods. Results: Using the normal average cluster analysis approach, the septal wall produced statistically significant results for predicting CRT results in the ischemic population (ROC AUC = 0.73;p < 0.05 vs. equal chance ROC AUC = 0.50) with an optimal operating point of 71% sensitivity and 60% specificity. Cluster analysis results were similar to SPECT RNA phase analysis (ROC AUC = 0.78, p = 0.73 vs cluster AUC; sensitivity/specificity = 59%/89%) and PET scar size analysis (ROC AUC = 0.73, p = 1.0 vs cluster AUC; sensitivity/specificity = 76%/67%). Conclusions: A SPECT RNA cluster analysis algorithm was developed for the prediction of CRT outcome. Cluster analysis results produced results equivalent to those obtained from Fourier and scar analysis.« less

Influencing clinicians and healthcare managers: can ROC be more persuasive?

NASA Astrophysics Data System (ADS)

Taylor-Phillips, S.; Wallis, M. G.; Duncan, A.; Gale, A. G.

2010-02-01

Receiver Operating Characteristic analysis provides a reliable and cost effective performance measurement tool, without using full clinical trials. However, when ROC analysis shows that performance is statistically superior in one condition than another it is difficult to relate this result to effects in practice, or even to determine whether it is clinically significant. In this paper we present two concurrent analyses: using ROC methods alongside single threshold recall rate data, and suggest that reporting both provides complimentary data. Four mammographers read 160 difficult cases (41% malignant) twice, with and without prior mammograms. Lesion location and probability of malignancy was reported for each case and analyzed using JAFROC. Concurrently each participant chose recall or return to screen for each case. JAFROC analysis showed that the presence of prior mammograms improved performance (p<.05). Single threshold data showed a trend towards a 26% increase in the number of false positive recalls without prior mammograms (p=.056). If this trend were present throughout the NHS Breast Screening Programme then discarding prior mammograms would correspond to an increase in recall rate from 4.6% to 5.3%, and 12,414 extra women recalled annually for assessment. Whilst ROC methods account for all possible thresholds of recall and have higher power, providing a single threshold example of false positive, false negative, and recall rates when reporting results could be more influential for clinicians. This paper discusses whether this is a useful additional method of presenting data, or whether it is misleading and inaccurate.

Receiver operating characteristic analysis of eyewitness memory: comparing the diagnostic accuracy of simultaneous versus sequential lineups.

PubMed

Mickes, Laura; Flowe, Heather D; Wixted, John T

2012-12-01

A police lineup presents a real-world signal-detection problem because there are two possible states of the world (the suspect is either innocent or guilty), some degree of information about the true state of the world is available (the eyewitness has some degree of memory for the perpetrator), and a decision is made (identifying the suspect or not). A similar state of affairs applies to diagnostic tests in medicine because, in a patient, the disease is either present or absent, a diagnostic test yields some degree of information about the true state of affairs, and a decision is made about the presence or absence of the disease. In medicine, receiver operating characteristic (ROC) analysis is the standard method for assessing diagnostic accuracy. By contrast, in the eyewitness memory literature, this powerful technique has never been used. Instead, researchers have attempted to assess the diagnostic performance of different lineup procedures using methods that cannot identify the better procedure (e.g., by computing a diagnosticity ratio). Here, we describe the basics of ROC analysis, explaining why it is needed and showing how to use it to measure the performance of different lineup procedures. To illustrate the unique advantages of this technique, we also report 3 ROC experiments that were designed to investigate the diagnostic accuracy of simultaneous versus sequential lineups. According to our findings, the sequential procedure appears to be inferior to the simultaneous procedure in discriminating between the presence versus absence of a guilty suspect in a lineup.

Reliability of cone beam computed tomography as a biopsy-independent tool in differential diagnosis of periapical cysts and granulomas: An In vivo Study

PubMed Central

Chanani, Ankit; Adhikari, Haridas Das

2017-01-01

Background: Differential diagnosis of periapical cysts and granulomas is required as their treatment modalities are different. Aim: The aim of this study was to evaluate the efficacy of cone beam computed tomography (CBCT) in the differential diagnosis of periapical cysts from granulomas. Settings and Design: A single-centered observational study was carried out in the Department of Conservative Dentistry and Endodontics, Dr. R. Ahmed Dental College and Hospital, using CBCT and dental operating microscope. Methods: Forty-five lesions were analyzed using CBCT scans. One evaluator analyzed each CBCT scan for the presence of the following six characteristic radiological features: cyst like-location, shape, periphery, internal structure, effect on the surrounding structures, and cortical plate perforation. Another independent evaluator analyzed the CBCT scans. This process was repeated after 6 months, and inter- and intrarater reliability of CBCT diagnoses was evaluated. Periapical surgeries were performed and tissue samples were obtained for histopathological analysis. To evaluate the efficacy, CBCT diagnoses were compared with histopathological diagnoses, and six receiver operating characteristic (ROC) curve analyses were conducted. Statistical Analysis Used: ROC curve, Cronbach's alpha (α) test, and Cohen Kappa (κ) test were used for statistical analysis. Results: Both inter- and intrarater reliability were excellent (α = 0.94, κ = 0.75 and 0.77, respectively). ROC curve with regard to ≥4 positive findings revealed the highest area under curve (0.66). Conclusion: CBCT is moderately accurate in the differential diagnosis of periapical cysts and granulomas. PMID:29386780

Optimal algorithm for automatic detection of microaneurysms based on receiver operating characteristic curve

NASA Astrophysics Data System (ADS)

Xu, Lili; Luo, Shuqian

2010-11-01

Microaneurysms (MAs) are the first manifestations of the diabetic retinopathy (DR) as well as an indicator for its progression. Their automatic detection plays a key role for both mass screening and monitoring and is therefore in the core of any system for computer-assisted diagnosis of DR. The algorithm basically comprises the following stages: candidate detection aiming at extracting the patterns possibly corresponding to MAs based on mathematical morphological black top hat, feature extraction to characterize these candidates, and classification based on support vector machine (SVM), to validate MAs. Feature vector and kernel function of SVM selection is very important to the algorithm. We use the receiver operating characteristic (ROC) curve to evaluate the distinguishing performance of different feature vectors and different kernel functions of SVM. The ROC analysis indicates the quadratic polynomial SVM with a combination of features as the input shows the best discriminating performance.

Optimal algorithm for automatic detection of microaneurysms based on receiver operating characteristic curve.

PubMed

Xu, Lili; Luo, Shuqian

2010-01-01

Microaneurysms (MAs) are the first manifestations of the diabetic retinopathy (DR) as well as an indicator for its progression. Their automatic detection plays a key role for both mass screening and monitoring and is therefore in the core of any system for computer-assisted diagnosis of DR. The algorithm basically comprises the following stages: candidate detection aiming at extracting the patterns possibly corresponding to MAs based on mathematical morphological black top hat, feature extraction to characterize these candidates, and classification based on support vector machine (SVM), to validate MAs. Feature vector and kernel function of SVM selection is very important to the algorithm. We use the receiver operating characteristic (ROC) curve to evaluate the distinguishing performance of different feature vectors and different kernel functions of SVM. The ROC analysis indicates the quadratic polynomial SVM with a combination of features as the input shows the best discriminating performance.

Diagnostic accuracy of presepsin (sCD14-ST) as a biomarker of infection and sepsis in the emergency department.

PubMed

de Guadiana Romualdo, Luis García; Torrella, Patricia Esteban; Acebes, Sergio Rebollo; Otón, María Dolores Albaladejo; Sánchez, Roberto Jiménez; Holgado, Ana Hernando; Santos, Enrique Jiménez; Freire, Alejandro Ortín

2017-01-01

Presepsin is a promising biomarker for the diagnosis and prognosis of sepsis. However, results reported about its value to diagnose sepsis in an emergency department (ED) are controversial, probably due to differences in the design of the studies. We have evaluated the diagnostic accuracy of presepsin for infection and sepsis, compared with procalcitonin (PCT) and C-reactive protein (CRP), in patients presenting to the emergency department (ED) with suspected infection. 223 patients with suspected infection were enrolled for the study. Blood samples were collected on admission for measurement of biomarkers. Definitive diagnosis was obtained afterwards by analysis of digital medical records. Receiver operating characteristic (ROC) curve analysis was conducted to determine the diagnostic accuracy. Infection was confirmed in 200 patients, including 130 with non-complicated infection and 70 with sepsis. Median CRP, PCT and presepsin levels were significantly higher in patients with infection and sepsis. PCT was the biomarker with the highest performance for infection (ROC AUC: 0.910); for sepsis, PCT (ROC AUC: 0.815) and presepsin (ROC AUC: 0.775) shown a similar performance. Although presepsin is a valuable biomarker for diagnosis of infection and sepsis, its diagnostic accuracy in our study does not improve that of PCT. Its introduction in clinical practice is not justified. Copyright © 2016 Elsevier B.V. All rights reserved.

Operating characteristics of depression and anxiety disorder phenotype dimensions and trait neuroticism: a theoretical examination of the fear and distress disorders from the Netherlands study of depression and anxiety.

PubMed

Tully, Phillip J; Wardenaar, Klaas J; Penninx, Brenda W J H

2015-03-15

The receiver operating characteristics (ROC) of anhedonic depression and anxious arousal to detect the distress- (major depression, dysthymia, generalized anxiety disorder) and fear-disorder clusters (i.e. panic disorder, agoraphobia, social phobia) have not been reported in a large sample. A sample of 2981 persons underwent structured psychiatric interview; n=652 were without lifetime depression and anxiety disorder history. Participants also completed a neuroticism scale (Revised NEO Five Factor Inventory [NEO-FFI]), and the 30-item short adaptation of the Mood and Anxiety Symptoms Questionnaire (MASQ-D30) measuring anhedonic depression, anxious arousal and general distress. Maximal sensitivity and specificity was determined by the Youden Index and the area-under-the-curve (AUC) in ROC analysis. A total of 2624 completed all measures (age M=42.4 years±13.1, 1760 females [67.1%]), including 1060 (40.4%) persons who met criteria for a distress-disorder, and 973 (37.1%) who met criteria for a fear-disorder. The general distress dimension provided the highest ROC values in the detection of the distress-disorders (AUC=.814, sensitivity=71.95%, specificity=76.34%, positive predictive value=67.33, negative predictive value=80.07). None of the measures provided suitable operating characteristics in the detection of the fear-disorders with specificity values <75%. Over sampling of depression and anxiety disorders may lead to inflated positive- and negative predictive values. The MASQ-D30 general distress dimension showed clinically suitable operating characteristics in the detection of distress-disorders. Neither neuroticism nor the MASQ-D30 dimensions provided suitable operating characteristics in the detection of the fear-disorders. Copyright © 2014 Elsevier B.V. All rights reserved.

Bayesian multivariate hierarchical transformation models for ROC analysis.

PubMed

O'Malley, A James; Zou, Kelly H

2006-02-15

A Bayesian multivariate hierarchical transformation model (BMHTM) is developed for receiver operating characteristic (ROC) curve analysis based on clustered continuous diagnostic outcome data with covariates. Two special features of this model are that it incorporates non-linear monotone transformations of the outcomes and that multiple correlated outcomes may be analysed. The mean, variance, and transformation components are all modelled parametrically, enabling a wide range of inferences. The general framework is illustrated by focusing on two problems: (1) analysis of the diagnostic accuracy of a covariate-dependent univariate test outcome requiring a Box-Cox transformation within each cluster to map the test outcomes to a common family of distributions; (2) development of an optimal composite diagnostic test using multivariate clustered outcome data. In the second problem, the composite test is estimated using discriminant function analysis and compared to the test derived from logistic regression analysis where the gold standard is a binary outcome. The proposed methodology is illustrated on prostate cancer biopsy data from a multi-centre clinical trial.

Bayesian multivariate hierarchical transformation models for ROC analysis

PubMed Central

O'Malley, A. James; Zou, Kelly H.

2006-01-01

SUMMARY A Bayesian multivariate hierarchical transformation model (BMHTM) is developed for receiver operating characteristic (ROC) curve analysis based on clustered continuous diagnostic outcome data with covariates. Two special features of this model are that it incorporates non-linear monotone transformations of the outcomes and that multiple correlated outcomes may be analysed. The mean, variance, and transformation components are all modelled parametrically, enabling a wide range of inferences. The general framework is illustrated by focusing on two problems: (1) analysis of the diagnostic accuracy of a covariate-dependent univariate test outcome requiring a Box–Cox transformation within each cluster to map the test outcomes to a common family of distributions; (2) development of an optimal composite diagnostic test using multivariate clustered outcome data. In the second problem, the composite test is estimated using discriminant function analysis and compared to the test derived from logistic regression analysis where the gold standard is a binary outcome. The proposed methodology is illustrated on prostate cancer biopsy data from a multi-centre clinical trial. PMID:16217836

Reliability of cone beam computed tomography as a biopsy-independent tool in differential diagnosis of periapical cysts and granulomas: An In vivo Study.

PubMed

Chanani, Ankit; Adhikari, Haridas Das

2017-01-01

Differential diagnosis of periapical cysts and granulomas is required as their treatment modalities are different. The aim of this study was to evaluate the efficacy of cone beam computed tomography (CBCT) in the differential diagnosis of periapical cysts from granulomas. A single-centered observational study was carried out in the Department of Conservative Dentistry and Endodontics, Dr. R. Ahmed Dental College and Hospital, using CBCT and dental operating microscope. Forty-five lesions were analyzed using CBCT scans. One evaluator analyzed each CBCT scan for the presence of the following six characteristic radiological features: cyst like-location, shape, periphery, internal structure, effect on the surrounding structures, and cortical plate perforation. Another independent evaluator analyzed the CBCT scans. This process was repeated after 6 months, and inter- and intrarater reliability of CBCT diagnoses was evaluated. Periapical surgeries were performed and tissue samples were obtained for histopathological analysis. To evaluate the efficacy, CBCT diagnoses were compared with histopathological diagnoses, and six receiver operating characteristic (ROC) curve analyses were conducted. ROC curve, Cronbach's alpha (α) test, and Cohen Kappa (κ) test were used for statistical analysis. Both inter- and intrarater reliability were excellent (α = 0.94, κ = 0.75 and 0.77, respectively). ROC curve with regard to ≥4 positive findings revealed the highest area under curve (0.66). CBCT is moderately accurate in the differential diagnosis of periapical cysts and granulomas.

Validation of a Competitive Enzyme-Linked Immunosorbent Assay for Detection of Babesia bigemina Antibodies in Cattle

USDA-ARS?s Scientific Manuscript database

A competitive ELISA (cELISA) based on a broadly conserved, species-specific, B-cell epitope within the C-terminus of Babesia bigemina rhoptry-associated protein-1a was validated for international use. Receiver Operating Characteristic (ROC) analysis revealed 16% inhibition as the threshold for a neg...

Examining Classification Criteria: A Comparison of Three Cut Score Methods

ERIC Educational Resources Information Center

DiStefano, Christine; Morgan, Grant

2011-01-01

This study compared 3 different methods of creating cut scores for a screening instrument, T scores, receiver operating characteristic curve (ROC) analysis, and the Rasch rating scale method (RSM), for use with the Behavioral and Emotional Screening System (BESS) Teacher Rating Scale for Children and Adolescents (Kamphaus & Reynolds, 2007).…

Use of the Child Behavior Checklist as a Diagnostic Screening Tool in Community Mental Health

ERIC Educational Resources Information Center

Rishel, Carrie W.; Greeno, Catherine; Marcus, Steven C.; Shear, M. Katherine; Anderson, Carol

2005-01-01

Objective: This study examines whether the Child Behavior Checklist (CBCL) can be used as an accurate psychiatric screening tool for children in community mental health settings. Method: Associations, logistic regression models, and receiver operating characteristic (ROC) analysis were used to test the predictive relationship between the CBCL and…

Investigating Strength and Frequency Effects in Recognition Memory Using Type-2 Signal Detection Theory

ERIC Educational Resources Information Center

Higham, Philip A.; Perfect, Timothy J.; Bruno, Davide

2009-01-01

Criterion- versus distribution-shift accounts of frequency and strength effects in recognition memory were investigated with Type-2 signal detection receiver operating characteristic (ROC) analysis, which provides a measure of metacognitive monitoring. Experiment 1 demonstrated a frequency-based mirror effect, with a higher hit rate and lower…

Improving fMRI reliability in presurgical mapping for brain tumours.

PubMed

Stevens, M Tynan R; Clarke, David B; Stroink, Gerhard; Beyea, Steven D; D'Arcy, Ryan Cn

2016-03-01

Functional MRI (fMRI) is becoming increasingly integrated into clinical practice for presurgical mapping. Current efforts are focused on validating data quality, with reliability being a major factor. In this paper, we demonstrate the utility of a recently developed approach that uses receiver operating characteristic-reliability (ROC-r) to: (1) identify reliable versus unreliable data sets; (2) automatically select processing options to enhance data quality; and (3) automatically select individualised thresholds for activation maps. Presurgical fMRI was conducted in 16 patients undergoing surgical treatment for brain tumours. Within-session test-retest fMRI was conducted, and ROC-reliability of the patient group was compared to a previous healthy control cohort. Individually optimised preprocessing pipelines were determined to improve reliability. Spatial correspondence was assessed by comparing the fMRI results to intraoperative cortical stimulation mapping, in terms of the distance to the nearest active fMRI voxel. The average ROC-r reliability for the patients was 0.58±0.03, as compared to 0.72±0.02 in healthy controls. For the patient group, this increased significantly to 0.65±0.02 by adopting optimised preprocessing pipelines. Co-localisation of the fMRI maps with cortical stimulation was significantly better for more reliable versus less reliable data sets (8.3±0.9 vs 29±3 mm, respectively). We demonstrated ROC-r analysis for identifying reliable fMRI data sets, choosing optimal postprocessing pipelines, and selecting patient-specific thresholds. Data sets with higher reliability also showed closer spatial correspondence to cortical stimulation. ROC-r can thus identify poor fMRI data at time of scanning, allowing for repeat scans when necessary. ROC-r analysis provides optimised and automated fMRI processing for improved presurgical mapping. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Analysis of confidence level scores from an ROC study: comparison of three mammographic systems for detection of simulated calcifications

NASA Astrophysics Data System (ADS)

Lai, Chao-Jen; Shaw, Chris C.; Whitman, Gary J.; Yang, Wei T.; Dempsey, Peter J.

2005-04-01

The purpose of this study is to compare the detection performance of three different mammography systems: screen/film (SF) combination, a-Si/CsI flat-panel (FP-), and charge-coupled device (CCD-) based systems. A 5-cm thick 50% adipose/50% glandular breast tissue equivalent slab phantom was used to provide an uniform background. Calcium carbonate grains of three different size groups were used to simulate microcalcifications (MCs): 112-125, 125-140, and 140-150 μm overlapping with the uniform background. Calcification images were acquired with the three mammography systems. Digital images were printed on hardcopy films. All film images were displayed on a mammographic viewer and reviewed by 5 mammographers. The visibility of the MC was rated with a 5-point confidence rating scale for each detection task, including the negative controls. Scores were averaged over all readers for various detectors and size groups. Receiver operating characteristic (ROC) analysis was performed and the areas under the ROC curves (Az"s) were computed for various imaging conditions. The results shows that (1) the FP-based system performed significantly better than the SF and CCD-based systems for individual size groups using ROC analysis (2) the FP-based system also performed significantly better than the SF and CCD-based systems for individual size groups using averaged confidence scale, and (3) the results obtained from the Az"s were largely correlated with these from confidence level scores. However, the correlation varied slightly among different imaging conditions.

Effect of Edge-Preserving Adaptive Image Filter on Low-Contrast Detectability in CT Systems: Application of ROC Analysis

PubMed Central

Okumura, Miwa; Ota, Takamasa; Kainuma, Kazuhisa; Sayre, James W.; McNitt-Gray, Michael; Katada, Kazuhiro

2008-01-01

Objective. For the multislice CT (MSCT) systems with a larger number of detector rows, it is essential to employ dose-reduction techniques. As reported in previous studies, edge-preserving adaptive image filters, which selectively eliminate only the noise elements that are increased when the radiation dose is reduced without affecting the sharpness of images, have been developed. In the present study, we employed receiver operating characteristic (ROC) analysis to assess the effects of the quantum denoising system (QDS), which is an edge-preserving adaptive filter that we have developed, on low-contrast resolution, and to evaluate to what degree the radiation dose can be reduced while maintaining acceptable low-contrast resolution. Materials and Methods. The low-contrast phantoms (Catphan 412) were scanned at various tube current settings, and ROC analysis was then performed for the groups of images obtained with/without the use of QDS at each tube current to determine whether or not a target could be identified. The tube current settings for which the area under the ROC curve (Az value) was approximately 0.7 were determined for both groups of images with/without the use of QDS. Then, the radiation dose reduction ratio when QDS was used was calculated by converting the determined tube current to the radiation dose. Results. The use of the QDS edge-preserving adaptive image filter allowed the radiation dose to be reduced by up to 38%. Conclusion. The QDS was found to be useful for reducing the radiation dose without affecting the low-contrast resolution in MSCT studies. PMID:19043565

A new method to predict anatomical outcome after idiopathic macular hole surgery.

PubMed

Liu, Peipei; Sun, Yaoyao; Dong, Chongya; Song, Dan; Jiang, Yanrong; Liang, Jianhong; Yin, Hong; Li, Xiaoxin; Zhao, Mingwei

2016-04-01

To investigate whether a new macular hole closure index (MHCI) could predict anatomic outcome of macular hole surgery. A vitrectomy with internal limiting membrane peeling, air-fluid exchange, and gas tamponade were performed on all patients. The postoperative anatomic status of the macular hole was defined by spectral-domain OCT. MHCI was calculated as (M+N)/BASE based on the preoperative OCT status. M and N were the curve lengths of the detached photoreceptor arms, and BASE was the length of the retinal pigment epithelial layer (RPE layer) detaching from the photoreceptors. Postoperative anatomical outcomes were divided into three grades: A (bridge-like closure), B (good closure), and C (poor closure or no closure). Correlation analysis was performed between anatomical outcomes and MHCI. Receiver operating characteristic (ROC) curves were derived for MHCI, indicating good model discrimination. ROC curves were also assessed by the area under the curve, and cut-offs were calculated. Other predictive parameters reported previously, which included the MH minimum, the MH height, the macular hole index (MHI), the diameter hole index (DHI), and the tractional hole index (THI) had been compared as well. MHCI correlated significantly with postoperative anatomical outcomes (r = 0.543, p = 0.000), but other predictive parameters did not. The areas under the curves indicated that MHCI could be used as an effective predictor of anatomical outcome. Cut-off values of 0.7 and 1.0 were obtained for MHCI from ROC curve analysis. MHCI demonstrated a better predictive effect than other parameters, both in the correlation analysis and ROC analysis. MHCI could be an easily measured and accurate predictive index for postoperative anatomical outcomes.

Clinical value of the neutrophil/lymphocyte ratio in diagnosing adult strangulated inguinal hernia.

PubMed

Zhou, Huanhao; Ruan, Xiaojiao; Shao, Xia; Huang, Xiaming; Fang, Guan; Zheng, Xiaofeng

2016-12-01

Diagnosis of incarcerated inguinal hernia (IIH) is not difficult, but currently, there are no diagnostic criteria that can be used to differentiate it from strangulated inguinal hernia (SIH). This research aimed to evaluate the clinical value of the neutrophil/lymphocyte ratio (NLR) in diagnosing SIH. We retrospectively analyzed 263 patients with IIH who had undergone emergency operation. The patients were divided into two groups according to IIH severity: group A, patients with pure IIH validated during operation as having no bowel ischemia; group B, patients with SIH validated during operation as having obvious bowel ischemia, including bowel necrosis. We statistically evaluated the relation between several clinical features and SIH. The accuracy of different indices was then evaluated and compared using receiver operating characteristic (ROC) curve analyses, and the corresponding cutoff values were calculated. Univariate analysis showed eight clinical features that were significantly different between the two groups. They were then subjected to multivariate analysis, which showed that the NLR, type of hernia, and incarcerated organ were significantly related to SIH. ROC curve analysis showed that the NLR had the largest area under the ROC curve. Among the different clinical features, the NLR appears to be the best index in diagnosing SIH. Copyright © 2016 IJS Publishing Group Ltd. Published by Elsevier Ltd. All rights reserved.

Asymptotic Properties of the Sequential Empirical ROC, PPV and NPV Curves Under Case-Control Sampling.

PubMed

Koopmeiners, Joseph S; Feng, Ziding

2011-01-01

The receiver operating characteristic (ROC) curve, the positive predictive value (PPV) curve and the negative predictive value (NPV) curve are three measures of performance for a continuous diagnostic biomarker. The ROC, PPV and NPV curves are often estimated empirically to avoid assumptions about the distributional form of the biomarkers. Recently, there has been a push to incorporate group sequential methods into the design of diagnostic biomarker studies. A thorough understanding of the asymptotic properties of the sequential empirical ROC, PPV and NPV curves will provide more flexibility when designing group sequential diagnostic biomarker studies. In this paper we derive asymptotic theory for the sequential empirical ROC, PPV and NPV curves under case-control sampling using sequential empirical process theory. We show that the sequential empirical ROC, PPV and NPV curves converge to the sum of independent Kiefer processes and show how these results can be used to derive asymptotic results for summaries of the sequential empirical ROC, PPV and NPV curves.

Asymptotic Properties of the Sequential Empirical ROC, PPV and NPV Curves Under Case-Control Sampling

PubMed Central

Koopmeiners, Joseph S.; Feng, Ziding

2013-01-01

The receiver operating characteristic (ROC) curve, the positive predictive value (PPV) curve and the negative predictive value (NPV) curve are three measures of performance for a continuous diagnostic biomarker. The ROC, PPV and NPV curves are often estimated empirically to avoid assumptions about the distributional form of the biomarkers. Recently, there has been a push to incorporate group sequential methods into the design of diagnostic biomarker studies. A thorough understanding of the asymptotic properties of the sequential empirical ROC, PPV and NPV curves will provide more flexibility when designing group sequential diagnostic biomarker studies. In this paper we derive asymptotic theory for the sequential empirical ROC, PPV and NPV curves under case-control sampling using sequential empirical process theory. We show that the sequential empirical ROC, PPV and NPV curves converge to the sum of independent Kiefer processes and show how these results can be used to derive asymptotic results for summaries of the sequential empirical ROC, PPV and NPV curves. PMID:24039313

Computed Tomography Angiography Evaluation of Risk Factors for Unstable Intracranial Aneurysms.

PubMed

Wang, Guang-Xian; Gong, Ming-Fu; Wen, Li; Liu, Lan-Lan; Yin, Jin-Bo; Duan, Chun-Mei; Zhang, Dong

2018-03-19

To evaluate risk factors for instability in intracranial aneurysms (IAs) using computed tomography angiography (CTA). A total of 614 consecutive patients diagnosed with 661 IAs between August 2011 and February 2016 were reviewed. Patients and IAs were divided into stable and unstable groups. Along with clinical characteristics, IA characteristics were evaluated by CTA. Multiple logistic regression analysis was used to identify the independent risk factors associated with unstable IAs. Receiver operating characteristic (ROC) curve analysis was performed on the final model, and optimal thresholds were obtained. Patient age (odds ratio [OR], 0.946), cerebral atherosclerosis (CA; OR, 0.525), and IAs located at the middle cerebral artery (OR, 0.473) or internal carotid artery (OR, 0.512) were negatively correlated with instability, whereas IAs with irregular shape (OR, 2.157), deep depth (OR, 1.557), or large flow angle (FA; OR, 1.015) were more likely to be unstable. ROC analysis revealed threshold values of age, depth, and FA of 59.5 years, 4.25 mm, and 87.8°, respectively. The stability of IAs is significantly affected by several factors, including patient age and the presence of CA. IA shape and location also have an impact on the stability of IAs. Growth into an irregular shape, with a deep depth, and a large FA are risk factors for a change in IAs from stable to unstable. Copyright © 2018 Elsevier Inc. All rights reserved.

Optimal joint detection and estimation that maximizes ROC-type curves

PubMed Central

Wunderlich, Adam; Goossens, Bart; Abbey, Craig K.

2017-01-01

Combined detection-estimation tasks are frequently encountered in medical imaging. Optimal methods for joint detection and estimation are of interest because they provide upper bounds on observer performance, and can potentially be utilized for imaging system optimization, evaluation of observer efficiency, and development of image formation algorithms. We present a unified Bayesian framework for decision rules that maximize receiver operating characteristic (ROC)-type summary curves, including ROC, localization ROC (LROC), estimation ROC (EROC), free-response ROC (FROC), alternative free-response ROC (AFROC), and exponentially-transformed FROC (EFROC) curves, succinctly summarizing previous results. The approach relies on an interpretation of ROC-type summary curves as plots of an expected utility versus an expected disutility (or penalty) for signal-present decisions. We propose a general utility structure that is flexible enough to encompass many ROC variants and yet sufficiently constrained to allow derivation of a linear expected utility equation that is similar to that for simple binary detection. We illustrate our theory with an example comparing decision strategies for joint detection-estimation of a known signal with unknown amplitude. In addition, building on insights from our utility framework, we propose new ROC-type summary curves and associated optimal decision rules for joint detection-estimation tasks with an unknown, potentially-multiple, number of signals in each observation. PMID:27093544

Optimal Joint Detection and Estimation That Maximizes ROC-Type Curves.

PubMed

Wunderlich, Adam; Goossens, Bart; Abbey, Craig K

2016-09-01

Combined detection-estimation tasks are frequently encountered in medical imaging. Optimal methods for joint detection and estimation are of interest because they provide upper bounds on observer performance, and can potentially be utilized for imaging system optimization, evaluation of observer efficiency, and development of image formation algorithms. We present a unified Bayesian framework for decision rules that maximize receiver operating characteristic (ROC)-type summary curves, including ROC, localization ROC (LROC), estimation ROC (EROC), free-response ROC (FROC), alternative free-response ROC (AFROC), and exponentially-transformed FROC (EFROC) curves, succinctly summarizing previous results. The approach relies on an interpretation of ROC-type summary curves as plots of an expected utility versus an expected disutility (or penalty) for signal-present decisions. We propose a general utility structure that is flexible enough to encompass many ROC variants and yet sufficiently constrained to allow derivation of a linear expected utility equation that is similar to that for simple binary detection. We illustrate our theory with an example comparing decision strategies for joint detection-estimation of a known signal with unknown amplitude. In addition, building on insights from our utility framework, we propose new ROC-type summary curves and associated optimal decision rules for joint detection-estimation tasks with an unknown, potentially-multiple, number of signals in each observation.

Decision making for pancreatic resection in patients with intraductal papillary mucinous neoplasms.

PubMed

Xu, Bin; Ding, Wei-Xing; Jin, Da-Yong; Wang, Dan-Song; Lou, Wen-Hui

2013-03-07

To identify a practical approach for preoperative decision-making in patients with intraductal papillary mucinous neoplasms (IPMNs) of the pancreas. Between March 1999 and November 2006, the clinical characteristics, pathological data and computed tomography/magnetic resonance imaging (CT/MRI) of 54 IPMNs cases were retrieved and analyzed. The relationships between the above data and decision-making for pancreatic resection were analyzed using SPSS 13.0 software. Univariate analysis of risk factors for malignant or invasive IPMNs was performed with regard to the following variables: carcinoembryonic antigen, carbohydrate antigen 19-9 (CA19-9) and the characteristics from CT/MRI images. Receiver operating characteristic (ROC) curve analysis for pancreatic resection was performed using significant factors from the univariate analysis. CT/MRI images, including main and mixed duct IPMNs, tumor size > 30 mm or a solid component appearance in the lesion, and preoperative serum CA19-9 > 37 U/mL had good predictive value for determining pancreatic resection (P < 0.05), but with limitations. Combining the above factors (CT/MRI images and CA19-9) improved the accuracy and sensitivity for determining pancreatic resection in IPMNs. Using ROC analysis, the area under the curve reached 0.893 (P < 0.01, 95%CI: 0.763-1.023), with a sensitivity, specificity, positive predictive value and negative predictive value of 95.2%, 83.3%, 95.2% and 83.3%, respectively. Combining preoperative CT/MRI images and CA19-9 level may provide useful information for surgical decision-making in IPMNs.

Impact of FIB-4 index on hepatocellular carcinoma incidence during nucleos(t)ide analogue therapy in patients with chronic hepatitis B: An analysis using time-dependent receiver operating characteristic.

PubMed

Tada, Toshifumi; Kumada, Takashi; Toyoda, Hidenori; Tsuji, Kunihiko; Hiraoka, Atsushi; Tanaka, Junko

2017-02-01

Nucleos(t)ide analogue (NA) therapy has been reported to reduce the risk of hepatocellular carcinoma (HCC) development in patients with chronic hepatitis B (CHB). However, even during NA therapy, development of HCC has been observed in patients with CHB. Therefore, we clarified the predictive power of clinical factors for HCC incidence using receiver operating characteristic (ROC) analysis that takes time dependence into account. A total of 539 patients with CHB treated with NAs were enrolled. Univariate, multivariate, and time-dependent ROC curves for clinical factors associated with the development of HCC were analyzed. Eighty-one patients developed HCC during the follow-up period (median duration, 5.9 years). α-fetoprotein (AFP) and FIB-4 index at 24 weeks from the initiation of treatment and sex were significantly associated with HCC incidence according to the log-rank test. Cox proportional hazards models including the covariates of sex, hepatitis B genotype, basal core promoter mutations, AFP at 24 weeks, and FIB-4 index at 24 weeks showed that FIB-4 index >2.65 (HR, 5.03; 95% CI, 3.06-8.26; P < 0.001) and male sex were independently associated with HCC incidence. In addition, time-dependent ROC analysis showed that compared with AFP at 24 weeks, FIB-4 index at 24 weeks had higher predictive power for HCC incidence throughout the follow-up period. Elevated FIB-4 index at 24 weeks in patients with CHB receiving NA therapy is a risk factor for developing HCC. The FIB-4 index is an excellent predictor of HCC development. © 2016 Journal of Gastroenterology and Hepatology Foundation and John Wiley & Sons Australia, Ltd.

Expected p-values in light of an ROC curve analysis applied to optimal multiple testing procedures.

PubMed

Vexler, Albert; Yu, Jihnhee; Zhao, Yang; Hutson, Alan D; Gurevich, Gregory

2017-01-01

Many statistical studies report p-values for inferential purposes. In several scenarios, the stochastic aspect of p-values is neglected, which may contribute to drawing wrong conclusions in real data experiments. The stochastic nature of p-values makes their use to examine the performance of given testing procedures or associations between investigated factors to be difficult. We turn our focus on the modern statistical literature to address the expected p-value (EPV) as a measure of the performance of decision-making rules. During the course of our study, we prove that the EPV can be considered in the context of receiver operating characteristic (ROC) curve analysis, a well-established biostatistical methodology. The ROC-based framework provides a new and efficient methodology for investigating and constructing statistical decision-making procedures, including: (1) evaluation and visualization of properties of the testing mechanisms, considering, e.g. partial EPVs; (2) developing optimal tests via the minimization of EPVs; (3) creation of novel methods for optimally combining multiple test statistics. We demonstrate that the proposed EPV-based approach allows us to maximize the integrated power of testing algorithms with respect to various significance levels. In an application, we use the proposed method to construct the optimal test and analyze a myocardial infarction disease dataset. We outline the usefulness of the "EPV/ROC" technique for evaluating different decision-making procedures, their constructions and properties with an eye towards practical applications.

Clinical evaluation of JPEG2000 compression for digital mammography

NASA Astrophysics Data System (ADS)

Sung, Min-Mo; Kim, Hee-Joung; Kim, Eun-Kyung; Kwak, Jin-Young; Yoo, Jae-Kyung; Yoo, Hyung-Sik

2002-06-01

Medical images, such as computed radiography (CR), and digital mammographic images will require large storage facilities and long transmission times for picture archiving and communications system (PACS) implementation. American College of Radiology and National Equipment Manufacturers Association (ACR/NEMA) group is planning to adopt a JPEG2000 compression algorithm in digital imaging and communications in medicine (DICOM) standard to better utilize medical images. The purpose of the study was to evaluate the compression ratios of JPEG2000 for digital mammographic images using peak signal-to-noise ratio (PSNR), receiver operating characteristic (ROC) analysis, and the t-test. The traditional statistical quality measures such as PSNR, which is a commonly used measure for the evaluation of reconstructed images, measures how the reconstructed image differs from the original by making pixel-by-pixel comparisons. The ability to accurately discriminate diseased cases from normal cases is evaluated using ROC curve analysis. ROC curves can be used to compare the diagnostic performance of two or more reconstructed images. The t test can be also used to evaluate the subjective image quality of reconstructed images. The results of the t test suggested that the possible compression ratios using JPEG2000 for digital mammographic images may be as much as 15:1 without visual loss or with preserving significant medical information at a confidence level of 99%, although both PSNR and ROC analyses suggest as much as 80:1 compression ratio can be achieved without affecting clinical diagnostic performance.

Developing a new diagnostic algorithm for human papilloma virus associated oropharyngeal carcinoma: an investigation of HPV DNA assays.

PubMed

Cohen, Natasha; Gupta, Michael; Doerwald-Munoz, Lilian; Jang, Dan; Young, James Edward Massey; Archibald, Stuart; Jackson, Bernard; Lee, Jenny; Chernesky, Max

2017-02-13

Human papilloma virus (HPV) has been implicated in the development of a large proportion of oropharyngeal squamous cell carcinoma (OPSCC). Current techniques used to diagnose HPV etiology require histopathologic analysis. We aim to investigate the diagnostic accuracy of a new application non-histopathologic diagnostic tests to help assist diagnosis of HPV-related oropharyngeal tumors. Patients with OPSCC with nodal metastasis were consecutively recruited from a multidisciplinary cancer clinic. Appropriate samples were collected and analyzed. The various tests examined included COBAS® 4800, Cervista® HR and Genotyping. These tests were compared to p16 staining, which was used as the diagnostic standard. StataIC 14.2 was used to perform analysis, including sensitivity, specificity and receiver operator characteristic [ROC] curves. The COBAS® FNA (area under ROC 0.863) and saliva (area under ROC 0.847) samples performed well in diagnosing HPV positive and negative tumors. Samples tested with Cervista® did not corroborate p16 status reliably. We were able to increase the diagnostic yield of the COBAS® FNA samples by applying the results of the saliva test to negative FNA samples which correctly identified 11 additional p16 positive tumors (area under ROC 0.915). Surrogate testing for HPV using alternate methods is feasible and closely predicts the results of standard diagnostic methods. In the future, these could minimize invasive procedures for diagnosing HPV-related oropharyngeal cancer, but also help to diagnose and treat patients with unknown primaries.

Assessing Internalizing, Externalizing, and Attention Problems in Young Children: Validation of the MacArthur HBQ

ERIC Educational Resources Information Center

Lemery-Chalfant, Kathryn; Schreiber, Jane E.; Schmidt, Nicole L.; Van Hulle, Carol A.; Essex, Marilyn J.; Goldsmith, H. H.

2007-01-01

Objective: To test the validity of the MacArthur Health and Behavior Questionnaire (HBQ) using receiver operating characteristic (ROC) analysis to determine optimal thresholds for the HBQ in predicting Diagnostic Interview Schedule for Children Version-IV (DISC-IV)diagnoses. The roles of child sex, level of impairment, and physical health in…

Automatic Target Recognition Classification System Evaluation Methodology

DTIC Science & Technology

2002-09-01

Testing Set of Two-Class XOR Data (250 Samples)......................................... 2-59 2.27 Decision Analysis Process Flow Chart...ROC curve meta - analysis , which is the estimation of the true ROC curve of a given diagnostic system through ROC analysis across many studies or...technique can be very effective in sensitivity analysis ; trying to determine which data points have the most effect on the solution, and in

Theoretical vs. empirical discriminability: the application of ROC methods to eyewitness identification.

PubMed

Wixted, John T; Mickes, Laura

2018-01-01

Receiver operating characteristic (ROC) analysis was introduced to the field of eyewitness identification 5 years ago. Since that time, it has been both influential and controversial, and the debate has raised an issue about measuring discriminability that is rarely considered. The issue concerns the distinction between empirical discriminability (measured by area under the ROC curve) vs. underlying/theoretical discriminability (measured by d' or variants of it). Under most circumstances, the two measures will agree about a difference between two conditions in terms of discriminability. However, it is possible for them to disagree, and that fact can lead to confusion about which condition actually yields higher discriminability. For example, if the two conditions have implications for real-world practice (e.g., a comparison of competing lineup formats), should a policymaker rely on the area-under-the-curve measure or the theory-based measure? Here, we illustrate the fact that a given empirical ROC yields as many underlying discriminability measures as there are theories that one is willing to take seriously. No matter which theory is correct, for practical purposes, the singular area-under-the-curve measure best identifies the diagnostically superior procedure. For that reason, area under the ROC curve informs policy in a way that underlying theoretical discriminability never can. At the same time, theoretical measures of discriminability are equally important, but for a different reason. Without an adequate theoretical understanding of the relevant task, the field will be in no position to enhance empirical discriminability.

AVC: Selecting discriminative features on basis of AUC by maximizing variable complementarity.

PubMed

Sun, Lei; Wang, Jun; Wei, Jinmao

2017-03-14

The Receiver Operator Characteristic (ROC) curve is well-known in evaluating classification performance in biomedical field. Owing to its superiority in dealing with imbalanced and cost-sensitive data, the ROC curve has been exploited as a popular metric to evaluate and find out disease-related genes (features). The existing ROC-based feature selection approaches are simple and effective in evaluating individual features. However, these approaches may fail to find real target feature subset due to their lack of effective means to reduce the redundancy between features, which is essential in machine learning. In this paper, we propose to assess feature complementarity by a trick of measuring the distances between the misclassified instances and their nearest misses on the dimensions of pairwise features. If a misclassified instance and its nearest miss on one feature dimension are far apart on another feature dimension, the two features are regarded as complementary to each other. Subsequently, we propose a novel filter feature selection approach on the basis of the ROC analysis. The new approach employs an efficient heuristic search strategy to select optimal features with highest complementarities. The experimental results on a broad range of microarray data sets validate that the classifiers built on the feature subset selected by our approach can get the minimal balanced error rate with a small amount of significant features. Compared with other ROC-based feature selection approaches, our new approach can select fewer features and effectively improve the classification performance.

Diagnostic accuracy of the Kampala Trauma Score using estimated Abbreviated Injury Scale scores and physician opinion.

PubMed

Gardner, Andrew; Forson, Paa Kobina; Oduro, George; Stewart, Barclay; Dike, Nkechi; Glover, Paul; Maio, Ronald F

2017-01-01

The Kampala Trauma Score (KTS) has been proposed as a triage tool for use in low- and middle-income countries (LMICs). This study aimed to examine the diagnostic accuracy of KTS in predicting emergency department outcomes using timely injury estimation with Abbreviated Injury Scale (AIS) score and physician opinion to calculate KTS scores. This was a diagnostic accuracy study of KTS among injured patients presenting to Komfo Anokye Teaching Hospital A&E, Ghana. South African Triage Scale (SATS); KTS component variables, including AIS scores and physician opinion for serious injury quantification; and ED disposition were collected. Agreement between estimated AIS score and physician opinion were analyzed with normal, linear weighted, and maximum kappa. Receiver operating characteristic (ROC) analysis of KTS-AIS and KTS-physician opinion was performed to evaluate each measure's ability to predict A&E mortality and need for hospital admission to the ward or theatre. A total of 1053 patients were sampled. There was moderate agreement between AIS criteria and physician opinion by normal (κ=0.41), weighted (κ lin =0.47), and maximum (κ max =0.53) kappa. A&E mortality ROC area for KTS-AIS was 0.93, KTS-physician opinion 0.89, and SATS 0.88 with overlapping 95% confidence intervals (95%CI). Hospital admission ROC area for KTS-AIS was 0.73, KTS-physician opinion 0.79, and SATS 0.71 with statistical similarity. When evaluating only patients with serious injuries, KTS-AIS (ROC 0.88) and KTS-physician opinion (ROC 0.88) performed similarly to SATS (ROC 0.78) in predicting A&E mortality. The ROC area for KTS-AIS (ROC 0.71; 95%CI 0.66-0.75) and KTS-physician opinion (ROC 0.74; 95%CI 0.69-0.79) was significantly greater than SATS (ROC 0.57; 0.53-0.60) with regard to need for admission. KTS predicted mortality and need for admission from the ED well when early estimation of the number of serious injuries was used, regardless of method (i.e. AIS criteria or physician opinion). This study provides evidence for KTS to be used as a practical and valid triage tool to predict patient prognosis, ED outcomes and inform referral decision-making from first- or second-level hospitals in LMICs. Copyright © 2016 Elsevier Ltd. All rights reserved.

Diagnostic accuracy of the Kampala Trauma Score using estimated Abbreviated Injury Scale scores and physician opinion

PubMed Central

Gardner, Andrew; Forson, Paa Kobina; Oduro, George; Stewart, Barclay; Dike, Nkechi; Glover, Paul; Maio, Ronald F.

2016-01-01

Background The Kampala Trauma Score (KTS) has been proposed as a triage tool for use in low- and middle-income countries (LMICs). This study aimed to examine the diagnostic accuracy of KTS in predicting emergency department outcomes using timely injury estimation with Abbreviated Injury Scale (AIS) score and physician opinion to calculate KTS scores. Methods This was a diagnostic accuracy study of KTS among injured patients presenting to Komfo Anokye Teaching Hospital A&E, Ghana. South African Triage Scale (SATS); KTS component variables, including AIS scores and physician opinion for serious injury quantification; and ED disposition were collected. Agreement between estimated AIS score and physician opinion were analyzed with normal, linear weighted, and maximum kappa. Receiver operating characteristic (ROC) analysis of KTS-AIS and KTS-physician opinion was performed to evaluate each measure’s ability to predict A&E mortality and need for hospital admission to the ward or theatre. Results A total of 1,053 patients were sampled. There was moderate agreement between AIS criteria and physician opinion by normal (κ=0.41), weighted (κlin=0.47), and maximum (κmax=0.53) kappa. A&E mortality ROC area for KTS-AIS was 0.93, KTS-physician opinion 0.89, and SATS 0.88 with overlapping 95% confidence intervals (95%CI). Hospital admission ROC area for KTS-AIS was 0.73, KTS-physician opinion 0.79, and SATS 0.71 with statistical similarity. When evaluating only patients with serious injuries, KTS-AIS (ROC 0.88) and KTS-physician opinion (ROC 0.88) performed similarly to SATS (ROC 0.78) in predicting A&E mortality. The ROC area for KTS-AIS (ROC 0.71; 95%CI 0.66–0.75) and KTS-physician opinion (ROC 0.74; 95%CI 0.69–0.79) was significantly greater than SATS (ROC 0.57; 0.53–0.60) with regard to need for admission. Conclusions KTS predicted mortality and need for admission from the ED well when early estimation of the number of serious injuries was used, regardless of method (i.e. AIS criteria or physician opinion). This study provides evidence for KTS to be used as a practical and valid triage tool to predict patient prognosis, ED outcomes and inform referral decision-making from first- or second-level hospitals in LMICs. PMID:27908493

Nonparametric EROC analysis for observer performance evaluation on joint detection and estimation tasks

NASA Astrophysics Data System (ADS)

Wunderlich, Adam; Goossens, Bart

2014-03-01

The majority of the literature on task-based image quality assessment has focused on lesion detection tasks, using the receiver operating characteristic (ROC) curve, or related variants, to measure performance. However, since many clinical image evaluation tasks involve both detection and estimation (e.g., estimation of kidney stone composition, estimation of tumor size), there is a growing interest in performance evaluation for joint detection and estimation tasks. To evaluate observer performance on such tasks, Clarkson introduced the estimation ROC (EROC) curve, and the area under the EROC curve as a summary figure of merit. In the present work, we propose nonparametric estimators for practical EROC analysis from experimental data, including estimators for the area under the EROC curve and its variance. The estimators are illustrated with a practical example comparing MRI images reconstructed from different k-space sampling trajectories.

Turbidity of mouthrinsed water as a screening index for oral malodor.

PubMed

Ueno, Masayuki; Takeuchi, Susumu; Samnieng, Patcharaphol; Morishima, Seiji; Shinada, Kayoko; Kawaguchi, Yoko

2013-08-01

The objectives of this research were to examine the relationship between turbidity of mouthrinsed water and oral malodor, and to evaluate whether the turbidity could be used to screen oral malodor. The subjects were 165 oral malodor patients. Gas chromatography and organoleptic test (OT) were used for oral malodor measurement. Oral examination along with collection of saliva and quantification of bacteria was conducted. Turbidity of mouthrinsed water was measured with turbidimeter. Logistic regression with oral malodor status by OT as the dependent variable and receiver operating characteristic (ROC) analysis were performed. Turbidity had a significant association with oral malodor status. In addition, ROC analysis showed that the turbidity had an ability to screen for presence or absence of oral malodor. Turbidity could reflect or represent other influential variables of oral malodor and may be useful as a screening method for oral malodor. Copyright © 2013 Elsevier Inc. All rights reserved.

Wavelet coherence analysis: A new approach to distinguish organic and functional tremor types.

PubMed

Kramer, G; Van der Stouwe, A M M; Maurits, N M; Tijssen, M A J; Elting, J W J

2018-01-01

To distinguish tremor subtypes using wavelet coherence analysis (WCA). WCA enables to detect variations in coherence and phase difference between two signals over time and might be especially useful in distinguishing functional from organic tremor. In this pilot study, polymyography recordings were studied retrospectively of 26 Parkinsonian (PT), 26 functional (FT), 26 essential (ET), and 20 enhanced physiological (EPT) tremor patients. Per patient one segment of 20 s in duration, in which tremor was present continuously in the same posture, was selected. We studied several coherence and phase related parameters, and analysed all possible muscle combinations of the flexor and extensor muscles of the upper and fore arm. The area under the receiver operating characteristic curve (AUC-ROC) was applied to compare WCA and standard coherence analysis to distinguish tremor subtypes. The percentage of time with significant coherence (PTSC) and the number of periods without significant coherence (NOV) proved the most discriminative parameters. FT could be discriminated from organic (PT, ET, EPT) tremor by high NOV (31.88 vs 21.58, 23.12 and 10.20 respectively) with an AUC-ROC of 0.809, while standard coherence analysis resulted in an AUC-ROC of 0.552. EMG-EMG WCA analysis might provide additional variables to distinguish functional from organic tremor. WCA might prove to be of additional value to discriminate between tremor types. Copyright © 2017 International Federation of Clinical Neurophysiology. Published by Elsevier B.V. All rights reserved.

Optimizing area under the ROC curve using semi-supervised learning

PubMed Central

Wang, Shijun; Li, Diana; Petrick, Nicholas; Sahiner, Berkman; Linguraru, Marius George; Summers, Ronald M.

2014-01-01

Receiver operating characteristic (ROC) analysis is a standard methodology to evaluate the performance of a binary classification system. The area under the ROC curve (AUC) is a performance metric that summarizes how well a classifier separates two classes. Traditional AUC optimization techniques are supervised learning methods that utilize only labeled data (i.e., the true class is known for all data) to train the classifiers. In this work, inspired by semi-supervised and transductive learning, we propose two new AUC optimization algorithms hereby referred to as semi-supervised learning receiver operating characteristic (SSLROC) algorithms, which utilize unlabeled test samples in classifier training to maximize AUC. Unlabeled samples are incorporated into the AUC optimization process, and their ranking relationships to labeled positive and negative training samples are considered as optimization constraints. The introduced test samples will cause the learned decision boundary in a multidimensional feature space to adapt not only to the distribution of labeled training data, but also to the distribution of unlabeled test data. We formulate the semi-supervised AUC optimization problem as a semi-definite programming problem based on the margin maximization theory. The proposed methods SSLROC1 (1-norm) and SSLROC2 (2-norm) were evaluated using 34 (determined by power analysis) randomly selected datasets from the University of California, Irvine machine learning repository. Wilcoxon signed rank tests showed that the proposed methods achieved significant improvement compared with state-of-the-art methods. The proposed methods were also applied to a CT colonography dataset for colonic polyp classification and showed promising results.1 PMID:25395692

Optimizing area under the ROC curve using semi-supervised learning.

PubMed

Wang, Shijun; Li, Diana; Petrick, Nicholas; Sahiner, Berkman; Linguraru, Marius George; Summers, Ronald M

2015-01-01

Receiver operating characteristic (ROC) analysis is a standard methodology to evaluate the performance of a binary classification system. The area under the ROC curve (AUC) is a performance metric that summarizes how well a classifier separates two classes. Traditional AUC optimization techniques are supervised learning methods that utilize only labeled data (i.e., the true class is known for all data) to train the classifiers. In this work, inspired by semi-supervised and transductive learning, we propose two new AUC optimization algorithms hereby referred to as semi-supervised learning receiver operating characteristic (SSLROC) algorithms, which utilize unlabeled test samples in classifier training to maximize AUC. Unlabeled samples are incorporated into the AUC optimization process, and their ranking relationships to labeled positive and negative training samples are considered as optimization constraints. The introduced test samples will cause the learned decision boundary in a multidimensional feature space to adapt not only to the distribution of labeled training data, but also to the distribution of unlabeled test data. We formulate the semi-supervised AUC optimization problem as a semi-definite programming problem based on the margin maximization theory. The proposed methods SSLROC1 (1-norm) and SSLROC2 (2-norm) were evaluated using 34 (determined by power analysis) randomly selected datasets from the University of California, Irvine machine learning repository. Wilcoxon signed rank tests showed that the proposed methods achieved significant improvement compared with state-of-the-art methods. The proposed methods were also applied to a CT colonography dataset for colonic polyp classification and showed promising results.

MYC and Human Telomerase Gene (TERC) Copy Number Gain in Early-stage Non–small Cell Lung Cancer

PubMed Central

Flacco, Antonella; Ludovini, Vienna; Bianconi, Fortunato; Ragusa, Mark; Bellezza, Guido; Tofanetti, Francesca R.; Pistola, Lorenza; Siggillino, Annamaria; Vannucci, Jacopo; Cagini, Lucio; Sidoni, Angelo; Puma, Francesco; Varella-Garcia, Marileila; Crinò, Lucio

2015-01-01

Objectives We investigated the frequency of MYC and TERC increased gene copy number (GCN) in early-stage non–small cell lung cancer (NSCLC) and evaluated the correlation of these genomic imbalances with clinicopathologic parameters and outcome. Materials and Methods Tumor tissues were obtained from 113 resected NSCLCs. MYC and TERC GCNs were tested by fluorescence in situ hybridization (FISH) according to the University of Colorado Cancer Center (UCCC) criteria and based on the receiver operating characteristic (ROC) classification. Results When UCCC criteria were applied, 41 (36%) cases for MYC and 41 (36%) cases for TERC were considered FISH-positive. MYC and TERC concurrent FISH-positive was observed in 12 cases (11%): 2 (17%) cases with gene amplification and 10 (83%) with high polysomy. By using the ROC analysis, high MYC (mean ≥2.83 copies/cell) and TERC (mean ≥2.65 copies/cell) GCNs were observed in 60 (53.1%) cases and 58 (51.3%) cases, respectively. High TERC GCN was associated with squamous cell carcinoma (SCC) histology (P = 0.001). In univariate analysis, increased MYC GCN was associated with shorter overall survival (P = 0.032 [UCCC criteria] or P = 0.02 [ROC classification]), whereas high TERC GCN showed no association. In multivariate analysis including stage and age, high MYC GCN remained significantly associated with worse overall survival using both the UCCC criteria (P = 0.02) and the ROC classification (P = 0.008). Conclusions Our results confirm MYC as frequently amplified in early-stage NSCLC and increased MYC GCN as a strong predictor of worse survival. Increased TERC GCN does not have prognostic impact but has strong association with squamous histology. PMID:25806711

Plateletpheresis efficiency and mathematical correction of software-derived platelet yield prediction: A linear regression and ROC modeling approach.

PubMed

Jaime-Pérez, José Carlos; Jiménez-Castillo, Raúl Alberto; Vázquez-Hernández, Karina Elizabeth; Salazar-Riojas, Rosario; Méndez-Ramírez, Nereida; Gómez-Almaguer, David

2017-10-01

Advances in automated cell separators have improved the efficiency of plateletpheresis and the possibility of obtaining double products (DP). We assessed cell processor accuracy of predicted platelet (PLT) yields with the goal of a better prediction of DP collections. This retrospective proof-of-concept study included 302 plateletpheresis procedures performed on a Trima Accel v6.0 at the apheresis unit of a hematology department. Donor variables, software predicted yield and actual PLT yield were statistically evaluated. Software prediction was optimized by linear regression analysis and its optimal cut-off to obtain a DP assessed by receiver operating characteristic curve (ROC) modeling. Three hundred and two plateletpheresis procedures were performed; in 271 (89.7%) occasions, donors were men and in 31 (10.3%) women. Pre-donation PLT count had the best direct correlation with actual PLT yield (r = 0.486. P < .001). Means of software machine-derived values differed significantly from actual PLT yield, 4.72 × 10 11 vs.6.12 × 10 11 , respectively, (P < .001). The following equation was developed to adjust these values: actual PLT yield= 0.221 + (1.254 × theoretical platelet yield). ROC curve model showed an optimal apheresis device software prediction cut-off of 4.65 × 10 11 to obtain a DP, with a sensitivity of 82.2%, specificity of 93.3%, and an area under the curve (AUC) of 0.909. Trima Accel v6.0 software consistently underestimated PLT yields. Simple correction derived from linear regression analysis accurately corrected this underestimation and ROC analysis identified a precise cut-off to reliably predict a DP. © 2016 Wiley Periodicals, Inc.

Simultaneous detection of antibodies to five Actinobacillus pleuropneumoniae serovars using bead-based multiplex analysis.

PubMed

Berger, Sanne Schou; Lauritsen, Klara Tølbøll; Boas, Ulrik; Lind, Peter; Andresen, Lars Ole

2017-11-01

We developed and made a preliminary validation of a bead-based multiplexed immunoassay for simultaneous detection of porcine serum antibodies to Actinobacillus pleuropneumoniae serovars 1, 2, 6, 7, and 12. Magnetic fluorescent beads were coupled with A. pleuropneumoniae antigens and tested with a panel of serum samples from experimentally infected pigs and with serum samples from uninfected and naturally infected pigs. The multiplex assay was compared to in-house ELISAs and complement fixation (CF) tests, which have been used for decades as tools for herd classification in the Danish Specific Pathogen Free system. Assay specificities and sensitivities as well as the corresponding cutoff values were determined using receiver operating characteristic (ROC) curve analysis, and the A. pleuropneumoniae multiplex assay showed good correlation with the in-house ELISAs and CF tests with areas under ROC curves ≥ 0.988. Benefits of multiplexed assays compared to ELISAs and CF tests include reduced serum sample volumes needed for analysis, less labor, and shorter assay time.

"Textural analysis of multiparametric MRI detects transition zone prostate cancer".

PubMed

Sidhu, Harbir S; Benigno, Salvatore; Ganeshan, Balaji; Dikaios, Nikos; Johnston, Edward W; Allen, Clare; Kirkham, Alex; Groves, Ashley M; Ahmed, Hashim U; Emberton, Mark; Taylor, Stuart A; Halligan, Steve; Punwani, Shonit

2017-06-01

To evaluate multiparametric-MRI (mpMRI) derived histogram textural-analysis parameters for detection of transition zone (TZ) prostatic tumour. Sixty-seven consecutive men with suspected prostate cancer underwent 1.5T mpMRI prior to template-mapping-biopsy (TPM). Twenty-six men had 'significant' TZ tumour. Two radiologists in consensus matched TPM to the single axial slice best depicting tumour, or largest TZ diameter for those with benign histology, to define single-slice whole TZ-regions-of-interest (ROIs). Textural-parameter differences between single-slice whole TZ-ROI containing significant tumour versus benign/insignificant tumour were analysed using Mann Whitney U test. Diagnostic accuracy was assessed by receiver operating characteristic area under curve (ROC-AUC) analysis cross-validated with leave-one-out (LOO) analysis. ADC kurtosis was significantly lower (p < 0.001) in TZ containing significant tumour with ROC-AUC 0.80 (LOO-AUC 0.78); the difference became non-significant following exclusion of significant tumour from single-slice whole TZ-ROI (p = 0.23). T1-entropy was significantly lower (p = 0.004) in TZ containing significant tumour with ROC-AUC 0.70 (LOO-AUC 0.66) and was unaffected by excluding significant tumour from TZ-ROI (p = 0.004). Combining these parameters yielded ROC-AUC 0.86 (LOO-AUC 0.83). Textural features of the whole prostate TZ can discriminate significant prostatic cancer through reduced kurtosis of the ADC-histogram where significant tumour is included in TZ-ROI and reduced T1 entropy independent of tumour inclusion. • MR textural features of prostate transition zone may discriminate significant prostatic cancer. • Transition zone (TZ) containing significant tumour demonstrates a less peaked ADC histogram. • TZ containing significant tumour reveals higher post-contrast T1-weighted homogeneity. • The utility of MR texture analysis in prostate cancer merits further investigation.

A comparison of the validity of GHQ-12 and CHQ-12 in Chinese primary care patients in Manchester.

PubMed

Pan, P C; Goldberg, D P

1990-11-01

The present study compares the efficacy of the GHQ-12 and the Chinese Health Questionnaire (CHQ-12) in Cantonese speaking Chinese primary-care patients living in Greater Manchester, using relative operating characteristic (ROC) analysis. We did not find that the Chinese version offered any advantage over the conventional version of the GHQ in this population. Stepwise discriminant analysis however confirmed the value of individual items in the former pertaining to specific somatic symptoms and interpersonal relationships in differentiating cases from non-cases. Information biases, arising from the lack of a reliability study on the second-stage case identifying interview and the unique linguistic characteristics of the Chinese language may have affected the overall validity indices of the questionnaires. The study also examines the effects of using different criteria to define a case, and shows that with increasing levels of severity, there is an improvement in the diagnostic performance of the two questionnaires as reflected by areas under ROC curves and traditional validity indices. Possible explanations of these findings are discussed. The scoring method proposed by Goodchild & Duncan-Jones (1985) when used on these questionnaires had no demonstrable advantage over the conventional scoring method.

Cardiopulmonary exercise testing for the prediction of morbidity risk after rectal cancer surgery.

PubMed

West, M A; Parry, M G; Lythgoe, D; Barben, C P; Kemp, G J; Grocott, M P W; Jack, S

2014-08-01

This study investigated the relationship between objectively measured physical fitness variables derived by cardiopulmonary exercise testing (CPET) and in-hospital morbidity after rectal cancer surgery. Patients scheduled for rectal cancer surgery underwent preoperative CPET (reported blind to patient characteristics) with recording of morbidity (recorded blind to CPET variables). Non-parametric receiver operating characteristic (ROC) curves and logistic regression were used to assess the relationship between CPET variables and postoperative morbidity. Of 105 patients assessed, 95 (72 men) were included; ten patients had no surgery and were excluded (3 by choice, 7 owing to unresectable metastasis). Sixty-eight patients had received neoadjuvant treatment. ROC curve analysis of oxygen uptake (V˙o2 ) at estimated lactate threshold (θ^L ) and peak V˙o2 gave an area under the ROC curve of 0·87 (95 per cent confidence interval 0·78 to 0·95; P < 0·001) and 0·85 (0·77 to 0·93; P < 0·001) respectively, indicating that they can help discriminate patients at risk of postoperative morbidity. The optimal cut-off points identified were 10·6 and 18·6 ml per kg per min for V˙o2 at θ^L and peak respectively. CPET can help predict morbidity after rectal cancer surgery. © 2014 BJS Society Ltd. Published by John Wiley & Sons Ltd.

ROC-ing along: Evaluation and interpretation of receiver operating characteristic curves.

PubMed

Carter, Jane V; Pan, Jianmin; Rai, Shesh N; Galandiuk, Susan

2016-06-01

It is vital for clinicians to understand and interpret correctly medical statistics as used in clinical studies. In this review, we address current issues and focus on delivering a simple, yet comprehensive, explanation of common research methodology involving receiver operating characteristic (ROC) curves. ROC curves are used most commonly in medicine as a means of evaluating diagnostic tests. Sample data from a plasma test for the diagnosis of colorectal cancer were used to generate a prediction model. These are actual, unpublished data that have been used to describe the calculation of sensitivity, specificity, positive predictive and negative predictive values, and accuracy. The ROC curves were generated to determine the accuracy of this plasma test. These curves are generated by plotting the sensitivity (true-positive rate) on the y axis and 1 - specificity (false-positive rate) on the x axis. Curves that approach closest to the coordinate (x = 0, y = 1) are more highly predictive, whereas ROC curves that lie close to the line of equality indicate that the result is no better than that obtained by chance. The optimum sensitivity and specificity can be determined from the graph as the point where the minimum distance line crosses the ROC curve. This point corresponds to the Youden index (J), a function of sensitivity and specificity used commonly to rate diagnostic tests. The area under the curve is used to quantify the overall ability of a test to discriminate between 2 outcomes. By following these simple guidelines, interpretation of ROC curves will be less difficult and they can then be interpreted more reliably when writing, reviewing, or analyzing scientific papers. Copyright © 2016 Elsevier Inc. All rights reserved.

Estimating the Area Under ROC Curve When the Fitted Binormal Curves Demonstrate Improper Shape.

PubMed

Bandos, Andriy I; Guo, Ben; Gur, David

2017-02-01

The "binormal" model is the most frequently used tool for parametric receiver operating characteristic (ROC) analysis. The binormal ROC curves can have "improper" (non-concave) shapes that are unrealistic in many practical applications, and several tools (eg, PROPROC) have been developed to address this problem. However, due to the general robustness of binormal ROCs, the improperness of the fitted curves might carry little consequence for inferences about global summary indices, such as the area under the ROC curve (AUC). In this work, we investigate the effect of severe improperness of fitted binormal ROC curves on the reliability of AUC estimates when the data arise from an actually proper curve. We designed theoretically proper ROC scenarios that induce severely improper shape of fitted binormal curves in the presence of well-distributed empirical ROC points. The binormal curves were fitted using maximum likelihood approach. Using simulations, we estimated the frequency of severely improper fitted curves, bias of the estimated AUC, and coverage of 95% confidence intervals (CIs). In Appendix S1, we provide additional information on percentiles of the distribution of AUC estimates and bias when estimating partial AUCs. We also compared the results to a reference standard provided by empirical estimates obtained from continuous data. We observed up to 96% of severely improper curves depending on the scenario in question. The bias in the binormal AUC estimates was very small and the coverage of the CIs was close to nominal, whereas the estimates of partial AUC were biased upward in the high specificity range and downward in the low specificity range. Compared to a non-parametric approach, the binormal model led to slightly more variable AUC estimates, but at the same time to CIs with more appropriate coverage. The improper shape of the fitted binormal curve, by itself, ie, in the presence of a sufficient number of well-distributed points, does not imply unreliable AUC-based inferences. Copyright © 2017 The Association of University Radiologists. Published by Elsevier Inc. All rights reserved.

Utility of histogram analysis of apparent diffusion coefficient maps obtained using 3.0T MRI for distinguishing uterine carcinosarcoma from endometrial carcinoma.

PubMed

Takahashi, Masahiro; Kozawa, Eito; Tanisaka, Megumi; Hasegawa, Kousei; Yasuda, Masanori; Sakai, Fumikazu

2016-06-01

We explored the role of histogram analysis of apparent diffusion coefficient (ADC) maps for discriminating uterine carcinosarcoma and endometrial carcinoma. We retrospectively evaluated findings in 13 patients with uterine carcinosarcoma and 50 patients with endometrial carcinoma who underwent diffusion-weighted imaging (b = 0, 500, 1000 s/mm(2) ) at 3T with acquisition of corresponding ADC maps. We derived histogram data from regions of interest drawn on all slices of the ADC maps in which tumor was visualized, excluding areas of necrosis and hemorrhage in the tumor. We used the Mann-Whitney test to evaluate the capacity of histogram parameters (mean ADC value, 5th to 95th percentiles, skewness, kurtosis) to discriminate uterine carcinosarcoma and endometrial carcinoma and analyzed the receiver operating characteristic (ROC) curve to determine the optimum threshold value for each parameter and its corresponding sensitivity and specificity. Carcinosarcomas demonstrated significantly higher mean vales of ADC, 95th, 90th, 75th, 50th, 25th percentiles and kurtosis than endometrial carcinomas (P < 0.05). ROC curve analysis of the 75th percentile yielded the best area under the ROC curve (AUC; 0.904), sensitivity of 100%, and specificity of 78.0%, with a cutoff value of 1.034 × 10(-3) mm(2) /s. Histogram analysis of ADC maps might be helpful for discriminating uterine carcinosarcomas and endometrial carcinomas. J. Magn. Reson. Imaging 2016;43:1301-1307. © 2015 Wiley Periodicals, Inc.

Protein-coding genes combined with long noncoding RNA as a novel transcriptome molecular staging model to predict the survival of patients with esophageal squamous cell carcinoma.

PubMed

Guo, Jin-Cheng; Wu, Yang; Chen, Yang; Pan, Feng; Wu, Zhi-Yong; Zhang, Jia-Sheng; Wu, Jian-Yi; Xu, Xiu-E; Zhao, Jian-Mei; Li, En-Min; Zhao, Yi; Xu, Li-Yan

2018-04-09

Esophageal squamous cell carcinoma (ESCC) is the predominant subtype of esophageal carcinoma in China. This study was to develop a staging model to predict outcomes of patients with ESCC. Using Cox regression analysis, principal component analysis (PCA), partitioning clustering, Kaplan-Meier analysis, receiver operating characteristic (ROC) curve analysis, and classification and regression tree (CART) analysis, we mined the Gene Expression Omnibus database to determine the expression profiles of genes in 179 patients with ESCC from GSE63624 and GSE63622 dataset. Univariate cox regression analysis of the GSE63624 dataset revealed that 2404 protein-coding genes (PCGs) and 635 long non-coding RNAs (lncRNAs) were associated with the survival of patients with ESCC. PCA categorized these PCGs and lncRNAs into three principal components (PCs), which were used to cluster the patients into three groups. ROC analysis demonstrated that the predictive ability of PCG-lncRNA PCs when applied to new patients was better than that of the tumor-node-metastasis staging (area under ROC curve [AUC]: 0.69 vs. 0.65, P < 0.05). Accordingly, we constructed a molecular disaggregated model comprising one lncRNA and two PCGs, which we designated as the LSB staging model using CART analysis in the GSE63624 dataset. This LSB staging model classified the GSE63622 dataset of patients into three different groups, and its effectiveness was validated by analysis of another cohort of 105 patients. The LSB staging model has clinical significance for the prognosis prediction of patients with ESCC and may serve as a three-gene staging microarray.

Using a constrained formulation based on probability summation to fit receiver operating characteristic (ROC) curves

NASA Astrophysics Data System (ADS)

Swensson, Richard G.; King, Jill L.; Good, Walter F.; Gur, David

2000-04-01

A constrained ROC formulation from probability summation is proposed for measuring observer performance in detecting abnormal findings on medical images. This assumes the observer's detection or rating decision on each image is determined by a latent variable that characterizes the specific finding (type and location) considered most likely to be a target abnormality. For positive cases, this 'maximum- suspicion' variable is assumed to be either the value for the actual target or for the most suspicious non-target finding, whichever is the greater (more suspicious). Unlike the usual ROC formulation, this constrained formulation guarantees a 'well-behaved' ROC curve that always equals or exceeds chance- level decisions and cannot exhibit an upward 'hook.' Its estimated parameters specify the accuracy for separating positive from negative cases, and they also predict accuracy in locating or identifying the actual abnormal findings. The present maximum-likelihood procedure (runs on PC with Windows 95 or NT) fits this constrained formulation to rating-ROC data using normal distributions with two free parameters. Fits of the conventional and constrained ROC formulations are compared for continuous and discrete-scale ratings of chest films in a variety of detection problems, both for localized lesions (nodules, rib fractures) and for diffuse abnormalities (interstitial disease, infiltrates or pnumothorax). The two fitted ROC curves are nearly identical unless the conventional ROC has an ill behaved 'hook,' below the constrained ROC.

Real-time Raman spectroscopy for automatic in vivo skin cancer detection: an independent validation.

PubMed

Zhao, Jianhua; Lui, Harvey; Kalia, Sunil; Zeng, Haishan

2015-11-01

In a recent study, we have demonstrated that real-time Raman spectroscopy could be used for skin cancer diagnosis. As a translational study, the objective of this study is to validate previous findings through a completely independent clinical test. In total, 645 confirmed cases were included in the analysis, including a cohort of 518 cases from a previous study, and an independent cohort of 127 new cases. Multi-variant statistical data analyses including principal component with general discriminant analysis (PC-GDA) and partial least squares (PLS) were used separately for lesion classification, which generated similar results. When the previous cohort (n = 518) was used as training and the new cohort (n = 127) was used as testing, the area under the receiver operating characteristic curve (ROC AUC) was found to be 0.889 (95 % CI 0.834-0.944; PLS); when the two cohorts were combined, the ROC AUC was 0.894 (95 % CI 0.870-0.918; PLS) with the narrowest confidence intervals. Both analyses were comparable to the previous findings, where the ROC AUC was 0.896 (95 % CI 0.846-0.946; PLS). The independent study validates that real-time Raman spectroscopy could be used for automatic in vivo skin cancer diagnosis with good accuracy.

On the convexity of ROC curves estimated from radiological test results.

PubMed

Pesce, Lorenzo L; Metz, Charles E; Berbaum, Kevin S

2010-08-01

Although an ideal observer's receiver operating characteristic (ROC) curve must be convex-ie, its slope must decrease monotonically-published fits to empirical data often display "hooks." Such fits sometimes are accepted on the basis of an argument that experiments are done with real, rather than ideal, observers. However, the fact that ideal observers must produce convex curves does not imply that convex curves describe only ideal observers. This article aims to identify the practical implications of nonconvex ROC curves and the conditions that can lead to empirical or fitted ROC curves that are not convex. This article views nonconvex ROC curves from historical, theoretical, and statistical perspectives, which we describe briefly. We then consider population ROC curves with various shapes and analyze the types of medical decisions that they imply. Finally, we describe how sampling variability and curve-fitting algorithms can produce ROC curve estimates that include hooks. We show that hooks in population ROC curves imply the use of an irrational decision strategy, even when the curve does not cross the chance line, and therefore usually are untenable in medical settings. Moreover, we sketch a simple approach to improve any nonconvex ROC curve by adding statistical variation to the decision process. Finally, we sketch how to test whether hooks present in ROC data are likely to have been caused by chance alone and how some hooked ROCs found in the literature can be easily explained as fitting artifacts or modeling issues. In general, ROC curve fits that show hooks should be looked on with suspicion unless other arguments justify their presence. 2010 AUR. Published by Elsevier Inc. All rights reserved.

On the convexity of ROC curves estimated from radiological test results

PubMed Central

Pesce, Lorenzo L.; Metz, Charles E.; Berbaum, Kevin S.

2010-01-01

Rationale and Objectives Although an ideal observer’s receiver operating characteristic (ROC) curve must be convex — i.e., its slope must decrease monotonically — published fits to empirical data often display “hooks.” Such fits sometimes are accepted on the basis of an argument that experiments are done with real, rather than ideal, observers. However, the fact that ideal observers must produce convex curves does not imply that convex curves describe only ideal observers. This paper aims to identify the practical implications of non-convex ROC curves and the conditions that can lead to empirical and/or fitted ROC curves that are not convex. Materials and Methods This paper views non-convex ROC curves from historical, theoretical and statistical perspectives, which we describe briefly. We then consider population ROC curves with various shapes and analyze the types of medical decisions that they imply. Finally, we describe how sampling variability and curve-fitting algorithms can produce ROC curve estimates that include hooks. Results We show that hooks in population ROC curves imply the use of an irrational decision strategy, even when the curve doesn’t cross the chance line, and therefore usually are untenable in medical settings. Moreover, we sketch a simple approach to improve any non-convex ROC curve by adding statistical variation to the decision process. Finally, we sketch how to test whether hooks present in ROC data are likely to have been caused by chance alone and how some hooked ROCs found in the literature can be easily explained as fitting artifacts or modeling issues. Conclusion In general, ROC curve fits that show hooks should be looked upon with suspicion unless other arguments justify their presence. PMID:20599155

Recognition Errors Suggest Fast Familiarity and Slow Recollection in Rhesus Monkeys

ERIC Educational Resources Information Center

Basile, Benjamin M.; Hampton, Robert R.

2013-01-01

One influential model of recognition posits two underlying memory processes: recollection, which is detailed but relatively slow, and familiarity, which is quick but lacks detail. Most of the evidence for this dual-process model in nonhumans has come from analyses of receiver operating characteristic (ROC) curves in rats, but whether ROC analyses…

Beyond ROC Curvature: Strength Effects and Response Time Data Support Continuous-Evidence Models of Recognition Memory

ERIC Educational Resources Information Center

Dube, Chad; Starns, Jeffrey J.; Rotello, Caren M.; Ratcliff, Roger

2012-01-01

A classic question in the recognition memory literature is whether retrieval is best described as a continuous-evidence process consistent with signal detection theory (SDT), or a threshold process consistent with many multinomial processing tree (MPT) models. Because receiver operating characteristics (ROCs) based on confidence ratings are…

Equivalence of binormal likelihood-ratio and bi-chi-squared ROC curve models

PubMed Central

Hillis, Stephen L.

2015-01-01

A basic assumption for a meaningful diagnostic decision variable is that there is a monotone relationship between it and its likelihood ratio. This relationship, however, generally does not hold for a decision variable that results in a binormal ROC curve. As a result, receiver operating characteristic (ROC) curve estimation based on the assumption of a binormal ROC-curve model produces improper ROC curves that have “hooks,” are not concave over the entire domain, and cross the chance line. Although in practice this “improperness” is usually not noticeable, sometimes it is evident and problematic. To avoid this problem, Metz and Pan proposed basing ROC-curve estimation on the assumption of a binormal likelihood-ratio (binormal-LR) model, which states that the decision variable is an increasing transformation of the likelihood-ratio function of a random variable having normal conditional diseased and nondiseased distributions. However, their development is not easy to follow. I show that the binormal-LR model is equivalent to a bi-chi-squared model in the sense that the families of corresponding ROC curves are the same. The bi-chi-squared formulation provides an easier-to-follow development of the binormal-LR ROC curve and its properties in terms of well-known distributions. PMID:26608405

ROC Analysis of Chest Radiographs Using Computed Radiography and Conventional Analog Films

NASA Astrophysics Data System (ADS)

Morioka, Craig A.; Brown, Kathy; Hayrapetian, Alek S.; Kangarloo, Hooshang; Balter, Stephen; Huang, H. K.

1989-05-01

Receiver operating characteristic is used to compare the image quality of films obtained digitally using computed radiography (CR) and conventionally using analog film following fluoroscopic examination. Similar radiological views were obtained by both modalities. Twenty-four cases, some with a solitary noncalcified nodule and/or pneumothorax, were collected. Ten radiologists have been tested viewing analog and CR digital films separately. Final results indicate that there is no statistically significant difference in the ability to detect either a pneumothorax or a solitary noncalcified nodule when comparing CR digital film with conventional analog film. However, there is a trend that indicated the area under the ROC curves for detection of either a pneumothorax or solitary noncalcified nodule were greater for the analog film than for the digital film.

Promotion by humus-reducing bacteria for the degradation of UV254 absorbance in reverse-osmosis concentrates pretreated with O3-assisted UV-Fenton method.

PubMed

Xia, Jiaohui; Zhang, Hui; Ding, Shaoxuan; Li, Changyu; Ding, Jincheng; Lu, Jie

2017-07-12

The primary pollutants in reverse-osmosis concentrates (ROC) are the substances with the UV absorbance at 254 nm (UV 254 ), which is closely related to humic substances that can be degraded by humus-reducing bacteria. This work studied the degradation characteristics of humus-reducing bacteria in ROC treatment. The physiological and biochemical characteristics of humus-reducing bacteria were investigated, and the effects of pH values and electron donors on the reduction of humic analog, antraquinone-2, 6-disulfonate were explored to optimize the degradation. Furthermore, the O 3 -assisted UV-Fenton method was applied for the pretreatment of ROC, and the degradation of UV 254 absorbance was apparently promoted with their removal rate, reaching 84.2% after 10 days of degradation by humus-reducing bacteria.

Statistical properties of a utility measure of observer performance compared to area under the ROC curve

NASA Astrophysics Data System (ADS)

Abbey, Craig K.; Samuelson, Frank W.; Gallas, Brandon D.; Boone, John M.; Niklason, Loren T.

2013-03-01

The receiver operating characteristic (ROC) curve has become a common tool for evaluating diagnostic imaging technologies, and the primary endpoint of such evaluations is the area under the curve (AUC), which integrates sensitivity over the entire false positive range. An alternative figure of merit for ROC studies is expected utility (EU), which focuses on the relevant region of the ROC curve as defined by disease prevalence and the relative utility of the task. However if this measure is to be used, it must also have desirable statistical properties keep the burden of observer performance studies as low as possible. Here, we evaluate effect size and variability for EU and AUC. We use two observer performance studies recently submitted to the FDA to compare the EU and AUC endpoints. The studies were conducted using the multi-reader multi-case methodology in which all readers score all cases in all modalities. ROC curves from the study were used to generate both the AUC and EU values for each reader and modality. The EU measure was computed assuming an iso-utility slope of 1.03. We find mean effect sizes, the reader averaged difference between modalities, to be roughly 2.0 times as big for EU as AUC. The standard deviation across readers is roughly 1.4 times as large, suggesting better statistical properties for the EU endpoint. In a simple power analysis of paired comparison across readers, the utility measure required 36% fewer readers on average to achieve 80% statistical power compared to AUC.

A comparative study of quantitative immunohistochemistry and quantum dot immunohistochemistry for mutation carrier identification in Lynch syndrome.

PubMed

Barrow, Emma; Evans, D Gareth; McMahon, Ray; Hill, James; Byers, Richard

2011-03-01

Lynch Syndrome is caused by mutations in DNA mismatch repair (MMR) genes. Mutation carrier identification is facilitated by immunohistochemical detection of the MMR proteins MHL1 and MSH2 in tumour tissue and is desirable as colonoscopic screening reduces mortality. However, protein detection by conventional immunohistochemistry (IHC) is subjective, and quantitative techniques are required. Quantum dots (QDs) are novel fluorescent labels that enable quantitative multiplex staining. This study compared their use with quantitative 3,3'-diaminobenzidine (DAB) IHC for the diagnosis of Lynch Syndrome. Tumour sections from 36 mutation carriers and six controls were obtained. These were stained with DAB on an automated platform using antibodies against MLH1 and MSH2. Multiplex QD immunofluorescent staining of the sections was performed using antibodies against MLH1, MSH2 and smooth muscle actin (SMA). Multispectral analysis of the slides was performed. The staining intensity of DAB and QDs was measured in multiple colonic crypts, and the mean intensity scores calculated. Receiver operating characteristic (ROC) curves of staining performance for the identification of mutation carriers were evaluated. For quantitative DAB IHC, the area under the MLH1 ROC curve was 0.872 (95% CI 0.763 to 0.981), and the area under the MSH2 ROC curve was 0.832 (95% CI 0.704 to 0.960). For quantitative QD IHC, the area under the MLH1 ROC curve was 0.812 (95% CI 0.681 to 0.943), and the area under the MSH2 ROC curve was 0.598 (95% CI 0.418 to 0.777). Despite the advantage of QD staining to enable several markers to be measured simultaneously, it is of lower utility than DAB IHC for the identification of MMR mutation carriers. Automated DAB IHC staining and quantitative slide analysis may enable high-throughput IHC.

Quantitative contrast-enhanced ultrasound evaluation of pathological complete response in patients with locally advanced breast cancer receiving neoadjuvant chemotherapy.

PubMed

Wan, Cai-Feng; Liu, Xue-Song; Wang, Lin; Zhang, Jie; Lu, Jin-Song; Li, Feng-Hua

2018-06-01

To clarify whether the quantitative parameters of contrast-enhanced ultrasound (CEUS) can be used to predict pathological complete response (pCR) in patients with locally advanced breast cancer receiving neoadjuvant chemotherapy (NAC). Fifty-one patients with histologically proved locally advanced breast cancer scheduled for NAC were enrolled. The quantitative data for CEUS and the tumor diameter were collected at baseline and before surgery, and compared with the pathological response. Multiple logistic regression analysis was performed to examine quantitative parameters at CEUS and the tumor diameter to predict the pCR, and receiver operating characteristic (ROC) curve analysis was used as a summary statistic. Multiple logistic regression analysis revealed that PEAK (the maximum intensity of the time-intensity curve during bolus transit), PEAK%, TTP% (time to peak), and diameter% were significant independent predictors of pCR, and the area under the ROC curve was 0.932(Az 1 ), and the sensitivity and specificity to predict pCR were 93.7% and 80.0%. The area under the ROC curve for the quantitative parameters was 0.927(Az 2 ), and the sensitivity and specificity to predict pCR were 81.2% and 94.3%. For diameter%, the area under the ROC curve was 0.786 (Az 3 ), and the sensitivity and specificity to predict pCR were 93.8% and 54.3%. The values of Az 1 and Az 2 were significantly higher than that of Az 3 (P = 0.027 and P = 0.034, respectively). However, there was no significant difference between the values of Az 1 and Az 2 (P = 0.825). Quantitative analysis of tumor blood perfusion with CEUS is superior to diameter% to predict pCR, and can be used as a functional technique to evaluate tumor response to NAC. Copyright © 2018. Published by Elsevier B.V.

A statistical approach to evaluate the performance of cardiac biomarkers in predicting death due to acute myocardial infarction: time-dependent ROC curve

PubMed

Karaismailoğlu, Eda; Dikmen, Zeliha Günnur; Akbıyık, Filiz; Karaağaoğlu, Ahmet Ergun

2018-04-30

Background/aim: Myoglobin, cardiac troponin T, B-type natriuretic peptide (BNP), and creatine kinase isoenzyme MB (CK-MB) are frequently used biomarkers for evaluating risk of patients admitted to an emergency department with chest pain. Recently, time- dependent receiver operating characteristic (ROC) analysis has been used to evaluate the predictive power of biomarkers where disease status can change over time. We aimed to determine the best set of biomarkers that estimate cardiac death during follow-up time. We also obtained optimal cut-off values of these biomarkers, which differentiates between patients with and without risk of death. A web tool was developed to estimate time intervals in risk. Materials and methods: A total of 410 patients admitted to the emergency department with chest pain and shortness of breath were included. Cox regression analysis was used to determine an optimal set of biomarkers that can be used for estimating cardiac death and to combine the significant biomarkers. Time-dependent ROC analysis was performed for evaluating performances of significant biomarkers and a combined biomarker during 240 h. The bootstrap method was used to compare statistical significance and the Youden index was used to determine optimal cut-off values. Results : Myoglobin and BNP were significant by multivariate Cox regression analysis. Areas under the time-dependent ROC curves of myoglobin and BNP were about 0.80 during 240 h, and that of the combined biomarker (myoglobin + BNP) increased to 0.90 during the first 180 h. Conclusion: Although myoglobin is not clinically specific to a cardiac event, in our study both myoglobin and BNP were found to be statistically significant for estimating cardiac death. Using this combined biomarker may increase the power of prediction. Our web tool can be useful for evaluating the risk status of new patients and helping clinicians in making decisions.

Differentiation between microcystin contaminated and uncontaminated fish by determination of unconjugated MCs using an ELISA anti-Adda test based on receiver-operating characteristic curves threshold values: application to Tinca tinca from natural ponds.

PubMed

Moreno, Isabel María; Herrador, M Ángeles; Atencio, Loyda; Puerto, María; González, A Gustavo; Cameán, Ana María

2011-02-01

The aim of this study was to evaluate whether the enzyme-linked immunosorbent assay (ELISA) anti-Adda technique could be used to monitor free microcystins (MCs) in biological samples from fish naturally exposed to toxic cyanobacteria by using receiver operating characteristic (ROC) curve software to establish an optimal cut-off value for MCs. The cut-off value determined by ROC curve analysis in tench (Tinca tinca) exposed to MCs under laboratory conditions by ROC curve analysis was 5.90-μg MCs/kg tissue dry weight (d.w.) with a sensitivity of 93.3%. This value was applied in fish samples from natural ponds (Extremadura, Spain) in order to asses its potential MCs bioaccumulation by classifying samples as either true positive (TP), false positive (FP), true negative (TN), or false negative (FN). In this work, it has been demonstrated that toxic cyanobacteria, mainly Microcystis aeruginosa, Aphanizomenon issatchenkoi, and Anabaena spiroides, were present in two of these ponds, Barruecos de Abajo (BDown) and Barruecos de Arriba (BUp). The MCs levels were detected in waters from both ponds with an anti-MC-LR ELISA immunoassay and were of similar values (between 3.8-6.5-μg MC-LR equivalent/L in BDown pond and 4.8-6.0-μg MC-LR equivalent/L in BUp). The MCs cut-off values were applied in livers from fish collected from these two ponds using the ELISA anti-Adda technique. A total of 83% of samples from BDown pond and only 42% from BUp were TP with values of free MCs higher than 8.8-μg MCs/kg tissue (d.w.). Copyright © 2009 Wiley Periodicals, Inc.

A global goodness-of-fit test for receiver operating characteristic curve analysis via the bootstrap method.

PubMed

Zou, Kelly H; Resnic, Frederic S; Talos, Ion-Florin; Goldberg-Zimring, Daniel; Bhagwat, Jui G; Haker, Steven J; Kikinis, Ron; Jolesz, Ferenc A; Ohno-Machado, Lucila

2005-10-01

Medical classification accuracy studies often yield continuous data based on predictive models for treatment outcomes. A popular method for evaluating the performance of diagnostic tests is the receiver operating characteristic (ROC) curve analysis. The main objective was to develop a global statistical hypothesis test for assessing the goodness-of-fit (GOF) for parametric ROC curves via the bootstrap. A simple log (or logit) and a more flexible Box-Cox normality transformations were applied to untransformed or transformed data from two clinical studies to predict complications following percutaneous coronary interventions (PCIs) and for image-guided neurosurgical resection results predicted by tumor volume, respectively. We compared a non-parametric with a parametric binormal estimate of the underlying ROC curve. To construct such a GOF test, we used the non-parametric and parametric areas under the curve (AUCs) as the metrics, with a resulting p value reported. In the interventional cardiology example, logit and Box-Cox transformations of the predictive probabilities led to satisfactory AUCs (AUC=0.888; p=0.78, and AUC=0.888; p=0.73, respectively), while in the brain tumor resection example, log and Box-Cox transformations of the tumor size also led to satisfactory AUCs (AUC=0.898; p=0.61, and AUC=0.899; p=0.42, respectively). In contrast, significant departures from GOF were observed without applying any transformation prior to assuming a binormal model (AUC=0.766; p=0.004, and AUC=0.831; p=0.03), respectively. In both studies the p values suggested that transformations were important to consider before applying any binormal model to estimate the AUC. Our analyses also demonstrated and confirmed the predictive values of different classifiers for determining the interventional complications following PCIs and resection outcomes in image-guided neurosurgery.

Separating Mnemonic Process from Participant and Item Effects in the Assessment of ROC Asymmetries

ERIC Educational Resources Information Center

Pratte, Michael S.; Rouder, Jeffrey N.; Morey, Richard D.

2010-01-01

One of the most influential findings in the study of recognition memory is that receiver operating characteristic (ROC) curves are asymmetric about the negative diagonal. This result has led to the rejection of the equal-variance signal detection model of recognition memory and has provided motivation for more complex models, such as the…

Fusion of multiscale wavelet-based fractal analysis on retina image for stroke prediction.

PubMed

Che Azemin, M Z; Kumar, Dinesh K; Wong, T Y; Wang, J J; Kawasaki, R; Mitchell, P; Arjunan, Sridhar P

2010-01-01

In this paper, we present a novel method of analyzing retinal vasculature using Fourier Fractal Dimension to extract the complexity of the retinal vasculature enhanced at different wavelet scales. Logistic regression was used as a fusion method to model the classifier for 5-year stroke prediction. The efficacy of this technique has been tested using standard pattern recognition performance evaluation, Receivers Operating Characteristics (ROC) analysis and medical prediction statistics, odds ratio. Stroke prediction model was developed using the proposed system.

Compare diagnostic tests using transformation-invariant smoothed ROC curves⋆

PubMed Central

Tang, Liansheng; Du, Pang; Wu, Chengqing

2012-01-01

Receiver operating characteristic (ROC) curve, plotting true positive rates against false positive rates as threshold varies, is an important tool for evaluating biomarkers in diagnostic medicine studies. By definition, ROC curve is monotone increasing from 0 to 1 and is invariant to any monotone transformation of test results. And it is often a curve with certain level of smoothness when test results from the diseased and non-diseased subjects follow continuous distributions. Most existing ROC curve estimation methods do not guarantee all of these properties. One of the exceptions is Du and Tang (2009) which applies certain monotone spline regression procedure to empirical ROC estimates. However, their method does not consider the inherent correlations between empirical ROC estimates. This makes the derivation of the asymptotic properties very difficult. In this paper we propose a penalized weighted least square estimation method, which incorporates the covariance between empirical ROC estimates as a weight matrix. The resulting estimator satisfies all the aforementioned properties, and we show that it is also consistent. Then a resampling approach is used to extend our method for comparisons of two or more diagnostic tests. Our simulations show a significantly improved performance over the existing method, especially for steep ROC curves. We then apply the proposed method to a cancer diagnostic study that compares several newly developed diagnostic biomarkers to a traditional one. PMID:22639484

Impact of signal scattering and parametric uncertainties on receiver operating characteristics

NASA Astrophysics Data System (ADS)

Wilson, D. Keith; Breton, Daniel J.; Hart, Carl R.; Pettit, Chris L.

2017-05-01

The receiver operating characteristic (ROC curve), which is a plot of the probability of detection as a function of the probability of false alarm, plays a key role in the classical analysis of detector performance. However, meaningful characterization of the ROC curve is challenging when practically important complications such as variations in source emissions, environmental impacts on the signal propagation, uncertainties in the sensor response, and multiple sources of interference are considered. In this paper, a relatively simple but realistic model for scattered signals is employed to explore how parametric uncertainties impact the ROC curve. In particular, we show that parametric uncertainties in the mean signal and noise power substantially raise the tails of the distributions; since receiver operation with a very low probability of false alarm and a high probability of detection is normally desired, these tails lead to severely degraded performance. Because full a priori knowledge of such parametric uncertainties is rarely available in practice, analyses must typically be based on a finite sample of environmental states, which only partially characterize the range of parameter variations. We show how this effect can lead to misleading assessments of system performance. For the cases considered, approximately 64 or more statistically independent samples of the uncertain parameters are needed to accurately predict the probabilities of detection and false alarm. A connection is also described between selection of suitable distributions for the uncertain parameters, and Bayesian adaptive methods for inferring the parameters.

Validity of the posttraumatic stress disorders (PTSD) checklist in pregnant women.

PubMed

Gelaye, Bizu; Zheng, Yinnan; Medina-Mora, Maria Elena; Rondon, Marta B; Sánchez, Sixto E; Williams, Michelle A

2017-05-12

The PTSD Checklist-civilian (PCL-C) is one of the most commonly used self-report measures of PTSD symptoms, however, little is known about its validity when used in pregnancy. This study aims to evaluate the reliability and validity of the PCL-C as a screen for detecting PTSD symptoms among pregnant women. A total of 3372 pregnant women who attended their first prenatal care visit in Lima, Peru participated in the study. We assessed the reliability of the PCL-C items using Cronbach's alpha. Criterion validity and performance characteristics of PCL-C were assessed against an independent, blinded Clinician-Administered PTSD Scale (CAPS) interview using measures of sensitivity, specificity and receiver operating characteristics (ROC) curves. We tested construct validity using exploratory and confirmatory factor analytic approaches. The reliability of the PCL-C was excellent (Cronbach's alpha =0.90). ROC analysis showed that a cut-off score of 26 offered optimal discriminatory power, with a sensitivity of 0.86 (95% CI: 0.78-0.92) and a specificity of 0.63 (95% CI: 0.62-0.65). The area under the ROC curve was 0.75 (95% CI: 0.71-0.78). A three-factor solution was extracted using exploratory factor analysis and was further complemented with three other models using confirmatory factor analysis (CFA). In a CFA, a three-factor model based on DSM-IV symptom structure had reasonable fit statistics with comparative fit index of 0.86 and root mean square error of approximation of 0.09. The Spanish-language version of the PCL-C may be used as a screening tool for pregnant women. The PCL-C has good reliability, criterion validity and factorial validity. The optimal cut-off score obtained by maximizing the sensitivity and specificity should be considered cautiously; women who screened positive may require further investigation to confirm PTSD diagnosis.

Influences on emergency department length of stay for older people.

PubMed

Street, Maryann; Mohebbi, Mohammadreza; Berry, Debra; Cross, Anthony; Considine, Julie

2018-02-14

The aim of this study was to examine the influences on emergency department (ED) length of stay (LOS) for older people and develop a predictive model for an ED LOS more than 4 h. This retrospective cohort study used organizational data linkage at the patient level from a major Australian health service. The study population was aged 65 years or older, attending an ED during the 2013/2014 financial year. We developed and internally validated a clinical prediction rule. Discriminatory performance of the model was evaluated by receiver operating characteristic (ROC) curve analysis. An integer-based risk score was developed using multivariate logistic regression. The risk score was evaluated using ROC analysis. There were 33 926 ED attendances: 57.5% (n=19 517) had an ED LOS more than 4 h. The area under ROC for age, usual accommodation, triage category, arrival by ambulance, arrival overnight, imaging, laboratory investigations, overcrowding, time to be seen by doctor, ED visits with admission and access block relating to ED LOS more than 4 h was 0.796, indicating good performance. In the validation set, area under ROC was 0.80, P-value was 0.36 and prediction mean square error was 0.18, indicating good calibration. The risk score value attributed to each risk factor ranged from 2 to 68 points. The clinical prediction rule stratified patients into five levels of risk on the basis of the total risk score. Objective identification of older people at intermediate and high risk of an ED LOS more than 4 h early in ED care enables targeted approaches to streamline the patient journey, decrease ED LOS and optimize emergency care for older people.

ROC-king onwards: intraepithelial lymphocyte counts, distribution & role in coeliac disease mucosal interpretation

PubMed Central

Rostami, Kamran; Marsh, Michael N; Johnson, Matt W; Mohaghegh, Hamid; Heal, Calvin; Holmes, Geoffrey; Ensari, Arzu; Aldulaimi, David; Bancel, Brigitte; Bassotti, Gabrio; Bateman, Adrian; Becheanu, Gabriel; Bozzola, Anna; Carroccio, Antonio; Catassi, Carlo; Ciacci, Carolina; Ciobanu, Alexandra; Danciu, Mihai; Derakhshan, Mohammad H; Elli, Luca; Ferrero, Stefano; Fiorentino, Michelangelo; Fiorino, Marilena; Ganji, Azita; Ghaffarzadehgan, Kamran; Going, James J; Ishaq, Sauid; Mandolesi, Alessandra; Mathews, Sherly; Maxim, Roxana; Mulder, Chris J; Neefjes-Borst, Andra; Robert, Marie; Russo, Ilaria; Rostami-Nejad, Mohammad; Sidoni, Angelo; Sotoudeh, Masoud; Villanacci, Vincenzo; Volta, Umberto; Zali, Mohammad R; Srivastava, Amitabh

2017-01-01

Objectives Counting intraepithelial lymphocytes (IEL) is central to the histological diagnosis of coeliac disease (CD), but no definitive ‘normal’ IEL range has ever been published. In this multicentre study, receiver operating characteristic (ROC) curve analysis was used to determine the optimal cut-off between normal and CD (Marsh III lesion) duodenal mucosa, based on IEL counts on >400 mucosal biopsy specimens. Design The study was designed at the International Meeting on Digestive Pathology, Bucharest 2015. Investigators from 19 centres, eight countries of three continents, recruited 198 patients with Marsh III histology and 203 controls and used one agreed protocol to count IEL/100 enterocytes in well-oriented duodenal biopsies. Demographic and serological data were also collected. Results The mean ages of CD and control groups were 45.5 (neonate to 82) and 38.3 (2–88) years. Mean IEL count was 54±18/100 enterocytes in CD and 13±8 in normal controls (p=0.0001). ROC analysis indicated an optimal cut-off point of 25 IEL/100 enterocytes, with 99% sensitivity, 92% specificity and 99.5% area under the curve. Other cut-offs between 20 and 40 IEL were less discriminatory. Additionally, there was a sufficiently high number of biopsies to explore IEL counts across the subclassification of the Marsh III lesion. Conclusion Our ROC curve analyses demonstrate that for Marsh III lesions, a cut-off of 25 IEL/100 enterocytes optimises discrimination between normal control and CD biopsies. No differences in IEL counts were found between Marsh III a, b and c lesions. There was an indication of a continuously graded dose–response by IEL to environmental (gluten) antigenic influence. PMID:28893865

An extension of the receiver operating characteristic curve and AUC-optimal classification.

PubMed

Takenouchi, Takashi; Komori, Osamu; Eguchi, Shinto

2012-10-01

While most proposed methods for solving classification problems focus on minimization of the classification error rate, we are interested in the receiver operating characteristic (ROC) curve, which provides more information about classification performance than the error rate does. The area under the ROC curve (AUC) is a natural measure for overall assessment of a classifier based on the ROC curve. We discuss a class of concave functions for AUC maximization in which a boosting-type algorithm including RankBoost is considered, and the Bayesian risk consistency and the lower bound of the optimum function are discussed. A procedure derived by maximizing a specific optimum function has high robustness, based on gross error sensitivity. Additionally, we focus on the partial AUC, which is the partial area under the ROC curve. For example, in medical screening, a high true-positive rate to the fixed lower false-positive rate is preferable and thus the partial AUC corresponding to lower false-positive rates is much more important than the remaining AUC. We extend the class of concave optimum functions for partial AUC optimality with the boosting algorithm. We investigated the validity of the proposed method through several experiments with data sets in the UCI repository.

Postoperative Decrease in Platelet Counts Is Associated with Delayed Liver Function Recovery and Complications after Partial Hepatectomy.

PubMed

Takahashi, Kazuhiro; Kurokawa, Tomohiro; Oshiro, Yukio; Fukunaga, Kiyoshi; Sakashita, Shingo; Ohkohchi, Nobuhiro

2016-05-01

Peripheral platelet counts decrease after partial hepatectomy; however, the implications of this phenomenon are unclear. We assessed if the observed decrease in platelet counts was associated with postoperative liver function and morbidity (complications grade ≤ II according to the Clavien-Dindo classification). We enrolled 216 consecutive patients who underwent partial hepatectomy for primary liver cancers, metastatic liver cancers, benign tumors, and donor hepatectomy. We classified patients as either low or high platelet percentage (postoperative platelet count/preoperative platelet count) using the optimal cutoff value calculated by a receiver operating characteristic (ROC) curve analysis, and analyzed risk factors for delayed liver functional recovery and morbidity after hepatectomy. Delayed liver function recovery and morbidity were significantly correlated with the lowest value of platelet percentage based on ROC analysis. Using a cutoff value of 60% acquired by ROC analysis, univariate and multivariate analysis determined that postoperative lowest platelet percentage ≤ 60% was identified as an independent risk factor of delayed liver function recovery (odds ratio (OR) 6.85; P < 0.01) and morbidity (OR, 4.90; P < 0.01). Furthermore, patients with the lowest platelet percentage ≤ 60% had decreased postoperative prothrombin time ratio and serum albumin level and increased serum bilirubin level when compared with patients with platelet percentage ≥ 61%. A greater than 40% decrease in platelet count after partial hepatectomy was an independent risk factor for delayed liver function recovery and postoperative morbidity. In conclusion, the decrease in platelet counts is an early marker to predict the liver function recovery and complications after hepatectomy.

Eyewitness identification in simultaneous and sequential lineups: an investigation of position effects using receiver operating characteristics.

PubMed

Meisters, Julia; Diedenhofen, Birk; Musch, Jochen

2018-04-20

For decades, sequential lineups have been considered superior to simultaneous lineups in the context of eyewitness identification. However, most of the research leading to this conclusion was based on the analysis of diagnosticity ratios that do not control for the respondent's response criterion. Recent research based on the analysis of ROC curves has found either equal discriminability for sequential and simultaneous lineups, or higher discriminability for simultaneous lineups. Some evidence for potential position effects and for criterion shifts in sequential lineups has also been reported. Using ROC curve analysis, we investigated the effects of the suspect's position on discriminability and response criteria in both simultaneous and sequential lineups. We found that sequential lineups suffered from an unwanted position effect. Respondents employed a strict criterion for the earliest lineup positions, and shifted to a more liberal criterion for later positions. No position effects and no criterion shifts were observed in simultaneous lineups. This result suggests that sequential lineups are not superior to simultaneous lineups, and may give rise to unwanted position effects that have to be considered when conducting police lineups.

A new comparison of hyperspectral anomaly detection algorithms for real-time applications

NASA Astrophysics Data System (ADS)

Díaz, María.; López, Sebastián.; Sarmiento, Roberto

2016-10-01

Due to the high spectral resolution that remotely sensed hyperspectral images provide, there has been an increasing interest in anomaly detection. The aim of anomaly detection is to stand over pixels whose spectral signature differs significantly from the background spectra. Basically, anomaly detectors mark pixels with a certain score, considering as anomalies those whose scores are higher than a threshold. Receiver Operating Characteristic (ROC) curves have been widely used as an assessment measure in order to compare the performance of different algorithms. ROC curves are graphical plots which illustrate the trade- off between false positive and true positive rates. However, they are limited in order to make deep comparisons due to the fact that they discard relevant factors required in real-time applications such as run times, costs of misclassification and the competence to mark anomalies with high scores. This last fact is fundamental in anomaly detection in order to distinguish them easily from the background without any posterior processing. An extensive set of simulations have been made using different anomaly detection algorithms, comparing their performances and efficiencies using several extra metrics in order to complement ROC curves analysis. Results support our proposal and demonstrate that ROC curves do not provide a good visualization of detection performances for themselves. Moreover, a figure of merit has been proposed in this paper which encompasses in a single global metric all the measures yielded for the proposed additional metrics. Therefore, this figure, named Detection Efficiency (DE), takes into account several crucial types of performance assessment that ROC curves do not consider. Results demonstrate that algorithms with the best detection performances according to ROC curves do not have the highest DE values. Consequently, the recommendation of using extra measures to properly evaluate performances have been supported and justified by the conclusions drawn from the simulations.

Receiver-operating-characteristic analysis of an automated program for analyzing striatal uptake of 123I-ioflupane SPECT images: calibration using visual reads.

PubMed

Kuo, Phillip Hsin; Avery, Ryan; Krupinski, Elizabeth; Lei, Hong; Bauer, Adam; Sherman, Scott; McMillan, Natalie; Seibyl, John; Zubal, George

2013-03-01

A fully automated objective striatal analysis (OSA) program that quantitates dopamine transporter uptake in subjects with suspected Parkinson's disease was applied to images from clinical (123)I-ioflupane studies. The striatal binding ratios or alternatively the specific binding ratio (SBR) of the lowest putamen uptake was computed, and receiver-operating-characteristic (ROC) analysis was applied to 94 subjects to determine the best discriminator using this quantitative method. Ninety-four (123)I-ioflupane SPECT scans were analyzed from patients referred to our clinical imaging department and were reconstructed using the manufacturer-supplied reconstruction and filtering parameters for the radiotracer. Three trained readers conducted independent visual interpretations and reported each case as either normal or showing dopaminergic deficit (abnormal). The same images were analyzed using the OSA software, which locates the striatal and occipital structures and places regions of interest on the caudate and putamen. Additionally, the OSA places a region of interest on the occipital region that is used to calculate the background-subtracted SBR. The lower SBR of the 2 putamen regions was taken as the quantitative report. The 33 normal (bilateral comma-shaped striata) and 61 abnormal (unilateral or bilateral dopaminergic deficit) studies were analyzed to generate ROC curves. Twenty-nine of the scans were interpreted as normal and 59 as abnormal by all 3 readers. For 12 scans, the 3 readers did not unanimously agree in their interpretations (discordant). The ROC analysis, which used the visual-majority-consensus interpretation from the readers as the gold standard, yielded an area under the curve of 0.958 when using 1.08 as the threshold SBR for the lowest putamen. The sensitivity and specificity of the automated quantitative analysis were 95% and 89%, respectively. The OSA program delivers SBR quantitative values that have a high sensitivity and specificity, compared with visual interpretations by trained nuclear medicine readers. Such a program could be a helpful aid for readers not yet experienced with (123)I-ioflupane SPECT images and if further adapted and validated may be useful to assess disease progression during pharmaceutical testing of therapies.

Timing of occurrence is the most important characteristic of spot sign

PubMed Central

Xu, Mengjun; Zhang, Sheng; Liu, Keqin; Hu, Haitao; Selim, Magdy; Lou, Min

2016-01-01

Background and Purpose Most previous studies have used single-phase CT angiography (CTA) to detect the spot sign, a marker for hematoma expansion (HE) in spontaneous intracerebral hemorrhage (SICH). We investigated whether defining the spot sign based on timing on perfusion CT (CTP) would improve its specificity for predicting HE. Methods We prospectively enrolled supratentorial SICH patients, who underwent CTP within 6 h of onset. Logistic regression were performed to assess the risk factors for HE and poor outcome. Predictive performance of individual CTP spot sign characteristics were examined with receiver operating characteristic (ROC) analysis. Results Sixty-two men and 21 women with SICH were included in this analysis. Spot sign was detected in 46% (38/83) patients. ROC analysis indicated that the timing of spot sign occurrence on CTP had the greatest AUC for HE (0.794; 95% CI, 0.630-0.958; P=0.007); the cutoff time was 23.13 seconds. On multivariable analysis, the presence of early-occurring spot sign (EOSS; i.e. spot sign before 23.13 seconds) was an independent predictor, not only of HE (OR=28.835; 95% CI, 6.960-119.458; P<0.001), but also of mortality at 3 months (OR=22.377; 95% CI, 1.773-282.334; P=0.016). Moreover, the predictive performance showed that the redefined EOSS maintained a higher specificity for HE compared to spot sign (91% vs 74%). Conclusions Redefining the spot sign based on timing of contrast leakage on CTP to determine EOSS, improves the specificity for predicting HE and 3-month mortality. The use of EOSS could improve the selection of ICH patients for potential hemostatic therapy. PMID:27026627

Blood-based biomarkers used to predict disease activity in Crohn's disease and ulcerative colitis.

PubMed

Burakoff, Robert; Pabby, Vikas; Onyewadume, Louisa; Odze, Robert; Adackapara, Cheryl; Wang, Wei; Friedman, Sonia; Hamilton, Matthew; Korzenik, Joshua; Levine, Jonathan; Makrauer, Frederick; Cheng, Changming; Smith, Hai Choo; Liew, Choong-Chin; Chao, Samuel

2015-05-01

Identifying specific genes that are differentially expressed during inflammatory bowel disease flares may help stratify disease activity. The aim of this study was to identify panels of genes to be able to distinguish disease activity in Crohn's disease (CD) and ulcerative colitis (UC). Patients were grouped into categories based on disease and severity determined by histological grading. Whole blood was collected by PAXgene Blood RNA collection tubes, (PreAnalytiX) and gene expression analysis using messenger RNA was conducted. Logistic regression was performed on multiple combinations of common probe sets, and data were evaluated in terms of discrimination by computing the area under the receiving operator characteristic curve (ROC-AUC). Nine inactive CD, 8 mild CD, 10 moderate-to-severe CD, 9 inactive UC, 8 mild UC, 10 moderate-to-severe UC, and 120 controls were hybridized to Affymetrix U133 Plus 2 microarrays. Panels of 6 individual genes discriminated the stages of disease activity: CD with mild severity {ROC-AUC, 0.89 (95% confidence interval [CI], 0.84%-0.95%)}, CD with moderate-to-severe severity (ROC-AUC 0.98 [95% CI, 0.97-1.0]), UC with mild severity (ROC-AUC 0.92 [95% CI, 0.87-0.96]), and UC with moderate-to-severe severity (ROC-AUC 0.99 [95% CI, 0.97-1.0]). Validation by real-time reverse transcription-PCR confirmed the Affymetrix microarray data. The specific whole blood gene panels reliably distinguished CD and UC and determined the activity of disease, with high sensitivity and specificity in our cohorts of patients. This simple serological test has the potential to become a biomarker to determine the activity of disease.

Utility as a rationale for choosing observer performance assessment paradigms for detection tasks in medical imaging.

PubMed

Wunderlich, Adam; Abbey, Craig K

2013-11-01

Studies of lesion detectability are often carried out to evaluate medical imaging technology. For such studies, several approaches have been proposed to measure observer performance, such as the receiver operating characteristic (ROC), the localization ROC (LROC), the free-response ROC (FROC), the alternative free-response ROC (AFROC), and the exponentially transformed FROC (EFROC) paradigms. Therefore, an experimenter seeking to carry out such a study is confronted with an array of choices. Traditionally, arguments for different approaches have been made on the basis of practical considerations (statistical power, etc.) or the gross level of analysis (case-level or lesion-level). This article contends that a careful consideration of utility should form the rationale for matching the assessment paradigm to the clinical task of interest. In utility theory, task performance is commonly evaluated with total expected utility, which integrates the various event utilities against the probability of each event. To formalize the relationship between expected utility and the summary curve associated with each assessment paradigm, the concept of a "natural" utility structure is proposed. A natural utility structure is defined for a summary curve when the variables associated with the summary curve axes are sufficient for computing total expected utility, assuming that the disease prevalence is known. Natural utility structures for ROC, LROC, FROC, AFROC, and EFROC curves are introduced, clarifying how the utilities of correct and incorrect decisions are aggregated by summary curves. Further, conditions are given under which general utility structures for localization-based methodologies reduce to case-based assessment. Overall, the findings reveal how summary curves correspond to natural utility structures of diagnostic tasks, suggesting utility as a motivating principle for choosing an assessment paradigm.

Triceps and Subscapular Skinfold Thickness Percentiles and Cut-Offs for Overweight and Obesity in a Population-Based Sample of Schoolchildren and Adolescents in Bogota, Colombia.

PubMed

Ramírez-Vélez, Robinson; López-Cifuentes, Mario Ferney; Correa-Bautista, Jorge Enrique; González-Ruíz, Katherine; González-Jiménez, Emilio; Córdoba-Rodríguez, Diana Paola; Vivas, Andrés; Triana-Reina, Hector Reynaldo; Schmidt-RioValle, Jacqueline

2016-09-24

The assessment of skinfold thickness is an objective measure of adiposity. The aims of this study were to establish Colombian smoothed centile charts and LMS L (Box-Cox transformation), M (median), and S (coefficient of variation) tables for triceps, subscapular, and triceps + subscapular skinfolds; appropriate cut-offs were selected using receiver operating characteristic (ROC) analysis based on a population-based sample of children and adolescents in Bogotá, Colombia. A cross-sectional study was conducted in 9618 children and adolescents (55.7% girls; age range of 9-17.9 years). Triceps and subscapular skinfold measurements were obtained using standardized methods. We calculated the triceps + subscapular skinfold (T + SS) sum. Smoothed percentile curves for triceps and subscapular skinfold thickness were derived using the LMS method. ROC curve analyses were used to evaluate the optimal cut-off point of skinfold thickness for overweight and obesity, based on the International Obesity Task Force definitions. Subscapular and triceps skinfolds and T + SS were significantly higher in girls than in boys (p < 0.001). The ROC analysis showed that subscapular and triceps skinfolds and T + SS have a high discriminatory power in the identification of overweight and obesity in the sample population in this study. Our results provide sex- and age-specific normative reference standards for skinfold thickness values from a population from Bogotá, Colombia.

A novel multi-epitope recombined protein for diagnosis of human brucellosis.

PubMed

Yin, Dehui; Li, Li; Song, Xiuling; Li, Han; Wang, Juan; Ju, Wen; Qu, Xiaofeng; Song, Dandan; Liu, Yushen; Meng, Xiangjun; Cao, Hongqian; Song, Weiyi; Meng, Rizeng; Liu, Jinhua; Li, Juan; Xu, Kun

2016-05-21

In epidemic regions of the world, brucellosis is a reemerging zoonosis with minimal mortality but is a serious public hygiene problem. Currently, there are various methods for brucellosis diagnosis, however few of them are available to be used to diagnose, especially for serious cross-reaction with other bacteria. To overcome this disadvantage, we explored a novel multi-epitope recombinant protein as human brucellosis diagnostic antigen. We established an indirect enzyme-linked immunosorbent assay (ELISA) based on this recombinant protein. 248 sera obtained from three different groups including patients with brucellosis (146 samples), non-brucellosis patients (82 samples), and healthy individuals (20 samples) were tested by indirect ELISA. To evaluate the assay, a receiver-operating characteristic (ROC) analysis and immunoblotting were carried out using these characterized serum samples. For this test, the area under the ROC curve was 0.9409 (95 % confidence interval, 0.9108 to 0.9709), and a sensitivity of 88.89 % and a specificity of 85.54 % was given with a cutoff value of 0.3865 from this ROC analysis. The Western blot results indicate that it is feasible to differentiate human brucellosis and non-brucellosis with the newly established method based on this recombinant protein. Our results obtained high diagnostic accuracy of the ELISA assay which encourage the use of this novel recombinant protein as diagnostic antigen to implement serological diagnosis of brucellosis.

Electrochemical Skin Conductance May Be Used to Screen for Diabetic Cardiac Autonomic Neuropathy in a Chinese Population with Diabetes

PubMed Central

He, Tianyi; Wang, Chuan; Zuo, Anju; Liu, Pan; Li, Wenjuan

2017-01-01

Aims. This study aimed to assess whether the electrochemical skin conductance (ESC) could be used to screen for diabetic cardiac autonomic neuropathy (DCAN) in a Chinese population with diabetes. Methods. We recruited 75 patients with type 2 diabetes mellitus (T2DM) and 45 controls without diabetes. DCAN was diagnosed by the cardiovascular autonomic reflex tests (CARTs) as gold standard. In all subjects ESCs of hands and feet were also detected by SUDOSCAN™ as a new screening method. The efficacy was assessed by receiver operating characteristic (ROC) curve analysis. Results. The ESCs of both hands and feet were significantly lower in T2DM patients with DCAN than those without DCAN (67.33 ± 15.37 versus 78.03 ± 13.73, P = 0.002, and 57.77 ± 20.99 versus 75.03 ± 11.41, P < 0.001). The ROC curve analysis showed the areas under the ROC curve were both 0.75 for ESCs of hands and feet in screening DCAN. And the optimal cut-off values of ESCs, sensitivities, and specificities were 76 μS, 76.7%, and 75.6% for hands and 75 μS, 80.0%, and 60.0% for feet, respectively. Conclusions. ESC measurement is a reliable and feasible method to screen DCAN in the Chinese population with diabetes before further diagnosis with CARTs. PMID:28280746

A statistical investigation of z test and ROC curve on seismo-ionospheric anomalies in TEC associated earthquakes in Taiwan during 1999-2014

NASA Astrophysics Data System (ADS)

Shih, A. L.; Liu, J. Y. G.

2015-12-01

A median-based method and a z test are employed to find characteristics of seismo-ionospheric precursor (SIP) of the total electron content (TEC) in global ionosphere map (GIM) associated with 129 M≥5.5 earthquakes in Taiwan during 1999-2014. Results show that both negative and positive anomalies in the GIM TEC with the statistical significance of the z test appear few days before the earthquakes. The receiver operating characteristic (ROC) curve is further applied to see whether the SIPs exist in Taiwan.

Variations in recollection: the effects of complexity on source recognition.

PubMed

Parks, Colleen M; Murray, Linda J; Elfman, Kane; Yonelinas, Andrew P

2011-07-01

Whether recollection is a threshold or signal detection process is highly controversial, and the controversy has centered in part on the shape of receiver operating characteristics (ROCs) and z-transformed ROCs (zROCs). U-shaped zROCs observed in tests thought to rely heavily on recollection, such as source memory tests, have provided evidence in favor of the threshold assumption, but zROCs are not always as U-shaped as threshold theory predicts. Source zROCs have been shown to become more linear when the contribution of familiarity to source discriminations is increased, and this may account for the existing results. However, another way in which source zROCs may become more linear is if the recollection threshold begins to break down and recollection becomes more graded and Gaussian. We tested the "graded recollection" account in the current study. We found that increasing stimulus complexity (i.e., changing from single words to sentences) or increasing source complexity (i.e., changing the sources from audio to videos of speakers) resulted in flatter source zROCs. In addition, conditions expected to reduce recollection (i.e., divided attention and amnesia) had comparable effects on source memory in simple and complex conditions, suggesting that differences between simple and complex conditions were due to differences in the nature of recollection, rather than differences in the utility of familiarity. The results suggest that under conditions of high complexity, recollection can appear more graded, and it can produce curved ROCs. The results have implications for measurement models and for current theories of recognition memory.

Predictive inference for best linear combination of biomarkers subject to limits of detection.

PubMed

Coolen-Maturi, Tahani

2017-08-15

Measuring the accuracy of diagnostic tests is crucial in many application areas including medicine, machine learning and credit scoring. The receiver operating characteristic (ROC) curve is a useful tool to assess the ability of a diagnostic test to discriminate between two classes or groups. In practice, multiple diagnostic tests or biomarkers are combined to improve diagnostic accuracy. Often, biomarker measurements are undetectable either below or above the so-called limits of detection (LoD). In this paper, nonparametric predictive inference (NPI) for best linear combination of two or more biomarkers subject to limits of detection is presented. NPI is a frequentist statistical method that is explicitly aimed at using few modelling assumptions, enabled through the use of lower and upper probabilities to quantify uncertainty. The NPI lower and upper bounds for the ROC curve subject to limits of detection are derived, where the objective function to maximize is the area under the ROC curve. In addition, the paper discusses the effect of restriction on the linear combination's coefficients on the analysis. Examples are provided to illustrate the proposed method. Copyright © 2017 John Wiley & Sons, Ltd. Copyright © 2017 John Wiley & Sons, Ltd.

Development and testing of new candidate psoriatic arthritis screening questionnaires combining optimal questions from existing tools.

PubMed

Coates, Laura C; Walsh, Jessica; Haroon, Muhammad; FitzGerald, Oliver; Aslam, Tariq; Al Balushi, Farida; Burden, A D; Burden-Teh, Esther; Caperon, Anna R; Cerio, Rino; Chattopadhyay, Chandrabhusan; Chinoy, Hector; Goodfield, Mark J D; Kay, Lesley; Kelly, Stephen; Kirkham, Bruce W; Lovell, Christopher R; Marzo-Ortega, Helena; McHugh, Neil; Murphy, Ruth; Reynolds, Nick J; Smith, Catherine H; Stewart, Elizabeth J C; Warren, Richard B; Waxman, Robin; Wilson, Hilary E; Helliwell, Philip S

2014-09-01

Several questionnaires have been developed to screen for psoriatic arthritis (PsA), but head-to-head studies have found limitations. This study aimed to develop new questionnaires encompassing the most discriminative questions from existing instruments. Data from the CONTEST study, a head-to-head comparison of 3 existing questionnaires, were used to identify items with a Youden index score of ≥0.1. These were combined using 4 approaches: CONTEST (simple additions of questions), CONTESTw (weighting using logistic regression), CONTESTjt (addition of a joint manikin), and CONTESTtree (additional questions identified by classification and regression tree [CART] analysis). These candidate questionnaires were tested in independent data sets. Twelve individual questions with a Youden index score of ≥0.1 were identified, but 4 of these were excluded due to duplication and redundancy. Weighting for 2 of these questions was included in CONTESTw. Receiver operating characteristic (ROC) curve analysis showed that involvement in 6 joint areas on the manikin was predictive of PsA for inclusion in CONTESTjt. CART analysis identified a further 5 questions for inclusion in CONTESTtree. CONTESTtree was not significant on ROC curve analysis and discarded. The other 3 questionnaires were significant in all data sets, although CONTESTw was slightly inferior to the others in the validation data sets. Potential cut points for referral were also discussed. Of 4 candidate questionnaires combining existing discriminatory items to identify PsA in people with psoriasis, 3 were found to be significant on ROC curve analysis. Testing in independent data sets identified 2 questionnaires (CONTEST and CONTESTjt) that should be pursued for further prospective testing. Copyright © 2014 by the American College of Rheumatology.

Differentiating benign from malignant mediastinal lymph nodes visible at EBUS using grey-scale textural analysis.

PubMed

Edey, Anthony J; Pollentine, Adrian; Doody, Claire; Medford, Andrew R L

2015-04-01

Recent data suggest that grey-scale textural analysis on endobronchial ultrasound (EBUS) imaging can differentiate benign from malignant lymphadenopathy. The objective of studies was to evaluate grey-scale textural analysis and examine its clinical utility. Images from 135 consecutive clinically indicated EBUS procedures were evaluated retrospectively using MATLAB software (MathWorks, Natick, MA, USA). Manual node mapping was performed to obtain a region of interest and grey-scale textural features (range of pixel values and entropy) were analysed. The initial analysis involved 94 subjects and receiver operating characteristic (ROC) curves were generated. The ROC thresholds were then applied on a second cohort (41 subjects) to validate the earlier findings. A total of 371 images were evaluated. There was no difference in proportions of malignant disease (56% vs 53%, P = 0.66) in the prediction (group 1) and validation (group 2) sets. There was no difference in range of pixel values in group 1 but entropy was significantly higher in the malignant group (5.95 vs 5.77, P = 0.03). Higher entropy was seen in adenocarcinoma versus lymphoma (6.00 vs 5.50, P < 0.05). An ROC curve for entropy gave an area under the curve of 0.58 with 51% sensitivity and 71% specificity for entropy greater than 5.94 for malignancy. In group 2, the entropy threshold phenotyped only 47% of benign cases and 20% of malignant cases correctly. These findings suggest that use of EBUS grey-scale textural analysis for differentiation of malignant from benign lymphadenopathy may not be accurate. Further studies are required. © 2015 Asian Pacific Society of Respirology.

Comparison of two correlated ROC curves at a given specificity or sensitivity level.

PubMed

Bantis, Leonidas E; Feng, Ziding

2016-10-30

The receiver operating characteristic (ROC) curve is the most popular statistical tool for evaluating the discriminatory capability of a given continuous biomarker. The need to compare two correlated ROC curves arises when individuals are measured with two biomarkers, which induces paired and thus correlated measurements. Many researchers have focused on comparing two correlated ROC curves in terms of the area under the curve (AUC), which summarizes the overall performance of the marker. However, particular values of specificity may be of interest. We focus on comparing two correlated ROC curves at a given specificity level. We propose parametric approaches, transformations to normality, and nonparametric kernel-based approaches. Our methods can be straightforwardly extended for inference in terms of ROC -1 (t). This is of particular interest for comparing the accuracy of two correlated biomarkers at a given sensitivity level. Extensions also involve inference for the AUC and accommodating covariates. We evaluate the robustness of our techniques through simulations, compare them with other known approaches, and present a real-data application involving prostate cancer screening. Copyright © 2016 John Wiley & Sons, Ltd. Copyright © 2016 John Wiley & Sons, Ltd.

Machine-Learning Algorithms Predict Graft Failure After Liver Transplantation.

PubMed

Lau, Lawrence; Kankanige, Yamuna; Rubinstein, Benjamin; Jones, Robert; Christophi, Christopher; Muralidharan, Vijayaragavan; Bailey, James

2017-04-01

The ability to predict graft failure or primary nonfunction at liver transplant decision time assists utilization of scarce resource of donor livers, while ensuring that patients who are urgently requiring a liver transplant are prioritized. An index that is derived to predict graft failure using donor and recipient factors, based on local data sets, will be more beneficial in the Australian context. Liver transplant data from the Austin Hospital, Melbourne, Australia, from 2010 to 2013 has been included in the study. The top 15 donor, recipient, and transplant factors influencing the outcome of graft failure within 30 days were selected using a machine learning methodology. An algorithm predicting the outcome of interest was developed using those factors. Donor Risk Index predicts the outcome with an area under the receiver operating characteristic curve (AUC-ROC) value of 0.680 (95% confidence interval [CI], 0.669-0.690). The combination of the factors used in Donor Risk Index with the model for end-stage liver disease score yields an AUC-ROC of 0.764 (95% CI, 0.756-0.771), whereas survival outcomes after liver transplantation score obtains an AUC-ROC of 0.638 (95% CI, 0.632-0.645). The top 15 donor and recipient characteristics within random forests results in an AUC-ROC of 0.818 (95% CI, 0.812-0.824). Using donor, transplant, and recipient characteristics known at the decision time of a transplant, high accuracy in matching donors and recipients can be achieved, potentially providing assistance with clinical decision making.

Evaluating the Unequal-Variance and Dual-Process Explanations of zROC Slopes with Response Time Data and the Diffusion Model

ERIC Educational Resources Information Center

Starns, Jeffrey J.; Ratcliff, Roger; McKoon, Gail

2012-01-01

We tested two explanations for why the slope of the z-transformed receiver operating characteristic (zROC) is less than 1 in recognition memory: the unequal-variance account (target evidence is more variable than lure evidence) and the dual-process account (responding reflects both a continuous familiarity process and a threshold recollection…

Fertility biomarkers to estimate metabolic risks in women with polycystic ovary syndrome.

PubMed

Detti, Laura; Jeffries-Boyd, Heather E; Williams, Lucy J; Diamond, Michael P; Uhlmann, Rebecca A

2015-12-01

We sought to evaluate the relationship between the polycystic ovary syndrome (PCOS)-defining characteristics and the risk of developing metabolic complications in women presenting with complaints of infertility and/or menstrual irregularities and subsequently diagnosed with PCOS. This was a cross-sectional study. Women presenting with complaints of infertility and/or irregular menses and diagnosed with PCOS by the Rotterdam criteria, underwent endocrine, metabolic, and ultrasound assessment in the early follicular phase. Reproductive and metabolic parameters were included in regression analysis models with the PCOS-defining characteristics; ROC curves were calculated for the significant predictors. Three hundred and seventy-four women with PCOS were included in our study. Oligo-anovulation, menstrual irregularities, and hirsutism were not predictive of any of the variables. Ovarian volume, follicle count, and biochemical hyperandrogenism were predictors for hormonal, metabolic, and endometrial complications. The relationships were independent of age and body mass index. ROC curves identified lower cut-off values of the PCOS-defining characteristics to predict patients' risks of hyperinsulinemia, dyslipidemia, and glucose intolerance. Adverse metabolic effects of PCOS are already present in women at the time they present complaining of infertility and/or irregular menses. Hyperandrogenism and ultrasound can assist in predicting the patients' concomitant metabolic abnormalities and can aid physicians in tailoring counseling for effective preventive strategies.

Computed tomographic (CT) neuroradiological evaluation of intra-axial and extra-axial lesions: a receiver operating characteristic (ROC) study of film and 1K workstation

NASA Astrophysics Data System (ADS)

El-Saden, Suzie; Hademenos, George J.; Zhu, Wei; Sayre, James W.; Glenn, Brad; Steidler, Jim; Kode, L.; King, Brian; Quinones, Diana; Valentino, Daniel J.; Bentsen, John R.

1995-04-01

Digital display workstations are now commonly used for cross-sectional image viewing; however, few receiver operating characteristic (ROC) studies have been performed to evaluate the diagnostic efficiency of hard copy versus a workstation display for neuroradiology applications. We have performed an ROC study of film and 1K workstation based on the diagnostic performance of neuroradiology fellows to detect subtle intra- axial (high density (HD) and low density (LD)) and extra-axial (fluid, blood) lesions presented on computed tomographic (CT) images. An ROC analysis of the interpretation of approximately 200 CT images (1/2 normals and 1/2 abnormals) was performed by five experienced observers. The total number of abnormal images were equally divided among the three represented types of lesions (HD, LD, and extra-axial lesions). The images comprising the extra-axial lesion group were further subdivided into the following three distinct types: subdural hemorrhage, subarachnoid hemorrhage, and epidural hemorrhage. A fraction of the abnormal images were represented by more than one type of lesion, e.g., one abnormal image could contain both a HD and LD lesion. The digitized CT images were separated into four groups and read on the standard light box and a 1K workstation monitor equipped with simple image processing functions. Confidence ratings were scaled on a range from 0 (least confident) to 4 (most confident). Reader order sequences were randomized for each reader and for each modality. Each observer read from a total of eight different groups with a four-week intermission following the fourth group. The randomly assigned image number, lesion type and approximate location, incidental findings and comments, and confidence ratings were reported in individual worksheets for each image. ROC curves that were generated and analyzed for the various subgroups are presented in addition to the overall generalized jackknifed estimates of the grouped data. Also, 95% confidence intervals are presented for the differences in the area under the ROC curves. Although there were no statistically significant differences in the diagnostic accuracy between the original CT slice with HD and LD lesions viewed on the light box and on the 1K display workstation, the observers tended to record extra- axial lesions more frequently and with more confidence on the 1K display in comparison to the light box primarily due to the added advantage of adjusting the display window levels.

Combining fibre optic Raman spectroscopy and tactile resonance measurement for tissue characterization

NASA Astrophysics Data System (ADS)

Candefjord, Stefan; Nyberg, Morgan; Jalkanen, Ville; Ramser, Kerstin; Lindahl, Olof A.

2010-12-01

Tissue characterization is fundamental for identification of pathological conditions. Raman spectroscopy (RS) and tactile resonance measurement (TRM) are two promising techniques that measure biochemical content and stiffness, respectively. They have potential to complement the golden standard--histological analysis. By combining RS and TRM, complementary information about tissue content can be obtained and specific drawbacks can be avoided. The aim of this study was to develop a multivariate approach to compare RS and TRM information. The approach was evaluated on measurements at the same points on porcine abdominal tissue. The measurement points were divided into five groups by multivariate analysis of the RS data. A regression analysis was performed and receiver operating characteristic (ROC) curves were used to compare the RS and TRM data. TRM identified one group efficiently (area under ROC curve 0.99). The RS data showed that the proportion of saturated fat was high in this group. The regression analysis showed that stiffness was mainly determined by the amount of fat and its composition. We concluded that RS provided additional, important information for tissue identification that was not provided by TRM alone. The results are promising for development of a method combining RS and TRM for intraoperative tissue characterization.

Laboratory test variables useful for distinguishing upper from lower gastrointestinal bleeding.

PubMed

Tomizawa, Minoru; Shinozaki, Fuminobu; Hasegawa, Rumiko; Shirai, Yoshinori; Motoyoshi, Yasufumi; Sugiyama, Takao; Yamamoto, Shigenori; Ishige, Naoki

2015-05-28

To distinguish upper from lower gastrointestinal (GI) bleeding. Patient records between April 2011 and March 2014 were analyzed retrospectively (3296 upper endoscopy, and 1520 colonoscopy). Seventy-six patients had upper GI bleeding (Upper group) and 65 had lower GI bleeding (Lower group). Variables were compared between the groups using one-way analysis of variance. Logistic regression was performed to identify variables significantly associated with the diagnosis of upper vs lower GI bleeding. Receiver-operator characteristic (ROC) analysis was performed to determine the threshold value that could distinguish upper from lower GI bleeding. Hemoglobin (P = 0.023), total protein (P = 0.0002), and lactate dehydrogenase (P = 0.009) were significantly lower in the Upper group than in the Lower group. Blood urea nitrogen (BUN) was higher in the Upper group than in the Lower group (P = 0.0065). Logistic regression analysis revealed that BUN was most strongly associated with the diagnosis of upper vs lower GI bleeding. ROC analysis revealed a threshold BUN value of 21.0 mg/dL, with a specificity of 93.0%. The threshold BUN value for distinguishing upper from lower GI bleeding was 21.0 mg/dL.

Laboratory test variables useful for distinguishing upper from lower gastrointestinal bleeding

PubMed Central

Tomizawa, Minoru; Shinozaki, Fuminobu; Hasegawa, Rumiko; Shirai, Yoshinori; Motoyoshi, Yasufumi; Sugiyama, Takao; Yamamoto, Shigenori; Ishige, Naoki

2015-01-01

AIM: To distinguish upper from lower gastrointestinal (GI) bleeding. METHODS: Patient records between April 2011 and March 2014 were analyzed retrospectively (3296 upper endoscopy, and 1520 colonoscopy). Seventy-six patients had upper GI bleeding (Upper group) and 65 had lower GI bleeding (Lower group). Variables were compared between the groups using one-way analysis of variance. Logistic regression was performed to identify variables significantly associated with the diagnosis of upper vs lower GI bleeding. Receiver-operator characteristic (ROC) analysis was performed to determine the threshold value that could distinguish upper from lower GI bleeding. RESULTS: Hemoglobin (P = 0.023), total protein (P = 0.0002), and lactate dehydrogenase (P = 0.009) were significantly lower in the Upper group than in the Lower group. Blood urea nitrogen (BUN) was higher in the Upper group than in the Lower group (P = 0.0065). Logistic regression analysis revealed that BUN was most strongly associated with the diagnosis of upper vs lower GI bleeding. ROC analysis revealed a threshold BUN value of 21.0 mg/dL, with a specificity of 93.0%. CONCLUSION: The threshold BUN value for distinguishing upper from lower GI bleeding was 21.0 mg/dL. PMID:26034359

Least squares regression methods for clustered ROC data with discrete covariates.

PubMed

Tang, Liansheng Larry; Zhang, Wei; Li, Qizhai; Ye, Xuan; Chan, Leighton

2016-07-01

The receiver operating characteristic (ROC) curve is a popular tool to evaluate and compare the accuracy of diagnostic tests to distinguish the diseased group from the nondiseased group when test results from tests are continuous or ordinal. A complicated data setting occurs when multiple tests are measured on abnormal and normal locations from the same subject and the measurements are clustered within the subject. Although least squares regression methods can be used for the estimation of ROC curve from correlated data, how to develop the least squares methods to estimate the ROC curve from the clustered data has not been studied. Also, the statistical properties of the least squares methods under the clustering setting are unknown. In this article, we develop the least squares ROC methods to allow the baseline and link functions to differ, and more importantly, to accommodate clustered data with discrete covariates. The methods can generate smooth ROC curves that satisfy the inherent continuous property of the true underlying curve. The least squares methods are shown to be more efficient than the existing nonparametric ROC methods under appropriate model assumptions in simulation studies. We apply the methods to a real example in the detection of glaucomatous deterioration. We also derive the asymptotic properties of the proposed methods. © 2016 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.

Differential gene expression profiles of peripheral blood mononuclear cells in childhood asthma.

PubMed

Kong, Qian; Li, Wen-Jing; Huang, Hua-Rong; Zhong, Ying-Qiang; Fang, Jian-Pei

2015-05-01

Asthma is a common childhood disease with strong genetic components. This study compared whole-genome expression differences between asthmatic young children and healthy controls to identify gene signatures of childhood asthma. Total RNA extracted from peripheral blood mononuclear cells (PBMC) was subjected to microarray analysis. QRT-PCR was performed to verify the microarray results. Classification and functional characterization of differential genes were illustrated by hierarchical clustering and gene ontology analysis. Multiple logistic regression (MLR) analysis, receiver operating characteristic (ROC) curve analysis, and discriminate power were used to scan asthma-specific diagnostic markers. For fold-change>2 and p < 0.05, there were 758 named differential genes. The results of QRT-PCR confirmed successfully the array data. Hierarchical clustering divided 29 highly possible genes into seven categories and the genes in the same cluster were likely to possess similar expression patterns or functions. Gene ontology analysis presented that differential genes primarily enriched in immune response, response to stress or stimulus, and regulation of apoptosis in biological process. MLR and ROC curve analysis revealed that the combination of ADAM33, Smad7, and LIGHT possessed excellent discriminating power. The combination of ADAM33, Smad7, and LIGHT would be a reliable and useful childhood asthma model for prediction and diagnosis.

Signal Detection Theory Applied to Helicopter Transmission Diagnostic Thresholds

NASA Technical Reports Server (NTRS)

Dempsey, Paula J.; Keller, Jonathan A.; Wade, Daniel R.

2008-01-01

Helicopter Health Usage Monitoring Systems (HUMS) have potential for providing data to support increasing the service life of a dynamic mechanical component in the transmission of a helicopter. Data collected can demonstrate the HUMS condition indicator responds to a specific component fault with appropriate alert limits and minimal false alarms. Defining thresholds for specific faults requires a tradeoff between the sensitivity of the condition indicator (CI) limit to indicate damage and the number of false alarms. A method using Receiver Operating Characteristic (ROC) curves to assess CI performance was demonstrated using CI data collected from accelerometers installed on several UH60 Black Hawk and AH64 Apache helicopters and an AH64 helicopter component test stand. Results of the analysis indicate ROC curves can be used to reliably assess the performance of commercial HUMS condition indicators to detect damaged gears and bearings in a helicopter transmission.

Diagnosis of focal liver lesions suspected of metastases by diffusion-weighted imaging (DWI): systematic comparison favors free-breathing technique.

PubMed

Baltzer, Pascal A T; Schelhorn, Juliane; Benndorf, Matthias; Dietzel, Matthias; Kaiser, Werner A

2013-01-01

Two echo planar imaging diffusion-weighted imaging (DWI) techniques [one breath hold (DWI(bh)), repetition time/echo time (TR/TE) 2100/62 ms; one at free breathing (DWI(fb)), TR/TE 2000/65 ms] were compared regarding diagnosis of focal liver lesions (FLLs) in 45 patients with suspected liver metastasis without prior treatment. Apparent diffusion coefficient values of 46 benign and 67 malignant FLLs were analyzed by receiver operating characteristics (ROC) analysis. DWI(fb) detected more malignant lesions than DWI(bh) (P=.002). Lesion size ≤10 mm was associated with FLLs missed by DWI(bh) (P=.018). Area under the ROC curve of DWI(fb) (0.801) was higher compared to that of DWI(bh) (0.669, P<.0113), demonstrating the diagnostic superiority of DWI(fb). Copyright © 2013 Elsevier Inc. All rights reserved.

Aedes aegypti Larval Indices and Risk for Dengue Epidemics

PubMed Central

Sanchez, Lizet; Vanlerberghe, Veerle; Alfonso, Lázara; Marquetti, María del Carmen; Guzman, María Guadalupe; Bisset, Juan; van der Stuyft, Patrick

2006-01-01

We assessed in a case-control study the test-validity of Aedes larval indices for the 2000 Havana outbreak. "Cases" were blocks where a dengue fever patient lived during the outbreak. "Controls" were randomly sampled blocks. Before, during, and after the epidemic, we calculated Breteau index (BI) and house index at the area, neighborhood, and block level. We constructed receiver operating characteristic (ROC) curves to determine their performance as predictors of dengue transmission. We observed a pronounced effect of the level of measurement. The BImax (maximum block BI in a radius of 100 m) at 2-month intervals had an area under the ROC curve of 71%. At a cutoff of 4.0, it significantly (odds ratio 6.00, p<0.05) predicted transmission with 78% sensitivity and 63% specificity. Analysis of BI at the local level, with human-defined boundaries, could be introduced in control programs to identify neighborhoods at high risk for dengue transmission. PMID:16704841

Signal Detection Theory Applied to Helicopter Transmission Diagnostic Thresholds

NASA Technical Reports Server (NTRS)

Dempsey, Paula J.; Keller, Jonathan A.; Wade, Daniel R.

2009-01-01

Helicopter Health Usage Monitoring Systems (HUMS) have potential for providing data to support increasing the service life of a dynamic mechanical component in the transmission of a helicopter. Data collected can demonstrate the HUMS condition indicator responds to a specific component fault with appropriate alert limits and minimal false alarms. Defining thresholds for specific faults requires a tradeoff between the sensitivity of the condition indicator (CI) limit to indicate damage and the number of false alarms. A method using Receiver Operating Characteristic (ROC) curves to assess CI performance was demonstrated using CI data collected from accelerometers installed on several UH60 Black Hawk and AH64 Apache helicopters and an AH64 helicopter component test stand. Results of the analysis indicate ROC curves can be used to reliably assess the performance of commercial HUMS condition indicators to detect damaged gears and bearings in a helicopter transmission.

[Predicting very early rebleeding after acute variceal bleeding based in classification and regression tree analysis (CRTA).].

PubMed

Altamirano, J; Augustin, S; Muntaner, L; Zapata, L; González-Angulo, A; Martínez, B; Flores-Arroyo, A; Camargo, L; Genescá, J

2010-01-01

Variceal bleeding (VB) is the main cause of death among cirrhotic patients. About 30-50% of early rebleeding is encountered few days after the acute episode of VB. It is necessary to stratify patients with high risk of very early rebleeding (VER) for more aggressive therapies. However, there are few and incompletely understood prognostic models for this purpose. To determine the risk factors associated with VER after an acute VB. Assessment and comparison of a novel prognostic model generated by Classification and Regression Tree Analysis (CART) with classic-used models (MELD and Child-Pugh [CP]). Sixty consecutive cirrhotic patients with acute variceal bleeding. CART analysis, MELD and Child-Pugh scores were performed at admission. Receiver operating characteristic (ROC) curves were constructed to evaluate the predictive performance of the models. Very early rebleeding rate was 13%. Variables associated with VER were: serum albumin (p = 0.027), creatinine (p = 0.021) and transfused blood units in the first 24 hrs (p = 0.05). The area under the ROC for MELD, CHILD-Pugh and CART were 0.46, 0.50 and 0.82, respectively. The value of cut analyzed by CART for the significant variables were: 1) Albumin 2.85 mg/dL, 2) Packed red cells 2 units and 3) Creatinine 1.65 mg/dL the ABC-ROC. Serum albumin, creatinine and number of transfused blood units were associated with VER. A simple CART algorithm combining these variables allows an accurate predictive assessment of VER after acute variceal bleeding. Key words: cirrhosis, variceal bleeding, esophageal varices, prognosis, portal hypertension.

On the form of ROCs constructed from confidence ratings.

PubMed

Malmberg, Kenneth J

2002-03-01

A classical question for memory researchers is whether memories vary in an all-or-nothing, discrete manner (e.g., stored vs. not stored, recalled vs. not recalled), or whether they vary along a continuous dimension (e.g., strength, similarity, or familiarity). For yes-no classification tasks, continuous- and discrete-state models predict nonlinear and linear receiver operating characteristics (ROCs), respectively (D. M. Green & J. A. Swets, 1966; N. A. Macmillan & C. D. Creelman, 1991). Recently, several authors have assumed that these predictions are generalizable to confidence ratings tasks (J. Qin, C. L. Raye, M. K. Johnson, & K. J. Mitchell, 2001; S. D. Slotnick, S. A. Klein, C. S. Dodson, & A. P. Shimamura, 2000, and A. P. Yonelinas, 1999). This assumption is shown to be unwarranted by showing that discrete-state ratings models predict both linear and nonlinear ROCs. The critical factor determining the form of the discrete-state ROC is the response strategy adopted by the classifier.

Analysis of SEER Adenosquamous Carcinoma Data to Identify Cause Specific Survival Predictors and Socioeconomic Disparities.

PubMed

Cheung, Rex

2016-01-01

This study used receiver operating characteristic curve to analyze Surveillance, Epidemiology and End Results (SEER) adenosquamous carcinoma data to identify predictive models and potential disparities in outcome. This study analyzed socio-economic, staging and treatment factors available in the SEER database for adenosquamous carcinoma. For the risk modeling, each factor was fitted by a generalized linear model to predict the cause specific survival. An area under the receiver operating characteristic curve (ROC) was computed. Similar strata were combined to construct the most parsimonious models. A total of 20,712 patients diagnosed from 1973 to 2009 were included in this study. The mean follow up time (S.D.) was 54.2 (78.4) months. Some 2/3 of the patients were female. The mean (S.D.) age was 63 (13.8) years. SEER stage was the most predictive factor of outcome (ROC area of 0.71). 13.9% of the patients were un-staged and had risk of cause specific death of 61.3% that was higher than the 45.3% risk for the regional disease and lower than the 70.3% for metastatic disease. Sex, site, radiotherapy, and surgery had ROC areas of about 0.55-0.65. Rural residence and race contributed to socioeconomic disparity for treatment outcome. Radiotherapy was underused even with localized and regional stages when the intent was curative. This under use was most pronounced in older patients. Anatomic stage was predictive and useful in treatment selection. Under-staging may have contributed to poor outcome.

Using patient data similarities to predict radiation pneumonitis via a self-organizing map

NASA Astrophysics Data System (ADS)

Chen, Shifeng; Zhou, Sumin; Yin, Fang-Fang; Marks, Lawrence B.; Das, Shiva K.

2008-01-01

This work investigates the use of the self-organizing map (SOM) technique for predicting lung radiation pneumonitis (RP) risk. SOM is an effective method for projecting and visualizing high-dimensional data in a low-dimensional space (map). By projecting patients with similar data (dose and non-dose factors) onto the same region of the map, commonalities in their outcomes can be visualized and categorized. Once built, the SOM may be used to predict pneumonitis risk by identifying the region of the map that is most similar to a patient's characteristics. Two SOM models were developed from a database of 219 lung cancer patients treated with radiation therapy (34 clinically diagnosed with Grade 2+ pneumonitis). The models were: SOMall built from all dose and non-dose factors and, for comparison, SOMdose built from dose factors alone. Both models were tested using ten-fold cross validation and Receiver Operating Characteristics (ROC) analysis. Models SOMall and SOMdose yielded ten-fold cross-validated ROC areas of 0.73 (sensitivity/specificity = 71%/68%) and 0.67 (sensitivity/specificity = 63%/66%), respectively. The significant difference between the cross-validated ROC areas of these two models (p < 0.05) implies that non-dose features add important information toward predicting RP risk. Among the input features selected by model SOMall, the two with highest impact for increasing RP risk were: (a) higher mean lung dose and (b) chemotherapy prior to radiation therapy. The SOM model developed here may not be extrapolated to treatment techniques outside that used in our database, such as several-field lung intensity modulated radiation therapy or gated radiation therapy.

Unsupervised classification of cirrhotic livers using MRI data

NASA Astrophysics Data System (ADS)

Lee, Gobert; Kanematsu, Masayuki; Kato, Hiroki; Kondo, Hiroshi; Zhou, Xiangrong; Hara, Takeshi; Fujita, Hiroshi; Hoshi, Hiroaki

2008-03-01

Cirrhosis of the liver is a chronic disease. It is characterized by the presence of widespread nodules and fibrosis in the liver which results in characteristic texture patterns. Computerized analysis of hepatic texture patterns is usually based on regions-of-interest (ROIs). However, not all ROIs are typical representatives of the disease stage of the liver from which the ROIs originated. This leads to uncertainties in the ROI labels (diseased or non-diseased). On the other hand, supervised classifiers are commonly used in determining the assignment rule. This presents a problem as the training of a supervised classifier requires the correct labels of the ROIs. The main purpose of this paper is to investigate the use of an unsupervised classifier, the k-means clustering, in classifying ROI based data. In addition, a procedure for generating a receiver operating characteristic (ROC) curve depicting the classification performance of k-means clustering is also reported. Hepatic MRI images of 44 patients (16 cirrhotic; 28 non-cirrhotic) are used in this study. The MRI data are derived from gadolinium-enhanced equilibrium phase images. For each patient, 10 ROIs selected by an experienced radiologist and 7 texture features measured on each ROI are included in the MRI data. Results of the k-means classifier are depicted using an ROC curve. The area under the curve (AUC) has a value of 0.704. This is slightly lower than but comparable to that of LDA and ANN classifiers which have values 0.781 and 0.801, respectively. Methods in constructing ROC curve in relation to k-means clustering have not been previously reported in the literature.

Comparison of two correlated ROC curves at a given specificity or sensitivity level

PubMed Central

Bantis, Leonidas E.; Feng, Ziding

2017-01-01

The receiver operating characteristic (ROC) curve is the most popular statistical tool for evaluating the discriminatory capability of a given continuous biomarker. The need to compare two correlated ROC curves arises when individuals are measured with two biomarkers, which induces paired and thus correlated measurements. Many researchers have focused on comparing two correlated ROC curves in terms of the area under the curve (AUC), which summarizes the overall performance of the marker. However, particular values of specificity may be of interest. We focus on comparing two correlated ROC curves at a given specificity level. We propose parametric approaches, transformations to normality, and nonparametric kernel-based approaches. Our methods can be straightforwardly extended for inference in terms of ROC−1(t). This is of particular interest for comparing the accuracy of two correlated biomarkers at a given sensitivity level. Extensions also involve inference for the AUC and accommodating covariates. We evaluate the robustness of our techniques through simulations, compare to other known approaches and present a real data application involving prostate cancer screening. PMID:27324068

Magnetic Resonance Lymphography Findings in Patients With Biochemical Recurrence After Prostatectomy and the Relation With the Stephenson Nomogram

DOE Office of Scientific and Technical Information (OSTI.GOV)

Meijer, Hanneke J.M., E-mail: H.Meijer@rther.umcn.nl; Debats, Oscar A.; Roach, Mack

2012-12-01

Purpose: To estimate the occurrence of positive lymph nodes on magnetic resonance lymphography (MRL) in patients with a prostate-specific antigen (PSA) recurrence after prostatectomy and to investigate the relation between score on the Stephenson nomogram and lymph node involvement on MRL. Methods and Materials: Sixty-five candidates for salvage radiation therapy were referred for an MRL to determine their lymph node status. Clinical and histopathologic features were recorded. For 49 patients, data were complete to calculate the Stephenson nomogram score. Receiver operating characteristic (ROC) analysis was performed to determine how well this nomogram related to the MRL result. Analysis was donemore » for the whole group and separately for patients with a PSA <1.0 ng/mL to determine the situation in candidates for early salvage radiation therapy, and for patients without pathologic lymph nodes at initial lymph node dissection. Results: MRL detected positive lymph nodes in 47 patients. ROC analysis for the Stephenson nomogram yielded an area under the curve (AUC) of 0.78 (95% confidence interval, 0.61-0.93). Of 29 patients with a PSA <1.0 ng/mL, 18 had a positive MRL. Of 37 patients without lymph node involvement at initial lymph node dissection, 25 had a positive MRL. ROC analysis for the Stephenson nomogram showed AUCs of 0.84 and 0.74, respectively, for these latter groups. Conclusion: MRL detected positive lymph nodes in 72% of candidates for salvage radiation therapy, in 62% of candidates for early salvage radiation therapy, and in 68% of initially node-negative patients. The Stephenson nomogram showed a good correlation with the MRL result and may thus be useful for identifying patients with a PSA recurrence who are at high risk for lymph node involvement.« less

Discrimination of dementia with Lewy bodies from Alzheimer's disease using voxel-based morphometry of white matter by statistical parametric mapping 8 plus diffeomorphic anatomic registration through exponentiated Lie algebra.

PubMed

Nakatsuka, Tomoya; Imabayashi, Etsuko; Matsuda, Hiroshi; Sakakibara, Ryuji; Inaoka, Tsutomu; Terada, Hitoshi

2013-05-01

The purpose of this study was to identify brain atrophy specific for dementia with Lewy bodies (DLB) and to evaluate the discriminatory performance of this specific atrophy between DLB and Alzheimer's disease (AD). We retrospectively reviewed 60 DLB and 30 AD patients who had undergone 3D T1-weighted MRI. We randomly divided the DLB patients into two equal groups (A and B). First, we obtained a target volume of interest (VOI) for DLB-specific atrophy using correlation analysis of the percentage rate of significant whole white matter (WM) atrophy calculated using the Voxel-based Specific Regional Analysis System for Alzheimer's Disease (VSRAD) based on statistical parametric mapping 8 (SPM8) plus diffeomorphic anatomic registration through exponentiated Lie algebra, with segmented WM images in group A. We then evaluated the usefulness of this target VOI for discriminating the remaining 30 DLB patients in group B from the 30 AD patients. Z score values in this target VOI obtained from VSRAD were used as the determinant in receiver operating characteristic (ROC) analysis. Specific target VOIs for DLB were determined in the right-side dominant dorsal midbrain, right-side dominant dorsal pons, and bilateral cerebellum. ROC analysis revealed that the target VOI limited to the midbrain exhibited the highest area under the ROC curves of 0.75. DLB patients showed specific atrophy in the midbrain, pons, and cerebellum. Midbrain atrophy demonstrated the highest power for discriminating DLB and AD. This approach may be useful for determining the contributions of DLB and AD pathologies to the dementia syndrome.

Diagnostic Performance of Mammographic Texture Analysis in the Differential Diagnosis of Benign and Malignant Breast Tumors.

PubMed

Li, Zhiming; Yu, Lan; Wang, Xin; Yu, Haiyang; Gao, Yuanxiang; Ren, Yande; Wang, Gang; Zhou, Xiaoming

2017-11-09

The purpose of this study was to investigate the diagnostic performance of mammographic texture analysis in the differential diagnosis of benign and malignant breast tumors. Digital mammography images were obtained from the Picture Archiving and Communication System at our institute. Texture features of mammographic images were calculated. Mann-Whitney U test was used to identify differences between the benign and malignant group. The receiver operating characteristic (ROC) curve analysis was used to assess the diagnostic performance of texture features. Significant differences of texture features of histogram, gray-level co-occurrence matrix (GLCM) and run length matrix (RLM) were found between the benign and malignant breast group (P < .05). The area under the ROC (AUROC) of histogram, GLCM, and RLM were 0.800, 0.787, and 0.761, with no differences between them (P > .05). The AUROCs of imaging-based diagnosis, texture analysis, and imaging-based diagnosis combined with texture analysis were 0.873, 0.863, and 0.961, respectively. When imaging-based diagnosis was combined with texture analysis, the AUROC was higher than that of imaging-based diagnosis or texture analysis (P < .05). Mammographic texture analysis is a reliable technique for differential diagnosis of benign and malignant breast tumors. Furthermore, the combination of imaging-based diagnosis and texture analysis can significantly improve diagnostic performance. Copyright © 2017 Elsevier Inc. All rights reserved.

Sensitivity and specificity of machine learning classifiers for glaucoma diagnosis using Spectral Domain OCT and standard automated perimetry.

PubMed

Silva, Fabrício R; Vidotti, Vanessa G; Cremasco, Fernanda; Dias, Marcelo; Gomi, Edson S; Costa, Vital P

2013-01-01

To evaluate the sensitivity and specificity of machine learning classifiers (MLCs) for glaucoma diagnosis using Spectral Domain OCT (SD-OCT) and standard automated perimetry (SAP). Observational cross-sectional study. Sixty two glaucoma patients and 48 healthy individuals were included. All patients underwent a complete ophthalmologic examination, achromatic standard automated perimetry (SAP) and retinal nerve fiber layer (RNFL) imaging with SD-OCT (Cirrus HD-OCT; Carl Zeiss Meditec Inc., Dublin, California). Receiver operating characteristic (ROC) curves were obtained for all SD-OCT parameters and global indices of SAP. Subsequently, the following MLCs were tested using parameters from the SD-OCT and SAP: Bagging (BAG), Naive-Bayes (NB), Multilayer Perceptron (MLP), Radial Basis Function (RBF), Random Forest (RAN), Ensemble Selection (ENS), Classification Tree (CTREE), Ada Boost M1(ADA),Support Vector Machine Linear (SVML) and Support Vector Machine Gaussian (SVMG). Areas under the receiver operating characteristic curves (aROC) obtained for isolated SAP and OCT parameters were compared with MLCs using OCT+SAP data. Combining OCT and SAP data, MLCs' aROCs varied from 0.777(CTREE) to 0.946 (RAN).The best OCT+SAP aROC obtained with RAN (0.946) was significantly larger the best single OCT parameter (p<0.05), but was not significantly different from the aROC obtained with the best single SAP parameter (p=0.19). Machine learning classifiers trained on OCT and SAP data can successfully discriminate between healthy and glaucomatous eyes. The combination of OCT and SAP measurements improved the diagnostic accuracy compared with OCT data alone.

An enhancement of ROC curves made them clinically relevant for diagnostic-test comparison and optimal-threshold determination.

PubMed

Subtil, Fabien; Rabilloud, Muriel

2015-07-01

The receiver operating characteristic curves (ROC curves) are often used to compare continuous diagnostic tests or determine the optimal threshold of a test; however, they do not consider the costs of misclassifications or the disease prevalence. The ROC graph was extended to allow for these aspects. Two new lines are added to the ROC graph: a sensitivity line and a specificity line. Their slopes depend on the disease prevalence and on the ratio of the net benefit of treating a diseased subject to the net cost of treating a nondiseased one. First, these lines help researchers determine the range of specificities within which test comparisons of partial areas under the curves is clinically relevant. Second, the ROC curve point the farthest from the specificity line is shown to be the optimal threshold in terms of expected utility. This method was applied: (1) to determine the optimal threshold of ratio specific immunoglobulin G (IgG)/total IgG for the diagnosis of congenital toxoplasmosis and (2) to select, among two markers, the most accurate for the diagnosis of left ventricular hypertrophy in hypertensive subjects. The two additional lines transform the statistically valid ROC graph into a clinically relevant tool for test selection and threshold determination. Copyright © 2015 Elsevier Inc. All rights reserved.

The precision-recall plot is more informative than the ROC plot when evaluating binary classifiers on imbalanced datasets.

PubMed

Saito, Takaya; Rehmsmeier, Marc

2015-01-01

Binary classifiers are routinely evaluated with performance measures such as sensitivity and specificity, and performance is frequently illustrated with Receiver Operating Characteristics (ROC) plots. Alternative measures such as positive predictive value (PPV) and the associated Precision/Recall (PRC) plots are used less frequently. Many bioinformatics studies develop and evaluate classifiers that are to be applied to strongly imbalanced datasets in which the number of negatives outweighs the number of positives significantly. While ROC plots are visually appealing and provide an overview of a classifier's performance across a wide range of specificities, one can ask whether ROC plots could be misleading when applied in imbalanced classification scenarios. We show here that the visual interpretability of ROC plots in the context of imbalanced datasets can be deceptive with respect to conclusions about the reliability of classification performance, owing to an intuitive but wrong interpretation of specificity. PRC plots, on the other hand, can provide the viewer with an accurate prediction of future classification performance due to the fact that they evaluate the fraction of true positives among positive predictions. Our findings have potential implications for the interpretation of a large number of studies that use ROC plots on imbalanced datasets.

Fractal and Gray Level Cooccurrence Matrix Computational Analysis of Primary Osteosarcoma Magnetic Resonance Images Predicts the Chemotherapy Response.

PubMed

Djuričić, Goran J; Radulovic, Marko; Sopta, Jelena P; Nikitović, Marina; Milošević, Nebojša T

2017-01-01

The prediction of induction chemotherapy response at the time of diagnosis may improve outcomes in osteosarcoma by allowing for personalized tailoring of therapy. The aim of this study was thus to investigate the predictive potential of the so far unexploited computational analysis of osteosarcoma magnetic resonance (MR) images. Fractal and gray level cooccurrence matrix (GLCM) algorithms were employed in retrospective analysis of MR images of primary osteosarcoma localized in distal femur prior to the OsteoSa induction chemotherapy. The predicted and actual chemotherapy response outcomes were then compared by means of receiver operating characteristic (ROC) analysis and accuracy calculation. Dbin, Λ, and SCN were the standard fractal and GLCM features which significantly associated with the chemotherapy outcome, but only in one of the analyzed planes. Our newly developed normalized fractal dimension, called the space-filling ratio (SFR) exerted an independent and much better predictive value with the prediction significance accomplished in two of the three imaging planes, with accuracy of 82% and area under the ROC curve of 0.20 (95% confidence interval 0-0.41). In conclusion, SFR as the newly designed fractal coefficient provided superior predictive performance in comparison to standard image analysis features, presumably by compensating for the tumor size variation in MR images.

Triceps and Subscapular Skinfold Thickness Percentiles and Cut-Offs for Overweight and Obesity in a Population-Based Sample of Schoolchildren and Adolescents in Bogota, Colombia

PubMed Central

Ramírez-Vélez, Robinson; López-Cifuentes, Mario Ferney; Correa-Bautista, Jorge Enrique; González-Ruíz, Katherine; González-Jiménez, Emilio; Córdoba-Rodríguez, Diana Paola; Vivas, Andrés; Triana-Reina, Hector Reynaldo; Schmidt-RioValle, Jacqueline

2016-01-01

The assessment of skinfold thickness is an objective measure of adiposity. The aims of this study were to establish Colombian smoothed centile charts and LMS L (Box–Cox transformation), M (median), and S (coefficient of variation) tables for triceps, subscapular, and triceps + subscapular skinfolds; appropriate cut-offs were selected using receiver operating characteristic (ROC) analysis based on a population-based sample of children and adolescents in Bogotá, Colombia. A cross-sectional study was conducted in 9618 children and adolescents (55.7% girls; age range of 9–17.9 years). Triceps and subscapular skinfold measurements were obtained using standardized methods. We calculated the triceps + subscapular skinfold (T + SS) sum. Smoothed percentile curves for triceps and subscapular skinfold thickness were derived using the LMS method. ROC curve analyses were used to evaluate the optimal cut-off point of skinfold thickness for overweight and obesity, based on the International Obesity Task Force definitions. Subscapular and triceps skinfolds and T + SS were significantly higher in girls than in boys (p < 0.001). The ROC analysis showed that subscapular and triceps skinfolds and T + SS have a high discriminatory power in the identification of overweight and obesity in the sample population in this study. Our results provide sex- and age-specific normative reference standards for skinfold thickness values from a population from Bogotá, Colombia. PMID:27669294

Analysis of glottal source parameters in Parkinsonian speech.

PubMed

Hanratty, Jane; Deegan, Catherine; Walsh, Mary; Kirkpatrick, Barry

2016-08-01

Diagnosis and monitoring of Parkinson's disease has a number of challenges as there is no definitive biomarker despite the broad range of symptoms. Research is ongoing to produce objective measures that can either diagnose Parkinson's or act as an objective decision support tool. Recent research on speech based measures have demonstrated promising results. This study aims to investigate the characteristics of the glottal source signal in Parkinsonian speech. An experiment is conducted in which a selection of glottal parameters are tested for their ability to discriminate between healthy and Parkinsonian speech. Results for each glottal parameter are presented for a database of 50 healthy speakers and a database of 16 speakers with Parkinsonian speech symptoms. Receiver operating characteristic (ROC) curves were employed to analyse the results and the area under the ROC curve (AUC) values were used to quantify the performance of each glottal parameter. The results indicate that glottal parameters can be used to discriminate between healthy and Parkinsonian speech, although results varied for each parameter tested. For the task of separating healthy and Parkinsonian speech, 2 out of the 7 glottal parameters tested produced AUC values of over 0.9.

Cognitive Vulnerabilities and Depression in Young Adults: An ROC Curves Analysis.

PubMed

Balsamo, Michela; Imperatori, Claudio; Sergi, Maria Rita; Belvederi Murri, Martino; Continisio, Massimo; Tamburello, Antonino; Innamorati, Marco; Saggino, Aristide

2013-01-01

Objectives and Methods. The aim of the present study was to evaluate, by means of receiver operating characteristic (ROC) curves, whether cognitive vulnerabilities (CV), as measured by three well-known instruments (the Beck Hopelessness Scale, BHS; the Life Orientation Test-Revised, LOT-R; and the Attitudes Toward Self-Revised, ATS-R), independently discriminate between subjects with different severities of depression. Participants were 467 young adults (336 females and 131 males), recruited from the general population. The subjects were also administered the Beck Depression Inventory-II (BDI-II). Results. Four first-order (BHS Optimism/Low Standard; BHS Pessimism; Generalized Self-Criticism; and LOT Optimism) and two higher-order factors (Pessimism/Negative Attitudes Toward Self, Optimism) were extracted using Principal Axis Factoring analysis. Although all first-order and second-order factors were able to discriminate individuals with different depression severities, the Pessimism factor had the best performance in discriminating individuals with moderate to severe depression from those with lower depression severity. Conclusion. In the screening of young adults at risk of depression, clinicians have to pay particular attention to the expression of pessimism about the future.

Initial development of a computer-aided diagnosis tool for solitary pulmonary nodules

NASA Astrophysics Data System (ADS)

Catarious, David M., Jr.; Baydush, Alan H.; Floyd, Carey E., Jr.

2001-07-01

This paper describes the development of a computer-aided diagnosis (CAD) tool for solitary pulmonary nodules. This CAD tool is built upon physically meaningful features that were selected because of their relevance to shape and texture. These features included a modified version of the Hotelling statistic (HS), a channelized HS, three measures of fractal properties, two measures of spicularity, and three manually measured shape features. These features were measured from a difficult database consisting of 237 regions of interest (ROIs) extracted from digitized chest radiographs. The center of each 256x256 pixel ROI contained a suspicious lesion which was sent to follow-up by a radiologist and whose nature was later clinically determined. Linear discriminant analysis (LDA) was used to search the feature space via sequential forward search using percentage correct as the performance metric. An optimized feature subset, selected for the highest accuracy, was then fed into a three layer artificial neural network (ANN). The ANN's performance was assessed by receiver operating characteristic (ROC) analysis. A leave-one-out testing/training methodology was employed for the ROC analysis. The performance of this system is competitive with that of three radiologists on the same database.

Competitive Enzyme-Linked Immunosorbent Assay for Detection of Leptospira interrogans Serovar pomona Antibodies in Bovine Sera

PubMed Central

Surujballi, Om; Mallory, Maria

2001-01-01

A competitive enzyme-linked immunosorbent assay (ELISA) using a specific monoclonal antibody (M898) was developed for detection of bovine antibodies to Leptospira interrogans serovar pomona. This assay was evaluated using field sera (n = 190) with serovar pomona microscopic agglutination test (MAT) titers of ≥100 as the positive population (group A); field sera (n = 1,445) which were negative in the MAT (1:100 dilution) for serovar pomona (group B); and sera (from a specific-pathogen-free cattle herd [n = 210]) which were negative in the MAT (1:100 dilution) for serovars canicola, copenhageni, grippotyphosa, hardjo, pomona, and sejroe (group C). At the cutoff point recommended by receiver operating characteristic (ROC) curve analysis of the combined ELISA results of serum groups A, B, and C, the sensitivity and specificity values were 93.7 and 96.3%, respectively. The value for the area under this ROC curve was 0.977, indicating a high level of accuracy for the ELISA. Similar results were obtained from the analysis of the combined results of serum groups A and B and from the analysis of the combined results of serum groups A and C. PMID:11139193

High level of distress in long-term survivors of thyroid carcinoma: results of rapid screening using the distress thermometer.

PubMed

Roerink, Sean H P P; de Ridder, Mischa; Prins, Judith; Huijbers, Angelique; de Wilt, Hans J H; Marres, Henri; Repping-Wuts, Han; Stikkelbroeck, Nike M M L; Timmers, Henri J; Hermus, Ad R M M; Netea-Maier, Romana T

2013-01-01

Cancer patients are at increased risk for distress. The Distress Thermometer (DT) and problem list (PL) are short-tools validated and recommended for distress screening in cancer patients. To investigate the level of distress and problems experienced by survivors of differentiated non-medullary thyroid carcinoma (DTC), using the DT and PL and whether this correlates with clinical and demographical variables. All 205 DTC patients, under follow-up at the outpatient clinic of our university hospital, were asked to fill in the DT and PL, hospital anxiety and depression scale (HADS), illness cognition questionnaire (ICQ) and an ad hoc questionnaire. Receiver Operator Characteristic analysis (ROC) was used to establish the optimal DT cut-off score according to HADS. Correlations of questionnaires scores with data on diagnosis, treatment and follow-up collected from medical records were analyzed. Of the 159 respondents, 145 agreed to participate [118 in remission, median follow-up 7.2 years (range 3 months-41 years)]. Of these, 34.3% rated their distress score ≥5, indicating clinically relevant distress according to ROC analysis. Patients reported physical (86%) over emotional problems (76%) as sources of distress. DT scores correlated with HADS scores and ICQ subscales. No significant correlations were found between DT scores and clinical or demographical characteristics except for employment status. Prevalence of distress is high among patients with DTC even after long-term remission and cannot be predicted by clinical and demographical characteristics. DT and PL are useful screening instruments for distress in DTC patients and could easily be incorporated into daily practice.

Structural models used in real-time biosurveillance outbreak detection and outbreak curve isolation from noisy background morbidity levels

PubMed Central

Cheng, Karen Elizabeth; Crary, David J; Ray, Jaideep; Safta, Cosmin

2013-01-01

Objective We discuss the use of structural models for the analysis of biosurveillance related data. Methods and results Using a combination of real and simulated data, we have constructed a data set that represents a plausible time series resulting from surveillance of a large scale bioterrorist anthrax attack in Miami. We discuss the performance of anomaly detection with structural models for these data using receiver operating characteristic (ROC) and activity monitoring operating characteristic (AMOC) analysis. In addition, we show that these techniques provide a method for predicting the level of the outbreak valid for approximately 2 weeks, post-alarm. Conclusions Structural models provide an effective tool for the analysis of biosurveillance data, in particular for time series with noisy, non-stationary background and missing data. PMID:23037798

What is an ROC curve?

PubMed

Hoo, Zhe Hui; Candlish, Jane; Teare, Dawn

2017-06-01

The paper by Body et al is concerned with the evaluation of decision aids, which can be used to identify potential acute coronary syndromes (ACS) in the ED. The authors previously developed the Manchester Acute Coronary Syndromes model (MACS) decision aid, which uses several clinical variables and two biomarkers to 'rule in' and 'rule out' ACS. However, one of the two biomarkers (heart-type fatty acid bindingprotein, H-FABP) is not widely used so a revised decision aid has been developed (Troponin-only Manchester Acute Coronary Syndromes, T-MACS), which include a single biomarker hs-cTnT. In this issue, the authors show how they derive a revised decision aid and describe its performance in a number of independent diagnostic cohort studies. Decision aids (as well as other types of 'diagnostic tests') are often evaluated in terms of diagnostic testing parameters such as the area under the receiver operating characteristic (ROC) curve, sensitivity and specificity. In this article, we explain how the ROC analysis is conducted and why it is an essential step towards developing a test with the desirable levels of sensitivity and specificity. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Ultrasound bladder wall thickness measurement in diagnosis of recurrent urinary tract infections and cystitis cystica in prepubertal girls.

PubMed

Milošević, Danko; Trkulja, Vladimir; Turudić, Daniel; Batinić, Danica; Spajić, Borislav; Tešović, Goran

2013-12-01

To evaluate urinary bladder wall thickness (BWT) assessed by ultrasound as a diagnostic tool for cystitis cystica. This was a 9-year prospective study comprising 120 prepubertal girls. Sixty subjects of whom half underwent cystoscopy represented cases while the other 60 (those with a single urinary tract infection and healthy subjects) represented controls. Based on receiver operating characteristics (ROC) analysis, BWT discriminated very well between cases and controls with area under the ROC curve close to 1.0. At the optimum cut-off defined at 3.9 mm, negative predictive value (NPV) was 100% leaving no probability of cystic cystitis with BWT <3.9 mm. Positive predictive value (PPV) was also very high (95.2%), indicating only around 4.82% probability of no cystic cystitis in patients with BWT values ≥3.9 mm. BWT could also distinguish between healthy subjects and those with a cured single urinary tract infection, although discriminatory properties were moderate (area under ROC 86.7%, PPV 78.8%, NPV 85.2%). Ultrasound mucosal bladder wall measurement is a non-invasive, simple and quite reliable method in diagnosis of cystitis cystica in prepubertal girls with recurrent urinary tract infections. Copyright © 2013 Journal of Pediatric Urology Company. Published by Elsevier Ltd. All rights reserved.

Morphological and wavelet features towards sonographic thyroid nodules evaluation.

PubMed

Tsantis, Stavros; Dimitropoulos, Nikos; Cavouras, Dionisis; Nikiforidis, George

2009-03-01

This paper presents a computer-based classification scheme that utilized various morphological and novel wavelet-based features towards malignancy risk evaluation of thyroid nodules in ultrasonography. The study comprised 85 ultrasound images-patients that were cytological confirmed (54 low-risk and 31 high-risk). A set of 20 features (12 based on nodules boundary shape and 8 based on wavelet local maxima located within each nodule) has been generated. Two powerful pattern recognition algorithms (support vector machines and probabilistic neural networks) have been designed and developed in order to quantify the power of differentiation of the introduced features. A comparative study has also been held, in order to estimate the impact speckle had onto the classification procedure. The diagnostic sensitivity and specificity of both classifiers was made by means of receiver operating characteristics (ROC) analysis. In the speckle-free feature set, the area under the ROC curve was 0.96 for the support vector machines classifier whereas for the probabilistic neural networks was 0.91. In the feature set with speckle, the corresponding areas under the ROC curves were 0.88 and 0.86 respectively for the two classifiers. The proposed features can increase the classification accuracy and decrease the rate of missing and misdiagnosis in thyroid cancer control.

The "surprise question" for predicting death in seriously ill patients: a systematic review and meta-analysis.

PubMed

Downar, James; Goldman, Russell; Pinto, Ruxandra; Englesakis, Marina; Adhikari, Neill K J

2017-04-03

The surprise question - "Would I be surprised if this patient died in the next 12 months?" - has been used to identify patients at high risk of death who might benefit from palliative care services. Our objective was to systematically review the performance characteristics of the surprise question in predicting death. We searched multiple electronic databases from inception to 2016 to identify studies that prospectively screened patients with the surprise question and reported on death at 6 to 18 months. We constructed models of hierarchical summary receiver operating characteristics (sROCs) to determine prognostic performance. Sixteen studies (17 cohorts, 11 621 patients) met the selection criteria. For the outcome of death at 6 to 18 months, the pooled prognostic characteristics were sensitivity 67.0% (95% confidence interval [CI] 55.7%-76.7%), specificity 80.2% (73.3%-85.6%), positive likelihood ratio 3.4 (95% CI 2.8-4.1), negative likelihood ratio 0.41 (95% CI 0.32-0.54), positive predictive value 37.1% (95% CI 30.2%-44.6%) and negative predictive value 93.1% (95% CI 91.0%-94.8%). The surprise question had worse discrimination in patients with noncancer illness (area under sROC curve 0.77 [95% CI 0.73-0.81]) than in patients with cancer (area under sROC curve 0.83 [95% CI 0.79-0.87; p = 0.02 for difference]). Most studies had a moderate to high risk of bias, often because they had a low or unknown participation rate or had missing data. The surprise question performs poorly to modestly as a predictive tool for death, with worse performance in noncancer illness. Further studies are needed to develop accurate tools to identify patients with palliative care needs and to assess the surprise question for this purpose. © 2017 Canadian Medical Association or its licensors.

Diagnostic Performance of (18)F-Fluorodeoxyglucose in 162 Small Pulmonary Nodules Incidentally Detected in Subjects Without a History of Malignancy.

PubMed

Calcagni, Maria Lucia; Taralli, Silvia; Cardillo, Giuseppe; Graziano, Paolo; Ialongo, Pasquale; Mattoli, Maria Vittoria; Di Franco, Davide; Caldarella, Carmelo; Carleo, Francesco; Indovina, Luca; Giordano, Alessandro

2016-04-01

Solitary pulmonary nodule (SPN) still represents a diagnostic challenge. The aim of our study was to evaluate the diagnostic performance of (18)F-fluorodeoxyglucose positron emission tomography-computed tomography in one of the largest samples of small SPNs, incidentally detected in subjects without a history of malignancy (nonscreening population) and undetermined at computed tomography. One-hundred and sixty-two small (>0.8 to 1.5 cm) and, for comparison, 206 large nodules (>1.5 to 3 cm) were retrospectively evaluated. Diagnostic performance of (18)F-fluorodeoxyglucose visual analysis, receiver-operating characteristic (ROC) analysis for maximum standardized uptake value (SUVmax), and Bayesian analysis were assessed using histology or radiological follow-up as a golden standard. In 162 small nodules, (18)F-fluorodeoxyglucose visual and ROC analyses (SUVmax = 1.3) provided 72.6% and 77.4% sensitivity and 88.0% and 82.0% specificity, respectively. The prevalence of malignancy was 38%; Bayesian analysis provided 78.8% positive and 16.0% negative posttest probabilities of malignancy. In 206 large nodules (18)F-fluorodeoxyglucose visual and ROC analyses (SUVmax = 1.9) provided 89.5% and 85.1% sensitivity and 70.8% and 79.2% specificity, respectively. The prevalence of malignancy was 65%; Bayesian analysis provided 85.0% positive and 21.6% negative posttest probabilities of malignancy. In both groups, malignant nodules had a significant higher SUVmax (p < 0.0001) than benign nodules. Only in the small group, malignant nodules were significantly larger (p = 0.0054) than benign ones. (18)F-fluorodeoxyglucose can be clinically relevant to rule in and rule out malignancy in undetermined small SPNs, incidentally detected in nonscreening population with intermediate pretest probability of malignancy, as well as in larger ones. Visual analysis can be considered an optimal diagnostic criterion, adequately detecting a wide range of malignant nodules with different metabolic activity. Copyright © 2016 The Society of Thoracic Surgeons. Published by Elsevier Inc. All rights reserved.

Evaluation of clinical image processing algorithms used in digital mammography.

PubMed

Zanca, Federica; Jacobs, Jurgen; Van Ongeval, Chantal; Claus, Filip; Celis, Valerie; Geniets, Catherine; Provost, Veerle; Pauwels, Herman; Marchal, Guy; Bosmans, Hilde

2009-03-01

Screening is the only proven approach to reduce the mortality of breast cancer, but significant numbers of breast cancers remain undetected even when all quality assurance guidelines are implemented. With the increasing adoption of digital mammography systems, image processing may be a key factor in the imaging chain. Although to our knowledge statistically significant effects of manufacturer-recommended image processings have not been previously demonstrated, the subjective experience of our radiologists, that the apparent image quality can vary considerably between different algorithms, motivated this study. This article addresses the impact of five such algorithms on the detection of clusters of microcalcifications. A database of unprocessed (raw) images of 200 normal digital mammograms, acquired with the Siemens Novation DR, was collected retrospectively. Realistic simulated microcalcification clusters were inserted in half of the unprocessed images. All unprocessed images were subsequently processed with five manufacturer-recommended image processing algorithms (Agfa Musica 1, IMS Raffaello Mammo 1.2, Sectra Mamea AB Sigmoid, Siemens OPVIEW v2, and Siemens OPVIEW v1). Four breast imaging radiologists were asked to locate and score the clusters in each image on a five point rating scale. The free-response data were analyzed by the jackknife free-response receiver operating characteristic (JAFROC) method and, for comparison, also with the receiver operating characteristic (ROC) method. JAFROC analysis revealed highly significant differences between the image processings (F = 8.51, p < 0.0001), suggesting that image processing strongly impacts the detectability of clusters. Siemens OPVIEW2 and Siemens OPVIEW1 yielded the highest and lowest performances, respectively. ROC analysis of the data also revealed significant differences between the processing but at lower significance (F = 3.47, p = 0.0305) than JAFROC. Both statistical analysis methods revealed that the same six pairs of modalities were significantly different, but the JAFROC confidence intervals were about 32% smaller than ROC confidence intervals. This study shows that image processing has a significant impact on the detection of microcalcifications in digital mammograms. Objective measurements, such as described here, should be used by the manufacturers to select the optimal image processing algorithm.

Acute respiratory distress syndrome in blunt trauma: identification of independent risk factors.

PubMed

Miller, Preston R; Croce, Martin A; Kilgo, Patrick D; Scott, John; Fabian, Timothy C

2002-10-01

Acute respiratory distress syndrome (ARDS) is a major contributor to morbidity and mortality in trauma patients. Although many injuries and conditions are believed to be associated with ARDS independent risk factors in trauma patients and their relative importance in development of the syndrome are undefined. The aim of this project is to identify independent risk factors for the development of ARDS in blunt trauma patients and to examine the contributions of each factor to ARDS development. Patients with ARDS were identified from the registry of a Level I trauma center over a 4.5-year period. Records were reviewed for demographics, injury characteristics, transfusion requirements, and hospital course. Variables examined included age >65 years, Injury Severity Score (ISS) >25, hypotension on admission (systolic blood pressure <90), significant metabolic acidosis (base deficit <-5.0), severe brain injury as shown by a Glasgow Coma Scale score (GCS) <8 on admission, 24-hour transfusion requirement >10 units packed red blood cells, pulmonary contusion (PC), femur fracture, and major infection (pneumonia, empyema, or intra-abdominal abscess). Both univariate and stepwise logistic regression were used to identify independent risk factors, and receiver operating characteristic curve (ROC) analysis was used to determine the relative contribution of each risk factor. A total of 4397 patients having sustained blunt trauma were admitted to the intensive care unit and survived >24 hours between October 1995 and May 2000. Of these patients 200 (4.5%) developed ARDS. All studied variables were significantly associated with ARDS in univariate analyses. Stepwise logistic regression, however, demonstrated age >65 years, ISS >25, hypotension on admission, 24-hour transfusion requirement >10 units, and pulmonary contusion as independent risk factors, whereas admission metabolic acidosis, femur fracture, infection, and severe brain injury were not. Using a model based on the logistic regression equation derived yields better than 80 per cent discrimination in ARDS patients. The risk factors providing the greatest contribution to ARDS development were ISS >25 (ROC area 0.72) and PC (ROC area 0.68) followed by large transfusion requirement (ROC area 0.56), admission hypotension (ROC area 0.57), and age >65 (ROC area 0.54). Independent risk factors for ARDS in blunt trauma include ISS >25, PC, age >65 years, hypotension on admission, and 24-hour transfusion requirement >10 units but not admission metabolic acidosis, femur fracture, infection, or severe brain injury. Assessment of these variables allows accurate estimate of risk in the majority of cases, and the most potent contributors to the predictive value of the model are ISS >25 and PC. Improvement in understanding of which patients are actually at risk may allow for advances in treatment as well as prevention in the future.

Non-invasive detection of the freezing of gait in Parkinson's disease using spectral and wavelet features.

PubMed

Nazarzadeh, Kimia; Arjunan, Sridhar P; Kumar, Dinesh K; Das, Debi Prasad

2016-08-01

In this study, we have analyzed the accelerometer data recorded during gait analysis of Parkinson disease patients for detecting freezing of gait (FOG) episodes. The proposed method filters the recordings for noise reduction of the leg movement changes and computes the wavelet coefficients to detect FOG events. Publicly available FOG database was used and the technique was evaluated using receiver operating characteristic (ROC) analysis. Results show a higher performance of the wavelet feature in discrimination of the FOG events from the background activity when compared with the existing technique.

ROC curves in clinical chemistry: uses, misuses, and possible solutions.

PubMed

Obuchowski, Nancy A; Lieber, Michael L; Wians, Frank H

2004-07-01

ROC curves have become the standard for describing and comparing the accuracy of diagnostic tests. Not surprisingly, ROC curves are used often by clinical chemists. Our aims were to observe how the accuracy of clinical laboratory diagnostic tests is assessed, compared, and reported in the literature; to identify common problems with the use of ROC curves; and to offer some possible solutions. We reviewed every original work using ROC curves and published in Clinical Chemistry in 2001 or 2002. For each article we recorded phase of the research, prospective or retrospective design, sample size, presence/absence of confidence intervals (CIs), nature of the statistical analysis, and major analysis problems. Of 58 articles, 31% were phase I (exploratory), 50% were phase II (challenge), and 19% were phase III (advanced) studies. The studies increased in sample size from phase I to III and showed a progression in the use of prospective designs. Most phase I studies were powered to assess diagnostic tests with ROC areas >/=0.70. Thirty-eight percent of studies failed to include CIs for diagnostic test accuracy or the CIs were constructed inappropriately. Thirty-three percent of studies provided insufficient analysis for comparing diagnostic tests. Other problems included dichotomization of the gold standard scale and inappropriate analysis of the equivalence of two diagnostic tests. We identify available software and make some suggestions for sample size determination, testing for equivalence in diagnostic accuracy, and alternatives to a dichotomous classification of a continuous-scale gold standard. More methodologic research is needed in areas specific to clinical chemistry.

ROC-king onwards: intraepithelial lymphocyte counts, distribution & role in coeliac disease mucosal interpretation.

PubMed

Rostami, Kamran; Marsh, Michael N; Johnson, Matt W; Mohaghegh, Hamid; Heal, Calvin; Holmes, Geoffrey; Ensari, Arzu; Aldulaimi, David; Bancel, Brigitte; Bassotti, Gabrio; Bateman, Adrian; Becheanu, Gabriel; Bozzola, Anna; Carroccio, Antonio; Catassi, Carlo; Ciacci, Carolina; Ciobanu, Alexandra; Danciu, Mihai; Derakhshan, Mohammad H; Elli, Luca; Ferrero, Stefano; Fiorentino, Michelangelo; Fiorino, Marilena; Ganji, Azita; Ghaffarzadehgan, Kamran; Going, James J; Ishaq, Sauid; Mandolesi, Alessandra; Mathews, Sherly; Maxim, Roxana; Mulder, Chris J; Neefjes-Borst, Andra; Robert, Marie; Russo, Ilaria; Rostami-Nejad, Mohammad; Sidoni, Angelo; Sotoudeh, Masoud; Villanacci, Vincenzo; Volta, Umberto; Zali, Mohammad R; Srivastava, Amitabh

2017-12-01

Counting intraepithelial lymphocytes (IEL) is central to the histological diagnosis of coeliac disease (CD), but no definitive 'normal' IEL range has ever been published. In this multicentre study, receiver operating characteristic (ROC) curve analysis was used to determine the optimal cut-off between normal and CD (Marsh III lesion) duodenal mucosa, based on IEL counts on >400 mucosal biopsy specimens. The study was designed at the International Meeting on Digestive Pathology, Bucharest 2015. Investigators from 19 centres, eight countries of three continents, recruited 198 patients with Marsh III histology and 203 controls and used one agreed protocol to count IEL/100 enterocytes in well-oriented duodenal biopsies. Demographic and serological data were also collected. The mean ages of CD and control groups were 45.5 (neonate to 82) and 38.3 (2-88) years. Mean IEL count was 54±18/100 enterocytes in CD and 13±8 in normal controls (p=0.0001). ROC analysis indicated an optimal cut-off point of 25 IEL/100 enterocytes, with 99% sensitivity, 92% specificity and 99.5% area under the curve. Other cut-offs between 20 and 40 IEL were less discriminatory. Additionally, there was a sufficiently high number of biopsies to explore IEL counts across the subclassification of the Marsh III lesion. Our ROC curve analyses demonstrate that for Marsh III lesions, a cut-off of 25 IEL/100 enterocytes optimises discrimination between normal control and CD biopsies. No differences in IEL counts were found between Marsh III a, b and c lesions. There was an indication of a continuously graded dose-response by IEL to environmental (gluten) antigenic influence. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Application of impulse oscillometry and bronchial dilation test for analysis in patients with asthma and chronic obstructive pulmonary disease

PubMed Central

Li, Yueyue; Chen, Yang; Wang, Ping

2015-01-01

Impulse oscillometry (IOS) is a good method for measuring airway resistance. The aim of this study was to assess the diagnostic contribution of IOS combined with bronchial dilation test (BDT) when distinguishing between patients with asthma and those with chronic obstructive pulmonary disease (COPD). 870 were enrolled in the study including 561 patients with asthma, 100 patients with COPD and 209 patients with chronic coughing or normal subjects. All the participants underwent routine pulmonary function tests, IOS and BDT examination. And IOS examination was before and after BDT. IOS parameters (R5, R20, R25, R35, X5, X20, X25, X35, Fres, Zrs & RP) and forced expiratory volume in one second (FEV1) were recorded. Receiver operating characteristics (ROC) curve analysis was performed to evaluate the diagnostic ability to differentiate asthma and COPD. The discriminative power of the various parameters studied was determined by means of ROC curves: the area under the curve (AUC), sensitivity and specificity. The X5, X20, X25, X35, Fres, Zrs and Rp correlated better with COPD. In particular, X5, Fres and X25 have been found to be significantly correlated with COPD. The diagnostic efficiency of X5, Fres and X25 when diagnosis COPD, expressed by ROC curve parameters, was as follows: AUC (0.725, 0.730, 0.724), sensitivity (67%, 77%, 83%) and specificity (68%, 65%, 58%), respectively. The diagnostic efficiency of Zrs, R5 and X35 when diagnosis asthma, expressed by ROC curve parameters, was as follows: AUC (0.721, 0.710, 0.695), sensitivity (62%, 72%, 53%) and specificity (72%, 61%, 76%), respectively. Our findings show, that X5, X25 and Fres may be useful for predictions and evaluations for COPD. And R5, X35 and Zrs may provide useful IOS parameters for asthma. IOS combined BDT could be useful diagnostic and differential diagnosis between asthma and COPD. PMID:25785124

Application of impulse oscillometry and bronchial dilation test for analysis in patients with asthma and chronic obstructive pulmonary disease.

PubMed

Li, Yueyue; Chen, Yang; Wang, Ping

2015-01-01

Impulse oscillometry (IOS) is a good method for measuring airway resistance. The aim of this study was to assess the diagnostic contribution of IOS combined with bronchial dilation test (BDT) when distinguishing between patients with asthma and those with chronic obstructive pulmonary disease (COPD). 870 were enrolled in the study including 561 patients with asthma, 100 patients with COPD and 209 patients with chronic coughing or normal subjects. All the participants underwent routine pulmonary function tests, IOS and BDT examination. And IOS examination was before and after BDT. IOS parameters (R5, R20, R25, R35, X5, X20, X25, X35, Fres, Zrs & RP) and forced expiratory volume in one second (FEV1) were recorded. Receiver operating characteristics (ROC) curve analysis was performed to evaluate the diagnostic ability to differentiate asthma and COPD. The discriminative power of the various parameters studied was determined by means of ROC curves: the area under the curve (AUC), sensitivity and specificity. The X5, X20, X25, X35, Fres, Zrs and Rp correlated better with COPD. In particular, X5, Fres and X25 have been found to be significantly correlated with COPD. The diagnostic efficiency of X5, Fres and X25 when diagnosis COPD, expressed by ROC curve parameters, was as follows: AUC (0.725, 0.730, 0.724), sensitivity (67%, 77%, 83%) and specificity (68%, 65%, 58%), respectively. The diagnostic efficiency of Zrs, R5 and X35 when diagnosis asthma, expressed by ROC curve parameters, was as follows: AUC (0.721, 0.710, 0.695), sensitivity (62%, 72%, 53%) and specificity (72%, 61%, 76%), respectively. Our findings show, that X5, X25 and Fres may be useful for predictions and evaluations for COPD. And R5, X35 and Zrs may provide useful IOS parameters for asthma. IOS combined BDT could be useful diagnostic and differential diagnosis between asthma and COPD.

Fluorescence spectroscopy for diagnosis of squamous intraepithelial lesions of the cervix.

PubMed

Mitchell, M F; Cantor, S B; Ramanujam, N; Tortolero-Luna, G; Richards-Kortum, R

1999-03-01

To calculate receiver operating characteristic (ROC) curves for fluorescence spectroscopy in order to measure its performance in the diagnosis of squamous intraepithelial lesions (SILs) and to compare these curves with those for other diagnostic methods: colposcopy, cervicography, speculoscopy, Papanicolaou smear screening, and human papillomavirus (HPV) testing. Data from our previous clinical study were used to calculate ROC curves for fluorescence spectroscopy. Curves for other techniques were calculated from other investigators' reports. To identify these, a MEDLINE search for articles published from 1966 to 1996 was carried out, using the search terms "colposcopy," "cervicoscopy," "cervicography," "speculoscopy," "Papanicolaou smear," "HPV testing," "fluorescence spectroscopy," and "polar probe" in conjunction with the terms "diagnosis," "positive predictive value," "negative predictive value," and "receiver operating characteristic curve." We found 270 articles, from which articles were selected if they reported results of studies involving high-disease-prevalence populations, reported findings of studies in which colposcopically directed biopsy was the criterion standard, and included sufficient data for recalculation of the reported sensitivities and specificities. We calculated ROC curves for fluorescence spectroscopy using Bayesian and neural net algorithms. A meta-analytic approach was used to calculate ROC curves for the other techniques. Areas under the curves were calculated. Fluorescence spectroscopy using the neural net algorithm had the highest area under the ROC curve, followed by fluorescence spectroscopy using the Bayesian algorithm, followed by colposcopy, the standard diagnostic technique. Cervicography, Papanicolaou smear screening, and HPV testing performed comparably with each other but not as well as fluorescence spectroscopy and colposcopy. Fluorescence spectroscopy performs better than colposcopy and other techniques in the diagnosis of SILs. Because it also permits real-time diagnosis and has the potential of being used by inexperienced health care personnel, this technology holds bright promise.

Description of the ambulance services participating in the Aus-ROC Australian and New Zealand out-of-hospital cardiac arrest Epistry.

PubMed

Beck, Ben; Bray, Janet E; Smith, Karen; Walker, Tony; Grantham, Hugh; Hein, Cindy; Thorrowgood, Melanie; Smith, Anthony; Inoue, Madoka; Smith, Tony; Dicker, Bridget; Swain, Andy; Bosley, Emma; Pemberton, Katherine; McKay, Michael; Johnston-Leek, Malcolm; Cameron, Peter; Perkins, Gavin D; Finn, Judith

2016-12-01

The present study aimed to describe and examine similarities and differences in the current service provision and resuscitation protocols of the ambulance services participating in the Aus-ROC Australian and New Zealand out-of-hospital cardiac arrest (OHCA) Epistry. Understanding these similarities and differences is important in identifying ambulance service factors that might explain regional variation in survival of OHCA in the Aus-ROC Epistry. A structured questionnaire was completed by each of the ambulance services participating in the Aus-ROC Epistry. These ambulance services were SA Ambulance Service, Ambulance Victoria, St John Ambulance Western Australia, Queensland Ambulance Service, St John Ambulance NT, St John New Zealand and Wellington Free Ambulance. The survey aimed to describe ambulance service and dispatch characteristics, resuscitation protocols and details of cardiac arrest registries. We observed similarities between services with respect to the treatment of OHCA and dispatch systems. Differences between services were observed in the serviced population; the proportion of paramedics with basic life support, advanced life support or intensive care training skills; the number of OHCA cases attended; guidelines related to withholding or terminating resuscitation attempts; and the variables that might be used to define 'attempted resuscitation'. All seven participating ambulance services were noted to have existing OHCA registries. There is marked variation between ambulance services currently participating in the Aus-ROC Australian and New Zealand OHCA Epistry with respect to workforce characteristics and key variable definitions. This variation between ambulance services might account for a proportion of the regional variation in survival of OHCA. © 2016 Australasian College for Emergency Medicine and Australasian Society for Emergency Medicine.

Diagnostic performance of traditional hepatobiliary biomarkers of drug-induced liver injury in the rat.

PubMed

Ennulat, Daniela; Magid-Slav, Michal; Rehm, Sabine; Tatsuoka, Kay S

2010-08-01

Nonclinical studies provide the opportunity to anchor biochemical with morphologic findings; however, liver injury is often complex and heterogeneous, confounding the ability to relate biochemical changes with specific patterns of injury. The aim of the current study was to compare diagnostic performance of hepatobiliary markers for specific manifestations of drug-induced liver injury in rat using data collected in a recent hepatic toxicogenomics initiative in which rats (n = 3205) were given 182 different treatments for 4 or 14 days. Diagnostic accuracy of alanine aminotransferase (ALT), aspartate aminotransferase (AST), total bilirubin (Tbili), serum bile acids (SBA), alkaline phosphatase (ALP), gamma glutamyl transferase (GGT), total cholesterol (Chol), and triglycerides (Trig) was evaluated for specific types of liver histopathology by Receiver Operating Characteristic (ROC) analysis. To assess the relationship between biochemical and morphologic changes in the absence of hepatocellular necrosis, a second ROC analysis was performed on a subset of rats (n = 2504) given treatments (n = 152) that did not cause hepatocellular necrosis. In the initial analysis, ALT, AST, Tbili, and SBA had the greatest diagnostic utility for manifestations of hepatocellular necrosis and biliary injury, with comparable magnitude of area under the ROC curve and serum hepatobiliary marker changes for both. In the absence of hepatocellular necrosis, ALT increases were observed with biochemical or morphologic evidence of cholestasis. In both analyses, diagnostic utility of ALP and GGT for biliary injury was limited; however, ALP had modest diagnostic value for peroxisome proliferation, and ALT, AST, and total Chol had moderate diagnostic utility for phospholipidosis. None of the eight markers evaluated had diagnostic value for manifestations of hypertrophy, cytoplasmic rarefaction, inflammation, or lipidosis.

Anti-A2 and anti-A1 domain antibodies are potential predictors of immune tolerance induction outcome in children with hemophilia A.

PubMed

Lapalud, P; Rothschild, C; Mathieu-Dupas, E; Balicchi, J; Gruel, Y; Laune, D; Molina, F; Schved, J F; Granier, C; Lavigne-Lissalde, G

2015-04-01

Hemophilia A (HA) is a congenital bleeding disorder resulting from factor VIII deficiency. The most serious complication of HA management is the appearance of inhibitory antibodies (Abs) against injected FVIII concentrates. To eradicate inhibitors, immune tolerance induction (ITI) is usually attempted, but it fails in up to 30% of cases. Currently, no undisputed predictive marker of ITI outcome is available to facilitate the clinical decision. To identify predictive markers of ITI efficacy. The isotypic and epitopic repertoires of inhibitory Abs were analyzed in plasma samples collected before ITI initiation from 15 children with severe HA and high-titer inhibitors, and their levels were compared in the two outcome groups (ITI success [n = 7] and ITI failure [n = 8]). The predictive value of these candidate biomarkers and of the currently used indicators (inhibitor titer and age at ITI initiation, highest inhibitor titer before ITI, and interval between inhibitor diagnosis and ITI initiation) was then compared by statistical analysis (Wilcoxon test and receiver receiver operating characteristic [ROC] curve analysis). Whereas current indicators seemed to fail in discriminating patients in the two outcome groups (ITI success or failure), anti-A1 and anti-A2 Ab levels before ITI initiation appeared to be good potential predictive markers of ITI outcome (P < 0.018). ROC analysis showed that anti-A1 and anti-A2 Abs were the best at discriminating between outcome groups (area under the ROC curve of > 0.875). Anti-A1 and anti-A2 Abs could represent new promising tools for the development of ITI outcome prediction tests for children with severe HA. © 2015 International Society on Thrombosis and Haemostasis.

Comparison of conventional and automated breast volume ultrasound in the description and characterization of solid breast masses based on BI-RADS features.

PubMed

Kim, Hyunji; Cha, Joo Hee; Oh, Ha-Yeun; Kim, Hak Hee; Shin, Hee Jung; Chae, Eun Young

2014-07-01

To compare the performance of radiologists in the use of conventional ultrasound (US) and automated breast volume ultrasound (ABVU) for the characterization of benign and malignant solid breast masses based on breast imaging and reporting data system (BI-RADS) criteria. Conventional US and ABVU images were obtained in 87 patients with 106 solid breast masses (52 cancers, 54 benign lesions). Three experienced radiologists who were blinded to all examination results independently characterized the lesions and reported a BI-RADS assessment category and a level of suspicion of malignancy. The results were analyzed by calculation of Cohen's κ coefficient and by receiver operating characteristic (ROC) analysis. Assessment of the agreement of conventional US and ABVU indicated that the posterior echo feature was the most discordant feature of seven features (κ = 0.371 ± 0.225) and that orientation had the greatest agreement (κ = 0.608 ± 0.210). The final assessment showed substantial agreement (κ = 0.773 ± 0.104). The areas under the ROC curves (Az) for conventional US and ABVU were not statistically significant for each reader, but the mean Az values of conventional US and ABVU by multi-reader multi-case analysis were significantly different (conventional US 0.991, ABVU 0.963; 95 % CI -0.0471 to -0.0097). The means for sensitivity, specificity, positive predictive value, and negative predictive value of conventional US and ABVU did not differ significantly. There was substantial inter-observer agreement in the final assessment of solid breast masses by conventional US and ABVU. ROC analysis comparing the performance of conventional US and ABVU indicated a marginally significant difference in mean Az, but not in mean sensitivity, specificity, positive predictive value, or negative predictive value.

[Correlation between percentage of body fat and simple anthropometric parameters in children aged 6-9 years in Guangzhou].

PubMed

Yan, H C; Hao, Y T; Guo, Y F; Wei, Y H; Zhang, J H; Huang, G P; Mao, L M; Zhang, Z Q

2017-11-10

Objective: To evaluate the accuracy of simple anthropometric parameters in diagnosing obesity in children in Guangzhou. Methods: A cross-sectional study, including 465 children aged 6-9 years, was carried out in Guangzhou. Their body height and weight, waist circumference (WC) and hip circumference were measured according to standard procedure. Body mass index (BMI), waist to hip ratio (WHR) and waist-to-height ratio (WHtR) were calculated. Body fat percentage (BF%) was determined by dual-energy X-ray absorptiometry. Multiple regression analysis was applied to evaluate the correlations between age-adjusted physical indicators and BF%, after the adjustment for age. Obesity was defined by BF%. Receiver operating characteristic (ROC) curve analyses were performed to assess the diagnostic accuracy of the indicators for childhood obesity. Area under-ROC curves (AUCs) were calculated and the best cut-off point that maximizing 'sensitivity + specificity-1' was determined. Results: BMI showed the strongest association with BF% through multiple regression analysis. For 'per-standard deviation increase' of BMI, BF% increased by 5.3% ( t =23.1, P <0.01) in boys and 4.6% ( t =17.5, P <0.01) in girls, respectively. The ROC curve analysis indicated that BMI exhibited the largest AUC in both boys (AUC=0.908) and girls (AUC=0.895). The sensitivity was 80.8% in boys and 81.8% in girls, and the specificity was 88.2% in boys and 87.1% in girls. Both the AUCs for WHtR and WC were less than 0.8 in boys and girls. WHR had the smallest AUCs (<0.8) in both boys and girls. Conclusion: BMI appeared to be a good predicator for BF% in children aged 6-9 years in Guangzhou.

Bronchial lavage P 16INK4A gene promoter methylation and lung cancer diagnosis: A meta-analysis.

PubMed

Yifan, D; Qun, L; Yingshuang, H; Xulin, L; Jianjun, W; Qian, M; Yuman, Yu; Zhaoyang, R

2015-12-01

To evaluate the diagnostic value of bronchial lavage P16INK4A promoter methylation and lung cancer. The databases of PubMed, Medline, China National Knowledge Infrastructure, and Wanfang were electronically searched by two reviewers to find the suitable studies related to the association between P16INK4A promoter methylation and lung cancer. The P16INK4A promoter methylation rate was extracted from each included individual study. The diagnostic sensitivity, specificity, and area under the receiver operating characteristic ROC curve of bronchial lavage P16INK4Aas a biomarker for diagnosis of lung cancer were pooled by stata 11.0 software (Stata Corporation, College Station, TX, USA). At last, 10 publications were included in this meta-analysis. Of the included 10 studies, five are published in English with relatively high quality and other five papers published in Chinese have relatively low quality. The pooled sensitivity and specificity of bronchial lavage P16INK4A promoter methylation for lung cancer diagnosis were 0.61 (95% confidence interval [CI]: 0.57-0.65) and 0.81 (95% CI: 0.78-0.85), respectively, with random effect model. The ROC curve were calculated and drawn according to Bayes' theorem by stata 11.0 software. The systematic area under the ROC was 0.72 (95% CI: 0.68-0.76), which indicated that the diagnostic value of bronchial lavage P16INK4A promoter methylation for lung cancer was relatively high. Moreover, no significant publication bias was existed in this meta-analysis (t = 0.69, P > 0.05). Bronchial lavage P16INK4A promoter methylation can be a potential biomarker for diagnosis of lung cancer.

Utility of Shear Wave Elastography for Differentiating Biliary Atresia From Infantile Hepatitis Syndrome.

PubMed

Wang, Xiaoman; Qian, Linxue; Jia, Liqun; Bellah, Richard; Wang, Ning; Xin, Yue; Liu, Qinglin

2016-07-01

The purpose of this study was to investigate the potential utility of shear wave elastography (SWE) for diagnosis of biliary atresia and for differentiating biliary atresia from infantile hepatitis syndrome by measuring liver stiffness. Thirty-eight patients with biliary atresia and 17 patients with infantile hepatitis syndrome were included, along with 31 healthy control infants. The 3 groups underwent SWE. The hepatic tissue of each patient with biliary atresia had been surgically biopsied. Statistical analyses for mean values of the 3 groups were performed. Optimum cutoff values using SWE for differentiation between the biliary atresia and control groups were calculated by a receiver operating characteristic (ROC) analysis. The mean SWE values ± SD for the 3 groups were as follows: biliary atresia group, 20.46 ± 10.19 kPa; infantile hepatitis syndrome group, 6.29 ± 0.99 kPa; and control group, 6.41 ± 1.08 kPa. The mean SWE value for the biliary atresia group was higher than the values for the control and infantile hepatitis syndrome groups (P < .01). The mean SWE values between the control and infantile hepatitis syndrome groups were not statistically different. The ROC analysis showed a cutoff value of 8.68 kPa for differentiation between the biliary atresia and control groups. The area under the ROC curve was 0.997, with sensitivity of 97.4%, specificity of 100%, a positive predictive value of 100%, and a negative predictive value of 96.9%. Correlation analysis suggested a positive correlation between SWE values and age for patients with biliary atresia, with a Pearson correlation coefficient of 0.463 (P < .05). The significant increase in liver SWE values in neonates and infants with biliary atresia supports their application for differentiating biliary atresia from infantile hepatitis syndrome.

Three new potential ovarian cancer biomarkers detected in human urine with equalizer bead technology.

PubMed

Petri, Anette Lykke; Simonsen, Anja Hviid; Yip, Tai-Tung; Hogdall, Estrid; Fung, Eric T; Lundvall, Lene; Hogdall, Claus

2009-01-01

To examine whether urine can be used to measure specific ovarian cancer proteomic profiles and whether one peak alone or in combination with other peaks or CA125 has the sensitivity and specificity to discriminate between ovarian cancer pelvic mass and benign pelvic mass. A total of 209 women were admitted for surgery for pelvic mass at the Gynaecological Department at Rigshospitalet, Copenhagen. Of the women, 156 had benign gynaecological tumors, 13 had borderline tumors and 40 had malignant epithelial ovarian cancer. The prospectively and preoperatively collected urine samples were aliquotted and frozen at -80 degrees until the time of analysis. The urine was fractionated using equalizer bead technology and then analyzed with surface-enhanced laser desorption/ionization time-of-flight mass spectrometry. Biomarkers were purified and identified using combinations of chromatographic techniques and tandem mass spectrometry. Benign and malignant ovarian cancer cases were compared; 21 significantly different peaks (p<0.001) were visualized using Mann-Whitney analysis, ranging in m/z values from 1,500 to 185,000. The three most significant peaks were purified and identified as fibrinogen alpha fragment (m/z=2570.21), collagen alpha 1 (III) fragment (m/z=2707.32) and fibrinogen beta NT fragment (m/z=4425.09). The area under the receiver operator characteristic curve (ROC AUC) value for these three peaks in combination was 0.88, and their ROC AUC value in combination with CA125 was 0.96. This result supports the feasibility of using urine as a clinical diagnostic medium, and the ROC AUC value for the three most significant peaks in combination with or without CA125 demonstrates the enhanced prediction performance of combined marker analysis.

Dual-time point scanning of integrated FDG PET/CT for the evaluation of mediastinal and hilar lymph nodes in non-small cell lung cancer diagnosed as operable by contrast-enhanced CT.

PubMed

Kasai, Takami; Motoori, Ken; Horikoshi, Takuro; Uchiyama, Katsuhiro; Yasufuku, Kazuhiro; Takiguchi, Yuichi; Takahashi, Fumiaki; Kuniyasu, Yoshio; Ito, Hisao

2010-08-01

To evaluate whether dual-time point scanning with integrated fluorine-18 fluorodeoxyglucose ((18)F-FDG) positron emission tomography and computed tomography (PET/CT) is useful for evaluation of mediastinal and hilar lymph nodes in non-small cell lung cancer diagnosed as operable by contrast-enhanced CT. PET/CT data and pathological findings of 560 nodal stations in 129 patients with pathologically proven non-small cell lung cancer diagnosed as operable by contrast-enhanced CT were reviewed retrospectively. Standardized uptake values (SUVs) on early scans (SUVe) 1h, and on delayed scans (SUVd) 2h after FDG injection of each nodal station were measured. Retention index (RI) (%) was calculated by subtracting SUVe from SUVd and dividing by SUVe. Logistic regression analysis was performed with seven kinds of models, consisting of (1) SUVe, (2) SUVd, (3) RI, (4) SUVe and SUVd, (5) SUVe and RI, (6) SUVd and RI, and (7) SUVe, SUVd and RI. The seven derived models were compared by receiver-operating characteristic (ROC) analysis. k-Fold cross-validation was performed with k values of 5 and 10. p<0.05 was considered statistically significant. Model (1) including the term of SUVe showed the largest area under the ROC curve among the seven models. The cut-off probability of metastasis of 3.5% with SUVe of 2.5 revealed a sensitivity of 78% and a specificity of 81% on ROC analysis, and approximately 60% and 80% on k-fold cross-validation. Single scanning of PET/CT is sufficiently useful for evaluating mediastinal and hilar nodes for metastasis. Copyright (c) 2009 Elsevier Ireland Ltd. All rights reserved.

Anisotropy of anomalous diffusion improves the accuracy of differentiating low- and high-grade cerebral gliomas.

PubMed

Xu, Boyan; Su, Lu; Wang, Zhenxiong; Fan, Yang; Gong, Gaolang; Zhu, Wenzhen; Gao, Peiyi; Gao, Jia-Hong

2018-04-17

Anomalous diffusion model has been introduced and shown to be beneficial in clinical applications. However, only the directionally averaged values of anomalous diffusion parameters were investigated, and the anisotropy of anomalous diffusion remains unexplored. The aim of this study was to demonstrate the feasibility of using anisotropy of anomalous diffusion for differentiating low- and high-grade cerebral gliomas. Diffusion MRI images were acquired from brain tumor patients and analyzed using the fractional motion (FM) model. Twenty-two patients with histopathologically confirmed gliomas were selected. An anisotropy metric for the FM-related parameters, including the Noah exponent (α) and the Hurst exponent (H), was introduced and their values were statistically compared between the low- and high-grade gliomas. Additionally, multivariate logistic regression analysis was performed to assess the combination of the anisotropy metric and the directionally averaged value for each parameter. The diagnostic performances for grading gliomas were evaluated using a receiver operating characteristic (ROC) analysis. The Hurst exponent H was more anisotropic in high-grade than in low-grade gliomas (P = 0.015), while no significant difference was observed for the anisotropy of α. The ROC analysis revealed that larger areas under the ROC curves were produced for the combination of α (1) and the combination of H (0.813) compared with the directionally averaged α (0.979) and H (0.594), indicating an improved performance for tumor differentiation. The anisotropy of anomalous diffusion can provide distinctive information and benefit the differentiation of low- and high-grade gliomas. The utility of anisotropic anomalous diffusion may have an improved effect for investigating pathological changes in tissues. Copyright © 2018 Elsevier Inc. All rights reserved.

Cumulative lactate and hospital mortality in ICU patients

PubMed Central

2013-01-01

Background Both hyperlactatemia and persistence of hyperlactatemia have been associated with bad outcome. We compared lactate and lactate-derived variables in outcome prediction. Methods Retrospective observational study. Case records from 2,251 consecutive intensive care unit (ICU) patients admitted between 2001 and 2007 were analyzed. Baseline characteristics, all lactate measurements, and in-hospital mortality were recorded. The time integral of arterial blood lactate levels above the upper normal threshold of 2.2 mmol/L (lactate-time-integral), maximum lactate (max-lactate), and time-to-first-normalization were calculated. Survivors and nonsurvivors were compared and receiver operating characteristic (ROC) analysis were applied. Results A total of 20,755 lactate measurements were analyzed. Data are srpehown as median [interquartile range]. In nonsurvivors (n = 405) lactate-time-integral (192 [0–1881] min·mmol/L) and time-to-first normalization (44.0 [0–427] min) were higher than in hospital survivors (n = 1846; 0 [0–134] min·mmol/L and 0 [0–75] min, respectively; all p < 0.001). Normalization of lactate <6 hours after ICU admission revealed better survival compared with normalization of lactate >6 hours (mortality 16.6% vs. 24.4%; p < 0.001). AUC of ROC curves to predict in-hospital mortality was the largest for max-lactate, whereas it was not different among all other lactate derived variables (all p > 0.05). The area under the ROC curves for admission lactate and lactate-time-integral was not different (p = 0.36). Conclusions Hyperlactatemia is associated with in-hospital mortality in a heterogeneous ICU population. In our patients, lactate peak values predicted in-hospital mortality equally well as lactate-time-integral of arterial blood lactate levels above the upper normal threshold. PMID:23446002

Statistical evidences of seismo-ionospheric precursors applying receiver operating characteristic (ROC) curve on the GPS total electron content in China

NASA Astrophysics Data System (ADS)

Chen, Yuh-Ing; Huang, Chi-Shen; Liu, Jann-Yenq

2015-12-01

Evidence of the seismo-ionospheric precursor (SIP) is reported by statistically investigating the relationship between the total electron content (TEC) in global ionosphere map (GIM) and 56 M ⩾ 6.0 earthquakes during 1998-2013 in China. A median-based method together with the z test is employed to examine the TEC variations 30 days before and after the earthquake. It is found that the TEC significantly decreases 0600-1000 LT 1-6 days before the earthquake, and anomalously increases in 3 time periods of 1300-1700 LT 12-15 days; 0000-0500 LT 15-17 days; and 0500-0900 LT 22-28 days before the earthquake. The receiver operating characteristic (ROC) curve is then used to evaluate the efficiency of TEC for predicting M ⩾ 6.0 earthquakes in China during a specified time period. Statistical results suggest that the SIP is the significant TEC reduction in the morning period of 0600-1000 LT. The SIP is further confirmed since the area under the ROC curve is positively associated with the earthquake magnitude.

A Metric for Reducing False Positives in the Computer-Aided Detection of Breast Cancer from Dynamic Contrast-Enhanced Magnetic Resonance Imaging Based Screening Examinations of High-Risk Women.

PubMed

Levman, Jacob E D; Gallego-Ortiz, Cristina; Warner, Ellen; Causer, Petrina; Martel, Anne L

2016-02-01

Magnetic resonance imaging (MRI)-enabled cancer screening has been shown to be a highly sensitive method for the early detection of breast cancer. Computer-aided detection systems have the potential to improve the screening process by standardizing radiologists to a high level of diagnostic accuracy. This retrospective study was approved by the institutional review board of Sunnybrook Health Sciences Centre. This study compares the performance of a proposed method for computer-aided detection (based on the second-order spatial derivative of the relative signal intensity) with the signal enhancement ratio (SER) on MRI-based breast screening examinations. Comparison is performed using receiver operating characteristic (ROC) curve analysis as well as free-response receiver operating characteristic (FROC) curve analysis. A modified computer-aided detection system combining the proposed approach with the SER method is also presented. The proposed method provides improvements in the rates of false positive markings over the SER method in the detection of breast cancer (as assessed by FROC analysis). The modified computer-aided detection system that incorporates both the proposed method and the SER method yields ROC results equal to that produced by SER while simultaneously providing improvements over the SER method in terms of false positives per noncancerous exam. The proposed method for identifying malignancies outperforms the SER method in terms of false positives on a challenging dataset containing many small lesions and may play a useful role in breast cancer screening by MRI as part of a computer-aided detection system.

Urinary Squamous Epithelial Cells Do Not Accurately Predict Urine Culture Contamination, but May Predict Urinalysis Performance in Predicting Bacteriuria.

PubMed

Mohr, Nicholas M; Harland, Karisa K; Crabb, Victoria; Mutnick, Rachel; Baumgartner, David; Spinosi, Stephanie; Haarstad, Michael; Ahmed, Azeemuddin; Schweizer, Marin; Faine, Brett

2016-03-01

The presence of squamous epithelial cells (SECs) has been advocated to identify urinary contamination despite a paucity of evidence supporting this practice. We sought to determine the value of using quantitative SECs as a predictor of urinalysis contamination. Retrospective cross-sectional study of adults (≥18 years old) presenting to a tertiary academic medical center who had urinalysis with microscopy and urine culture performed. Patients with missing or implausible demographic data were excluded (2.5% of total sample). The primary analysis aimed to determine an SEC threshold that predicted urine culture contamination using receiver operating characteristics (ROC) curve analysis. The a priori secondary analysis explored how demographic variables (age, sex, body mass index) may modify the SEC test performance and whether SECs impacted traditional urinalysis indicators of bacteriuria. A total of 19,328 records were included. ROC curve analysis demonstrated that SEC count was a poor predictor of urine culture contamination (area under the ROC curve = 0.680, 95% confidence interval [CI] = 0.671 to 0.689). In secondary analysis, the positive likelihood ratio (LR+) of predicting bacteriuria via urinalysis among noncontaminated specimens was 4.98 (95% CI = 4.59 to 5.40) in the absence of SECs, but the LR+ fell to 2.35 (95% CI = 2.17 to 2.54) for samples with more than 8 SECs/low-powered field (lpf). In an independent validation cohort, urinalysis samples with fewer than 8 SECs/lpf predicted bacteriuria better (sensitivity = 75%, specificity = 84%) than samples with more than 8 SECs/lpf (sensitivity = 86%, specificity = 70%; diagnostic odds ratio = 17.5 [14.9 to 20.7] vs. 8.7 [7.3 to 10.5]). Squamous epithelial cells are a poor predictor of urine culture contamination, but may predict poor predictive performance of traditional urinalysis measures. © 2016 by the Society for Academic Emergency Medicine.

Factors associated with excessive bleeding after cardiac surgery: A prospective cohort study.

PubMed

Lopes, Camila Takao; Brunori, Evelise Fadini Reis; Cavalcante, Agueda Maria Ruiz Zimmer; Moorhead, Sue Ann; Swanson, Elizabeth; Lopes, Juliana de Lima; de Barros, Alba Lucia Bottura Leite

2016-01-01

To identify factors associated with excessive bleeding (ExB) after cardiac surgery in adults. Excessive bleeding after cardiac surgery must be anticipated for implementation of timely interventions. A prospective cohort study with 323 adults requiring open-chest cardiac surgery. Potential factors associated with ExB were investigated through univariate analysis and logistic regression. The accuracy of the relationship between the independent variables and the outcome was depicted through the receiver-operating characteristic (ROC) curve. The factors associated with ExB included gender, body mass index (BMI), preoperative platelet count, intraoperative heparin doses and intraoperative platelet transfusion. The ROC curve cut-off points were 26.35 for the BMI; 214,000 for the preoperative platelet count, and 6.25 for intraoperative heparin dose. This model had an accuracy = 77.3%, a sensitivity = 81%, and a specificity = 62%. Male gender, BMI, preoperative platelet count, dose of intraoperative heparin >312.5 mg without subsequent platelet transfusion, are factors associated with ExB. Copyright © 2016 Elsevier Inc. All rights reserved.

Power calculation for comparing diagnostic accuracies in a multi-reader, multi-test design.

PubMed

Kim, Eunhee; Zhang, Zheng; Wang, Youdan; Zeng, Donglin

2014-12-01

Receiver operating characteristic (ROC) analysis is widely used to evaluate the performance of diagnostic tests with continuous or ordinal responses. A popular study design for assessing the accuracy of diagnostic tests involves multiple readers interpreting multiple diagnostic test results, called the multi-reader, multi-test design. Although several different approaches to analyzing data from this design exist, few methods have discussed the sample size and power issues. In this article, we develop a power formula to compare the correlated areas under the ROC curves (AUC) in a multi-reader, multi-test design. We present a nonparametric approach to estimate and compare the correlated AUCs by extending DeLong et al.'s (1988, Biometrics 44, 837-845) approach. A power formula is derived based on the asymptotic distribution of the nonparametric AUCs. Simulation studies are conducted to demonstrate the performance of the proposed power formula and an example is provided to illustrate the proposed procedure. © 2014, The International Biometric Society.

Likelihood Ratio, Optimal Decision Rules, and Relationship between Proportion Correct and d' in the Dual-Pair AB vs BA identification Paradigm

PubMed Central

Micheyl, Christophe; Dai, Huanping

2010-01-01

The equal-variance Gaussian signal-detection-theory (SDT) decision model for the dual-pair change-detection (or “4IAX”) paradigm has been described in earlier publications. In this note, we consider the equal-variance Gaussian SDT model for the related dual-pair AB vs BA identification paradigm. The likelihood ratios, optimal decision rules, receiver operating characteristics (ROCs), and relationships between d' and proportion-correct (PC) are analyzed for two special cases: that of statistically independent observations, which is likely to apply in constant-stimuli experiments, and that of highly correlated observations, which is likely to apply in experiments where stimuli are roved widely across trials or pairs. A surprising outcome of this analysis is that although these two situations lead to different optimal decision rules, the predicted ROCs and proportions of correct responses (PCs) for these two cases are not substantially different, and are either identical or similar to those observed in the basic Yes-No paradigm. PMID:19633356

Bayesian semiparametric estimation of covariate-dependent ROC curves

PubMed Central

Rodríguez, Abel; Martínez, Julissa C.

2014-01-01

Receiver operating characteristic (ROC) curves are widely used to measure the discriminating power of medical tests and other classification procedures. In many practical applications, the performance of these procedures can depend on covariates such as age, naturally leading to a collection of curves associated with different covariate levels. This paper develops a Bayesian heteroscedastic semiparametric regression model and applies it to the estimation of covariate-dependent ROC curves. More specifically, our approach uses Gaussian process priors to model the conditional mean and conditional variance of the biomarker of interest for each of the populations under study. The model is illustrated through an application to the evaluation of prostate-specific antigen for the diagnosis of prostate cancer, which contrasts the performance of our model against alternative models. PMID:24174579

Analytical and clinical performance of thyroglobulin autoantibody assays in thyroid cancer follow-up.

PubMed

Katrangi, Waddah; Grebe, Stephan K G; Algeciras-Schimnich, Alicia

2017-10-26

While thyroglobulin autoantibodies (TgAb) can result in false low serum thyroglobulin (Tg) immunoassay (IA) measurements, they might also be indicators of disease persistence/recurrence. Hence, accurate TgAb measurement, in addition to Tg quantification, is crucial for thyroid cancer monitoring. We compared the analytical and clinical performance of four commonly used TgAb IAs. We measured Tg by mass spectrometry (Tg-MS) and by four pairs of Tg and TgAb IAs (Beckman, Roche, Siemens, Thermo) in 576 samples. Limit of quantitation (LOQ) and manufacturers' upper reference interval cut-off (URI) were used for comparisons. Clinical performance was assessed by receiving operator characteristics (ROC) curve analysis. Quantitative and qualitative agreement between TgAb-IAs was moderate with R2 of 0.20-0.70 and κ from 0.41-0.66 using LOQ and 0.47-0.71 using URI. In samples with TgAb interference, detection rates of TgAb were similar using LOQ and URI for Beckman, Siemens, and Thermo, but much lower for the Roche TgAb-IA when the URI was used. In TgAb positive cases, the ROC areas under the curve (AUC) for the TgAb-IAs were 0.59 (Beckman), 0.62 (Siemens), 0.59 (Roche), and 0.59 (Thermo), similar to ROC AUCs achieved with Tg. Combining Tg and TgAb measurements improved the ROC AUCs compared to Tg or TgAb alone. TgAb-IAs show significant qualitative and quantitative differences. For 2 of the 4 TgAb-IAs, using the LOQ improves the detection of interfering TgAbs. All assays showed suboptimal clinical performance when used as surrogate markers of disease, with modest improvements when Tg and TgAb were combined.

Magnetic Resonance Imaging of Intracranial Hypotension: Diagnostic Value of Combined Qualitative Signs and Quantitative Metrics.

PubMed

Aslan, Kerim; Gunbey, Hediye Pinar; Tomak, Leman; Ozmen, Zafer; Incesu, Lutfi

The aim of this study was to investigate whether the use of combination quantitative metrics (mamillopontine distance [MPD], pontomesencephalic angle, and mesencephalon anterior-posterior/medial-lateral diameter ratios) with qualitative signs (dural enhancement, subdural collections/hematoma, venous engorgement, pituitary gland enlargements, and tonsillar herniations) provides a more accurate diagnosis of intracranial hypotension (IH). The quantitative metrics and qualitative signs of 34 patients and 34 control subjects were assessed by 2 independent observers. Receiver operating characteristic (ROC) curve was used to evaluate the diagnostic performance of quantitative metrics and qualitative signs, and for the diagnosis of IH, optimum cutoff values of quantitative metrics were found with ROC analysis. Combined ROC curve was measured for the quantitative metrics, and qualitative signs combinations in determining diagnostic accuracy and sensitivity, specificity, and positive and negative predictive values were found, and the best model combination was formed. Whereas MPD and pontomesencephalic angle were significantly lower in patients with IH when compared with the control group (P < 0.001), mesencephalon anterior-posterior/medial-lateral diameter ratio was significantly higher (P < 0.001). For qualitative signs, the highest individual distinctive power was dural enhancement with area under the ROC curve (AUC) of 0.838. For quantitative metrics, the highest individual distinctive power was MPD with AUC of 0.947. The best accuracy in the diagnosis of IH was obtained by combination of dural enhancement, venous engorgement, and MPD with an AUC of 1.00. This study showed that the combined use of dural enhancement, venous engorgement, and MPD had diagnostic accuracy of 100 % for the diagnosis of IH. Therefore, a more accurate IH diagnosis can be provided with combination of quantitative metrics with qualitative signs.

Diagnostic accuracy of routine blood examinations and CSF lactate level for post-neurosurgical bacterial meningitis.

PubMed

Zhang, Yang; Xiao, Xiong; Zhang, Junting; Gao, Zhixian; Ji, Nan; Zhang, Liwei

2017-06-01

To evaluate the diagnostic accuracy of routine blood examinations and Cerebrospinal Fluid (CSF) lactate level for Post-neurosurgical Bacterial Meningitis (PBM) at a large sample-size of post-neurosurgical patients. The diagnostic accuracies of routine blood examinations and CSF lactate level to distinguish between PAM and PBM were evaluated with the values of the Area Under the Curve of the Receiver Operating Characteristic (AUC -ROC ) by retrospectively analyzing the datasets of post-neurosurgical patients in the clinical information databases. The diagnostic accuracy of routine blood examinations was relatively low (AUC -ROC <0.7). The CSF lactate level achieved rather high diagnostic accuracy (AUC -ROC =0.891; CI 95%, 0.852-0.922). The variables of patient age, operation duration, surgical diagnosis and postoperative days (the interval days between the neurosurgery and examinations) were shown to affect the diagnostic accuracy of these examinations. The variables were integrated with routine blood examinations and CSF lactate level by Fisher discriminant analysis to improve their diagnostic accuracy. As a result, the diagnostic accuracy of blood examinations and CSF lactate level was significantly improved with an AUC -ROC value=0.760 (CI 95%, 0.737-0.782) and 0.921 (CI 95%, 0.887-0.948) respectively. The PBM diagnostic accuracy of routine blood examinations was relatively low, whereas the accuracy of CSF lactate level was high. Some variables that are involved in the incidence of PBM can also affect the diagnostic accuracy for PBM. Taking into account the effects of these variables significantly improves the diagnostic accuracies of routine blood examinations and CSF lactate level. Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.

Tumor necrosis factor receptor 1 (TNFRI) for ventilator-associated pneumonia diagnosis by cytokine multiplex analysis.

PubMed

Martin-Loeches, Ignacio; Bos, Lieuwe D; Povoa, Pedro; Ramirez, Paula; Schultz, Marcus J; Torres, Antoni; Artigas, Antonio

2015-12-01

The diagnosis of ventilator-associated pneumonia (VAP) is challenging. An important aspect to improve outcome is early recognition of VAP and the initiation of the appropriate empirical treatment. We hypothesized that biological markers in plasma can rule out VAP at the moment of clinical suspicion and could rule in VAP before the diagnosis can be made clinically. In this prospective study, patients with VAP (n = 24, microbiology confirmed) were compared to controls (n = 19) with a similar duration of mechanical ventilation. Blood samples from the day of VAP diagnosis and 1 and 3 days before were analyzed with a multiplex array for markers of inflammation, coagulation, and apoptosis. The best biomarker combination was selected and the diagnostic accuracy was given by the area under the receiver operating characteristic curve (ROC-AUC). TNF-receptor 1 (TNFRI) and granulocyte colony-stimulating factor (GCSF) were selected as optimal biomarkers at the day of VAP diagnosis, which resulted in a ROC-AUC of 0.96, with excellent sensitivity. Three days before the diagnosis TNFRI and plasminogen activator inhibitor-1 (PAI-1) levels in plasma predicted VAP with a ROC-AUC of 0.79. The slope of IL-10 and PAI-1 resulted in a ROC-AUC of 0.77. These biomarkers improved the classification of the clinical pulmonary infection score when combined. Concentration of TNFRI and PAI-1 and the slope of PAI-1 and IL-10 may be used to predict the development of VAP as early as 3 days before the diagnosis made clinically. TNFRI and GCSF may be used to exclude VAP at the moment of clinical suspicion. Especially TNFRI seems to be a promising marker for the prediction and diagnosis of VAP.

Pulse Oximetry for the Detection of Obstructive Sleep Apnea Syndrome: Can the Memory Capacity of Oxygen Saturation Influence Their Diagnostic Accuracy?

PubMed Central

Nigro, Carlos A.; Dibur, Eduardo; Rhodius, Edgardo

2011-01-01

Objective. To assess the diagnostic ability of WristOx 3100 using its three different recording settings in patients with suspected obstructive sleep apnea syndrome (OSAS). Methods. All participants (135) performed the oximetry (three oximeters WristOx 3100) and polysomnography (PSG) simultaneously in the sleep laboratory. Both recordings were interpreted blindly. Each oximeter was set to one of three different recording settings (memory capabilities 0.25, 0.5, and 1 Hz). The software (nVision 5.1) calculated the adjusted O2 desaturation index-mean number of O2 desaturation per hour of analyzed recording ≥2, 3, and 4% (ADI2, 3, and 4). The ADI2, 3, and 4 cutoff points that better discriminated between subjects with or without OSAS arose from the receiver-operator characteristics (ROCs) curve analysis. OSAS was defined as a respiratory disturbance index (RDI) ≥ 5. Results. 101 patients were included (77 men, mean age 52, median RDI 22.6, median BMI 27.4 kg/m2). The area under the ROCs curves (AUC-ROCs) of ADI2, 3, and 4 with different data storage rates were similar (AUC-ROCs with data storage rates of 0.25/0.5/1 Hz: ADI2: 0.958/0.948/0.965, ADI3: 0.961/0.95/0.966, and ADI4: 0.957/0.949/0.963, P NS). Conclusions. The ability of WristOx 3100 to detect patients with OSAS was not affected by the data storage rate of the oxygen saturation signal. Both memory capacity of 0.25, 0.5, or 1 Hz showed a similar performance for the diagnosis of OSAS. PMID:23471171

Exploring the utility of narrative analysis in diagnostic decision making: picture-bound reference, elaboration, and fetal alcohol spectrum disorders.

PubMed

Thorne, John C; Coggins, Truman E; Carmichael Olson, Heather; Astley, Susan J

2007-04-01

To evaluate classification accuracy and clinical feasibility of a narrative analysis tool for identifying children with a fetal alcohol spectrum disorder (FASD). Picture-elicited narratives generated by 16 age-matched pairs of school-aged children (FASD vs. typical development [TD]) were coded for semantic elaboration and reference strategy by judges who were unaware of age, gender, and group membership of the participants. Receiver operating characteristic (ROC) curves were used to examine the classification accuracy of the resulting set of narrative measures for making 2 classifications: (a) for the 16 children diagnosed with FASD, low performance (n = 7) versus average performance (n = 9) on a standardized expressive language task and (b) FASD (n = 16) versus TD (n = 16). Combining the rates of semantic elaboration and pragmatically inappropriate reference perfectly matched a classification based on performance on the standardized language task. More importantly, the rate of ambiguous nominal reference was highly accurate in classifying children with an FASD regardless of their performance on the standardized language task (area under the ROC curve = .863, confidence interval = .736-.991). Results support further study of the diagnostic utility of narrative analysis using discourse level measures of elaboration and children's strategic use of reference.

Mild pulmonary emphysema a risk factor for interstitial lung disease when using cetuximab for squamous cell carcinoma of the head and neck.

PubMed

Okamoto, Isaku; Tsukahara, Kiyoaki; Sato, Hiroki; Motohashi, Ray; Yunaiyama, Daisuke; Shimizu, Akira

2017-12-01

Interstitial lung disease (ILD) is an occasionally fatal adverse event associated with cetuximab (Cmab) therapy. Our objective was to clarify to what degree pulmonary emphysema is a risk factor in the treatment of head and neck cancer with Cmab through a retrospective analysis. Subjects were 116 patients who were administered Cmab for head and neck squamous cell carcinoma. The degree of pulmonary emphysema before initiating treatment with Cmab was visually assessed retrospectively, with scoring according to the Goddard classification used in Japanese chronic obstructive pulmonary disease (COPD) guidelines for chest computed tomography (CT). Scoring was conducted by two diagnostic radiologists and mean scores were used. Cutoffs for the development and nondevelopment of ILD were examined by receiver operating characteristic (ROC) analysis and Fisher's exact test. Values of p < .05 were considered to indicate a significant difference. Among the 116 patients, 11 (9.5%) developed ILD, and 105 (90.5%) did not. In ROC analysis, the optimal Goddard score cut-off of <3.0 offered 55% sensitivity and 81% specificity (p = .015). With a cutoff of <3.0, even very mild pulmonary emphysema would represent a risk factor for ILD when using Cmab.

Detection of tuberculosis patterns in digital photographs of chest X-ray images using Deep Learning: feasibility study.

PubMed

Becker, A S; Blüthgen, C; Phi van, V D; Sekaggya-Wiltshire, C; Castelnuovo, B; Kambugu, A; Fehr, J; Frauenfelder, T

2018-03-01

To evaluate the feasibility of Deep Learning-based detection and classification of pathological patterns in a set of digital photographs of chest X-ray (CXR) images of tuberculosis (TB) patients. In this prospective, observational study, patients with previously diagnosed TB were enrolled. Photographs of their CXRs were taken using a consumer-grade digital still camera. The images were stratified by pathological patterns into classes: cavity, consolidation, effusion, interstitial changes, miliary pattern or normal examination. Image analysis was performed with commercially available Deep Learning software in two steps. Pathological areas were first localised; detected areas were then classified. Detection was assessed using receiver operating characteristics (ROC) analysis, and classification using a confusion matrix. The study cohort was 138 patients with human immunodeficiency virus (HIV) and TB co-infection (median age 34 years, IQR 28-40); 54 patients were female. Localisation of pathological areas was excellent (area under the ROC curve 0.82). The software could perfectly distinguish pleural effusions from intraparenchymal changes. The most frequent misclassifications were consolidations as cavitations, and miliary patterns as interstitial patterns (and vice versa). Deep Learning analysis of CXR photographs is a promising tool. Further efforts are needed to build larger, high-quality data sets to achieve better diagnostic performance.

Bayesian modeling and inference for diagnostic accuracy and probability of disease based on multiple diagnostic biomarkers with and without a perfect reference standard.

PubMed

Jafarzadeh, S Reza; Johnson, Wesley O; Gardner, Ian A

2016-03-15

The area under the receiver operating characteristic (ROC) curve (AUC) is used as a performance metric for quantitative tests. Although multiple biomarkers may be available for diagnostic or screening purposes, diagnostic accuracy is often assessed individually rather than in combination. In this paper, we consider the interesting problem of combining multiple biomarkers for use in a single diagnostic criterion with the goal of improving the diagnostic accuracy above that of an individual biomarker. The diagnostic criterion created from multiple biomarkers is based on the predictive probability of disease, conditional on given multiple biomarker outcomes. If the computed predictive probability exceeds a specified cutoff, the corresponding subject is allocated as 'diseased'. This defines a standard diagnostic criterion that has its own ROC curve, namely, the combined ROC (cROC). The AUC metric for cROC, namely, the combined AUC (cAUC), is used to compare the predictive criterion based on multiple biomarkers to one based on fewer biomarkers. A multivariate random-effects model is proposed for modeling multiple normally distributed dependent scores. Bayesian methods for estimating ROC curves and corresponding (marginal) AUCs are developed when a perfect reference standard is not available. In addition, cAUCs are computed to compare the accuracy of different combinations of biomarkers for diagnosis. The methods are evaluated using simulations and are applied to data for Johne's disease (paratuberculosis) in cattle. Copyright © 2015 John Wiley & Sons, Ltd.

Investigating strength and frequency effects in recognition memory using type-2 signal detection theory.

PubMed

Higham, Philip A; Perfect, Timothy J; Bruno, Davide

2009-01-01

Criterion- versus distribution-shift accounts of frequency and strength effects in recognition memory were investigated with Type-2 signal detection receiver operating characteristic (ROC) analysis, which provides a measure of metacognitive monitoring. Experiment 1 demonstrated a frequency-based mirror effect, with a higher hit rate and lower false alarm rate, for low frequency words compared with high frequency words. In Experiment 2, the authors manipulated item strength with repetition, which showed an increased hit rate but no effect on the false alarm rate. Whereas Type-1 indices were ambiguous as to whether these effects were based on a criterion- or distribution-shift model, the two models predict opposite effects on Type-2 distractor monitoring under some assumptions. Hence, Type-2 ROC analysis discriminated between potential models of recognition that could not be discriminated using Type-1 indices alone. In Experiment 3, the authors manipulated Type-1 response bias by varying the number of old versus new response categories to confirm the assumptions made in Experiments 1 and 2. The authors conclude that Type-2 analyses are a useful tool for investigating recognition memory when used in conjunction with more traditional Type-1 analyses.

Associations Among Indicators of Depression in Medicaid-Eligible Community-Dwelling Older Adults

PubMed Central

Byma, Elizabeth A.

2013-01-01

Purpose: The purpose of this research was to examine associations among 2 separate Minimum Data Set-Home Care (MDS-HC) depression measures (the Depression Rating Scale [DRS] and medical diagnosis of depression) with billed antidepressant medications in Medicaid paid claim files. Design and Methods: The sample for this cross-sectional research included 3,041 Medicaid-eligible older adult participants in a Home and Community Based Waiver Program and used data from the MDS-HC, Version 1 and Medicaid Paid Claim Files. Sensitivity and specificity analyses, receiver operating characteristic (ROC) curve analysis, and t tests were utilized. Results: DRS scoring indicated that 15.4% of participants had behaviors indicative of depression, whereas 42% had a medical diagnosis of depression noted in the MDS-HC. Of those with a medical diagnosis of depression, 51% had a prescribed antidepressant medication. ROC analysis suggested that the DRS was a poor distinguisher of participants with and without a medical diagnosis of depression or prescribed antidepressant medications. Implications: Approximately half of Medicaid-eligible older adults medically diagnosed with depression were treated pharmacologically. Longitudinal research is recommended to assess responsiveness of the DRS over time to pharmacological and psychotherapeutic interventions for depression. PMID:23103523

On determining the most appropriate test cut-off value: the case of tests with continuous results

PubMed Central

Habibzadeh, Parham; Yadollahie, Mahboobeh

2016-01-01

There are several criteria for determination of the most appropriate cut-off value in a diagnostic test with continuous results. Mostly based on receiver operating characteristic (ROC) analysis, there are various methods to determine the test cut-off value. The most common criteria are the point on ROC curve where the sensitivity and specificity of the test are equal; the point on the curve with minimum distance from the left-upper corner of the unit square; and the point where the Youden’s index is maximum. There are also methods mainly based on Bayesian decision analysis. Herein, we show that a proposed method that maximizes the weighted number needed to misdiagnose, an index of diagnostic test effectiveness we previously proposed, is the most appropriate technique compared to the aforementioned ones. For determination of the cut-off value, we need to know the pretest probability of the disease of interest as well as the costs incurred by misdiagnosis. This means that even for a certain diagnostic test, the cut-off value is not universal and should be determined for each region and for each disease condition. PMID:27812299

Lipid accumulation product is related to metabolic syndrome in women with polycystic ovary syndrome.

PubMed

Xiang, S; Hua, F; Chen, L; Tang, Y; Jiang, X; Liu, Z

2013-02-01

Metabolic disturbances are common features of polycystic ovary syndrome (PCOS), which possibly enhance the risk of diabetes and cardiovascular disease. Lipid accumulation product (LAP) is an emerging cardiovascular risk factor. The aim of this study was to explore the ability of LAP to identify metabolic syndrome (MS) in PCOS women. In a cross-sectional study, anthropometric, biochemical and clinical parameters were measured in 105 PCOS women. Receiver operating characteristic (ROC) analysis was used to find out the cut-off points of LAP to predict MS. MS was categorized according to International Diabetes Federation (IDF) criteria. The prevalence of MS was 43.8% in this study. PCOS women with MS had significantly higher LAP levels compared to those without MS. LAP was highly correlated with components of MS. ROC analysis showed that LAP was a significant discriminator for MS in PCOS women, and the optimal cutoff point of LAP to predict MS was 54.2 (93.3% sensitivity, 96.7% specificity). LAP seems to be associated with MS and has a strong and reliable diagnostic accuracy for MS in PCOS women. © J. A. Barth Verlag in Georg Thieme Verlag KG Stuttgart · New York.

Identification of Serum Periostin as a Potential Diagnostic and Prognostic Marker for Colorectal Cancer.

PubMed

Dong, Dong; Zhang, Lufang; Jia, Li; Ji, Wei; Wang, Zhiyong; Ren, Li; Niu, Ruifang; Zhou, Yunli

2018-06-01

Periostin (POSTN) plays an important role in numerous cancers, especially in gastrointestinal malignancy. The objective of this study was to investigate the diagnostic and prognostic role of serum POSTN in colorectal cancer (CRC). Serum periostin, together with CEA, CA19.9, CA72.4, and CA242 levels were measured in samples from 108 patients with CRC and 56 healthy controls, and their correlation with clinical characteristics was further analyzed. Receiver operating curves (ROC), Kaplan-Meier curves, and log-rank analyses were used to evaluate diagnostic and prognostic significance. Serum POSTN levels were significantly higher in patients with CRC compared with healthy controls (p < 0.0001) and associated with clinical stages (p < 0.001). ROC analysis revealed that POSTN was a biomarker comparable to CEA, CA19.9, and CA72.4 to distinguish all CRC from healthy controls (AUC = 0.75). Moreover, POSTN retained its diagnostic ability for CEA-negative (AUC = 0.69) and CA19.9-negative CRC patients (AUC = 0.71). Survival analysis revealed that patients with lower serum POSTN had longer overall survival than those with high serum POSTN (p = 0.0146). Serum POSTN might be a novel diagnostic and prognostic biomarker for patients with CRC.

Recollection, not familiarity, decreases in healthy aging: Converging evidence from four estimation methods

PubMed Central

Koen, Joshua D.; Yonelinas, Andrew P.

2014-01-01

Although it is generally accepted that aging is associated with recollection impairments, there is considerable disagreement surrounding how healthy aging influences familiarity-based recognition. One factor that might contribute to the mixed findings regarding age differences in familiarity is the estimation method used to quantify the two mnemonic processes. Here, this issue is examined by having a group of older adults (N = 39) between 40 and 81 years of age complete Remember/Know (RK), receiver operating characteristic (ROC), and process dissociation (PD) recognition tests. Estimates of recollection, but not familiarity, showed a significant negative correlation with chronological age. Inconsistent with previous findings, the estimation method did not moderate the relationship between age and estimations of recollection and familiarity. In a final analysis, recollection and familiarity were estimated as latent factors in a confirmatory factor analysis (CFA) that modeled the covariance between measures of free recall and recognition, and the results converged with the results from the RK, PD, and ROC tasks. These results are consistent with the hypothesis that episodic memory declines in older adults are primary driven by recollection deficits, and also suggest that the estimation method plays little to no role in age-related decreases in familiarity. PMID:25485974

Extent of agreement between the body fluid model of Sysmex XN-20 and the manual microscopy method.

PubMed

Huang, Wei-Hua; Lu, Lin-Peng; Wu, Kang; Guo, Fang-Yu; Guo, Jie; Yu, Jing-Long; Zhou, Dao-Yin; Sun, Yi; Deng, An-Mei

2017-09-01

Although the correlations concerning cellular component analysis between the Sysmex XN-20 body fluid (BF) model and manual microscopy have been investigated by several studies, the extent of agreement between these two methods has not been investigated. A total of 90 BF samples were prospectively collected and analyzed using the Sysmex XN-20 BF model and microscopy. The extent of agreement between these two methods was evaluated using the Bland-Altman approach. Receiver operating characteristic (ROC) curve analysis was employed to evaluate the diagnostic accuracy of high-fluorescence (HF) BF cells for malignant diseases. The agreements of white blood cell (WBC), red blood cell (RBC), and percentages of neutrophils, lymphocytes, and monocytes between the Sysmex XN-20 BF model and manual microscopy were imperfect. The areas under the ROC curves for absolute and relative HF cells were 0.67 (95% confidence interval [CI]: 0.56-0.78) and 0.60 (95% CI: 0.48-0.72), respectively. Due to the Sysmex XN-20 BF model's imperfect agreement with manual microscopy and its weak diagnostic accuracy for malignant diseases, the current evidence does not support replacing manual microscopy with this model in clinical practice. © 2016 Wiley Periodicals, Inc.

Diagnostic performance of FDG PET or PET/CT in prosthetic infection after arthroplasty: a meta-analysis.

PubMed

Jin, H; Yuan, L; Li, C; Kan, Y; Hao, R; Yang, J

2014-03-01

The purpose of this study was to systematically review and perform a meta-analysis of published data regarding the diagnostic performance of positron emission tomography (PET) or PET/computed tomography (PET/CT) in prosthetic infection after arthroplasty. A comprehensive computer literature search of studies published through May 31, 2012 regarding PET or PET/CT in patients suspicious of prosthetic infection was performed in PubMed/MEDLINE, Embase and Scopus databases. Pooled sensitivity and specificity of PET or PET/CT in patients suspicious of prosthetic infection on a per prosthesis-based analysis were calculated. The area under the receiver-operating characteristic (ROC) curve was calculated to measure the accuracy of PET or PET/CT in patients with suspicious of prosthetic infection. Fourteen studies comprising 838 prosthesis with suspicious of prosthetic infection after arthroplasty were included in this meta-analysis. The pooled sensitivity of PET or PET/CT in detecting prosthetic infection was 86% (95% confidence interval [CI] 82-90%) on a per prosthesis-based analysis. The pooled specificity of PET or PET/CT in detecting prosthetic infection was 86% (95% CI 83-89%) on a per prosthesis-based analysis. The area under the ROC curve was 0.93 on a per prosthesis-based analysis. In patients suspicious of prosthetic infection, FDG PET or PET/CT demonstrated high sensitivity and specificity. FDG PET or PET/CT are accurate methods in this setting. Nevertheless, possible sources of false positive results and influcing factors should kept in mind.

External validation of the ability of the DRAGON score to predict outcome after thrombolysis treatment.

PubMed

Ovesen, C; Christensen, A; Nielsen, J K; Christensen, H

2013-11-01

Easy-to-perform and valid assessment scales for the effect of thrombolysis are essential in hyperacute stroke settings. Because of this we performed an external validation of the DRAGON scale proposed by Strbian et al. in a Danish cohort. All patients treated with intravenous recombinant plasminogen activator between 2009 and 2011 were included. Upon admission all patients underwent physical and neurological examination using the National Institutes of Health Stroke Scale along with non-contrast CT scans and CT angiography. Patients were followed up through the Outpatient Clinic and their modified Rankin Scale (mRS) was assessed after 3 months. Three hundred and three patients were included in the analysis. The DRAGON scale proved to have a good discriminative ability for predicting highly unfavourable outcome (mRS 5-6) (area under the curve-receiver operating characteristic [AUC-ROC]: 0.89; 95% confidence interval [CI] 0.81-0.96; p<0.001) and good outcome (mRS 0-2) (AUC-ROC: 0.79; 95% CI 0.73-0.85; p<0.001). When only patients with M1 occlusions were selected the DRAGON scale provided good discriminative capability (AUC-ROC: 0.89; 95% CI 0.78-1.0; p=0.003) for highly unfavourable outcome. We confirmed the validity of the DRAGON scale in predicting outcome after thrombolysis treatment. Copyright © 2013 Elsevier Ltd. All rights reserved.

Cerebrospinal fluid cytokines in the diagnosis of bacterial meningitis in infants.

PubMed

Srinivasan, Lakshmi; Kilpatrick, Laurie; Shah, Samir S; Abbasi, Soraya; Harris, Mary C

2016-10-01

Bacterial meningitis poses diagnostic challenges in infants. Antibiotic pretreatment and low bacterial density diminish cerebrospinal fluid (CSF) culture yield, while laboratory parameters do not reliably identify bacterial meningitis. Pro and anti-inflammatory cytokines are elevated in bacterial meningitis and may be useful diagnostic adjuncts when CSF cultures are negative. In a prospective cohort study of infants, we used cytometric bead arrays to measure tumor necrosis factor alpha (TNF-α), interleukin 1 (IL-1), IL-6, IL-8, IL-10, and IL-12 in CSF. Receiver operating characteristic (ROC) analyses and Principal component analysis (PCA) were used to determine cytokine combinations that identified bacterial meningitis. Six hundred and eighty four infants < 6 mo were included; 11 had culture-proven bacterial meningitis. IL-6 and IL-10 were the individual cytokines possessing greatest accuracy in diagnosis of culture proven bacterial meningitis (ROC analyses; area under the concentration-time curve (AUC) 0.91; 0.9103 respectively), and performed as well as, or better than combinations identified using ROC and PCA. CSF cytokines were highly correlated with each other and with CSF white blood cell count (WBC) counts in infants with meningitis. A subset of antibiotic pretreated culture-negative subjects demonstrated cytokine patterns similar to culture positive subjects. CSF cytokine levels may aid diagnosis of bacterial meningitis, and facilitate decision-making regarding treatment for culture negative meningitis.

Significance of MPEG-7 textural features for improved mass detection in mammography.

PubMed

Eltonsy, Nevine H; Tourassi, Georgia D; Fadeev, Aleksey; Elmaghraby, Adel S

2006-01-01

The purpose of the study is to investigate the significance of MPEG-7 textural features for improving the detection of masses in screening mammograms. The detection scheme was originally based on morphological directional neighborhood features extracted from mammographic regions of interest (ROIs). Receiver Operating Characteristics (ROC) was performed to evaluate the performance of each set of features independently and merged into a back-propagation artificial neural network (BPANN) using the leave-one-out sampling scheme (LOOSS). The study was based on a database of 668 mammographic ROIs (340 depicting cancer regions and 328 depicting normal parenchyma). Overall, the ROC area index of the BPANN using the directional morphological features was Az=0.85+/-0.01. The MPEG-7 edge histogram descriptor-based BPNN showed an ROC area index of Az=0.71+/-0.01 while homogeneous textural descriptors using 30 and 120 channels helped the BPNN achieve similar ROC area indexes of Az=0.882+/-0.02 and Az=0.877+/-0.01 respectively. After merging the MPEG-7 homogeneous textural features with the directional neighborhood features the performance of the BPANN increased providing an ROC area index of Az=0.91+/-0.01. MPEG-7 homogeneous textural descriptor significantly improved the morphology-based detection scheme.

Sensitivity and specificity of machine learning classifiers and spectral domain OCT for the diagnosis of glaucoma.

PubMed

Vidotti, Vanessa G; Costa, Vital P; Silva, Fabrício R; Resende, Graziela M; Cremasco, Fernanda; Dias, Marcelo; Gomi, Edson S

2012-06-15

Purpose. To investigate the sensitivity and specificity of machine learning classifiers (MLC) and spectral domain optical coherence tomography (SD-OCT) for the diagnosis of glaucoma. Methods. Sixty-two patients with early to moderate glaucomatous visual field damage and 48 healthy individuals were included. All subjects underwent a complete ophthalmologic examination, achromatic standard automated perimetry, and RNFL imaging with SD-OCT (Cirrus HD-OCT; Carl Zeiss Meditec, Inc., Dublin, California, USA). Receiver operating characteristic (ROC) curves were obtained for all SD-OCT parameters. Subsequently, the following MLCs were tested: Classification Tree (CTREE), Random Forest (RAN), Bagging (BAG), AdaBoost M1 (ADA), Ensemble Selection (ENS), Multilayer Perceptron (MLP), Radial Basis Function (RBF), Naive-Bayes (NB), and Support Vector Machine (SVM). Areas under the ROC curves (aROCs) obtained for each parameter and each MLC were compared. Results. The mean age was 57.0±9.2 years for healthy individuals and 59.9±9.0 years for glaucoma patients (p=0.103). Mean deviation values were -4.1±2.4 dB for glaucoma patients and -1.5±1.6 dB for healthy individuals (p<0.001). The SD-OCT parameters with the greater aROCs were inferior quadrant (0.813), average thickness (0.807), 7 o'clock position (0.765), and 6 o'clock position (0.754). The aROCs from classifiers varied from 0.785 (ADA) to 0.818 (BAG). The aROC obtained with BAG was not significantly different from the aROC obtained with the best single SD-OCT parameter (p=0.93). Conclusions. The SD-OCT showed good diagnostic accuracy in a group of patients with early glaucoma. In this series, MLCs did not improve the sensitivity and specificity of SD-OCT for the diagnosis of glaucoma.

NASA Ares I Launch Vehicle First Stage Roll Control System Cold Flow Development Test Program Overview

NASA Technical Reports Server (NTRS)

Butt, Adam; Popp, Christopher G.; Holt, Kimberly A.; Pitts, Hank M.

2010-01-01

The Ares I launch vehicle is the selected design, chosen to return humans to the moon, Mars, and beyond. It is configured in two inline stages: the First Stage is a Space Shuttle derived five-segment Solid Rocket Booster and the Upper Stage is powered by a Saturn V derived J-2X engine. During launch, roll control for the First Stage (FS) is handled by a dedicated Roll Control System (RoCS) located on the connecting Interstage. That system will provide the Ares I with the ability to counteract induced roll torque while any induced yaw or pitch moments are handled by vectoring of the booster nozzle. This paper provides an overview of NASA s Ares I FS RoCS cold flow development test program including detailed test objectives, types of tests run to meet those objectives, an overview of the results, and applicable lessons learned. The test article was built and tested at the NASA Marshall Space Flight Center in Huntsville, AL. The FS RoCS System Development Test Article (SDTA) is a full scale, flight representative water flow test article whose primary objective was to obtain fluid system performance data to evaluate integrated system level performance characteristics and verify analytical models. Development testing and model correlation was deemed necessary as there is little historical precedent for similar large flow, pulsing systems such as the FS RoCS. The cold flow development test program consisted of flight-similar tanks, pressure regulators, and thruster valves, as well as plumbing simulating flight geometries, combined with other facility grade components and structure. Orifices downstream of the thruster valves were used to simulate the pressure drop through the thrusters. Additional primary objectives of this test program were to: evaluate system surge pressure (waterhammer) characteristics due to thruster valve operation over a range of mission duty cycles at various feed system pressures, evaluate temperature transients and heat transfer in the pressurization system, including regulator blowdown and propellant ullage performance, measure system pressure drops for comparison to analysis of tubing and components, and validate system activation and re-activation procedures for the helium pressurant system. Secondary objectives included: validating system processes for loading, unloading, and purging, validating procedures and system response for multiple failure scenarios, including relief valve operation, and evaluating system performance for contingency scenarios. The test results of the cold flow development test program are essential in validating the performance and interaction of the Roll Control System and anchoring analysis tools and results to a Critical Design Review level of fidelity.

The impact of faceplate surface characteristics on detection of pulmonary nodules

NASA Astrophysics Data System (ADS)

Toomey, R. J.; Ryan, J. T.; McEntee, M. F.; McNulty, J.; Evanoff, M. G.; Cuffe, F.; Yoneda, T.; Stowe, J.; Brennan, P. C.

2009-02-01

Introduction In order to prevent specular reflections, many monitor faceplates have features such as tiny dimples on their surface to diffuse ambient light incident on the monitor, however, this "anti-glare" surface may also diffuse the image itself. The purpose of the study was to determine whether the surface characteristics of monitor faceplates influence the detection of pulmonary nodules under low and high ambient lighting conditions. Methods and Materials Separate observer performance studies were conducted at each of two light levels (<1 lux and >250 lux). Twelve examining radiologists with the American Board of Radiology participated in the darker condition and eleven in the brighter condition. All observers read on both smooth "glare" and dimpled "anti-glare" faceplates in a single lighting condition. A counterbalanced methodology was utilized to minimise memory effects. In each reading, observers were presented with thirty chest images in random order, of which half contained a single simulated pulmonary nodule. They were asked to give their confidence that each image did or did not contain a nodule and to mark the suspicious location. ROC analysis was applied to resultant data. Results No statistically significant differences were seen in the trapezoidal area under the ROC curve (AUC), sensitivity, specificity or average time per case at either light level for chest specialists or radiologists from other specialities. Conclusion The characteristics of the faceplate surfaces do not appear to affect detection of pulmonary nodules. Further work into other image types is being conducted.

Multiparametric voxel-based analyses of standardized uptake values and apparent diffusion coefficients of soft-tissue tumours with a positron emission tomography/magnetic resonance system: Preliminary results.

PubMed

Sagiyama, Koji; Watanabe, Yuji; Kamei, Ryotaro; Hong, Sungtak; Kawanami, Satoshi; Matsumoto, Yoshihiro; Honda, Hiroshi

2017-12-01

To investigate the usefulness of voxel-based analysis of standardized uptake values (SUVs) and apparent diffusion coefficients (ADCs) for evaluating soft-tissue tumour malignancy with a PET/MR system. Thirty-five subjects with either ten low/intermediate-grade tumours or 25 high-grade tumours were prospectively enrolled. Zoomed diffusion-weighted and fluorodeoxyglucose ( 18 FDG)-PET images were acquired along with fat-suppressed T2-weighted images (FST2WIs). Regions of interest (ROIs) were drawn on FST2WIs including the tumour in all slices. ROIs were pasted onto PET and ADC-maps to measure SUVs and ADCs within tumour ROIs. Tumour volume, SUVmax, ADCminimum, the heterogeneity and the correlation coefficients of SUV and ADC were recorded. The parameters of high- and low/intermediate-grade groups were compared, and receiver operating characteristic (ROC) analysis was also performed. The mean correlation coefficient for SUV and ADC in high-grade sarcomas was lower than that of low/intermediate-grade tumours (-0.41 ± 0.25 vs. -0.08 ± 0.34, P < 0.01). Other parameters did not differ significantly. ROC analysis demonstrated that correlation coefficient showed the best diagnostic performance for differentiating the two groups (AUC 0.79, sensitivity 96.0%, specificity 60%, accuracy 85.7%). SUV and ADC determined via PET/MR may be useful for differentiating between high-grade and low/intermediate-grade soft tissue tumours. • PET/MR allows voxel-based comparison of SUVs and ADCs in soft-tissue tumours. • A comprehensive assessment of internal heterogeneity was performed with scatter plots. • SUVmax or ADCminimum could not differentiate high-grade sarcoma from low/intermediate-grade tumours. • Only the correlation coefficient between SUV and ADC differentiated the two groups. • The correlation coefficient showed the best diagnostic performance by ROC analysis.

Prognostic subgroups for remission and response in the Coordinated Anxiety Learning and Management (CALM) trial.

PubMed

Kelly, J MacLaren; Jakubovski, Ewgeni; Bloch, Michael H

2015-03-01

Most patients with anxiety disorders receive treatment in primary care settings. Limited moderator data are available to inform clinicians of likely prognostic outcomes for individual patients. We identify baseline characteristics associated with outcome in adults seeking treatment for anxiety disorders. We conducted an exploratory moderator analysis from the Coordinated Anxiety Learning and Management (CALM) trial. In the CALM trial, 1,004 adults who met DSM-IV criteria for generalized anxiety disorder (GAD), panic disorder, social anxiety disorder, and/or posttraumatic stress disorder (PTSD) were randomized to usual care (UC) or a collaborative care intervention (ITV) of cognitive-behavioral therapy and/or pharmacotherapy between June 2006 and April 2008. Logistic regression was used to examine baseline characteristics associated with remission and response overall and by treatment condition. Receiver operating curve (ROC) analyses identified subgroups associated with similar likelihood of response and remission of global anxiety symptoms. Remission was defined as score < 6 on the 12-item Brief Symptom Inventory (BSI-12) anxiety and somatization subscales. Response was defined as at least 50% reduction on BSI-12, or meeting remission criteria. Randomization to ITV over UC was often the strongest predictor of outcome. Several baseline patient characteristics were associated with poor treatment outcome including comorbid depression, increased severity of underlying anxiety disorder(s) (P < .001), low socioeconomic status (perceived [P < .001] and actual [P < .05]), and limited social support (P < .001). Patient characteristics associated with particular benefit from ITV were being female (P < .05), increased depression (P < .01)/GAD severity (P < .05), and low socioeconomic status (P < .05). ROC analysis demonstrated prognostic subgroups with large differences in response likelihood. Further research should focus on the effectiveness of implementing the ITV intervention of CALM in community treatment centers where patients typically are of low socioeconomic status and may particularly benefit from ITV. ClinicalTrials.gov identifier: NCT00347269. © Copyright 2015 Physicians Postgraduate Press, Inc.

Initial Validation of a Comprehensive Assessment Instrument for Bereavement-Related Grief Symptoms and Risk of Complications: The Indicator of Bereavement Adaptation—Cruse Scotland (IBACS)

PubMed Central

Schut, Henk; Stroebe, Margaret S.; Wilson, Stewart; Birrell, John

2016-01-01

Objective This study assessed the validity of the Indicator of Bereavement Adaptation Cruse Scotland (IBACS). Designed for use in clinical and non-clinical settings, the IBACS measures severity of grief symptoms and risk of developing complications. Method N = 196 (44 male, 152 female) help-seeking, bereaved Scottish adults participated at two timepoints: T1 (baseline) and T2 (after 18 months). Four validated assessment instruments were administered: CORE-R, ICG-R, IES-R, SCL-90-R. Discriminative ability was assessed using ROC curve analysis. Concurrent validity was tested through correlation analysis at T1. Predictive validity was assessed using correlation analyses and ROC curve analysis. Optimal IBACS cutoff values were obtained by calculating a maximal Youden index J in ROC curve analysis. Clinical implications were compared across instruments. Results ROC curve analysis results (AUC = .84, p < .01, 95% CI between .77 and .90) indicated the IBACS is a good diagnostic instrument for assessing complicated grief. Positive correlations (p < .01, 2-tailed) with all four instruments at T1 demonstrated the IBACS' concurrent validity, strongest with complicated grief measures (r = .82). Predictive validity was shown to be fair in T2 ROC curve analysis results (n = 67, AUC = .78, 95% CI between .65 and .92; p < .01). Predictive validity was also supported by stable positive correlations between IBACS and other instruments at T2. Clinical indications were found not to differ across instruments. Conclusions The IBACS offers effective grief symptom and risk assessment for use by non-clinicians. Indications are sufficient to support intake assessment for a stepped model of bereavement intervention. PMID:27741246

Describing three-class task performance: three-class linear discriminant analysis and three-class ROC analysis

NASA Astrophysics Data System (ADS)

He, Xin; Frey, Eric C.

2007-03-01

Binary ROC analysis has solid decision-theoretic foundations and a close relationship to linear discriminant analysis (LDA). In particular, for the case of Gaussian equal covariance input data, the area under the ROC curve (AUC) value has a direct relationship to the Hotelling trace. Many attempts have been made to extend binary classification methods to multi-class. For example, Fukunaga extended binary LDA to obtain multi-class LDA, which uses the multi-class Hotelling trace as a figure-of-merit, and we have previously developed a three-class ROC analysis method. This work explores the relationship between conventional multi-class LDA and three-class ROC analysis. First, we developed a linear observer, the three-class Hotelling observer (3-HO). For Gaussian equal covariance data, the 3- HO provides equivalent performance to the three-class ideal observer and, under less strict conditions, maximizes the signal to noise ratio for classification of all pairs of the three classes simultaneously. The 3-HO templates are not the eigenvectors obtained from multi-class LDA. Second, we show that the three-class Hotelling trace, which is the figureof- merit in the conventional three-class extension of LDA, has significant limitations. Third, we demonstrate that, under certain conditions, there is a linear relationship between the eigenvectors obtained from multi-class LDA and 3-HO templates. We conclude that the 3-HO based on decision theory has advantages both in its decision theoretic background and in the usefulness of its figure-of-merit. Additionally, there exists the possibility of interpreting the two linear features extracted by the conventional extension of LDA from a decision theoretic point of view.

Voice-onset time and buzz-onset time identification: A ROC analysis

NASA Astrophysics Data System (ADS)

Lopez-Bascuas, Luis E.; Rosner, Burton S.; Garcia-Albea, Jose E.

2004-05-01

Previous studies have employed signal detection theory to analyze data from speech and nonspeech experiments. Typically, signal distributions were assumed to be Gaussian. Schouten and van Hessen [J. Acoust. Soc. Am. 104, 2980-2990 (1998)] explicitly tested this assumption for an intensity continuum and a speech continuum. They measured response distributions directly and, assuming an interval scale, concluded that the Gaussian assumption held for both continua. However, Pastore and Macmillan [J. Acoust. Soc. Am. 111, 2432 (2002)] applied ROC analysis to Schouten and van Hessen's data, assuming only an ordinal scale. Their ROC curves suppported the Gaussian assumption for the nonspeech signals only. Previously, Lopez-Bascuas [Proc. Audit. Bas. Speech Percept., 158-161 (1997)] found evidence with a rating scale procedure that the Gaussian model was inadequate for a voice-onset time continuum but not for a noise-buzz continuum. Both continua contained ten stimuli with asynchronies ranging from -35 ms to +55 ms. ROC curves (double-probability plots) are now reported for each pair of adjacent stimuli on the two continua. Both speech and nonspeech ROCs often appeared nonlinear, indicating non-Gaussian signal distributions under the usual zero-variance assumption for response criteria.

Application of texture analysis method for classification of benign and malignant thyroid nodules in ultrasound images.

PubMed

Abbasian Ardakani, Ali; Gharbali, Akbar; Mohammadi, Afshin

2015-01-01

The aim of this study was to evaluate computer aided diagnosis (CAD) system with texture analysis (TA) to improve radiologists' accuracy in identification of thyroid nodules as malignant or benign. A total of 70 cases (26 benign and 44 malignant) were analyzed in this study. We extracted up to 270 statistical texture features as a descriptor for each selected region of interests (ROIs) in three normalization schemes (default, 3s and 1%-99%). Then features by the lowest probability of classification error and average correlation coefficients (POE+ACC), and Fisher coefficient (Fisher) eliminated to 10 best and most effective features. These features were analyzed under standard and nonstandard states. For TA of the thyroid nodules, Principle Component Analysis (PCA), Linear Discriminant Analysis (LDA) and Non-Linear Discriminant Analysis (NDA) were applied. First Nearest-Neighbour (1-NN) classifier was performed for the features resulting from PCA and LDA. NDA features were classified by artificial neural network (A-NN). Receiver operating characteristic (ROC) curve analysis was used for examining the performance of TA methods. The best results were driven in 1-99% normalization with features extracted by POE+ACC algorithm and analyzed by NDA with the area under the ROC curve ( Az) of 0.9722 which correspond to sensitivity of 94.45%, specificity of 100%, and accuracy of 97.14%. Our results indicate that TA is a reliable method, can provide useful information help radiologist in detection and classification of benign and malignant thyroid nodules.

On the meaning of the weighted alternative free-response operating characteristic figure of merit.

PubMed

Chakraborty, Dev P; Zhai, Xuetong

2016-05-01

The free-response receiver operating characteristic (FROC) method is being increasingly used to evaluate observer performance in search tasks. Data analysis requires definition of a figure of merit (FOM) quantifying performance. While a number of FOMs have been proposed, the recommended one, namely, the weighted alternative FROC (wAFROC) FOM, is not well understood. The aim of this work is to clarify the meaning of this FOM by relating it to the empirical area under a proposed wAFROC curve. The weighted wAFROC FOM is defined in terms of a quasi-Wilcoxon statistic that involves weights, coding the clinical importance, assigned to each lesion. A new wAFROC curve is proposed, the y-axis of which incorporates the weights, giving more credit for marking clinically important lesions, while the x-axis is identical to that of the AFROC curve. An expression is derived relating the area under the empirical wAFROC curve to the wAFROC FOM. Examples are presented with small numbers of cases showing how AFROC and wAFROC curves are affected by correct and incorrect decisions and how the corresponding FOMs credit or penalize these decisions. The wAFROC, AFROC, and inferred ROC FOMs were applied to three clinical data sets involving multiple reader FROC interpretations in different modalities. It is shown analytically that the area under the empirical wAFROC curve equals the wAFROC FOM. This theorem is the FROC analog of a well-known theorem developed in 1975 for ROC analysis, which gave meaning to a Wilcoxon statistic based ROC FOM. A similar equivalence applies between the area under the empirical AFROC curve and the AFROC FOM. The examples show explicitly that the wAFROC FOM gives equal importance to all diseased cases, regardless of the number of lesions, a desirable statistical property not shared by the AFROC FOM. Applications to the clinical data sets show that the wAFROC FOM yields results comparable to that using the AFROC FOM. The equivalence theorem gives meaning to the weighted AFROC FOM, namely, it is identical to the empirical area under weighted AFROC curve.

Responsiveness of two Persian-versions of shoulder outcome measures following physiotherapy intervention in patients with shoulder disorders.

PubMed

Negahban, Hossein; Behtash, Zeinab; Sohani, Soheil Mansour; Salehi, Reza

2015-01-01

To identify the ability of the Persian-version of the Shoulder Pain and Disability Index (SPADI) and the Disabilities of the Arm, Shoulder, and Hand (DASH) to detect changes in shoulder function following physiotherapy intervention (i.e. responsiveness) and to determine the change score that indicates a meaningful change in functional ability of the patient (i.e. Minimally Clinically Important Difference (MCID)). A convenient sample of 200 Persian-speaking patients with shoulder disorders completed the SPADI and the DASH at baseline and then again 4 weeks after physiotherapy intervention. Furthermore, patients were asked to rate their global rating of shoulder function at follow-up. The responsiveness was evaluated using two methods: the receiver operating characteristics (ROC) method and the correlation analysis. Two useful statistics extracted from the ROC method are the area under curve (AUC) and the optimal cutoff point called as MCID. Both the SPADI and the DASH showed the AUC of greater than 0.70 (AUC ranges = 0.77-0.82). The best cutoff points (or change scores) for the SPADI-total, SPADI-pain, SPADI-disability and the DASH were 14.88, 26.36, 23.86, and 25.41, respectively. Additionally, moderate to good correlations (Gamma = -0.51 to -0.58) were found between the changes in SPADI/DASH and changes in global rating scale. The Persian SPADI and DASH have adequate responsiveness to clinical changes in patients with shoulder disorders. Moreover, the MCIDs obtained in this study will help the clinicians and researchers to determine if a Persian-speaking patient with shoulder disorder has experienced a true change following a physiotherapy intervention. Implications for Rehabilitation Responsiveness was evaluated using two methods; the receiver operating characteristics (ROC) method and the correlation analysis. The Persian SPADI and DASH can be used as two responsive instruments in both clinical practice and research settings. The MCIDs of 14.88 and 25.41 points obtained for the SPADI-total and DASH indicated that the change scores of at least 14.88 points on the SPADI-total and 25.41 points on the DASH is necessary to certain that a true change has occurred following a physiotherapy intervention.

Exhaled gases online measurements for esophageal cancer patients and healthy people by proton transfer reaction mass spectrometry.

PubMed

Zou, Xue; Zhou, Wenzhao; Lu, Yan; Shen, Chengyin; Hu, Zongtao; Wang, Hongzhi; Jiang, Haihe; Chu, Yannan

2016-11-01

Esophageal cancer is a prevalent malignancy. There is a considerable demand for developing a fast and noninvasive method to screen out the suspect esophageal cancer patients who may undergo further clinical diagnosis. The exhaled breathes from 29 esophageal cancer patients and 57 healthy people were directly measured using our home-made proton transfer reaction mass spectrometer (PTR-MS). Mann-Whitney U test and stepwise discriminant analysis were applied to identify the ions in the breath mass spectral data which can distinguish cancer cohort from healthy group. Receiver operating characteristics (ROC) analysis was also performed. Seven kinds of ions in the breath mass spectrum, viz., m/z 136, m/z 34, m/z 63, m/z 27, m/z 95, m/z 107 and m/z 45, have been found to distinguish between the esophageal cancer patients and healthy people with a sensitivity of 86.2% and a specificity of 89.5%, respectively. Compared with that from the healthy people, the breath mass spectra from esophageal cancer patients show that the mediant intensities of five kinds of ions were decrease and the rest two kinds of ions were increase. ROC analysis gave the area under the curve (AUC) of 0.943. This pilot study shows that the ionic characteristics of exhaled VOCs detected by PTR-MS may be used to differentiate between the esophageal cancer patients and the healthy people. Although the breath tests for more patients are needed to confirm such results, the present work indicates that the PTR-MS may be a promising method in the esophageal cancer screening. © 2016 Journal of Gastroenterology and Hepatology Foundation and John Wiley & Sons Australia, Ltd.

Impact of Preoperative Patient Characteristics on Posturethroplasty Recurrence: The Significance of Stricture Length and Prior Treatments

PubMed Central

Bello, Jibril Oyekunle

2016-01-01

Introduction: Urethral strictures are common in urologic practice of Sub-Saharan Africa including Nigeria. We determine the rate of stricture recurrence following urethroplasty for anterior urethral strictures and evaluate preoperative variables that predict of stricture recurrence in our practice. Subjects and Methods: Thirty-six men who had urethroplasty for proven anterior urethral stricture disease between February 2012 and January 2015 were retrospectively analyzed. Preoperative factors including age, socioeconomic factors, comorbidities, etiology of strictures, stricture location, stricture length, periurethral spongiofibrosis, and prior stricture treatments were assessed for independent predictors of stricture recurrence. Results: The median age was 49.5 years (range 21-90), median stricture length was 4 cm (range 1-18 cm) and the overall recurrence rate was 27.8%. Postinfectious strictures, pan urethral strictures or multiple strictures involving the penile and bulbar urethra were more common. Most patients had penile circular fasciocutaneous flap urethroplasty. Following univariate analysis of potential preoperative predictors of stricture recurrence, stricture length, and prior treatments with dilations or urethrotomies were found to be significantly associated with stricture recurrence. On multivariate analysis, they both remained statistically significant. Patients who had prior treatments had greater odds of having a recurrent stricture (odds ratio 18, 95% confidence interval [CI] 1.4–224.3). Stricture length was dichotomized based on receiver operating characteristic (ROC) analysis, and strictures of length ≥5 cm had significantly greater recurrence (area under ROC curve of 0.825, 95% CI 0.690–0.960, P = 0.032). Conclusion: Patients who had prior dilatations or urethrotomies and those with long strictures particularly strictures ≥5 cm have significantly greater odds of developing a recurrence following urethroplasty in Nigerian urology practice. PMID:27843271

Functional Movement Screen for Predicting Running Injuries in 18- to 24-Year-Old Competitive Male Runners.

PubMed

Hotta, Takayuki; Nishiguchi, Shu; Fukutani, Naoto; Tashiro, Yuto; Adachi, Daiki; Morino, Saori; Shirooka, Hidehiko; Nozaki, Yuma; Hirata, Hinako; Yamaguchi, Moe; Aoyama, Tomoki

2015-10-01

The purpose of this study was to investigate whether the functional movement screen (FMS) could predict running injuries in competitive runners. Eighty-four competitive male runners (average age = 20.0 ± 1.1 years) participated. Each subject performed the FMS, which consisted of 7 movement tests (each score range: 0-3, total score range: 0-21), during the preseason. The incidence of running injuries (time lost because of injury ≤ 4 weeks) was investigated through a follow-up survey during the 6-month season. Mann-Whitney U-tests were used to investigate which movement tests were significantly associated with running injuries. The receiver-operator characteristic (ROC) analysis was used to determine the cutoff. The mean FMS composite score was 14.1 ± 2.3. The ROC analysis determined the cutoff at 14/15 (sensitivity = 0.73, specificity = 0.54), suggesting that the composite score had a low predictability for running injuries. However, the total scores (0-6) from the deep squat (DS) and active straight leg raise (ASLR) tests (DS and ASLR), which were significant with the U-test, had relatively high predictability at the cutoff of 3/4 (sensitivity = 0.73, specificity = 0.74). Furthermore, the multivariate logistic regression analysis revealed that the DS and ASLR scores of ≤3 significantly influenced the incidence of running injuries after adjusting for subjects' characteristics (odds ratio = 9.7, 95% confidence interval = 2.1-44.4). Thus, the current study identified the DS and ASLR score as a more effective method than the composite score to screen the risk of running injuries in competitive male runners.

Serum galectin-9 as a noninvasive biomarker for the detection of endometriosis and pelvic pain or infertility-related gynecologic disorders.

PubMed

Brubel, Reka; Bokor, Attila; Pohl, Akos; Schilli, Gabriella Krisztina; Szereday, Laszlo; Bacher-Szamuel, Reka; Rigo, Janos; Polgar, Beata

2017-12-01

To investigate the usefulness of soluble galectin-9 (Gal-9) in the noninvasive laboratory diagnosis of endometriosis and various gynecologic disorders. Prospective case-control study. University medical centers. A total of 135 women of reproductive age were involved in the study, 77 endometriosis patients, 28 gynecologic controls, and 30 healthy women. Diagnostic laparoscopy and collection of tissue biopsies, peritoneal cells, and native peripheral blood from different case groups of gynecology patients and healthy women. The expression of mRNA and serum concentration of Gal-9. Semiquantitative reverse transcription-polymerase chain reaction analysis and serum soluble Gal-9 ELISA were performed on three different cohorts of patients: those with endometriosis, those with benign gynecologic disorders, and healthy controls. Differences in the Gal-9 concentrations between the investigated groups and the stability of Gal-9 in the serum and diagnostic characteristics of Gal-9 ELISA were determined by statistical evaluation and receiver operating characteristic (ROC) curve analysis. Significantly elevated Gal-9 levels were found in both minimal-mild (I-II) and moderate-severe (III-IV) stages of endometriosis in comparison with healthy controls. At a cutoff of 132 pg/mL, ROC analysis revealed an excellent diagnostic value of Gal-9 ELISA in endometriosis (area under the curve = 0.973) with a sensitivity of 94% and specificity of 93.75%, indicating better diagnostic potential than that of other endometriosis biomarkers. Furthermore, various pelvic pain or infertility-associated benign gynecologic conditions were also associated with increased serum Gal-9 levels. Our results suggest that Gal-9 could be a promising noninvasive biomarker of endometriosis and a predictor of various infertility or pelvic pain-related gynecologic disorders. Copyright © 2017 American Society for Reproductive Medicine. Published by Elsevier Inc. All rights reserved.

Rollover Car Crashes with Ejection: A Deadly Combination—An Analysis of 719 Patients

PubMed Central

Latifi, Rifat; El-Menyar, Ayman; El-Hennawy, Hany; Al-Thani, Hassan

2014-01-01

Rollover car crashes (ROCs) are serious public safety concerns worldwide. Objective. To determine the incidence and outcomes of ROCs with or without ejection of occupants in the State of Qatar. Methods. A retrospective study of all patients involved in ROCs admitted to Level I trauma center in Qatar (2011-2012). Patients were divided into Group I (ROC with ejection) and Group II (ROC without ejection). Results. A total of 719 patients were evaluated (237 in Group I and 482 in Group II). The mean age in Group I was lower than in Group II (24.3 ± 10.3 versus 29 ± 12.2; P = 0.001). Group I had higher injury severity score and sustained significantly more head, chest, and abdominal injuries in comparison to Group II. The mortality rate was higher in Group I (25% versus 7%; P = 0.001). Group I patients required higher ICU admission rate (P = 0.001). Patients in Group I had a 5-fold increased risk for age-adjusted mortality (OR 5.43; 95% CI 3.11–9.49), P = 0.001). Conclusion. ROCs with ejection are associated with higher rate of morbidity and mortality compared to ROCs without ejection. As an increased number of young Qatari males sustain ROCs with ejection, these findings highlight the need for research-based injury prevention initiatives in the country. PMID:24693231

ROC analysis of the accuracy of Noncycloplegic retinoscopy, Retinomax Autorefractor, and SureSight Vision Screener for preschool vision screening.

PubMed

Ying, Gui-shuang; Maguire, Maureen; Quinn, Graham; Kulp, Marjean Taylor; Cyert, Lynn

2011-12-28

To evaluate, by receiver operating characteristic (ROC) analysis, the accuracy of three instruments of refractive error in detecting eye conditions among 3- to 5-year-old Head Start preschoolers and to evaluate differences in accuracy between instruments and screeners and by age of the child. Children participating in the Vision In Preschoolers (VIP) Study (n = 4040), had screening tests administered by pediatric eye care providers (phase I) or by both nurse and lay screeners (phase II). Noncycloplegic retinoscopy (NCR), the Retinomax Autorefractor (Nikon, Tokyo, Japan), and the SureSight Vision Screener (SureSight, Alpharetta, GA) were used in phase I, and Retinomax and SureSight were used in phase II. Pediatric eye care providers performed a standardized eye examination to identify amblyopia, strabismus, significant refractive error, and reduced visual acuity. The accuracy of the screening tests was summarized by the area under the ROC curve (AUC) and compared between instruments and screeners and by age group. The three screening tests had a high AUC for all categories of screening personnel. The AUC for detecting any VIP-targeted condition was 0.83 for NCR, 0.83 (phase I) to 0.88 (phase II) for Retinomax, and 0.86 (phase I) to 0.87 (phase II) for SureSight. The AUC was 0.93 to 0.95 for detecting group 1 (most severe) conditions and did not differ between instruments or screeners or by age of the child. NCR, Retinomax, and SureSight had similar and high accuracy in detecting vision disorders in preschoolers across all types of screeners and age of child, consistent with previously reported results at specificity levels of 90% and 94%.

Diagnostic yield of ink-jet prints from digital radiographs for the assessment of approximal carious lesions: ROC-analysis.

PubMed

Schulze, Ralf K W; Grimm, Stefanie; Schulze, Dirk; Voss, Kai; Keller, Hans-Peter; Wedel, Matthias

2011-08-01

To investigate the diagnostic quality of different quality, individually calibrated ink-jet printers for the very challenging dental radiographic task of approximal carious lesion detection. A test-pattern evaluating resolution, contrast and homogeneity of the ink-jet prints was developed. 50 standardized dental radiographs each showing two neighbouring teeth in natural contact were printed on glossy paper with calibrated, randomly selected ink-jet printers (Canon S520 and iP4500, Epson Stylus Photo R2400). Printing size equalled the viewing size on a 17″ cathode-ray-tube monitor daily quality-tested according to German regulations. The true caries status was determined from serial sectioning and microscopic evaluation. 16 experienced observers evaluated the radiographs on a five-point confidence scale on all prints plus the viewing monitor with respect to the visibility of a carious lesion. A non-parametric Receiver-Operating Characteristics (ROC-) analysis was performed explicitly designed for the evaluation of readings stemming from identical samples but different modality. Significant differences are expressed by a critical ratio z exceeding ±2. Diagnostic accuracy was determined by the area (Az) underneath the ROC-curves. Average Az-values ranged between 0.62 (S520 and R2400) and 0.64 (monitor, iP4500), with no significant difference between modalities (P=0.172). Neither significant (range mean z: -0.40 (S520) and -0.11 (iP4500)) nor clinically relevant differences were found between printers and viewing monitor. Our results for a challenging task in dental radiography indicate that calibrated, off-the-shelf ink-jet printers are able to reproduce (dental) radiographs at quality levels sufficient for radiographic diagnosis in a typical dental working environment. Copyright © 2010 Elsevier Ireland Ltd. All rights reserved.

Preoperative vitamin D deficiency and postoperative hypocalcemia in thyroid cancer patients undergoing total thyroidectomy plus central compartment neck dissection

PubMed Central

Wang, Xiaofei; Zhu, Jingqiang; Liu, Feng; Gong, Yanping; Li, Zhihui

2017-01-01

Background There appears to be a lack of consensus whether preoperative vitamin D deficiency (VDD) increases the risk of postoperative hypocalcemia and decreases the accuracy of postoperative parathyroid hormone (PTH) in predicting hypocalcemia in thyroid cancer patients undergoing total thyroidectomy (TT) plus central compartment neck dissection (CCND). This study aims to address these issues. Method All consecutive thyroid cancer patients who underwent TT plus CCND were retrospectively reviewed through a prospectively collected database between October 2015 and April 2016 in a tertiary referral hospital. The multivariate analysis was performed to identify the significant predictors for hypocalcemia. Receiver operator characteristic curve (ROC) was created and the area under the ROC was used to evaluate the predictive accuracy of postoperative PTH and compared between patients with or without VDD. Results A total of 186 patients were included. The incidence of VDD was 73.7% (137 patients). The incidence of biochemical and symptomatic hypocalcemia was similar in patients with or without VDD (P = 0.304 and 0.657, respectively). Multivariate analysis showed that only postoperative PTH was an independent predictor of symptomatic hypocalcemia (OR = 8.05, 95%CI = 3.99-16.22; P = 0.000). The area under the ROC was similar between patients with preoperative vitamin D level < 20 and ≥20 ng/mL (0.809 versus 0.845, P = 0.592). Conclusion VDD was not a significant risk factor for hypocalcemia following TT+CCND, and did not affect the accuracy of postoperative PTH as a predictor of postoperative hypocalcemia. Thus, routine preoperative screening for vitamin D seems to be unnecessary. PMID:29100453

Usefulness of Tc-99m MDP spine SPECT imaging in differentiating malignant from benign lesions in cancer patients

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ryu, J.S.; Moon, D.H.; Shin, M.J.

1994-05-01

Solitary or a few spinal abnormalities on planar bone scan pose a dilemma in cancer patients. The purpose of this study was to evaluate the usefulness of spine SPECT imaging in differential diagnosis of malignant and benign lesion. Subjects were 54 adult patients with solitary or a few equivocal vertebral lesions on planar bone scan. Spine SPECT imaging was obtained by a triple head SPECT system (TRIAD, Trionix). The final diagnoses were based on data from biopsy, other imaging studies, or minimum 1 year of follow up. Two blind observers reviewed the planar image first, then both planar and SPECTmore » images. The uptake patterns on SPECT images were analyzed, and the diagnostic performance was evaluated by the ROC analysis. Thirty three lesions of 22 patients were malignant, and 60 lesions of 32 patients were benign. Common characteristic patterns of malignant lesions were focal or segmental hot uptake in the body, hot uptake in the body and pedicle, and cold defect with surrounding hot uptake in the vertebra. Whereas marginal protruding hot uptakes in endplate, and hot uptakes in facet joints were benign. The ROC analysis showed that SPECT improved the diagnostic performance (the area under the ROC curve of two observers for planar image 0.903 and 0.791, for the combination of planar and SPECT : 0.950 and 0.976). In conclusion, the uptake pattern recognition in spine SPECT provides useful information for differential diagnosis of malignant and benign lesions in vertebra. Spine SPECT is a valuable complement in cancer patients with inconclusive findings on planar bone scan.« less

Mammographic parenchymal texture as an imaging marker of hormonal activity: a comparative study between pre- and post-menopausal women

NASA Astrophysics Data System (ADS)

Daye, Dania; Bobo, Ezra; Baumann, Bethany; Ioannou, Antonios; Conant, Emily F.; Maidment, Andrew D. A.; Kontos, Despina

2011-03-01

Mammographic parenchymal texture patterns have been shown to be related to breast cancer risk. Yet, little is known about the biological basis underlying this association. Here, we investigate the potential of mammographic parenchymal texture patterns as an inherent phenotypic imaging marker of endogenous hormonal exposure of the breast tissue. Digital mammographic (DM) images in the cranio-caudal (CC) view of the unaffected breast from 138 women diagnosed with unilateral breast cancer were retrospectively analyzed. Menopause status was used as a surrogate marker of endogenous hormonal activity. Retroareolar 2.5cm2 ROIs were segmented from the post-processed DM images using an automated algorithm. Parenchymal texture features of skewness, coarseness, contrast, energy, homogeneity, grey-level spatial correlation, and fractal dimension were computed. Receiver operating characteristic (ROC) curve analysis was performed to evaluate feature classification performance in distinguishing between 72 pre- and 66 post-menopausal women. Logistic regression was performed to assess the independent effect of each texture feature in predicting menopause status. ROC analysis showed that texture features have inherent capacity to distinguish between pre- and post-menopausal statuses (AUC>0.5, p<0.05). Logistic regression including all texture features yielded an ROC curve with an AUC of 0.76. Addition of age at menarche, ethnicity, contraception use and hormonal replacement therapy (HRT) use lead to a modest model improvement (AUC=0.78) while texture features maintained significant contribution (p<0.05). The observed differences in parenchymal texture features between pre- and post- menopausal women suggest that mammographic texture can potentially serve as a surrogate imaging marker of endogenous hormonal activity.

Controlling Nutritional Status (CONUT) score is a prognostic marker for gastric cancer patients after curative resection.

PubMed

Kuroda, Daisuke; Sawayama, Hiroshi; Kurashige, Junji; Iwatsuki, Masaaki; Eto, Tsugio; Tokunaga, Ryuma; Kitano, Yuki; Yamamura, Kensuke; Ouchi, Mayuko; Nakamura, Kenichi; Baba, Yoshifumi; Sakamoto, Yasuo; Yamashita, Yoichi; Yoshida, Naoya; Chikamoto, Akira; Baba, Hideo

2018-03-01

Controlling Nutritional Status (CONUT), as calculated from serum albumin, total cholesterol concentration, and total lymphocyte count, was previously shown to be useful for nutritional assessment. The current study investigated the potential use of CONUT as a prognostic marker in gastric cancer patients after curative resection. Preoperative CONUT was retrospectively calculated in 416 gastric cancer patients who underwent curative resection at Kumamoto University Hospital from 2005 to 2014. The patients were divided into two groups: CONUT-high (≥4) and CONUT-low (≤3), according to time-dependent receiver operating characteristic (ROC) analysis. The associations of CONUT with clinicopathological factors and survival were evaluated. CONUT-high patients were significantly older (p < 0.001) and had a lower body mass index (p = 0.019), deeper invasion (p < 0.001), higher serum carcinoembryonic antigen (p = 0.037), and higher serum carbohydrate antigen 19-9 (p = 0.007) compared with CONUT-low patients. CONUT-high patients had significantly poorer overall survival (OS) compared with CONUT-low patients according to univariate and multivariate analyses (hazard ratio: 5.09, 95% confidence interval 3.12-8.30, p < 0.001). In time-dependent ROC analysis, CONUT had a higher area under the ROC curve (AUC) for the prediction of 5-year OS than the neutrophil lymphocyte ratio, the Modified Glasgow Prognostic Score, or pStage. When the time-dependent AUC curve was used to predict OS, CONUT tended to maintain its predictive accuracy for long-term survival at a significantly higher level for an extended period after surgery when compared with the other markers tested. CONUT is useful for not only estimating nutritional status but also for predicting long-term OS in gastric cancer patients after curative resection.

Effectiveness of computer aided detection for solitary pulmonary nodules

NASA Astrophysics Data System (ADS)

Yan, Jiayong; Li, Wenjie; Du, Xiangying; Lu, Huihai; Xu, Jianrong; Xu, Mantao; Rong, Dongdong

2009-02-01

This study is to investigate the incremental effect of using a high performance computer-aided detection (CAD) system in detection of solitary pulmonary nodules in chest radiographs. The Kodak Chest CAD system was evaluated by a panel of six radiologists at different levels of experience. The observer study consisted of two independent phases: readings without CAD and readings with assistance of CAD. The study was conducted over a set of chest radiographs comprising 150 cancer cases and 150 cancer-free cases. The actual sensitivity of the CAD system is 72% with 3.7 false positives per case. Receiver operating characteristic (ROC) analysis was used to assess the overall observer performance. The AUZ (area under ROC curve) showed a significantly improvement (P=0.0001) from 0.844 to 0.884 after using CAD. The ROC analysis was also applied for observer performances on nodules in different sizes and visibilities. The average AUZs are improved from 0.798 to 0.835 (P=0.0003) for 5-10mm nodules, 0.853 to 0.907 (P=0.001) for 10-15mm nodules, 0.864 to 0.897 (P=0.051) for 15-20 mm nodules and 0.859 to 0.896 (P=0.0342) for 20-30mm nodules, respectively. For different visibilities, the average AUZs are improved from 0.886 to 0.915 (P=0.0337), 0.803 to 0.840 (P=0.063), 0.830 to 0.893 (P=0.0001), and 0.813 to 0.847 (P=0.152), for nodules clearly visible, hidden by ribs, partially overlap with ribs, and overlap with other structures, respectively. These results showed that observer performance could be greatly improved when the CAD system is employed as a second reader, especially for small nodules and nodules occluded by ribs.

Prognostic Significance of the Short Physical Performance Battery in Older Patients Discharged from Acute Care Hospitals

PubMed Central

Lattanzio, Fabrizia; Pedone, Claudio; Garasto, Sabrina; Laino, Irma; Bustacchini, Silvia; Pranno, Luigi; Mazzei, Bruno; Passarino, Giuseppe; Incalzi, Raffaele Antonelli

2012-01-01

Abstract We investigated the prognostic role of the Short Physical Performance Battery (SPPB) in elderly patients discharged from the acute care hospital. Our series consisted of 506 patients aged 70 years or more enrolled in a multicenter collaborative observational study. We considered three main outcomes: 1-year survival after discharge, functional decline, and hospitalization during follow-up. Independent predictors/correlates of the outcomes were investigated by Cox regression or logistic regression analysis when appropriate. The diagnostic accuracy of SPPB in relation to study outcomes was investigated by receiver operating characteristic (ROC) curve. SPPB score was associated with reduced mortality (hazard ratio [HR]=0.86, 95% confidence interval [CI] 0.78–0.95). When the analysis was adjusted for functional status at discharge, such an association was still near significant only for SPPB values >8 (HR=0.51; 95% CI 0.30–1.05). An SPPB score<5 could identify patients who died during follow-up with fair sensitivity (0.66), specificity (0.62), and area under the ROC curve (0.66). SPPB also qualified as independent correlate of functional decline (odds ratio [OR]=0.82; 95% CI 0.70–0.96), but not of rehospitalization or combined end-point death or rehospitalization. An SPPB score <5 could identify patients experiencing functional decline during follow-up with lower sensitivity (0.60), but higher specificity (0.69), and area under the ROC curve (0.69) with respect to mortality. In conclusion, SPPB can be considered a valid instrument to identify patients at major risk of functional decline and death after discharge from acute care hospital. However, it could more efficiently target patients at risk of functional decline than those at risk of death. PMID:22004280

A receiver operated curve-based evaluation of change in sensitivity and specificity of cotinine urinalysis for detecting active tobacco use.

PubMed

Balhara, Yatan Pal Singh; Jain, Raka

2013-01-01

Tobacco use has been associated with various carcinomas including lung, esophagus, larynx, mouth, throat, kidney, bladder, pancreas, stomach, and cervix. Biomarkers such as concentration of cotinine in the blood, urine, or saliva have been used as objective measures to distinguish nonusers and users of tobacco products. A change in the cut-off value of urinary cotinine to detect active tobacco use is associated with a change in sensitivity and sensitivity of detection. The current study aimed at assessing the impact of using different cut-off thresholds of urinary cotinine on sensitivity and specificity of detection of smoking and smokeless tobacco product use among psychiatric patients. All the male subjects attending the psychiatry out-patient department of the tertiary care multispecialty teaching hospital constituted the sample frame for the current study in a cross-sectionally. Quantitative urinary cotinine assay was done by using ELISA kits of Calbiotech. Inc., USA. We used the receiver operating characteristic (ROC) curve to assess the sensitivity and specificity of various cut-off values of urinary cotinine to identify active smokers and users of smokeless tobacco products. ROC analysis of urinary cotinine levels in detection of self-reported smoking provided the area under curve (AUC) of 0.434. Similarly, the ROC analysis of urinary cotinine levels in detection of self-reported smoking revealed AUC of 0.44. The highest sensitivity and specificity of 100% for smoking were detected at the urinary cut-off value greater than or equal to 2.47 ng/ml. The choice of cut-off value of urinary cotinine used to distinguish nonusers form active users of tobacco products impacts the sensitivity as well as specificity of detection.

Regional homogeneity of resting-state brain abnormalities in bipolar and unipolar depression.

PubMed

Liu, Chun-Hong; Ma, Xin; Wu, Xia; Zhang, Yu; Zhou, Fu-Chun; Li, Feng; Tie, Chang-Le; Dong, Jie; Wang, Yong-Jun; Yang, Zhi; Wang, Chuan-Yue

2013-03-05

Bipolar disorder patients experiencing a depressive episode (BD-dep) without an observed history of mania are often misdiagnosed and are consequently treated as having unipolar depression (UD), leading to inadequate treatment and poor outcomes. An essential solution to this problem is to identify objective biological markers that distinguish BD-dep and UD patients at an early stage. However, studies directly comparing the brain dysfunctions associated with BD-dep and UD are rare. More importantly, the specificity of the differences in brain activity between these mental disorders has not been examined. With whole-brain regional homogeneity analysis and region-of-interest (ROI) based receiver operating characteristic (ROC) analysis, we aimed to compare the resting-state brain activity of BD-dep and UD patients. Furthermore, we examined the specific differences and whether these differences were attributed to the brain abnormality caused by BD-dep, UD, or both. Twenty-one bipolar and 21 unipolar depressed patients, as well as 26 healthy subjects matched for gender, age, and educational levels, participated in the study. We compared the differences in the regional homogeneity (ReHo) of the BD-dep and UD groups and further identified their pathophysiological abnormality. In the brain regions showing a difference between the BD-dep and UD groups, we further conducted receptive operation characteristic (ROC) analyses to confirm the effectiveness of the identified difference in classifying the patients. We observed ReHo differences between the BD-dep and UD groups in the right ventrolateral middle frontal gyrus, right dorsal anterior insular, right ventral anterior insular, right cerebellum posterior gyrus, right posterior cingulate cortex, right parahippocampal gyrus, and left cerebellum anterior gyrus. Further ROI comparisons and ROC analysis on these ROIs showed that the right parahippocampal gyrus reflected abnormality specific to the BD-dep group, while the right middle frontal gyrus, the right dorsal anterior insular, the right cerebellum posterior gyrus, and the right posterior cingulate cortex showed abnormality specific to the UD group. We found brain regions showing resting state ReHo differences and examined their sensitivity and specificity, suggesting a potential neuroimaging biomarker to distinguish between BD-dep and UD patients. We further clarified the pathophysiological abnormality of these regions for each of the two patient populations. Copyright © 2012 Elsevier Inc. All rights reserved.

A review of automatic mass detection and segmentation in mammographic images.

PubMed

Oliver, Arnau; Freixenet, Jordi; Martí, Joan; Pérez, Elsa; Pont, Josep; Denton, Erika R E; Zwiggelaar, Reyer

2010-04-01

The aim of this paper is to review existing approaches to the automatic detection and segmentation of masses in mammographic images, highlighting the key-points and main differences between the used strategies. The key objective is to point out the advantages and disadvantages of the various approaches. In contrast with other reviews which only describe and compare different approaches qualitatively, this review also provides a quantitative comparison. The performance of seven mass detection methods is compared using two different mammographic databases: a public digitised database and a local full-field digital database. The results are given in terms of Receiver Operating Characteristic (ROC) and Free-response Receiver Operating Characteristic (FROC) analysis. Copyright 2009 Elsevier B.V. All rights reserved.

Neyman-Pearson classification algorithms and NP receiver operating characteristics

PubMed Central

Tong, Xin; Feng, Yang; Li, Jingyi Jessica

2018-01-01

In many binary classification applications, such as disease diagnosis and spam detection, practitioners commonly face the need to limit type I error (that is, the conditional probability of misclassifying a class 0 observation as class 1) so that it remains below a desired threshold. To address this need, the Neyman-Pearson (NP) classification paradigm is a natural choice; it minimizes type II error (that is, the conditional probability of misclassifying a class 1 observation as class 0) while enforcing an upper bound, α, on the type I error. Despite its century-long history in hypothesis testing, the NP paradigm has not been well recognized and implemented in classification schemes. Common practices that directly limit the empirical type I error to no more than α do not satisfy the type I error control objective because the resulting classifiers are likely to have type I errors much larger than α, and the NP paradigm has not been properly implemented in practice. We develop the first umbrella algorithm that implements the NP paradigm for all scoring-type classification methods, such as logistic regression, support vector machines, and random forests. Powered by this algorithm, we propose a novel graphical tool for NP classification methods: NP receiver operating characteristic (NP-ROC) bands motivated by the popular ROC curves. NP-ROC bands will help choose α in a data-adaptive way and compare different NP classifiers. We demonstrate the use and properties of the NP umbrella algorithm and NP-ROC bands, available in the R package nproc, through simulation and real data studies. PMID:29423442

Neyman-Pearson classification algorithms and NP receiver operating characteristics.

PubMed

Tong, Xin; Feng, Yang; Li, Jingyi Jessica

2018-02-01

In many binary classification applications, such as disease diagnosis and spam detection, practitioners commonly face the need to limit type I error (that is, the conditional probability of misclassifying a class 0 observation as class 1) so that it remains below a desired threshold. To address this need, the Neyman-Pearson (NP) classification paradigm is a natural choice; it minimizes type II error (that is, the conditional probability of misclassifying a class 1 observation as class 0) while enforcing an upper bound, α, on the type I error. Despite its century-long history in hypothesis testing, the NP paradigm has not been well recognized and implemented in classification schemes. Common practices that directly limit the empirical type I error to no more than α do not satisfy the type I error control objective because the resulting classifiers are likely to have type I errors much larger than α, and the NP paradigm has not been properly implemented in practice. We develop the first umbrella algorithm that implements the NP paradigm for all scoring-type classification methods, such as logistic regression, support vector machines, and random forests. Powered by this algorithm, we propose a novel graphical tool for NP classification methods: NP receiver operating characteristic (NP-ROC) bands motivated by the popular ROC curves. NP-ROC bands will help choose α in a data-adaptive way and compare different NP classifiers. We demonstrate the use and properties of the NP umbrella algorithm and NP-ROC bands, available in the R package nproc, through simulation and real data studies.

Influence of optic disc size on the diagnostic performance of macular ganglion cell complex and peripapillary retinal nerve fiber layer analyses in glaucoma.

PubMed

Cordeiro, Daniela Valença; Lima, Verônica Castro; Castro, Dinorah P; Castro, Leonardo C; Pacheco, Maria Angélica; Lee, Jae Min; Dimantas, Marcelo I; Prata, Tiago Santos

2011-01-01

To evaluate the influence of optic disc size on the diagnostic accuracy of macular ganglion cell complex (GCC) and conventional peripapillary retinal nerve fiber layer (pRNFL) analyses provided by spectral domain optical coherence tomography (SD-OCT) in glaucoma. Eighty-two glaucoma patients and 30 healthy subjects were included. All patients underwent GCC (7 × 7 mm macular grid, consisting of RNFL, ganglion cell and inner plexiform layers) and pRNFL thickness measurement (3.45 mm circular scan) by SD-OCT. One eye was randomly selected for analysis. Initially, receiver operating characteristic (ROC) curves were generated for different GCC and pRNFL parameters. The effect of disc area on the diagnostic accuracy of these parameters was evaluated using a logistic ROC regression model. Subsequently, 1.5, 2.0, and 2.5 mm(2) disc sizes were arbitrarily chosen (based on data distribution) and the predicted areas under the ROC curves (AUCs) and sensitivities were compared at fixed specificities for each. Average mean deviation index for glaucomatous eyes was -5.3 ± 5.2 dB. Similar AUCs were found for the best pRNFL (average thickness = 0.872) and GCC parameters (average thickness = 0.824; P = 0.19). The coefficient representing disc area in the ROC regression model was not statistically significant for average pRNFL thickness (-0.176) or average GCC thickness (0.088; P ≥ 0.56). AUCs for fixed disc areas (1.5, 2.0, and 2.5 mm(2)) were 0.904, 0.891, and 0.875 for average pRNFL thickness and 0.834, 0.842, and 0.851 for average GCC thickness, respectively. The highest sensitivities - at 80% specificity for average pRNFL (84.5%) and GCC thicknesses (74.5%) - were found with disc sizes fixed at 1.5 mm(2) and 2.5 mm(2). Diagnostic accuracy was similar between pRNFL and GCC thickness parameters. Although not statistically significant, there was a trend for a better diagnostic accuracy of pRNFL thickness measurement in cases of smaller discs. For GCC analysis, an inverse effect was observed.

Face recognition in schizophrenia: do individual and average ROCs tell the same story?

PubMed

Tiberghien, Guy; Martin, Clara; Baudouin, Jean-Yves; Franck, Nicolas; Guillaume, Fabrice; Huron, Caroline

2015-01-01

Many studies have shown that recollection process is impaired in patients with schizophrenia, whereas familiarity is generally spared. However, in these studies, the Receiver Operating Characteristic (ROC) presented is average ROC likely to mask individual differences. In the present study using a face-recognition task, we computed the individual ROC of patients with schizophrenia and control participants. Each group was divided into two subgroups on the basis of the type of recognition processes implemented: recognition based on familiarity only and recognition based on familiarity and recollection. The recognition performance of the schizophrenia patients was below that of the control participants only when recognition was based solely on familiarity. For the familiarity-alone patients, the score obtained on the Scale for the Assessment of Positive Symptoms (SAPS) was correlated with the variance of the old-face familiarity. For the familiarity-recollection patients, the score obtained on the Scale for the Assessment of Negative Symptoms (SANS) was correlated with the decision criterion and with the old-face recollection probability. These results show that one cannot ascribe the impaired recognition observed in patients with schizophrenia to a recollection deficit alone. These results show that individual ROC can be used to distinguish between subtypes of schizophrenia and could serve as a basis for setting up specific cognitive remediation therapy for individuals with schizophrenia.

The prognostic value of preoperative inflammation-based prognostic scores and nutritional status for overall survival in resected patients with nonmetastatic Siewert type II/III adenocarcinoma of esophagogastric junction.

PubMed

Zhang, Lixiang; Su, Yezhou; Chen, Zhangming; Wei, Zhijian; Han, Wenxiu; Xu, Aman

2017-07-01

Immune and nutritional status of patients have been reported to predict postoperative complications, recurrence, and prognosis of patients with cancer. Therefore, this retrospective study aimed to explore the prognostic value of preoperative inflammation-based prognostic scores [neutrophil-lymphocyte ratio (NLR), platelet-lymphocyte ratio (PLR)] and nutritional status [prognostic nutritional index (PNI), body mass index (BMI), hemoglobin, albumin, and prealbumin] for overall survival (OS) in adenocarcinoma of esophagogastric junction (AEG) patients. A total of 355 patients diagnosed with Siewert type II/III AEG and underwent surgery between October 2010 and December 2011 were followed up until October 2016. Receiver operating characteristic (ROC) curve analysis was used to determine the cutoff values of NLR, PLR, and PNI. Kaplan-Meier curves and Cox regression analyses were used to calculate the OS characteristics. The ideal cutoff values for predicting OS were 3.5 for NLR, 171 for PLR, and 51.3 for PNI according to the ROC curve. The patients with hemoglobin <120 g/L (P = .001), prealbumin <180 mg/L (P = .000), PNI <51.3 (P = .010), NLR >3.5 (P = .000), PLR >171 (P = .006), and low BMI group (P = .000) had shorter OS. And multivariate survival analysis using the Cox proportional hazards model showed that the tumor-node-metastasis stage, BMI, NLR, and prealbumin levels were independent risk factors for the OS. Our study demonstrated that preoperative prealbumin, BMI, and NLR were independent prognostic factors of AEG patients.

Large meniscus extrusion ratio is a poor prognostic factor of conservative treatment for medial meniscus posterior root tear.

PubMed

Kwak, Yoon-Ho; Lee, Sahnghoon; Lee, Myung Chul; Han, Hyuk-Soo

2018-03-01

The purpose of this study was to find a prognostic factor of medial meniscus posterior root tear (MMPRT) for surgical decision making. Eighty-eight patients who were diagnosed as acute or subacute MMPRT without severe degeneration of the meniscus were treated conservatively for 3 months. Fifty-seven patients with MMPRT showed good response to conservative treatment (group 1), while the remaining 31 patients who failed to conservative treatment (group 2) received arthroscopic meniscus repair. Their demographic characteristics and radiographic features including hip-knee-ankle angle, joint line convergence angle, Kellgren-Lawrence grade in plain radiographs, meniscus extrusion (ME) ratio (ME-medial femoral condyle ratio, ME-medial tibial plateau ratio, ME-meniscus width ratio), the location of bony edema, and cartilage lesions in MRI were compared. Receiver operating characteristic (ROC) curve analysis was also performed to determine the cut-off values of risk factors. The degree of ME-medial femoral condyle and medial tibia plateau ratio of group 2 was significantly higher than group 1 (0.08 and 0.07 vs. 0.1 and 0.09, respectively, both p < 0.001). No significant (n.s.) difference in other variables was found between the two groups. On ROC curve analysis, ME-medial femoral condyle ratio was confirmed as the most reliable prognostic factor of conservative treatment for MMPRT (area under ROC = 0.8). The large meniscus extrusion ratio was the most reliable poor prognostic factor of conservative treatment for MMPRT. Therefore, for MMPRT patients with large meniscus extrusion, early surgical repair could be considered as the primary treatment option. III.

Optimal threshold estimation for binary classifiers using game theory.

PubMed

Sanchez, Ignacio Enrique

2016-01-01

Many bioinformatics algorithms can be understood as binary classifiers. They are usually compared using the area under the receiver operating characteristic ( ROC ) curve. On the other hand, choosing the best threshold for practical use is a complex task, due to uncertain and context-dependent skews in the abundance of positives in nature and in the yields/costs for correct/incorrect classification. We argue that considering a classifier as a player in a zero-sum game allows us to use the minimax principle from game theory to determine the optimal operating point. The proposed classifier threshold corresponds to the intersection between the ROC curve and the descending diagonal in ROC space and yields a minimax accuracy of 1-FPR. Our proposal can be readily implemented in practice, and reveals that the empirical condition for threshold estimation of "specificity equals sensitivity" maximizes robustness against uncertainties in the abundance of positives in nature and classification costs.

Analysis of Exhaled Breath Volatile Organic Compounds in Inflammatory Bowel Disease: A Pilot Study.

PubMed

Hicks, Lucy C; Huang, Juzheng; Kumar, Sacheen; Powles, Sam T; Orchard, Timothy R; Hanna, George B; Williams, Horace R T

2015-09-01

Distinguishing between the inflammatory bowel diseases [IBD], Crohn's disease [CD] and ulcerative colitis [UC], is important for determining management and prognosis. Selected ion flow tube mass spectrometry [SIFT-MS] may be used to analyse volatile organic compounds [VOCs] in exhaled breath: these may be altered in disease states, and distinguishing breath VOC profiles can be identified. The aim of this pilot study was to identify, quantify, and analyse VOCs present in the breath of IBD patients and controls, potentially providing insights into disease pathogenesis and complementing current diagnostic algorithms. SIFT-MS breath profiling of 56 individuals [20 UC, 18 CD, and 18 healthy controls] was undertaken. Multivariate analysis included principal components analysis and partial least squares discriminant analysis with orthogonal signal correction [OSC-PLS-DA]. Receiver operating characteristic [ROC] analysis was performed for each comparative analysis using statistically significant VOCs. OSC-PLS-DA modelling was able to distinguish both CD and UC from healthy controls and from one other with good sensitivity and specificity. ROC analysis using combinations of statistically significant VOCs [dimethyl sulphide, hydrogen sulphide, hydrogen cyanide, ammonia, butanal, and nonanal] gave integrated areas under the curve of 0.86 [CD vs healthy controls], 0.74 [UC vs healthy controls], and 0.83 [CD vs UC]. Exhaled breath VOC profiling was able to distinguish IBD patients from controls, as well as to separate UC from CD, using both multivariate and univariate statistical techniques. Copyright © 2015 European Crohn’s and Colitis Organisation (ECCO). Published by Oxford University Press. All rights reserved. For permissions, please email: journals.permissions@oup.com.

Diagnostic accuracy of atypical p-ANCA in autoimmune hepatitis using ROC- and multivariate regression analysis.

PubMed

Terjung, B; Bogsch, F; Klein, R; Söhne, J; Reichel, C; Wasmuth, J-C; Beuers, U; Sauerbruch, T; Spengler, U

2004-09-29

Antineutrophil cytoplasmic antibodies (atypical p-ANCA) are detected at high prevalence in sera from patients with autoimmune hepatitis (AIH), but their diagnostic relevance for AIH has not been systematically evaluated so far. Here, we studied sera from 357 patients with autoimmune (autoimmune hepatitis n=175, primary sclerosing cholangitis (PSC) n=35, primary biliary cirrhosis n=45), non-autoimmune chronic liver disease (alcoholic liver cirrhosis n=62; chronic hepatitis C virus infection (HCV) n=21) or healthy controls (n=19) for the presence of various non-organ specific autoantibodies. Atypical p-ANCA, antinuclear antibodies (ANA), antibodies against smooth muscles (SMA), antibodies against liver/kidney microsomes (anti-Lkm1) and antimitochondrial antibodies (AMA) were detected by indirect immunofluorescence microscopy, antibodies against the M2 antigen (anti-M2), antibodies against soluble liver antigen (anti-SLA/LP) and anti-Lkm1 by using enzyme linked immunosorbent assays. To define the diagnostic precision of the autoantibodies, results of autoantibody testing were analyzed by receiver operating characteristics (ROC) and forward conditional logistic regression analysis. Atypical p-ANCA were detected at high prevalence in sera from patients with AIH (81%) and PSC (94%). ROC- and logistic regression analysis revealed atypical p-ANCA and SMA, but not ANA as significant diagnostic seromarkers for AIH (atypical p-ANCA: AUC 0.754+/-0.026, odds ratio [OR] 3.4; SMA: 0.652+/-0.028, OR 4.1). Atypical p-ANCA also emerged as the only diagnostically relevant seromarker for PSC (AUC 0.690+/-0.04, OR 3.4). None of the tested antibodies yielded a significant diagnostic accuracy for patients with alcoholic liver cirrhosis, HCV or healthy controls. Atypical p-ANCA along with SMA represent a seromarker with high diagnostic accuracy for AIH and should be explicitly considered in a revised version of the diagnostic score for AIH.

C-Reactive Protein on Postoperative Day 1 Is a Reliable Predictor of Pancreas-Specific Complications After Pancreaticoduodenectomy.

PubMed

Guilbaud, Théophile; Birnbaum, David Jérémie; Lemoine, Coralie; Chirica, Mircea; Risse, Olivier; Berdah, Stéphane; Girard, Edouard; Moutardier, Vincent

2018-05-01

Postoperative pancreatic fistula and pancreas-specific complications have a significant influence on patient management and outcomes after pancreatoduodenectomy. The aim of the study was to assess the value of serum C-reactive protein on the postoperative day 1 as early predictor of pancreatic fistula and pancreas-specific complications. Between 2013 and 2016, 110 patients underwent pancreaticoduodenectomy. Clinical, biological, intraoperative, and pathological characteristics were prospectively recorded. Pancreatic fistula was graded according to the International Study Group on Pancreatic Fistula classification. A composite endpoint was defined as pancreas-specific complications including pancreatic fistula, intra-abdominal abscess, postoperative hemorrhage, and bile leak. The diagnostic accuracy of serum C-reactive protein on postoperative day 1 in predicting adverse postoperative outcomes was assessed by ROC curve analysis. Six patients (5%) died and 87 (79%) experienced postoperative complications (pancreatic-specific complications: n = 58 (53%); pancreatic fistula: n = 48 (44%)). A soft pancreatic gland texture, a main pancreatic duct diameter < 3 mm and serum C-reactive protein ≥ 100 mg/L on postoperative day 1 were independent predictors of pancreas-specific complications (p < 0.01) and pancreatic fistula (p < 0.01). ROC analysis showed that serum C-reactive protein ≥ 100 mg/L on postoperative day 1 was a significant predictor of pancreatic fistula (AUC: 0.70; 95%CI: 0.60-0.79, p < 0.01) and pancreas-specific complications (AUC: 0.72; 95%CI: 0.62-0.82, p < 0.01). ROC analysis showed that serum C-reactive protein ≥ 50 mg/L at discharge was a significant predictor of 90-day hospital readmission (AUC: 0.70; 95%CI: 0.60-0.79, p < 0.01). C-reactive protein levels reliably predict risks of pancreatic fistula, pancreas-specific complications, and hospital readmission, and should be inserted in risk-stratified management algorithms after pancreaticoduodenectomy.

The Weiss Functional Impairment Rating Scale-Parent Form for assessing ADHD: evaluating diagnostic accuracy and determining optimal thresholds using ROC analysis.

PubMed

Thompson, Trevor; Lloyd, Andrew; Joseph, Alain; Weiss, Margaret

2017-07-01

The Weiss Functional Impairment Rating Scale-Parent Form (WFIRS-P) is a 50-item scale that assesses functional impairment on six clinically relevant domains typically affected in attention-deficit/hyperactivity disorder (ADHD). As functional impairment is central to ADHD, the WFIRS-P offers potential as a tool for assessing functional impairment in ADHD. These analyses were designed to examine the overall performance of WFIRS-P in differentiating ADHD and non-ADHD cases using receiver operating characteristics (ROC) analysis. This is the first attempt to empirically determine the level of functional impairment that differentiates ADHD children from normal controls. This observational study comprised 5-19-year-olds with physician-diagnosed ADHD (n = 476) and non-ADHD controls (n = 202). ROC analysis evaluated the ability of WFIRS-P to discriminate between ADHD and non-ADHD, and identified a WFIRS-P cut-off score that optimises correct classification. Data were analysed for the complete sample, for males versus females and for participants in two age groups (5-12 versus 13-19 years). Area under the curve (AUC) was 0.91 (95% confidence interval 0.88-0.93) for the overall WFIRS-P score, suggesting highly accurate classification of ADHD distinct from non-ADHD. Sensitivity (0.83) and specificity (0.85) were maximal for a mean overall WFIRS-P score of 0.65, suggesting that this is an appropriate threshold for differentiation. DeLong's test found no significant differences in AUCs for males versus females or 5-12 versus 13-19 years, suggesting that WFIRS-P is an accurate classifier of ADHD across gender and age. When assessing function, WFIRS-P appears to provide a simple and effective basis for differentiating between individuals with/without ADHD in terms of functional impairment. Disease-specific applications of QOL research.

Prognostic factors of Bell's palsy: prospective patient collected observational study.

PubMed

Fujiwara, Takashi; Hato, Naohito; Gyo, Kiyofumi; Yanagihara, Naoaki

2014-07-01

The purpose of this study was to evaluate various parameters potentially influencing poor prognosis in Bell's palsy and to assess the predictive value for Bell's palsy. A single-center prospective patient collected observation and validation study was conducted. To evaluate the correlation between patient characteristics and poor prognosis, we performed univariate and multivariate analyzes of age, gender, side of palsy, diabetes mellitus, hypertension, and facial grading score 1 week after onset. To evaluate the accuracy of the facial grading score, we prepared a receiver operating characteristic (ROC) curve and calculated the area under the ROC curve (AUROC). We also calculated sensitivity, specificity, positive/negative likelihood ratio, and positive/negative predictive value. We included Bell's palsy patients who attended Ehime University Hospital within 1 week after onset between 1977 and 2011. We excluded patients who were less than 15 years old and lost-to-follow-up within 6 months. The main outcome was defined as non-recovery at 6 months after onset. In total, 679 adults with Bell's palsy were included. The facial grading score at 1 week showed a correlation with non-recovery in the multivariate analysis, although age, gender, side of palsy, diabetes mellitus, and hypertension did not. The AUROC of the facial grading score was 0.793. The Y-system score at 1 week moderate accurately predicted non-recovery at 6 months in Bell's palsy.

[Prognostic value of three different staging schemes based on pN, MLR and LODDS in patients with T3 esophageal cancer].

PubMed

Wang, L; Cai, L; Chen, Q; Jiang, Y H

2017-10-23

Objective: To evaluate the prognostic value of three different staging schemes based on positive lymph nodes (pN), metastatic lymph nodes ratio (MLR) and log odds of positive lymph nodes (LODDS) in patients with T3 esophageal cancer. Methods: From 2007 to 2014, clinicopathological characteristics of 905 patients who were pathologically diagnosed as T3 esophageal cancer and underwent radical esophagectomy in Zhejiang Cancer Hospital were retrospectively analyzed. Kaplan-Meier curves and Multivariate Cox proportional hazards models were used to evaluate the independent prognostic factors. The values of three lymph node staging schemes for predicting 5-year survival were analyzed by using receiver operating characteristic (ROC) curves. Results: The 1-, 3- and 5-year overall survival rates of patients with T3 esophageal cancer were 80.9%, 50.0% and 38.4%, respectively. Multivariate analysis showed that MLR stage, LODDS stage and differentiation were independent prognostic survival factors ( P <0.05 for all). ROC curves showed that the area under the curve of pN stage, MLR stage, LODDS stage was 0.607, 0.613 and 0.618, respectively. However, the differences were not statistically significant ( P >0.05). Conclusions: LODDS is an independent prognostic factor for patients with T3 esophageal cancer. The value of LODDS staging system may be superior to pN staging system for evaluating the prognosis of these patients.

A generic framework to simulate realistic lung, liver and renal pathologies in CT imaging

NASA Astrophysics Data System (ADS)

Solomon, Justin; Samei, Ehsan

2014-11-01

Realistic three-dimensional (3D) mathematical models of subtle lesions are essential for many computed tomography (CT) studies focused on performance evaluation and optimization. In this paper, we develop a generic mathematical framework that describes the 3D size, shape, contrast, and contrast-profile characteristics of a lesion, as well as a method to create lesion models based on CT data of real lesions. Further, we implemented a technique to insert the lesion models into CT images in order to create hybrid CT datasets. This framework was used to create a library of realistic lesion models and corresponding hybrid CT images. The goodness of fit of the models was assessed using the coefficient of determination (R2) and the visual appearance of the hybrid images was assessed with an observer study using images of both real and simulated lesions and receiver operator characteristic (ROC) analysis. The average R2 of the lesion models was 0.80, implying that the models provide a good fit to real lesion data. The area under the ROC curve was 0.55, implying that the observers could not readily distinguish between real and simulated lesions. Therefore, we conclude that the lesion-modeling framework presented in this paper can be used to create realistic lesion models and hybrid CT images. These models could be instrumental in performance evaluation and optimization of novel CT systems.

A Quantitative Approach to Distinguish Pneumonia From Atelectasis Using Computed Tomography Attenuation.

PubMed

Edwards, Rachael M; Godwin, J David; Hippe, Dan S; Kicska, Gregory

2016-01-01

It is known that atelectasis demonstrates greater contrast enhancement than pneumonia on computed tomography (CT). However, the effectiveness of using a Hounsfield unit (HU) threshold to distinguish pneumonia from atelectasis has never been shown. The objective of the study is to demonstrate that an HU threshold can be quantitatively used to effectively distinguish pneumonia from atelectasis. Retrospectively identified CT pulmonary angiogram examinations that did not show pulmonary embolism but contained nonaerated lungs were classified as atelectasis or pneumonia based on established clinical criteria. The HU attenuation was measured in these nonaerated lungs. Receiver operating characteristic (ROC) analysis was performed to determine the area under the ROC curve, sensitivity, and specificity of using the attenuation to distinguish pneumonia from atelectasis. Sixty-eight nonaerated lungs were measured in 55 patients. The mean (SD) enhancement was 62 (18) HU in pneumonia and 119 (24) HU in atelectasis (P < 0.001). A threshold of 92 HU diagnosed pneumonia with 97% sensitivity (confidence interval [CI], 80%-99%) and 85% specificity (CI, 70-93). Accuracy, measured as area under the ROC curve, was 0.97 (CI, 0.89-0.99). We have established that a threshold HU value can be used to confidently distinguish pneumonia from atelectasis with our standard CT pulmonary angiogram imaging protocol and patient population. This suggests that a similar threshold HU value may be determined for other scanning protocols, and application of this threshold may facilitate a more confident diagnosis of pneumonia and thus speed treatment.

Ratio of urine and blood urea nitrogen concentration predicts the response of tolvaptan in congestive heart failure.

PubMed

Shimizu, Keisuke; Doi, Kent; Imamura, Teruhiko; Noiri, Eisei; Yahagi, Naoki; Nangaku, Masaomi; Kinugawa, Koichiro

2015-06-01

This study was conducted to evaluate the performance of the ratio of urine and blood urea nitrogen concentration (UUN/BUN) as a new predictive factor for the response of an arginine vasopressin receptor 2 antagonist tolvaptan (TLV) in decompensated heart failure patients. This study enrolled 70 decompensated heart failure patients who were administered TLV at University of Tokyo Hospital. We collected the data of clinical parameters including UUN/BUN before administering TLV. Two different outcomes were defined as follows: having over 300 mL increase in urine volume on the first day (immediate urine output response) and having any decrease in body weight within one week after starting TLV treatment (subsequent clinical response). Among the 70 enrolled patients, 37 patients (52.9%) showed immediate urine output response; 51 patients (72.9%) showed a subsequent clinical response of body weight decrease. Receiver operating characteristics (ROC) analysis showed good prediction by UUN/BUN for the immediate response (AUC-ROC 0.86 [0.75-0.93]) and a significantly better prediction by UUN/BUN for the subsequent clinical response compared with urinary osmolality (AUC-ROC 0.78 [0.63-0.88] vs. 0.68 [0.52-0.80], P < 0.05). We demonstrated that a clinical parameter of UUN/BUN can predict the response of TLV even when measured before TLV administration. UUN/BUN might enable identification of good responders for this new drug. © 2015 Asian Pacific Society of Nephrology.

Homology search with binary and trinary scoring matrices.

PubMed

Smith, Scott F

2006-01-01

Protein homology search can be accelerated with the use of bit-parallel algorithms in conjunction with constraints on the values contained in the scoring matrices. Trinary scoring matrices (containing only the values -1, 0, and 1) allow for significant acceleration without significant reduction in the receiver operating characteristic (ROC) score of a Smith-Waterman search. Binary scoring matrices (containing the values 0 and 1) result in some reduction in ROC score, but result in even more acceleration. Binary scoring matrices and five-bit saturating scores can be used for fast prefilters to the Smith-Waterman algorithm.

[Support vector machine?assisted diagnosis of human malignant gastric tissues based on dielectric properties].

PubMed

Zhang, Sa; Li, Zhou; Xin, Xue-Gang

2017-12-20

To achieve differential diagnosis of normal and malignant gastric tissues based on discrepancies in their dielectric properties using support vector machine. The dielectric properties of normal and malignant gastric tissues at the frequency ranging from 42.58 to 500 MHz were measured by coaxial probe method, and the Cole?Cole model was used to fit the measured data. Receiver?operating characteristic (ROC) curve analysis was used to evaluate the discrimination capability with respect to permittivity, conductivity, and Cole?Cole fitting parameters. Support vector machine was used for discriminating normal and malignant gastric tissues, and the discrimination accuracy was calculated using k?fold cross? The area under the ROC curve was above 0.8 for permittivity at the 5 frequencies at the lower end of the measured frequency range. The combination of the support vector machine with the permittivity at all these 5 frequencies combined achieved the highest discrimination accuracy of 84.38% with a MATLAB runtime of 3.40 s. The support vector machine?assisted diagnosis is feasible for human malignant gastric tissues based on the dielectric properties.

Recent developments in the Dorfman-Berbaum-Metz procedure for multireader ROC study analysis.

PubMed

Hillis, Stephen L; Berbaum, Kevin S; Metz, Charles E

2008-05-01

The Dorfman-Berbaum-Metz (DBM) method has been one of the most popular methods for analyzing multireader receiver-operating characteristic (ROC) studies since it was proposed in 1992. Despite its popularity, the original procedure has several drawbacks: it is limited to jackknife accuracy estimates, it is substantially conservative, and it is not based on a satisfactory conceptual or theoretical model. Recently, solutions to these problems have been presented in three papers. Our purpose is to summarize and provide an overview of these recent developments. We present and discuss the recently proposed solutions for the various drawbacks of the original DBM method. We compare the solutions in a simulation study and find that they result in improved performance for the DBM procedure. We also compare the solutions using two real data studies and find that the modified DBM procedure that incorporates these solutions yields more significant results and clearer interpretations of the variance component parameters than the original DBM procedure. We recommend using the modified DBM procedure that incorporates the recent developments.

No special K! A signal detection framework for the strategic regulation of memory accuracy.

PubMed

Higham, Philip A

2007-02-01

Two experiments investigated criterion setting and metacognitive processes underlying the strategic regulation of accuracy on the Scholastic Aptitude Test (SAT) using Type-2 signal detection theory (SDT). In Experiment 1, report bias was manipulated by penalizing participants either 0.25 (low incentive) or 4 (high incentive) points for each error. Best guesses to unanswered items were obtained so that Type-2 signal detection indices of discrimination and bias could be calculated. The same incentive manipulation was used in Experiment 2, only the test was computerized, confidence ratings were taken so that receiver operating characteristic (ROC) curves could be generated, and feedback was manipulated. The results of both experiments demonstrated that SDT provides a viable alternative to A. Koriat and M. Goldsmith's (1996c) framework of monitoring and control and reveals information about the regulation of accuracy that their framework does not. For example, ROC analysis indicated that the threshold model implied by formula scoring is inadequate. Instead, performance on the SAT should be modeled with an equal-variance Gaussian, Type-2 signal detection model. ((c) 2007 APA, all rights reserved).

Parameters for screening music performance anxiety.

PubMed

Barbar, Ana E; Crippa, José A; Osório, Flávia L

2014-09-01

To assess the discriminative capacity of the Kenny Music Performance Anxiety Inventory (K-MPAI), in its version adapted for Brazil, in a sample of 230 Brazilian adult musicians. The Social Phobia Inventory (SPIN) was used to assess the presence of social anxiety indicators, adopting it as the gold standard. The Mann-Whitney U test and the receiver operating characteristic (ROC) curve were used for statistical analysis, with p ≤ 0.05 set as the significance level. Subjects with social anxiety indicators exhibited higher mean total K-MPAI scores, as well as higher individual scores on 62% of its items. The area under the ROC curve was 0.734 (p = 0.001), and considered appropriate. Within the possible cutoff scores presented, the score -15 had the best balance of sensitivity and specificity values. However, the score -7 had greater specificity and accuracy. The K-MPAI showed appropriate discriminant validity, with a marked association between music performance anxiety and social anxiety. The cutoff scores presented in the study have both clinical and research value, allowing screening for music performance anxiety and identification of possible cases.

Specific and social fears in children and adolescents: separating normative fears from problem indicators and phobias.

PubMed

Laporte, Paola P; Pan, Pedro M; Hoffmann, Mauricio S; Wakschlag, Lauren S; Rohde, Luis A; Miguel, Euripedes C; Pine, Daniel S; Manfro, Gisele G; Salum, Giovanni A

2017-01-01

To distinguish normative fears from problematic fears and phobias. We investigated 2,512 children and adolescents from a large community school-based study, the High Risk Study for Psychiatric Disorders. Parent reports of 18 fears and psychiatric diagnosis were investigated. We used two analytical approaches: confirmatory factor analysis (CFA)/item response theory (IRT) and nonparametric receiver operating characteristic (ROC) curve. According to IRT and ROC analyses, social fears are more likely to indicate problems and phobias than specific fears. Most specific fears were normative when mild; all specific fears indicate problems when pervasive. In addition, the situational fear of toilets and people who look unusual were highly indicative of specific phobia. Among social fears, those not restricted to performance and fear of writing in front of others indicate problems when mild. All social fears indicate problems and are highly indicative of social phobia when pervasive. These preliminary findings provide guidance for clinicians and researchers to determine the boundaries that separate normative fears from problem indicators in children and adolescents, and indicate a differential severity threshold for specific and social fears.

Corneal Structural Changes in Nonneoplastic and Neoplastic Monoclonal Gammopathies.

PubMed

Aragona, Pasquale; Allegra, Alessandro; Postorino, Elisa Imelde; Rania, Laura; Innao, Vanessa; Wylegala, Edward; Nowinska, Anna; Ieni, Antonio; Pisani, Antonina; Musolino, Caterina; Puzzolo, Domenico; Micali, Antonio

2016-05-01

To investigate corneal confocal microscopic changes in nonneoplastic and neoplastic monoclonal gammopathies. Three groups of subjects were considered: group 1, twenty normal subjects; group 2, fifteen patients with monoclonal gammopathy of undetermined significance (MGUS); group 3, eight patients with smoldering multiple myeloma and eight patients with untreated multiple myeloma. After hematologic diagnosis, patients underwent ophthalmologic exam and in vivo confocal microscopic study. The statistical analysis was performed using ANOVA and Student-Newman-Keuls tests and receiver operating characteristic (ROC) curve analysis. Epithelial cells of gammopathic patients showed significantly higher reflectivity than controls, demonstrated by optical density (P < 0.001). Subbasal nerve density, branching, and beading were significantly altered in gammopathic patients (P = 0.01, P = 0.02, P = 0.02, respectively). The number of keratocytes was significantly reduced in neoplastic patients (P < 0.001 versus both normal and MGUS) in the anterior, medium, and posterior stroma. The ROC curve analysis showed good sensitivity and specificity for this parameter. Group 2 and 3 keratocytes showed higher nuclear and cytoplasmatic reflectivity in the medium and posterior stroma. Endothelial cells were not affected. Patients with neoplastic gammopathies showed peculiar alterations of the keratocyte number, which appeared significantly reduced. A follow-up with corneal confocal microscopy of patients with MGUS is suggested as a useful tool to identify peripheral tissue alterations linked to possible neoplastic disease development.

Differentiating invasive and pre-invasive lung cancer by quantitative analysis of histopathologic images

NASA Astrophysics Data System (ADS)

Zhou, Chuan; Sun, Hongliu; Chan, Heang-Ping; Chughtai, Aamer; Wei, Jun; Hadjiiski, Lubomir; Kazerooni, Ella

2018-02-01

We are developing automated radiopathomics method for diagnosis of lung nodule subtypes. In this study, we investigated the feasibility of using quantitative methods to analyze the tumor nuclei and cytoplasm in pathologic wholeslide images for the classification of pathologic subtypes of invasive nodules and pre-invasive nodules. We developed a multiscale blob detection method with watershed transform (MBD-WT) to segment the tumor cells. Pathomic features were extracted to characterize the size, morphology, sharpness, and gray level variation in each segmented nucleus and the heterogeneity patterns of tumor nuclei and cytoplasm. With permission of the National Lung Screening Trial (NLST) project, a data set containing 90 digital haematoxylin and eosin (HE) whole-slide images from 48 cases was used in this study. The 48 cases contain 77 regions of invasive subtypes and 43 regions of pre-invasive subtypes outlined by a pathologist on the HE images using the pathological tumor region description provided by NLST as reference. A logistic regression model (LRM) was built using leave-one-case-out resampling and receiver operating characteristic (ROC) analysis for classification of invasive and pre-invasive subtypes. With 11 selected features, the LRM achieved a test area under the ROC curve (AUC) value of 0.91+/-0.03. The results demonstrated that the pathologic invasiveness of lung adenocarcinomas could be categorized with high accuracy using pathomics analysis.

Differentiating pheochromocytoma from lipid-poor adrenocortical adenoma by CT texture analysis: feasibility study.

PubMed

Zhang, Gu-Mu-Yang; Shi, Bing; Sun, Hao; Jin, Zheng-Yu; Xue, Hua-Dan

2017-09-01

To investigate the feasibility of using CT texture analysis (CTTA) to differentiate pheochromocytoma from lipid-poor adrenocortical adenoma (lp-ACA). Ninety-eight pheochromocytomas and 66 lp-ACAs were included in this retrospective study. CTTA was performed on unenhanced and enhanced images. Receiver operating characteristic (ROC) analysis was performed, and the area under the ROC curve (AUC) was calculated for texture parameters that were significantly different for the objective. Diagnostic accuracies were evaluated using the cutoff values of texture parameters with the highest AUCs. Compared to lp-ACAs, pheochromocytomas had significantly higher mean gray-level intensity (Mean), entropy, and mean of positive pixels (MPP), but lower skewness and kurtosis on unenhanced images (P < 0.001). On enhanced images, these texture-quantifiers followed a similar trend where Mean, entropy, and MPP were higher, but skewness and kurtosis were lower in pheochromocytomas. Standard deviation (SD) was also significantly higher in pheochromocytomas on enhanced images. Mean and MPP quantified from no filtration on unenhanced CT images yielded the highest AUC of 0.86 ± 0.03 (95% CI 0.81-0.91) at a cutoff value of 34.0 for Mean and MPP, respectively (sensitivity = 79.6%, specificity = 83.3%, accuracy = 81.1%). It was feasible to use CTTA to differentiate pheochromocytoma from lp-ACA.

Association between Serum Cystatin C and Diabetic Foot Ulceration in Patients with Type 2 Diabetes: A Cross-Sectional Study

PubMed Central

Zhao, Jie; Deng, Wuquan; Zhang, Yuping; Zheng, Yanling; Zhou, Lina; Boey, Johnson; Armstrong, David G.; Yang, Gangyi

2016-01-01

Serum cystatin C (CysC) has been identified as a possible potential biomarker in a variety of diabetic complications, including diabetic peripheral neuropathy and peripheral artery disease. We aimed to examine the association between CysC and diabetic foot ulceration (DFU) in patients with type 2 diabetes (T2D). 411 patients with T2D were enrolled in this cross-sectional study at a university hospital. Clinical manifestations and biochemical parameters were compared between DFU group and non-DFU group. The association between serum CysC and DFU was explored by binary logistic regression analysis. The cut point of CysC for DFU was also evaluated by receiver operating characteristic (ROC) curve. The prevalence of coronary artery disease, diabetic nephropathy (DN), and DFU dramatically increased with CysC (P < 0.01) in CysC quartiles. Multivariate logistic regression analysis indicated that the significant risk factors for DFU were serum CysC, coronary artery disease, hypertension, insulin use, the differences between supine and sitting TcPO2, and hypertension. ROC curve analysis revealed that the cut point of CysC for DFU was 0.735 mg/L. Serum CysC levels correlated with DFU and severity of tissue loss. Our study results indicated that serum CysC was associated with a high prevalence of DFU in Chinese T2D subjects. PMID:27668262

Development and prospective multicenter evaluation of the long noncoding RNA MALAT-1 as a diagnostic urinary biomarker for prostate cancer

PubMed Central

Lu, Ji; Shi, Xiaolei; Zhu, Yasheng; Zhang, Wei; Jing, Taile; Zhang, Chao; Shen, Jian; Xu, Chuanliang; Wang, Huiqing; Wang, Haifeng; Wang, Yang; Liu, Bin; Li, Yaoming; Fang, Ziyu; Guo, Fei; Qiao, Meng; Wu, Chengyao; Wei, Qiang; Xu, Danfeng; Shen, Dan; Lu, Xin; Gao, Xu; Hou, Jianguo; Sun, Yinghao

2014-01-01

The current strategy for diagnosing prostate cancer (PCa) is mainly based on the serum prostate-specific antigen (PSA) test. However, PSA has low specificity and has led to numerous unnecessary biopsies. We evaluated the effectiveness of urinary metastasis-associated lung adenocarcinoma transcript 1 (MALAT-1), a long noncoding RNA, for predicting the risk of PCa before biopsy. The MALAT-1 score was tested in a discovery phase and a multi-center validation phase. The predictive power of the MALAT-1 score was evaluated by the area under receiver operating characteristic (ROC) curve (AUC) and by decision curve analysis. As an independent predictor of PCa, the MALAT-1 score was significantly higher in men with a positive biopsy than in those with a negative biopsy. The ROC analysis showed a higher AUC for the MALAT-1 score (0.670 and 0.742) vs. the total PSA (0.545 and 0.601) and percent free PSA (0.622 and 0.627) in patients with PSA values of 4.0-10 ng/ml. According to the decision curve analysis, using a probability threshold of 25%, the MALAT-1 model would prevent 30.2%-46.5% of unnecessary biopsies in PSA 4–10 ng/ml cohorts, without missing any high-grade cancers. Our results demonstrate that urine MALAT-1 is a promising biomarker for predicting prostate cancer risk. PMID:25526029

Diagnosis of adrenal insufficiency.

PubMed

Dorin, Richard I; Qualls, Clifford R; Crapo, Lawrence M

2003-08-05

The cosyntropin stimulation test is the initial endocrine evaluation of suspected primary or secondary adrenal insufficiency. To critically review the utility of the cosyntropin stimulation test for evaluating adrenal insufficiency. The MEDLINE database was searched from 1966 to 2002 for all English-language papers related to the diagnosis of adrenal insufficiency. Studies with fewer than 5 persons with primary or secondary adrenal insufficiency or with fewer than 10 persons as normal controls were excluded. For secondary adrenal insufficiency, only studies that stratified participants by integrated tests of adrenal function were included. Summary receiver-operating characteristic (ROC) curves were generated from all studies that provided sensitivity and specificity data for 250-microg and 1-microg cosyntropin tests; these curves were then compared by using area under the curve (AUC) methods. All estimated values are given with 95% CIs. At a specificity of 95%, sensitivities were 97%, 57%, and 61% for summary ROC curves in tests for primary adrenal insufficiency (250-microg cosyntropin test), secondary adrenal insufficiency (250-microg cosyntropin test), and secondary adrenal insufficiency (1-microg cosyntropin test), respectively. The area under the curve for primary adrenal insufficiency was significantly greater than the AUC for secondary adrenal insufficiency for the high-dose cosyntropin test (P < 0.001), but AUCs for the 250-microg and 1-microg cosyntropin tests did not differ significantly (P > 0.5) for secondary adrenal insufficiency. At a specificity of 95%, summary ROC analysis for the 250-microg cosyntropin test yielded a positive likelihood ratio of 11.5 (95% CI, 8.7 to 14.2) and a negative likelihood ratio of 0.45 (CI, 0.30 to 0.60) for the diagnosis of secondary adrenal insufficiency. Cortisol response to cosyntropin varies considerably among healthy persons. The cosyntropin test performs well in patients with primary adrenal insufficiency, but the lower sensitivity in patients with secondary adrenal insufficiency necessitates use of tests involving stimulation of the hypothalamus if the pretest probability is sufficiently high. The operating characteristics of the 250-microg and 1-microg cosyntropin tests are similar.

Post-anoxic quantitative MRI changes may predict emergence from coma and functional outcomes at discharge.

PubMed

Reynolds, Alexandra S; Guo, Xiaotao; Matthews, Elizabeth; Brodie, Daniel; Rabbani, Leroy E; Roh, David J; Park, Soojin; Claassen, Jan; Elkind, Mitchell S V; Zhao, Binsheng; Agarwal, Sachin

2017-08-01

Traditional predictors of neurological prognosis after cardiac arrest are unreliable after targeted temperature management. Absence of pupillary reflexes remains a reliable predictor of poor outcome. Diffusion-weighted imaging has emerged as a potential predictor of recovery, and here we compare imaging characteristics to pupillary exam. We identified 69 patients who had MRIs within seven days of arrest and used a semi-automated algorithm to perform quantitative volumetric analysis of apparent diffusion coefficient (ADC) sequences at various thresholds. Area under receiver operating characteristic curves (ROC-AUC) were estimated to compare predictive values of quantitative MRI with pupillary exam at days 3, 5 and 7 post-arrest, for persistence of coma and functional outcomes at discharge. Cerebral Performance Category scores of 3-4 were considered poor outcome. Excluding patients where life support was withdrawn, ≥2.8% diffusion restriction of the entire brain at an ADC of ≤650×10 -6 m 2 /s was 100% specific and 68% sensitive for failure to wake up from coma before discharge. The ROC-AUC of ADC changes at ≤450×10 -6 mm 2 /s and ≤650×10 -6 mm 2 /s were significantly superior in predicting failure to wake up from coma compared to bilateral absence of pupillary reflexes. Among survivors, >0.01% of diffusion restriction of the entire brain at an ADC ≤450×10 -6 m 2 /s was 100% specific and 46% sensitive for poor functional outcome at discharge. The ROC curve predicting poor functional outcome at ADC ≤450×10 -6 mm 2 /s had an AUC of 0.737 (0.574-0.899, p=0.04). Post-anoxic diffusion changes using quantitative brain MRI may aid in predicting persistent coma and poor functional outcomes at hospital discharge. Copyright © 2017 Elsevier B.V. All rights reserved.

Value of combining serum carcinoembryonic antigen and PET/CT in predicting EGFR mutation in non-small cell lung cancer.

PubMed

Gu, Jincui; Xu, Siqi; Huang, Lixia; Li, Shaoli; Wu, Jian; Xu, Junwen; Feng, Jinlun; Liu, Baomo; Zhou, Yanbin

2018-02-01

We sought to investigate the associations between pretreatment serum Carcinoembryonic antigen (CEA) level, 18 F-Fluoro-2-deoxyglucose ( 18 F-FDG) uptake value of primary tumor and epidermal growth factor receptor ( EGFR ) mutation status in non-small cell lung cancer (NSCLC). We retrospectively reviewed medical records of 210 NSCLC patients who underwent EGFR mutation test and 18 F-FDG positron emission tomography/computed tomography (PET/CT) scan before anti-tumor therapy. The associations between EGFR mutations and patients' characteristics, serum CEA, PET/CT imaging characteristics maximal standard uptake value (SUVmax) of the primary tumor were analyzed. Receiver-operating characteristic (ROC) curve was used to assess the predictive value of these factors. EGFR mutations were found in 70 patients (33.3%). EGFR mutations were more common in high CEA group (CEA ≥7.0 ng/mL) than in low CEA group (CEA <7.0 ng/mL) (40.4% vs . 27.6%; P=0.05). Females (P<0.001), non-smokers (P<0.001), patients with adenocarcinoma (P<0.001) and SUVmax <9.0 (P=0.001) were more likely to be EGFR mutation-positive. Multivariate analysis revealed that gender, tumor histology, pretreatment serum CEA level, and SUVmax were the most significant predictors for EGFR mutations. The ROC curve revealed that combining these four factors yielded a higher calculated AUC (0.80). Gender, histology, pretreatment serum CEA level and SUVmax are significant predictors for EGFR mutations in NSCLC. Combining these factors in predicting EGFR mutations has a moderate diagnostic accuracy, and is helpful in guiding anti-tumor treatment.

Automatic Mexico Gulf Oil Spill Detection from Radarsat-2 SAR Satellite Data Using Genetic Algorithm

NASA Astrophysics Data System (ADS)

Marghany, Maged

2016-10-01

In this work, a genetic algorithm is exploited for automatic detection of oil spills of small and large size. The route is achieved using arrays of RADARSAT-2 SAR ScanSAR Narrow single beam data obtained in the Gulf of Mexico. The study shows that genetic algorithm has automatically segmented the dark spot patches related to small and large oil spill pixels. This conclusion is confirmed by the receiveroperating characteristic (ROC) curve and ground data which have been documented. The ROC curve indicates that the existence of oil slick footprints can be identified with the area under the curve between the ROC curve and the no-discrimination line of 90%, which is greater than that of other surrounding environmental features. The small oil spill sizes represented 30% of the discriminated oil spill pixels in ROC curve. In conclusion, the genetic algorithm can be used as a tool for the automatic detection of oil spills of either small or large size and the ScanSAR Narrow single beam mode serves as an excellent sensor for oil spill patterns detection and surveying in the Gulf of Mexico.

Lactate clearance cut off for early mortality prediction in adult sepsis and septic shock patients

NASA Astrophysics Data System (ADS)

Sinto, R.; Widodo, D.; Pohan, H. T.

2018-03-01

Previous lactate clearance cut off for early mortality prediction in sepsis and septic shock patient was determined by consensus from small sample size-study. We investigated the best lactate clearance cut off and its ability to predict early mortality in sepsis and septic shock patients. This cohort study was conducted in Intensive Care Unit of CiptoMangunkusumo Hospital in 2013. Patients’ lactate clearance and eight other resuscitationendpoints were recorded, and theoutcome was observed during the first 120 hours. The clearance cut off was determined using receiver operating characteristic (ROC) analysis, and its ability was investigated with Cox’s proportional hazard regression analysis using other resuscitation endpoints as confounders. Total of 268 subjects was included, of whom 70 (26.11%) subjects died within the first 120 hours. The area under ROC of lactate clearance to predict early mortality was 0.78 (95% % confidence interval [CI] 0.71-0.84) with best cut off was <7.5% (sensitivity and specificity 88.99% and 81.4% respectively). Compared with group achieving lactate clearance target, group not achieving lactate clearance target had to increase early mortality risk (adjusted hazard ratio 13.42; 95%CI 7.19-25.07). In conclusion, the best lactate clearance cut off as anearly mortality predictor in sepsis and septic shock patients is 7.5%.

Can unaided non-linguistic measures predict cochlear implant candidacy?

PubMed Central

Shim, Hyun Joon; Won, Jong Ho; Moon, Il Joon; Anderson, Elizabeth S.; Drennan, Ward R.; McIntosh, Nancy E.; Weaver, Edward M.; Rubinstein, Jay T.

2014-01-01

Objective To determine if unaided, non-linguistic psychoacoustic measures can be effective in evaluating cochlear implant (CI) candidacy. Study Design Prospective split-cohort study including predictor development subgroup and independent predictor validation subgroup. Setting Tertiary referral center. Subjects Fifteen subjects (28 ears) with hearing loss were recruited from patients visiting the University of Washington Medical Center for CI evaluation. Methods Spectral-ripple discrimination (using a 13-dB modulation depth) and temporal modulation detection using 10- and 100-Hz modulation frequencies were assessed with stimuli presented through insert earphones. Correlations between performance for psychoacoustic tasks and speech perception tasks were assessed. Receiver operating characteristic (ROC) curve analysis was performed to estimate the optimal psychoacoustic score for CI candidacy evaluation in the development subgroup and then tested in an independent sample. Results Strong correlations were observed between spectral-ripple thresholds and both aided sentence recognition and unaided word recognition. Weaker relationships were found between temporal modulation detection and speech tests. ROC curve analysis demonstrated that the unaided spectral ripple discrimination shows a good sensitivity, specificity, positive predictive value, and negative predictive value compared to the current gold standard, aided sentence recognition. Conclusions Results demonstrated that the unaided spectral-ripple discrimination test could be a promising tool for evaluating CI candidacy. PMID:24901669

Factors associated with an inadequate hypoglycemia in the insulin tolerance test in Japanese patients with suspected or proven hypopituitarism.

PubMed

Takahashi, Kiyohiko; Nakamura, Akinobu; Miyoshi, Hideaki; Nomoto, Hiroshi; Kameda, Hiraku; Cho, Kyu Yong; Nagai, So; Shimizu, Chikara; Taguri, Masataka; Terauchi, Yasuo; Atsumi, Tatsuya

2017-04-29

We attempted to identify the predictors of an inadequate hypoglycemia in insulin tolerance test (ITT), defined as a blood glucose level higher than 2.8 mmol/L after insulin injection, in Japanese patients with suspected or proven hypopituitarism. A total of 78 patients who had undergone ITT were divided into adequate and inadequate hypoglycemia groups. The relationships between the subjects' clinical parameters and inadequate hypoglycemia in ITT were analyzed. Stepwise logistic regression analysis identified high systolic blood pressure (SBP) and high homeostasis model assessment of insulin resistance (HOMA-IR) as being independent factors associated with inadequate hypoglycemia in ITT. Receiver operating characteristic (ROC) curve analysis revealed the cutoff value for inadequate hypoglycemia was 109 mmHg for SBP and 1.4 for HOMA-IR. The areas under ROC curve for SBP and HOMA-IR were 0.72 and 0.86, respectively. We confirmed that high values of SBP and HOMA-IR were associated with inadequate hypoglycemia in ITT, regardless of the degree of reduction of pituitary hormone levels. Furthermore, the strongest predictor of inadequate hypoglycemia was obtained by using the cutoff value of HOMA-IR. Our results suggest that HOMA-IR is a useful pre-screening tool for ITT in these populations.

Quantity of Candida Colonies in Saliva: 
A Diagnostic Evaluation for Oral Candidiasis.

PubMed

Zhou, Pei Ru; Hua, Hong; Liu, Xiao Song

To investigate the relationship between the quantity of Candida colonies in saliva and oral candidiasis (OC), as well as to identify the threshold for distinguishing oral candidiasis from healthy carriage. A diagnostic test was conducted in 197 patients with different oral problems. The diagnosis of OC was established based on clinical features. Whole saliva samples from the subjects were cultured for Candida species. Receiver operating characteristic (ROC) curve analysis was used in this study. OC patients had significantly more Candida colony-forming units per millilitre saliva (795 cfu/ml) than asymptomatic carriers (40 cfu/ml; P < 0.05). Among different types of candidiasis, the quantity of Candida colonies differed. The number of Candida colonies in pseudomembranous type was significantly higher than that in the erythematous type (P < 0.05). Candida albicans was the predominant species of Candida. The cut-off point with the best fit for OC diagnosis was calculated to be 266 cfu/ml. The sensitivity and specificity were 0.720 and 0.825, respectively. Analysis of the ROC curve indicated that Candida colonies had a high diagnostic value for OC, as demonstrated by the area under the curve (AUC = 0.873). Based on this study, the value of 270 cfu/ml was considered a threshold for distinguishing OC from carriage.

The effect of Interaction Anxiousness Scale and Brief Social Phobia Scale for screening social anxiety disorder in college students: a study on discriminative validity.

PubMed

Cao, Jianqin; Yang, Jinwei; Zhou, Yuqiu; Chu, Fuliu; Zhao, Xiwu; Wang, Weiren; Wang, Yunlong; Peng, Tao

2016-12-01

Social anxiety disorder (SAD) is one of the most prevalent mental health problems, but there is little research concerning the effective screening instruments in practice. This study was designed to examine the discriminative validity of Interaction Anxiousness Scale (IAS) and Brief Social Phobia Scale (BSPS) for the screening of SAD through the compared and combined analysis. Firstly, 421 Chinese undergraduates were screened by the IAS and BSPS. Secondly, in the follow-up stage, 248 students were interviewed by the Structured Clinical Interview for DSM-IV. Receiver operating characteristic (ROC) analysis was used, and the related psychometric characters were checked. The results indicated that the ROC in these two scales demonstrated discrimination is in satisfactory level (range: 0.7-0.8). However, the highest agreement (92.17%) was identified when a cut-off point of 50 measured by the IAS and a cut-off point of 34 by the BSPS were combined, also with higher PPV, SENS, SPEC and OA than that reached when BSPS was used individually, as well as PPV, SPEC and OA in IAS. The findings indicate that the combination of these two scales is valid as the general screening instrument for SAD in maximizing the discriminative validity.

A diagnostic model for the detection of sensitization to wheat allergens was developed and validated in bakery workers.

PubMed

Suarthana, Eva; Vergouwe, Yvonne; Moons, Karel G; de Monchy, Jan; Grobbee, Diederick; Heederik, Dick; Meijer, Evert

2010-09-01

To develop and validate a prediction model to detect sensitization to wheat allergens in bakery workers. The prediction model was developed in 867 Dutch bakery workers (development set, prevalence of sensitization 13%) and included questionnaire items (candidate predictors). First, principal component analysis was used to reduce the number of candidate predictors. Then, multivariable logistic regression analysis was used to develop the model. Internal validation and extent of optimism was assessed with bootstrapping. External validation was studied in 390 independent Dutch bakery workers (validation set, prevalence of sensitization 20%). The prediction model contained the predictors nasoconjunctival symptoms, asthma symptoms, shortness of breath and wheeze, work-related upper and lower respiratory symptoms, and traditional bakery. The model showed good discrimination with an area under the receiver operating characteristic (ROC) curve area of 0.76 (and 0.75 after internal validation). Application of the model in the validation set gave a reasonable discrimination (ROC area=0.69) and good calibration after a small adjustment of the model intercept. A simple model with questionnaire items only can be used to stratify bakers according to their risk of sensitization to wheat allergens. Its use may increase the cost-effectiveness of (subsequent) medical surveillance.

Relationship between CT densitometry with a slice thickness of 0.5 mm and audiometry in otosclerosis.

PubMed

Kawase, Setsuko; Naganawa, Shinji; Sone, Michihiko; Ikeda, Mitsuru; Ishigaki, Takeo

2006-06-01

The appropriate cutoff Hounsfield unit (HU) value for the diagnosis of otosclerosis was determined and the correlation between the bone conduction threshold and the findings of computed tomography (CT) densitometry investigated. CT images, 0.5-mm thick, were evaluated in 24 ears with otosclerosis and 19 control ears. Eight regions of interest were set around the otic capsule. The mean HU values in the area anterior to the oval window (A-OW) and anterior to the internal auditory canal (A-IAC) were significantly lower in otosclerosis than in controls. Based on receiver operating characteristic (ROC) analysis, the cutoff HU value in A-OW was determined to be 2,187.3 HU. The mean HU value in retrofenestral otosclerosis was significantly lower in the area A-OW, A-IAC and around the cochlea than in controls. Based on ROC analysis, the cutoff HU value in the latter was determined to be 2,045 HU. A statistically significant correlation was found between the density of the area A-OW and the hearing level at 500 and 1,000 Hz, and between the density of the area around the cochlea and the hearing level at most frequencies. These results suggest the semi-automated diagnosis of otosclerosis may be possible.

Increased Levels of Circulating Anti-ANXA1 IgG Antibody in Patients with Non-Small Cell Lung Cancer.

PubMed

Liang, Tingting; Han, Zhifeng; Zhao, Huan; Zhang, Xuan; Wang, Yao

2018-06-01

Our previous studies revealed that concentrations of circulating antibodies to annexin A1 (ANXA1) were increased in non-small lung cancer (NSCLC). This study was thus designed to replicate this initial finding with an independent sample set. An enzyme-linked immunosorbent assay (ELISA) was developed in-house to examine plasma antiANXA1 IgG levels in 220 patients with NSCLC and 200 control subjects. Mann-Whitney U test showed that patients with NSCLC had significantly higher anti-ANXA1 IgG levels than control subjects (Z = -4.02, p < 0.001); male patients appeared to mainly contribute to the increased antibody level (Z = -3.09, p = 0.002). Receiver operating characteristic (ROC) curve analysis showed an overall area under the ROC curve (AUC) of 0.61 (95% CI: 0.56 - 0.67), with sensitivity of 8% against a specificity of 95.0%. Spearman's correlation analysis failed to show a significant correlation between the anti-ANXA1 IgG levels and the expression of three tumor-associated antigens including p53 (r = 0.156, p = 0.027), Ki67 (r = -0.048, p = 0.489), and EGFR (r = 0.02, p = 0.782). Increased levels of circulating anti-ANXA1 IgG antibody may have a prognostic value for NSCLC.

Carboxyhemoglobin Formation in Preterm Infants Is Related to the Subsequent Development of Bronchopulmonary Dysplasia

PubMed Central

Tokuriki, Shuko; Okuno, Takashi; Ohta, Genrei

2015-01-01

Objective. To evaluate the usefulness of carboxyhemoglobin (CO-Hb) levels as a biomarker to predict the development and severity of bronchopulmonary dysplasia (BPD). Methods. Twenty-five infants born at <33 wk of gestational age or with a birth weight of <1,500 g were enrolled. CO-Hb levels were measured between postnatal days 5 and 8, 12 and 15, 19 and 22, and 26 and 29. Urinary levels of 8-hydroxydeoxyguanosine (8-OHdG), advanced oxidation protein products, and Nε-(hexanoyl) lysine were measured between postnatal days 5 and 8 and 26 and 29. Receiver operating characteristic (ROC) analysis was used to compare the biomarkers' predictive values. Results. Compared with infants in the no-or-mild BPD group, infants with moderate-to-severe BPD exhibited higher CO-Hb levels during the early postnatal period and higher 8-OHdG levels between postnatal days 5 and 8. Using ROC analysis to predict the development of moderate-to-severe BPD, the area under the curve (AUC) for CO-Hb levels between postnatal days 5 and 8 was higher than AUCs for the urinary markers. Conclusions. CO-Hb levels during the early postnatal period may serve as a practical marker for evaluating oxidative stress and the severity of subsequently developing BPD. PMID:26294808

Carboxyhemoglobin Formation in Preterm Infants Is Related to the Subsequent Development of Bronchopulmonary Dysplasia.

PubMed

Tokuriki, Shuko; Okuno, Takashi; Ohta, Genrei; Ohshima, Yusei

2015-01-01

To evaluate the usefulness of carboxyhemoglobin (CO-Hb) levels as a biomarker to predict the development and severity of bronchopulmonary dysplasia (BPD). Twenty-five infants born at <33 wk of gestational age or with a birth weight of <1,500 g were enrolled. CO-Hb levels were measured between postnatal days 5 and 8, 12 and 15, 19 and 22, and 26 and 29. Urinary levels of 8-hydroxydeoxyguanosine (8-OHdG), advanced oxidation protein products, and Nε-(hexanoyl) lysine were measured between postnatal days 5 and 8 and 26 and 29. Receiver operating characteristic (ROC) analysis was used to compare the biomarkers' predictive values. Compared with infants in the no-or-mild BPD group, infants with moderate-to-severe BPD exhibited higher CO-Hb levels during the early postnatal period and higher 8-OHdG levels between postnatal days 5 and 8. Using ROC analysis to predict the development of moderate-to-severe BPD, the area under the curve (AUC) for CO-Hb levels between postnatal days 5 and 8 was higher than AUCs for the urinary markers. CO-Hb levels during the early postnatal period may serve as a practical marker for evaluating oxidative stress and the severity of subsequently developing BPD.

Quantitative analysis of iris parameters in keratoconus patients using optical coherence tomography.

PubMed

Bonfadini, Gustavo; Arora, Karun; Vianna, Lucas M; Campos, Mauro; Friedman, David; Muñoz, Beatriz; Jun, Albert S

2015-01-01

To investigate the relationship between quantitative iris parameters and the presence of keratoconus. Cross-sectional observational study that included 15 affected eyes of 15 patients with keratoconus and 26 eyes of 26 normal age- and sex-matched controls. Iris parameters (area, thickness, and pupil diameter) of affected and unaffected eyes were measured under standardized light and dark conditions using anterior segment optical coherence tomography (AS-OCT). To identify optimal iris thickness cutoff points to maximize the sensitivity and specificity when discriminating keratoconus eyes from normal eyes, the analysis included the use of receiver operating characteristic (ROC) curves. Iris thickness and area were lower in keratoconus eyes than in normal eyes. The mean thickness at the pupillary margin under both light and dark conditions was found to be the best parameter for discriminating normal patients from keratoconus patients. Diagnostic performance was assessed by the area under the ROC curve (AROC), which had a value of 0.8256 with 80.0% sensitivity and 84.6% specificity, using a cutoff of 0.4125 mm. The sensitivity increased to 86.7% when a cutoff of 0.4700 mm was used. In our sample, iris thickness was lower in keratoconus eyes than in normal eyes. These results suggest that tomographic parameters may provide novel adjunct approaches for keratoconus screening.

Determining decision thresholds and evaluating indicators when conservation status is measured as a continuum.

PubMed

Connors, B M; Cooper, A B

2014-12-01

Categorization of the status of populations, species, and ecosystems underpins most conservation activities. Status is often based on how a system's current indicator value (e.g., change in abundance) relates to some threshold of conservation concern. Receiver operating characteristic (ROC) curves can be used to quantify the statistical reliability of indicators of conservation status and evaluate trade-offs between correct (true positive) and incorrect (false positive) classifications across a range of decision thresholds. However, ROC curves assume a discrete, binary relationship between an indicator and the conservation status it is meant to track, which is a simplification of the more realistic continuum of conservation status, and may limit the applicability of ROC curves in conservation science. We describe a modified ROC curve that treats conservation status as a continuum rather than a discrete state. We explored the influence of this continuum and typical sources of variation in abundance that can lead to classification errors (i.e., random variation and measurement error) on the true and false positive rates corresponding to varying decision thresholds and the reliability of change in abundance as an indicator of conservation status, respectively. We applied our modified ROC approach to an indicator of endangerment in Pacific salmon (Oncorhynchus nerka) (i.e., percent decline in geometric mean abundance) and an indicator of marine ecosystem structure and function (i.e., detritivore biomass). Failure to treat conservation status as a continuum when choosing thresholds for indicators resulted in the misidentification of trade-offs between true and false positive rates and the overestimation of an indicator's reliability. We argue for treating conservation status as a continuum when ROC curves are used to evaluate decision thresholds in indicators for the assessment of conservation status. © 2014 Society for Conservation Biology.

A study on risk factors and diagnostic efficiency of posthepatectomy liver failure in the nonobstructive jaundice.

PubMed

Wang, He; Lu, Shi-Chun; He, Lei; Dong, Jia-Hong

2018-02-01

Liver failure remains as the most common complication and cause of death after hepatectomy, and continues to be a challenge for doctors.t test and χ test were used for single factor analysis of data-related variables, then results were introduced into the model to undergo the multiple factors logistic regression analysis. Pearson correlation analysis was performed for related postoperative indexes, and a diagnostic evaluation was performed using the receiver operating characteristic (ROC) of postoperative indexes.Differences in age, body mass index (BMI), portal vein hypertension, bile duct cancer, total bilirubin, alkaline phosphatase (ALP), gamma-glutamyl transpeptidase (GGT), operation time, cumulative portal vein occlusion time, intraoperative blood volume, residual liver volume (RLV)/entire live rvolume, ascites volume at postoperative day (POD)3, supplemental albumin amount at POD3, hospitalization time after operation, and the prothrombin activity (PTA) were statistically significant. Furthermore, there were significant differences in total bilirubin and the supplemental albumin amount at POD3. ROC analysis of the average PTA, albumin amounts, ascites volume at POD3, and their combined diagnosis were performed, which had diagnostic value for postoperative liver failure (area under the curve (AUC): 0.895, AUC: 0.798, AUC: 0.775, and AUC: 0.903).Preoperative total bilirubin level and the supplemental albumin amount at POD3 were independent risk factors. PTA can be used as the index of postoperative liver failure, and the combined diagnosis of the indexes can improve the early prediction of postoperative liver failure.

Area and volume ratios for prediction of visual outcome in idiopathic macular hole.

PubMed

Geng, Xing-Yun; Wu, Hui-Qun; Jiang, Jie-Hui; Jiang, Kui; Zhu, Jun; Xu, Yi; Dong, Jian-Cheng; Yan, Zhuang-Zhi

2017-01-01

To predict the visual outcome in patients undergoing macular hole surgery by two novel three-dimensional morphological parameters on optical coherence tomography (OCT): area ratio factor (ARF) and volume ratio factor (VRF). A clinical case series was conducted, including 54 eyes of 54 patients with an idiopathic macular hole (IMH). Each patient had an OCT examination before and after surgery. Morphological parameters of the macular hole, such as minimum diameter, base diameter, and height were measured. Then, the macular hole index (MHI), tractional hole index (THI), and hole form factor (HFF) were calculated. Meanwhile, novel postoperative macular hole (MH) factors, ARF and VRF were calculated by three-dimensional morphology. Bivariate correlations were performed to acquire asymptotic significance values between the steady best corrected visual acuity (BCVA) after surgery and 2D/3D arguments of MH by the Pearson method with two-tailed test. All significant factors were analyzed by the receiver operating characteristic (ROC) curve analysis of SPSS software which were responsible for vision recovery. ROC curves analyses were performed to further discuss the different parameters on the prediction of visual outcome. The mean and standard deviation values of patients' age, symptoms duration, and follow-up time were 64.8±8.9y (range: 28-81), 18.6±11.5d (range: 2-60), and 11.4±0.4mo (range: 6-24), respectively. Steady-post-BCVA analyzed with bivariate correlations was found to be significantly correlated with base diameter ( r =0.521, P <0.001), minimum diameter ( r =0.514, P <0.001), MHI ( r =-0.531, P <0.001), THI ( r =-0.386, P =0.004), HFF ( r =-0.508, P <0.001), and ARF ( r =-0.532, P <0.001). Other characteristic parameters such as age, duration of surgery, height, diameter hole index, and VRF were not statistically significant with steady-post-BCVA. According to area under the curve (AUC) values, values of ARF, MHI, HFF, minimum diameter, THI, and base diameter are 0.806, 0.772, 0.750, 0.705, 0.690, and 0.686, respectively. However, Steady-post-BCVA analysis with bivariate correlations for VRF was no statistical significance. Results of ROC curve analysis indicated that the MHI value, HFF, and ARF was greater than 0.427, 1.027 and 1.558 respectively which could correlate with better visual acuity. Compared with MHI and HFF, ARF could effectively express three-dimensional characteristics of macular hole and achieve better sensitivity and specificity. Thus, ARF could be the most effective parameter to predict the visual outcome in macular hole surgery.

Using BIRADS categories in ROC experiments

NASA Astrophysics Data System (ADS)

Kallergi, Maria; Hersh, Marla R.; Thomas, Jerry A.

2002-04-01

This paper investigated the use of the Breast Imaging Reporting And Data System (BIRADS) Lexicon in ROC mammography experiments. Analysis was based on data from parallel ROC experiments performed at two Institutions with different readers and databases to compare film to digitized mammography. Seven readers participated in the studies and read approximately 200 cases each in two formats: film and digital or softcopy. Reporting was done using BIRADS categories 1 through 5. Training was done with a separate set of cases and included detailed review of the relationship between BIRADS and a standard ROC discrete 5-point rating scale. The results from both sites showed equivalency between film and softcopy mammography. Decisions using the BIRADS categories showed no unsampled ROC regions and no degenerate data. Fits yielded smooth ROC curves that correlated to clinical practice. In a qualitative evaluation, all observers indicated preference in using the BIRADS classes instead of a discrete or continuous rating scheme. Familiarity with the rating process seems to relieve some of the bias associated with the interpretation of digitized mammograms from computer monitors (softcopy reading). Our results suggested that BIRADS categories can be used in comparative ROC studies because they represent a scale familiar to the reader that can be followed consistently and they provide a rating approach that accounts for both positive and negative cases to be evaluated and categorized.

Vitamin D supplementation as a potential cause of U-shaped associations between vitamin D levels and negative health outcomes: a decision tree analysis for risk of frailty.

PubMed

Kojima, Gotaro; Iliffe, Steve; Tanabe, Marianne

2017-10-16

A recent controversy in vitamin D research is a "U-shaped association", with elevated disease risks at both high and low 25-hydroxyvitamin D (25 (OH) D) levels. This is a cross-sectional study of 238 male nursing home veterans in Hawaii. Classification and regression tree (CART) analysis identified groups based on 25 (OH) D and vitamin D supplementation for frailty risk. Characteristics were examined and compared across the groups using logistic regression and receiver operating characteristic (ROC) curve analyses. CART analysis identified three distinct groups: vitamin D supplement users (n = 86), non-users with low vitamin D (n = 55), and non-users with high vitamin D (n = 97). Supplement users were the most frail, but had high mean 25 (OH) D of 26.6 ng/mL, which was compatible with 27.1 ng/mL in non-users with high vitamin D, while mean 25 (OH) D of non-users with low vitamin D was 11.7 ng/mL. Supplement users and non-users with low vitamin D were significantly more likely to be frail (odds ratio (OR) = 9.90, 95% CI = 2.18-44.86, p = 0.003; OR = 4.28, 95% CI = 1.44-12.68, p = 0.009, respectively), compared with non-users with low vitamin D. ROC curve analysis showed the three groups significantly predicted frailty (area under the curve = 0.73), with sensitivity of 64.4% and specificity of 76.7%, while 25 (OH) D did not predict frailty. In these nursing home veterans, vitamin D supplement users were the most frail but with high 25 (OH) D. This can potentially be a cause of U-shaped associations between vitamin D levels and negative health outcomes.

Arterial injuries after penetrating brain injury in civilians: risk factors on admission head computed tomography.

PubMed

Bodanapally, Uttam K; Saksobhavivat, Nitima; Shanmuganathan, Kathirkamanathan; Aarabi, Bizhan; Roy, Ashis K

2015-01-01

The object of this study was to determine the specific CT findings of the injury profile in penetrating brain injury (PBI) that are risk factors related to intracranial arterial injuries. The authors retrospectively evaluated admission head CTs and accompanying digital subtraction angiography (DSA) studies from patients with penetrating trauma to the head in the period between January 2005 and December 2012. Two authors reviewed the CT images to determine the presence or absence of 30 injury profile variables and quantified selected variables. The CT characteristics in patients with and without arterial injuries were compared using univariate analysis, multivariate analysis, and receiver operating characteristic (ROC) curve analysis to determine the respective risk factors, independent predictors, and optimal threshold values for the continuous variables. Fifty-five patients were eligible for study inclusion. The risk factors for an intracranial arterial injury on univariate analysis were an entry wound over the frontobasal-temporal regions, a bihemispheric wound trajectory, a wound trajectory in proximity to the circle of Willis (COW), a subarachnoid hemorrhage (SAH), a higher SAH score, an intraventricular hemorrhage (IVH), and a higher IVH score. A trajectory in proximity to the COW was the best predictor of injury (OR 6.8 and p = 0.005 for all penetrating brain injuries [PBIs]; OR 13.3 and p = 0.001 for gunshot wounds [GSWs]). Significant quantitative variables were higher SAH and IVH scores. An SAH score of 3 (area under the ROC curve [AUC] for all PBIs 0.72; AUC for GSWs 0.71) and an IVH score of 3 (AUC for all PBIs 0.65; AUC for GSWs 0.65) could be used as threshold values to suggest an arterial injury. The risk factors identified may help radiologists suggest the possibility of arterial injury and prioritize neurointerventional consultation and potential DSA studies.

Utility of the Military Acute Concussion Evaluation as a screening tool for mild traumatic brain injury in a civilian trauma population.

PubMed

Stone, Melvin E; Safadjou, Saman; Farber, Benjamin; Velazco, Nerissa; Man, Jianliang; Reddy, Srinivas H; Todor, Roxanne; Teperman, Sheldon

2015-07-01

Mild traumatic brain injury (mTBI) constitutes 75% of more than 1.5 million traumatic brain injuries annually. There exists no consensus on point-of-care screening for mTBI. The Military Acute Concussion Evaluation (MACE) is a quick and easy test used by the US Army to screen for mTBI; however, its utility in civilian trauma is unclear. It has two parts: a history section and the Standardized Assessment of Concussion (SAC) score (0-30) previously validated in sports injury. As a performance improvement project, our institution sought to evaluate the MACE as a concussion screening tool that could be used by housestaff in a general civilian trauma population. From June 2013 to May 2014, patients 18 years to 65 years old with suspected concussion were given the MACE within 72 hours of admission to our urban Level I trauma center. Patients with a positive head computed tomography were excluded. Demographic data and MACE scores were recorded in prospect. Concussion was defined as loss of consciousness and/or posttraumatic amnesia; concussed patients were compared with those nonconcussed. Sensitivity and specificity for each respective MACE score were used to plot a receiver operating characteristic (ROC) curve. An ROC curve area of 0.8 was set as the benchmark for a good screening test to distinguish concussion from nonconcussion. There were 84 concussions and 30 nonconcussed patients. Both groups were similar; however, the concussion group had a lower mean MACE score than the nonconcussed patients. Data analysis demonstrated the sensitivity and specificity of a range of MACE scores used to generate an ROC curve area of only 0.65. The MACE showed a lower mean score for individuals with concussion, defined by loss of consciousness and/or posttraumatic amnesia. However, the ROC curve area of 0.65 highly suggests that MACE alone would be a poor screening test for mTBI in a general civilian trauma population. Diagnostic study, level II.

Differences in the associations of anthropometric measures with insulin resistance and type 2 diabetes mellitus between Korean and US populations: Comparisons of representative nationwide sample data.

PubMed

Yoon, Yeong Sook; Choi, Han Seok; Kim, Jin Kuk; Kim, Yu Il; Oh, Sang Woo

Variation among ethnic groups in the association between obesity and insulin resistance (IR)/diabetes has been suggested, but studies reported inconsistent results. We evaluated ethnic differences in the association between obesity and insulin resistance (IR)/diabetes. We conducted a cross-sectional analysis using Korea (n=18,845) and the USA (n=4657) National Health and Nutrition Examination Survey(NHANES) 2007-2010. We performed statistical comparisons of AUC-ROC (area under the curve in a receiver operating characteristic curve) values for body mass index (BMI), waist circumference (WC) and homeostasis model assessment of insulin resistance (HOMA-IR) to predict IR or diabetes among different ethnic groups. AUC-ROC values for BMI and WC for predicting IR were highest in Whites (0.8324 and 0.8468) and lowest in Koreans (0.7422 and 0.7367). Whites showed the highest AUC-ROC values for BMI (0.6869) and WC (0.7421) for predicting diabetes, while the AUC-ROC for HOMA-IR was highest in Koreans (0.8861). Linear regression showed significant interactions between ethnicity and the main effects (all P<0.0001). Increases in BMI were associated with a larger increase in HOMA-IR in Whites (β=0.0719) and WC in Hispanics (β=0.0324), while BMI was associated with a larger increase in fasting glucose in Koreans (β=0.8279) and WC in Blacks (β=0.4037). In addition, the slope for fasting glucose with increasing HOMA-IR was steeper in Koreans (β=16.5952, P<0.001) than in other groups. The ability of BMI and WC to predict IR and diabetes was highest in Whites, while the ability of HOMA-IR to predict diabetes was highest in Koreans. Copyright © 2015 Asia Oceania Association for the Study of Obesity. Published by Elsevier Ltd. All rights reserved.

Rockall score in predicting outcomes of elderly patients with acute upper gastrointestinal bleeding

PubMed Central

Wang, Chang-Yuan; Qin, Jian; Wang, Jing; Sun, Chang-Yi; Cao, Tao; Zhu, Dan-Dan

2013-01-01

AIM: To validate the clinical Rockall score in predicting outcomes (rebleeding, surgery and mortality) in elderly patients with acute upper gastrointestinal bleeding (AUGIB). METHODS: A retrospective analysis was undertaken in 341 patients admitted to the emergency room and Intensive Care Unit of Xuanwu Hospital of Capital Medical University with non-variceal upper gastrointestinal bleeding. The Rockall scores were calculated, and the association between clinical Rockall scores and patient outcomes (rebleeding, surgery and mortality) was assessed. Based on the Rockall scores, patients were divided into three risk categories: low risk ≤ 3, moderate risk 3-4, high risk ≥ 4, and the percentages of rebleeding/death/surgery in each risk category were compared. The area under the receiver operating characteristic (ROC) curve was calculated to assess the validity of the Rockall system in predicting rebleeding, surgery and mortality of patients with AUGIB. RESULTS: A positive linear correlation between clinical Rockall scores and patient outcomes in terms of rebleeding, surgery and mortality was observed (r = 0.962, 0.955 and 0.946, respectively, P = 0.001). High clinical Rockall scores > 3 were associated with adverse outcomes (rebleeding, surgery and death). There was a significant correlation between high Rockall scores and the occurrence of rebleeding, surgery and mortality in the entire patient population (χ2 = 49.29, 23.10 and 27.64, respectively, P = 0.001). For rebleeding, the area under the ROC curve was 0.788 (95%CI: 0.726-0.849, P = 0.001); For surgery, the area under the ROC curve was 0.752 (95%CI: 0.679-0.825, P = 0.001) and for mortality, the area under the ROC curve was 0.787 (95%CI: 0.716-0.859, P = 0.001). CONCLUSION: The Rockall score is clinically useful, rapid and accurate in predicting rebleeding, surgery and mortality outcomes in elderly patients with AUGIB. PMID:23801840

Validation of Thwaites Index for diagnosing tuberculous meningitis in a Colombian population.

PubMed

Saavedra, Juan Sebastián; Urrego, Sebastián; Toro, María Eugenia; Uribe, Carlos Santiago; García, Jenny; Hernández, Olga; Arango, Juan Carlos; Pérez, Ángela Beatriz; Franco, Andrés; Vélez, Isabel Cristina; Del Corral, Helena

2016-11-15

To determine the diagnostic accuracy of Thwaites Index (TI) in a Colombian population to distinguish meningeal tuberculosis (MTB) from bacterial meningitis (BM) and from non-tuberculous meningitis. Exploratory analyses were conducted to assess the TI's validity for patients with human immunodeficiency virus (HIV) and children above six-years-old. The study included 527 patients, the TI was calculated and results compared with those of a reference standard established by expert neurologists. Sensitivity, specificity, area under the curve of receiver-operator characteristics (AUC-ROC) and likelihood ratios were calculated. The AUC-ROC to distinguish MTB from non-tuberculous meningitis was 0.72 (95% CI: 0.67-0.77) for HIV negative adults. AUC-ROC was 0.62 (95% CI: 0.50-0.74) for HIV positive adults and 0.83 (95% CI: 0.68-0.97) for children. For distinguishing MTB from BM the AUC-ROC was 0.78 (95% CI: 0.73-0.83); furthermore, the AUC-ROC was 0.57 (95% CI: 0.31-0.83) for HIV positive adults and 0.86 (95% CI: 0.73-0.99) for children. The TI was sensitive but not specific when used to distinguish MTB from BM in HIV negative adults. In HIV positive adults the index had low diagnostic accuracy. Moreover, the TI showed discrimination capability for children over 6years; however, research with larger samples is required in these. Copyright © 2016 Elsevier B.V. All rights reserved.

Improving the prediction of pathologic outcomes in patients undergoing radical prostatectomy: the value of prostate cancer antigen 3 (PCA3), prostate health index (phi) and sarcosine.

PubMed

Ferro, Matteo; Lucarelli, Giuseppe; Bruzzese, Dario; Perdonà, Sisto; Mazzarella, Claudia; Perruolo, Giuseppe; Marino, Ada; Cosimato, Vincenzo; Giorgio, Emilia; Tagliamonte, Virginia; Bottero, Danilo; De Cobelli, Ottavio; Terracciano, Daniela

2015-02-01

Several efforts have been made to find biomarkers that could help clinicians to preoperatively determine prostate cancer (PCa) pathological characteristics and choose the best therapeutic approach, avoiding over-treatment. On this effort, prostate cancer antigen 3 (PCA3), prostate health index (phi) and sarcosine have been presented as promising tools. We evaluated the ability of these biomarkers to predict the pathologic PCa characteristics within a prospectively collected contemporary cohort of patients who underwent radical prostatectomy (RP) for clinically localized PCa at a single high-volume Institution. The prognostic performance of PCA3, phi and sarcosine were evaluated in 78 patients undergoing RP for biopsy-proven PCa. Receiver operating characteristic (ROC) curve analyses tested the accuracy (area under the curve (AUC)) in predicting PCa pathological characteristics. Decision curve analyses (DCA) were used to assess the clinical benefit of the three biomarkers. We found that PCA3, phi and sarcosine levels were significantly higher in patients with tumor volume (TV)≥0.5 ml, pathologic Gleason sum (GS)≥7 and pT3 disease (all p-values≤0.01). ROC curve analysis showed that phi is an accurate predictor of high-stage (AUC 0.85 [0.77-0.93]), high-grade (AUC 0.83 [0.73-0.93]) and high-volume disease (AUC 0.94 [0.88-0.99]). Sarcosine showed a comparable AUC (0.85 [0.76-0.94]) only for T3 stage prediction, whereas PCA3 score showed lower AUCs, ranging from 0.74 (for GS) to 0.86 (for TV). PCA3, phi and sarcosine are predictors of PCa characteristics at final pathology. Successful clinical translation of these findings would reduce the frequency of surveillance biopsies and may enhance acceptance of active surveillance (AS). Copyright© 2015 International Institute of Anticancer Research (Dr. John G. Delinassios), All rights reserved.

Predictors of Long-Term School-Based Behavioral Outcomes in the Multimodal Treatment Study of Children with Attention-Deficit/Hyperactivity Disorder

PubMed Central

Reed, Margot O.; Jakubovski, Ewgeni; Johnson, Jessica A.

2017-01-01

Abstract Objective: To explore predictors of 8-year school-based behavioral outcomes in attention-deficit/hyperactivity disorder (ADHD). Methods: We examined potential baseline predictors of school-based behavioral outcomes in children who completed the 8-year follow-up in the multimodal treatment study of children with ADHD. Stepwise logistic regression and receiver operating characteristic (ROC) analysis identified baseline predictors that were associated with a higher risk of truancy, school discipline, and in-school fights. Results: Stepwise regression analysis explained between 8.1% (in-school fights) and 12.0% (school discipline) of the total variance in school-based behavioral outcomes. Logistic regression identified several baseline characteristics that were associated with school-based behavioral difficulties 8 years later, including being male (associated with truancy and school discipline), African American (school discipline, in-school fights), increased conduct disorder (CD) symptoms (truancy), decreased affection from parents (school discipline), ADHD severity (in-school fights), and study site (truancy and school discipline). ROC analyses identified the most discriminative predictors of truancy, school discipline, and in-school fights, which were Aggression and Conduct Problem Scale Total score, family income, and race, respectively. Conclusions: A modest, but nontrivial portion of school-based behavioral outcomes, was predicted by baseline childhood characteristics. Exploratory analyses identified modifiable (lack of paternal involvement, lower parental knowledge of behavioral principles, and parental use of physical punishment), somewhat modifiable (income and having comorbid CD), and nonmodifiable (African American and male) factors that were associated with school-based behavioral difficulties. Future research should confirm that the associations between earlier specific parenting behaviors and poor subsequent school-based behavioral outcomes are, indeed, causally related and independent cooccurring childhood psychopathology. Future research might target increasing paternal involvement and parental knowledge of behavioral principles and reducing use of physical punishment to improve school-based behavioral outcomes in children with ADHD. PMID:28253029

Predictors of Long-Term School-Based Behavioral Outcomes in the Multimodal Treatment Study of Children with Attention-Deficit/Hyperactivity Disorder.

PubMed

Reed, Margot O; Jakubovski, Ewgeni; Johnson, Jessica A; Bloch, Michael H

2017-05-01

To explore predictors of 8-year school-based behavioral outcomes in attention-deficit/hyperactivity disorder (ADHD). We examined potential baseline predictors of school-based behavioral outcomes in children who completed the 8-year follow-up in the multimodal treatment study of children with ADHD. Stepwise logistic regression and receiver operating characteristic (ROC) analysis identified baseline predictors that were associated with a higher risk of truancy, school discipline, and in-school fights. Stepwise regression analysis explained between 8.1% (in-school fights) and 12.0% (school discipline) of the total variance in school-based behavioral outcomes. Logistic regression identified several baseline characteristics that were associated with school-based behavioral difficulties 8 years later, including being male (associated with truancy and school discipline), African American (school discipline, in-school fights), increased conduct disorder (CD) symptoms (truancy), decreased affection from parents (school discipline), ADHD severity (in-school fights), and study site (truancy and school discipline). ROC analyses identified the most discriminative predictors of truancy, school discipline, and in-school fights, which were Aggression and Conduct Problem Scale Total score, family income, and race, respectively. A modest, but nontrivial portion of school-based behavioral outcomes, was predicted by baseline childhood characteristics. Exploratory analyses identified modifiable (lack of paternal involvement, lower parental knowledge of behavioral principles, and parental use of physical punishment), somewhat modifiable (income and having comorbid CD), and nonmodifiable (African American and male) factors that were associated with school-based behavioral difficulties. Future research should confirm that the associations between earlier specific parenting behaviors and poor subsequent school-based behavioral outcomes are, indeed, causally related and independent cooccurring childhood psychopathology. Future research might target increasing paternal involvement and parental knowledge of behavioral principles and reducing use of physical punishment to improve school-based behavioral outcomes in children with ADHD.

Accuracy of Screening Mammography Interpretation by Characteristics of Radiologists

PubMed Central

Barlow, William E.; Chi, Chen; Carney, Patricia A.; Taplin, Stephen H.; D’Orsi, Carl; Cutter, Gary; Hendrick, R. Edward; Elmore, Joann G.

2011-01-01

Background Radiologists differ in their ability to interpret screening mammograms accurately. We investigated the relationship of radiologist characteristics to actual performance from 1996 to 2001. Methods Screening mammograms (n = 469 512) interpreted by 124 radiologists were linked to cancer outcome data. The radiologists completed a survey that included questions on demographics, malpractice concerns, years of experience interpreting mammograms, and the number of mammograms read annually. We used receiver operating characteristics (ROC) analysis to analyze variables associated with sensitivity, specificity, and the combination of the two, adjusting for patient variables that affect performance. All P values are two-sided. Results Within 1 year of the mammogram, 2402 breast cancers were identified. Relative to low annual interpretive volume (≤1000 mammograms), greater interpretive volume was associated with higher sensitivity (P = .001; odds ratio [OR] for moderate volume [1001–2000] = 1.68, 95% CI = 1.18 to 2.39; OR for high volume [>2000] = 1.89, 95% CI = 1.36 to 2.63). Specificity decreased with volume (OR for 1001–2000 = 0.65, 95% CI = 0.52 to 0.83; OR for more than 2000 = 0.76, 95% CI = 0.60 to 0.96), compared with 1000 or less (P = .002). Greater number of years of experience interpreting mammograms was associated with lower sensitivity (P = .001), but higher specificity (P = .003). ROC analysis using the ordinal BI-RADS interpretation showed an association between accuracy and both previous mammographic history (P = .012) and breast density (P<.001). No association was observed between accuracy and years interpreting mammograms (P = .34) or mammography volume (P = .94), after adjusting for variables that affect the threshold for calling a mammogram positive. Conclusions We found no evidence that greater volume or experience at interpreting mammograms is associated with better performance. However, they may affect sensitivity and specificity, possibly by determining the threshold for calling a mammogram positive. Increasing volume requirements is unlikely to improve overall mammography performance. PMID:15601640

Detection of common carotid artery stenosis using duplex ultrasonography: a validation study with computed tomographic angiography.

PubMed

Slovut, David P; Romero, Javier M; Hannon, Kathleen M; Dick, James; Jaff, Michael R

2010-01-01

Severe stenosis of the common carotid artery (CCA), while uncommon, is associated with increased risk of transient ischemic attack and stroke. To date, no validated duplex ultrasound criteria have been established for grading the severity of CCA stenosis. The goal of this study was to use receiver-operating curve (ROC) analysis with computed tomographic angiography as the reference standard to establish duplex ultrasound criteria for diagnosing >or=50% CCA stenosis. The study cohort included 64 patients (42 men, 22 women) with a mean age of 65 +/- 12 years (range, 16-89 years) who had CCA peak systolic velocity (PSV) >or=150 cm/sec and underwent computed tomographic angiography (CTA) of the cervical and intracerebral vessels within 1 month of the duplex examination. One study was excluded because the CTA was technically inadequate, whereas another was excluded because the patient underwent bilateral CCA stenting. The CCA ipsilateral to any of the following was excluded from the analysis: innominate artery occlusion (n = 1), previous stenting of the ICA or CCA (n = 7), carotid endarterectomy (n = 1), or carotid-to-carotid bypass (n = 1). Thus, the data set included 62 patients and 115 vessels. Bland-Altman analysis was used to examine the agreement between two measures of luminal reduction measured by CTA: percent diameter stenosis and percent area stenosis. Receiver operating characteristic (ROC) analysis was used to determine optimal PSV and EDV thresholds for diagnosing >or=50% CCA stenosis. Severity of CCA stenosis was <50% in 76 vessels, 50%-59% in eight, 60%-69% in eight, 70%-79% in nine, 80%-89% in three, 90%-99% in five, and occluded in six. Duplex ultrasonography identified six of six (100%) patients with 100% CCA occlusion by CTA. Bland-Altman analysis showed poor agreement between percent stenosis determined by vessel diameter compared with percent stenosis determined by reduction in lumen area. Therefore, subsequent analysis was performed using percent stenosis by area. ROC analysis of different PSV thresholds for detecting stenosis >or=50% showed that >182 cm/sec was the most accurate with a sensitivity of 64% and specificity of 88% (P < .0001). Sensitivity, specificity, and accuracy of carotid duplex were higher when the stenosis was located in the mid or distal aspects of the CCA (sensitivity 76%, specificity 89%, area under curve 0.84, P < .001) than in the intrathoracic and proximal segment of the artery (P = NS). ROC analysis of different EDV thresholds for detecting CCA stenosis >or=50% showed that >30 cm/sec was the most accurate with a sensitivity of 54% and a specificity of 74% (P < .0239). Duplex ultrasonography is highly sensitive, specific, and accurate for detecting CCA lesions in the mid and distal CCA. Use of peak systolic velocity may lead to improved detection of CCA disease and initiation of appropriate therapy to reduce the risk of stroke. Copyright 2010 Society for Vascular Surgery. Published by Mosby, Inc. All rights reserved.

Diagnostic value of blood-derived microRNAs for schizophrenia: results of a meta-analysis and validation.

PubMed

Liu, Sha; Zhang, Fuquan; Wang, Xijin; Shugart, Yin Yao; Zhao, Yingying; Li, Xinrong; Liu, Zhifen; Sun, Ning; Yang, Chunxia; Zhang, Kerang; Yue, Weihua; Yu, Xin; Xu, Yong

2017-11-10

There is an increasing interest in searching biomarkers for schizophrenia (SZ) diagnosis, which overcomes the drawbacks inherent with the subjective diagnostic methods. MicroRNA (miRNA) fingerprints have been explored for disease diagnosis. We performed a meta-analysis to examine miRNA diagnostic value for SZ and further validated the meta-analysis results. Using following terms: schizophrenia/SZ, microRNA/miRNA, diagnosis, sensitivity and specificity, we searched databases restricted to English language and reviewed all articles published from January 1990 to October 2016. All extracted data were statistically analyzed and the results were further validated with peripheral blood mononuclear cells (PBMNCs) isolated from patients and healthy controls using RT-qPCR and receiver operating characteristic (ROC) analysis. A total of 6 studies involving 330 patients and 202 healthy controls were included for meta-analysis. The pooled sensitivity, specificity and diagnostic odds ratio were 0.81 (95% CI: 0.75-0.86), 0.81 (95% CI: 0.72-0.88) and 18 (95% CI: 9-34), respectively; the positive and negative likelihood ratio was 4.3 and 0.24 respectively; the area under the curve in summary ROC was 0.87 (95% CI: 0.84-0.90). Validation revealed that miR-181b-5p, miR-21-5p, miR-195-5p, miR-137, miR-346 and miR-34a-5p in PBMNCs had high diagnostic sensitivity and specificity in the context of schizophrenia. In conclusion, blood-derived miRNAs might be promising biomarkers for SZ diagnosis.

Local variance for multi-scale analysis in geomorphometry.

PubMed

Drăguţ, Lucian; Eisank, Clemens; Strasser, Thomas

2011-07-15

Increasing availability of high resolution Digital Elevation Models (DEMs) is leading to a paradigm shift regarding scale issues in geomorphometry, prompting new solutions to cope with multi-scale analysis and detection of characteristic scales. We tested the suitability of the local variance (LV) method, originally developed for image analysis, for multi-scale analysis in geomorphometry. The method consists of: 1) up-scaling land-surface parameters derived from a DEM; 2) calculating LV as the average standard deviation (SD) within a 3 × 3 moving window for each scale level; 3) calculating the rate of change of LV (ROC-LV) from one level to another, and 4) plotting values so obtained against scale levels. We interpreted peaks in the ROC-LV graphs as markers of scale levels where cells or segments match types of pattern elements characterized by (relatively) equal degrees of homogeneity. The proposed method has been applied to LiDAR DEMs in two test areas different in terms of roughness: low relief and mountainous, respectively. For each test area, scale levels for slope gradient, plan, and profile curvatures were produced at constant increments with either resampling (cell-based) or image segmentation (object-based). Visual assessment revealed homogeneous areas that convincingly associate into patterns of land-surface parameters well differentiated across scales. We found that the LV method performed better on scale levels generated through segmentation as compared to up-scaling through resampling. The results indicate that coupling multi-scale pattern analysis with delineation of morphometric primitives is possible. This approach could be further used for developing hierarchical classifications of landform elements.

Local variance for multi-scale analysis in geomorphometry

PubMed Central

Drăguţ, Lucian; Eisank, Clemens; Strasser, Thomas

2011-01-01

Increasing availability of high resolution Digital Elevation Models (DEMs) is leading to a paradigm shift regarding scale issues in geomorphometry, prompting new solutions to cope with multi-scale analysis and detection of characteristic scales. We tested the suitability of the local variance (LV) method, originally developed for image analysis, for multi-scale analysis in geomorphometry. The method consists of: 1) up-scaling land-surface parameters derived from a DEM; 2) calculating LV as the average standard deviation (SD) within a 3 × 3 moving window for each scale level; 3) calculating the rate of change of LV (ROC-LV) from one level to another, and 4) plotting values so obtained against scale levels. We interpreted peaks in the ROC-LV graphs as markers of scale levels where cells or segments match types of pattern elements characterized by (relatively) equal degrees of homogeneity. The proposed method has been applied to LiDAR DEMs in two test areas different in terms of roughness: low relief and mountainous, respectively. For each test area, scale levels for slope gradient, plan, and profile curvatures were produced at constant increments with either resampling (cell-based) or image segmentation (object-based). Visual assessment revealed homogeneous areas that convincingly associate into patterns of land-surface parameters well differentiated across scales. We found that the LV method performed better on scale levels generated through segmentation as compared to up-scaling through resampling. The results indicate that coupling multi-scale pattern analysis with delineation of morphometric primitives is possible. This approach could be further used for developing hierarchical classifications of landform elements. PMID:21779138

A Simple and Effective Physical Characteristic Profiling Method for Methamphetamine Tablet Seized in China.

PubMed

Li, Tao; Hua, Zhendong; Meng, Xin; Liu, Cuimei

2018-03-01

Methamphetamine (MA) tablet production confers chemical and physical properties. This study developed a simple and effective physical characteristic profiling method for MA tablets with capital letter "WY" logos, which realized the discrimination between linked and unlinked seizures. Seventeen signature distances extracted from the "WY" logo were explored as factors for multivariate analysis and demonstrated to be effective to represent the features of tablets in the drug intelligence perspective. Receiver operating characteristic (ROC) curve was used to evaluate efficiency of different pretreatments and distance/correlation metrics, while "Standardization + Euclidean" and "Logarithm + Euclidean" algorithms outperformed the rest. Finally, hierarchical cluster analysis (HCA) was applied to the data set of 200 MA tablet seizures randomly selected from cases all around China in 2015, and 76% of them were classified into a group named after "WY-001." Moreover, the "WY-001" tablets occupied 51-80% tablet seizures from 2011 to 2015 in China, indicating the existence of a huge clandestine factory incessantly manufacturing MA tablets. © 2017 American Academy of Forensic Sciences.

Contrast-Enhanced Ultrasound in the Diagnosis of Gallbladder Diseases: A Multi-Center Experience

PubMed Central

Liu, Lin-Na; Xu, Hui-Xiong; Lu, Ming-De; Xie, Xiao-Yan; Wang, Wen-Ping; Hu, Bing; Yan, Kun; Ding, Hong; Tang, Shao-Shan; Qian, Lin-Xue; Luo, Bao-Ming; Wen, Yan-Ling

2012-01-01

Objective To assess the usefulness of contrast–enhanced ultrasound (CEUS) in differentiating malignant from benign gallbladder (GB) diseases. Methods This study had institutional review board approval. 192 patients with GB diseases from 9 university hospitals were studied. After intravenous bonus injection of a phospholipid-stabilized shell microbubble contrast agent, lesions were scanned with low acoustic power CEUS. A multiple logistic regression analysis was performed to identify diagnostic clues from 17 independent variables that enabled differentiation between malignant and benign GB diseases. Receiver operating characteristic (ROC) curve analysis was performed. Results Among the 17 independent variables, multiple logistic regression analysis showed that the following 4 independent variables were associated with the benign nature of the GB diseases, including the patient age, intralesional blood vessel depicted on CEUS, contrast washout time, and wall intactness depicted on CEUS (all P<0.05). ROC analysis showed that the patient age, intralesional vessels on CEUS, and the intactness of the GB wall depicted on CEUS yielded an area under the ROC curve (Az) greater than 0.8 in each and Az for the combination of the 4 significant independent variables was 0.915 [95% confidence interval (CI): 0.857–0.974]. The corresponding Az, sensitivity, and specificity for the age were 0.805 (95% CI: 0.746–0.863), 92.2%%, and 59.6%; for the intralesional vessels on CEUS were 0.813 (95% CI: 0.751–0.875), 59.8%, and 98.0%; and for the GB wall intactness were 0.857 (95% CI: 0.786–0.928), 78.4%, and 92.9%. The cut-off values for benign GB diseases were patient age <53.5 yrs, dotted intralesional vessels on CEUS and intact GB wall on CEUS. Conclusion CEUS is valuable in differentiating malignant from benign GB diseases. Branched or linear intralesional vessels and destruction of GB wall on CEUS are the CEUS features highly suggestive of GB malignancy and the patient age >53.5 yrs is also a clue for GB malignancy. PMID:23118996

Hepatic lesions: improved image quality and detection with the periodically rotated overlapping parallel lines with enhanced reconstruction technique--evaluation of SPIO-enhanced T2-weighted MR images.

PubMed

Hirokawa, Yuusuke; Isoda, Hiroyoshi; Maetani, Yoji S; Arizono, Shigeki; Shimada, Kotaro; Okada, Tomohisa; Shibata, Toshiya; Togashi, Kaori

2009-05-01

To evaluate the effectiveness of the periodically rotated overlapping parallel lines with enhanced reconstruction (PROPELLER) technique for superparamagnetic iron oxide (SPIO)-enhanced T2-weighted magnetic resonance (MR) imaging with respiratory compensation with the prospective acquisition correction (PACE) technique in the detection of hepatic lesions. The institutional human research committee approved this prospective study, and all patients provided written informed consent. Eighty-one patients (mean age, 58 years) underwent hepatic 1.5-T MR imaging. Fat-saturated T2-weighted turbo spin-echo images were acquired with the PACE technique and with and without the PROPELLER method after administration of SPIO. Images were qualitatively evaluated for image artifacts, depiction of liver edge and intrahepatic vessels, overall image quality, and presence of lesions. Three radiologists independently assessed these characteristics with a five-point confidence scale. Diagnostic performance was assessed with receiver operating characteristic (ROC) curve analysis. Quantitative analysis was conducted by measuring the liver signal-to-noise ratio (SNR) and the lesion-to-liver contrast-to-noise ratio (CNR). The Wilcoxon signed rank test and two-tailed Student t test were used, and P < .05 indicated a significant difference. MR imaging with the PROPELLER and PACE techniques resulted in significantly improved image quality, higher sensitivity, and greater area under the ROC curve for hepatic lesion detection than did MR imaging with the PACE technique alone (P < .001). The mean liver SNR and the lesion-to-liver CNR were higher with the PROPELLER technique than without it (P < .001). T2-weighted MR imaging with the PROPELLER and PACE technique and SPIO enhancement is a promising method with which to improve the detection of hepatic lesions. (c) RSNA, 2009.

Global detection approach for clustered microcalcifications in mammograms using a deep learning network.

PubMed

Wang, Juan; Nishikawa, Robert M; Yang, Yongyi

2017-04-01

In computerized detection of clustered microcalcifications (MCs) from mammograms, the traditional approach is to apply a pattern detector to locate the presence of individual MCs, which are subsequently grouped into clusters. Such an approach is often susceptible to the occurrence of false positives (FPs) caused by local image patterns that resemble MCs. We investigate the feasibility of a direct detection approach to determining whether an image region contains clustered MCs or not. Toward this goal, we develop a deep convolutional neural network (CNN) as the classifier model to which the input consists of a large image window ([Formula: see text] in size). The multiple layers in the CNN classifier are trained to automatically extract image features relevant to MCs at different spatial scales. In the experiments, we demonstrated this approach on a dataset consisting of both screen-film mammograms and full-field digital mammograms. We evaluated the detection performance both on classifying image regions of clustered MCs using a receiver operating characteristic (ROC) analysis and on detecting clustered MCs from full mammograms by a free-response receiver operating characteristic analysis. For comparison, we also considered a recently developed MC detector with FP suppression. In classifying image regions of clustered MCs, the CNN classifier achieved 0.971 in the area under the ROC curve, compared to 0.944 for the MC detector. In detecting clustered MCs from full mammograms, at 90% sensitivity, the CNN classifier obtained an FP rate of 0.69 clusters/image, compared to 1.17 clusters/image by the MC detector. These results indicate that using global image features can be more effective in discriminating clustered MCs from FPs caused by various sources, such as linear structures, thereby providing a more accurate detection of clustered MCs on mammograms.

A diagnostic scoring system for myxedema coma.

PubMed

Popoveniuc, Geanina; Chandra, Tanu; Sud, Anchal; Sharma, Meeta; Blackman, Marc R; Burman, Kenneth D; Mete, Mihriye; Desale, Sameer; Wartofsky, Leonard

2014-08-01

To develop diagnostic criteria for myxedema coma (MC), a decompensated state of extreme hypothyroidism with a high mortality rate if untreated, in order to facilitate its early recognition and treatment. The frequencies of characteristics associated with MC were assessed retrospectively in patients from our institutions in order to derive a semiquantitative diagnostic point scale that was further applied on selected patients whose data were retrieved from the literature. Logistic regression analysis was used to test the predictive power of the score. Receiver operating characteristic (ROC) curve analysis was performed to test the discriminative power of the score. Of the 21 patients examined, 7 were reclassified as not having MC (non-MC), and they were used as controls. The scoring system included a composite of alterations of thermoregulatory, central nervous, cardiovascular, gastrointestinal, and metabolic systems, and presence or absence of a precipitating event. All 14 of our MC patients had a score of ≥60, whereas 6 of 7 non-MC patients had scores of 25 to 50. A total of 16 of 22 MC patients whose data were retrieved from the literature had a score ≥60, and 6 of 22 of these patients scored between 45 and 55. The odds ratio per each score unit increase as a continuum was 1.09 (95% confidence interval [CI], 1.01 to 1.16; P = .019); a score of 60 identified coma, with an odds ratio of 1.22. The area under the ROC curve was 0.88 (95% CI, 0.65 to 1.00), and the score of 60 had 100% sensitivity and 85.71% specificity. A score ≥60 in the proposed scoring system is potentially diagnostic for MC, whereas scores between 45 and 59 could classify patients at risk for MC.

Vasculature surrounding a nodule: A novel lung cancer biomarker.

PubMed

Wang, Xiaohua; Leader, Joseph K; Wang, Renwei; Wilson, David; Herman, James; Yuan, Jian-Min; Pu, Jiantao

2017-12-01

To investigate whether the vessels surrounding a nodule depicted on non-contrast, low-dose computed tomography (LDCT) can discriminate benign and malignant screen detected nodules. We collected a dataset consisting of LDCT scans acquired on 100 subjects from the Pittsburgh Lung Screening study (PLuSS). Fifty subjects were diagnosed with lung cancer and 50 subjects had suspicious nodules later proven benign. For the lung cancer cases, the location of the malignant nodule in the LDCT scans was known; while for the benign cases, the largest nodule in the LDCT scan was used in the analysis. A computer algorithm was developed to identify surrounding vessels and quantify the number and volume of vessels that were connected or near the nodule. A nonparametric receiver operating characteristic (ROC) analysis was performed based on a single nodule per subject to assess the discriminability of the surrounding vessels to provide a lung cancer diagnosis. Odds ratio (OR) were computed to determine the probability of a nodule being lung cancer based on the vessel features. The areas under the ROC curves (AUCs) for vessel count and vessel volume were 0.722 (95% CI=0.616-0.811, p<0.01) and 0.676 (95% CI=0.565-0.772), respectively. The number of vessels attached to a nodule was significantly higher in the lung cancer group 9.7 (±9.6) compared to the non-lung cancer group 4.0 (±4.3) CONCLUSION: Our preliminary results showed that malignant nodules are often surrounded by more vessels compared to benign nodules, suggesting that the surrounding vessel characteristics could serve as lung cancer biomarker for indeterminate nodules detected during LDCT lung cancer screening using only the information collected during the initial visit. Copyright © 2017 Elsevier B.V. All rights reserved.

Critical thresholds of liver function parameters for ketosis prediction in dairy cows using receiver operating characteristic (ROC) analysis.

PubMed

Sun, Yuhang; Wang, Bo; Shu, Shi; Zhang, Hongyou; Xu, Chuang; Wu, Ling; Xia, Cheng

2015-01-01

Fatty liver syndrome and ketosis are important metabolic disorders in high-producing cows during early lactation with fatty liver usually preceding ketosis. To date, parameters for early prediction of the risk of ketosis have not been investigated in China. To determine the predictive value of some parameters on the risk of ketosis in China. In a descriptive study, 48 control and 32 ketotic Holstein Friesian cows were randomly selected from one farm with a serum β-hydroxybutyrate (BHBA) concentration of 1.20 mmol/L as cutoff point. The risk prediction thresholds for ketosis were determined by receiver operating characteristic (ROC) analysis. In line with a high BHBA concentration, blood glucose concentration was significantly lower in ketotic cows compared to control animals (2.77 ± 0.24 versus 3.34 ± 0.03 mmol/L; P = 0.02). Thresholds were more than 0.76 mmol/L for nonesterified fatty acids (NEFA, with 65% sensitivity and 92% specificity), more than 104 U/L for aspartate aminotransferase (AST, 74% and 85%, respectively), less than 140 U/L for cholinesterase (CHE, 75% and 59%, respectively), and more than 3.3 µmol/L for total bilirubin (TBIL, 58% and 83%, respectively). There were significant correlations between BHBA and glucose (R = -4.74), or CHE (R = -0.262), BHBA and NEFA (R = 0.520), or AST (R = 0.525), or TBIL (R = 0.278), or direct bilirubin (DBIL, R = 0.348). AST, CHE, TBIL and NEFA may be useful parameters for risk prediction of ketosis. This study might be of value in addressing novel directions for future research on the connection between ketosis and liver dysfunction.

[Predictive factors of functional decline at hospital discharge in elderly patients hospitalised due to acute illness].

PubMed

Condorhuamán-Alvarado, Patricia Ysabel; Menéndez-Colino, Rocío; Mauleón-Ladrero, Coro; Díez-Sebastián, Jesús; Alarcón, Teresa; González-Montalvo, Juan Ignacio

To compare baseline characteristics and those found during hospitalisation as predictors of functional decline at discharge (FDd) in elderly patients hospitalised due to acute illness. A review was made of the computerized records of patients admitted to a Geriatric Acute Unit of a tertiary hospital over a 10 year period. A record was made of demographic, clinical, functional and health-care variables. Functional decline at discharge (FDd) was defined by the difference between the previous Barthel Index (pBI) and the discharge Barthel Index (dBI). The percentage of FDd (%FDd=(pBI-dBI/pBI)×100) was calculated. The variables associated with greater %FDd in the bivariate analysis were included in multivariate logistic regression models. The predictive capacity of each model was assessed using the area under the ROC curve. The factors associated with greater %FDd were advanced age, female gender, to live in a nursing home, cognitive impairment, better baseline functional status and worse functional status at admission, number of diagnoses, and prolonged stay. The area under the ROC curve for the predictive models of %FDd was 0.638 (95% CI: 0.615-0.662) based on the previous situation, 0.756 (95% CI: 0.736-0.776) based on the situation during admission, and 0.952 (95% CI: 0.944-0.959) based on a combination of these factors. The overall assessment of patient characteristics, both during admission and baseline, may have greater value in prediction of FDd than analysis of factors separately in elderly patients hospitalised due to acute illness. Copyright © 2017. Publicado por Elsevier España, S.L.U.

Regional Cerebral Blood Flow In Dementia: Receiver-Operating-Characteristic Analysis

NASA Astrophysics Data System (ADS)

Zemcov, Alexander; Barclay, Laurie; Sansone, Joseph; Blass, John P.; Metz, Charles E.

1985-06-01

The coupling of mentation to regional cerebral blood flow (rCBF) has prompted the application of the Xe-133 inhalation method of measuring rCBF in the differential diagnosis of the two most common dementing diseases, Alzheimer's disease and multi-infarct dementia (MID). In this study receiver-operating-characteristic (ROC) curve analysis was used to assess the effectiveness of a 32 detector Xe-133 inhalation system in discriminating between patients with Alzheimer's disease and normal controls, MID patients and normal controls and between patients with Alzheimer's disease and MID. The populations were clinically evaluated as 1) normal (age 63.1 + 13.1, n=23), 2) Alzheimer's disease (age 72.7 + 7.0, n=82), 3) MID (age 76.4 + 7.6, n=27): The mean flow values for all detectors were lowest for the Alzheimer's disease group, larger for the MID group and largest for the normal controls. The dynamic relationship between the correct identifications (true posi-tives) versus incorrect identifications (false positives) per detector for any 2 pairs of clinical groups varies as the cutoff value of flow is changed over the range of experimental blood flow values. Therefore a quantitative characterization of the "decision" or ROC curve (TP vs FP) for each detector and for each pair of clinical groups provides a measure of the overall diagnostic efficacy of the detector. Detectors directed approximately toward the speech, auditory and association cortices were most effective in disciminatinq between each of the dementia groups and the controls. Frontal detectors were diagnostically inefficient. The Xe-133 inhalation system provided virtually no diagnostic power in discriminating between the two forms of dementia, however. Therefore this imaging technology is most useful when assessing the general diagnostic state of dementia (Alz-heimer's disease and MID) from normal cognitive function.

Prediction of Maternal Cytomegalovirus Serostatus in Early Pregnancy: A Retrospective Analysis in Western Europe

PubMed Central

Kuessel, Lorenz; Husslein, Heinrich; Marschalek, Julian; Brunner, Julia; Ristl, Robin; Popow-Kraupp, Theresia; Kiss, Herbert

2015-01-01

Background Cytomegalovirus (CMV) is the most prevalent congenital viral infection and thus places an enormous disease burden on newborn infants. Seroprevalence of maternal antibodies to CMV due to CMV exposure prior to pregnancy is currently the most important protective factor against congenital CMV disease. The aim of this study was to identify potential predictors, and to develop and evaluate a risk-predicting model for the maternal CMV serostatus in early pregnancy. Methods Maternal and paternal background information, as well as maternal CMV serostatus in early pregnancy from 882 pregnant women were analyzed. Women were divided into two groups based on their CMV serostatus, and were compared using univariate analysis. To predict serostatus based on epidemiological baseline characteristics, a multiple logistic regression model was calculated using stepwise model selection. Sensitivity and specificity were analyzed using ROC curves. A nomogram based on the model was developed. Results 646 women were CMV seropositive (73.2%), and 236 were seronegative (26.8%). The groups differed significantly with respect to maternal age (p = 0.006), gravidity (p<0.001), parity (p<0.001), use of assisted reproduction techniques (p = 0.018), maternal and paternal migration background (p<0.001), and maternal and paternal education level (p<0.001). ROC evaluation of the selected prediction model revealed an area under the curve of 0.83 (95%CI: 0.8–0.86), yielding sensitivity and specificity values of 0.69 and 0.86, respectively. Conclusion We identified predictors of maternal CMV serostatus in early pregnancy and developed a risk-predicting model based on baseline epidemiological characteristics. Our findings provide easy accessible information that can influence the counseling of pregnant woman in terms of their CMV-associated risk. PMID:26693714

Pre-Radiation Therapy Fluorine 18 Fluorodeoxyglucose PET Helps Identify Patients with Esophageal Cancer at High Risk for Radiation Pneumonitis.

PubMed

Castillo, Richard; Pham, Ngoc; Castillo, Edward; Aso-Gonzalez, Samantha; Ansari, Sobiya; Hobbs, Brian; Palacio, Diana; Skinner, Heath; Guerrero, Thomas M

2015-06-01

To examine the association between pre-radiation therapy (RT) fluorine 18 fluorodeoxyglucose (FDG) uptake and post-RT symptomatic radiation pneumonitis (RP). In accordance with the retrospective study protocol approved by the institutional review board, 228 esophageal cancer patients who underwent FDG PET/CT before chemotherapy and RT were examined. RP symptoms were evaluated by using the Common Terminology Criteria for Adverse Events, version 4.0, from the consensus of five clinicians. By using the cumulative distribution of standardized uptake values (SUVs) within the lungs, those values greater than 80%-95% of the total lung voxels were determined for each patient. The effect of pre-chemotherapy and RT FDG uptake, dose, and patient or treatment characteristics on RP toxicity was studied by using logistic regression. The study subjects were treated with three-dimensional conformal RT (n = 36), intensity-modulated RT (n = 135), or proton therapy (n = 57). Logistic regression analysis demonstrated elevated FDG uptake at pre-chemotherapy and RT was related to expression of RP symptoms. Study subjects with elevated 95% percentile of the SUV (SUV95) were more likely to develop symptomatic RP (P < .000012); each 0.1 unit increase in SUV95 was associated with a 1.36-fold increase in the odds of symptomatic RP. Receiver operating characteristic (ROC) curve analysis resulted in area under the ROC curve of 0.676 (95% confidence interval: 0.58, 0.77), sensitivity of 60%, and specificity of 71% at the 1.17 SUV95 threshold. CT imaging and dosimetric parameters were found to be poor predictors of RP symptoms. The SUV95, a biomarker of pretreatment pulmonary metabolic activity, was shown to be prognostic of symptomatic RP. Elevation in this pretreatment biomarker identifies patients at high risk for posttreatment symptomatic RP. RSNA, 2015

Modeling of recovery profiles in mentally disabled and intact patients after sevoflurane anesthesia; a pharmacodynamic analysis.

PubMed

Shin, Teo Jeon; Noh, Gyu-Jeong; Koo, Yong-Seo; Han, Dong Woo

2014-11-01

Mentally disabled patients show different recovery profiles compared to normal patients after general anesthesia. However, the relationship of dose-recovery profiles of mentally disabled patients has never been compared to that of normal patients. Twenty patients (10 mentally disabled patients and 10 mentally intact patients) scheduled to dental surgery under general anesthesia was recruited. Sevoflurane was administered to maintain anesthesia during dental treatment. At the end of the surgery, sevoflurane was discontinued. End-tidal sevoflurane and recovery of consciousness (ROC) were recorded after sevoflurane discontinuation. The pharmacodynamic relation between the probability of ROC and end-tidal sevoflurane concentration was analyzed using NONMEM software (version VII). End-tidal sevoflurane concentration associated with 50% probability of ROC (C₅₀) and γ value were lower in the mentally disabled patients (C₅₀=0.37 vol %, γ=16.5 in mentally intact patients, C₅₀=0.19 vol %, γ=4.58 in mentally disabled patients). Mentality was a significant covariate of C₅₀ for ROC and γ value to pharmacodynamic model. A sigmoid Emanx model explains the pharmacodynamic relationship between end-tidal sevoflurane concentration and ROC. Mentally disabled patients may recover slower from anesthesia at lower sevoflurane concentration at ROC an compared to normal patients.

Modeling of Recovery Profiles in Mentally Disabled and Intact Patients after Sevoflurane Anesthesia; A Pharmacodynamic Analysis

PubMed Central

Shin, Teo Jeon; Noh, Gyu-Jeong; Koo, Yong-Seo

2014-01-01

Purpose Mentally disabled patients show different recovery profiles compared to normal patients after general anesthesia. However, the relationship of dose-recovery profiles of mentally disabled patients has never been compared to that of normal patients. Materials and Methods Twenty patients (10 mentally disabled patients and 10 mentally intact patients) scheduled to dental surgery under general anesthesia was recruited. Sevoflurane was administered to maintain anesthesia during dental treatment. At the end of the surgery, sevoflurane was discontinued. End-tidal sevoflurane and recovery of consciousness (ROC) were recorded after sevoflurane discontinuation. The pharmacodynamic relation between the probability of ROC and end-tidal sevoflurane concentration was analyzed using NONMEM software (version VII). Results End-tidal sevoflurane concentration associated with 50% probability of ROC (C50) and γ value were lower in the mentally disabled patients (C50=0.37 vol %, γ=16.5 in mentally intact patients, C50=0.19 vol %, γ=4.58 in mentally disabled patients). Mentality was a significant covariate of C50 for ROC and γ value to pharmacodynamic model. Conclusion A sigmoid Emanx model explains the pharmacodynamic relationship between end-tidal sevoflurane concentration and ROC. Mentally disabled patients may recover slower from anesthesia at lower sevoflurane concentration at ROC an compared to normal patients. PMID:25323901

Serum Irisin Predicts Mortality Risk in Acute Heart Failure Patients.

PubMed

Shen, Shutong; Gao, Rongrong; Bei, Yihua; Li, Jin; Zhang, Haifeng; Zhou, Yanli; Yao, Wenming; Xu, Dongjie; Zhou, Fang; Jin, Mengchao; Wei, Siqi; Wang, Kai; Xu, Xuejuan; Li, Yongqin; Xiao, Junjie; Li, Xinli

2017-01-01

Irisin is a peptide hormone cleaved from a plasma membrane protein fibronectin type III domain containing protein 5 (FNDC5). Emerging studies have indicated association between serum irisin and many major chronic diseases including cardiovascular diseases. However, the role of serum irisin as a predictor for mortality risk in acute heart failure (AHF) patients is not clear. AHF patients were enrolled and serum was collected at the admission and all patients were followed up for 1 year. Enzyme-linked immunosorbent assay was used to measure serum irisin levels. To explore predictors for AHF mortality, the univariate and multivariate logistic regression analysis, and receiver-operator characteristic (ROC) curve analysis were used. To determine the role of serum irisin levels in predicting survival, Kaplan-Meier survival analysis was used. In this study, 161 AHF patients were enrolled and serum irisin level was found to be significantly higher in patients deceased in 1-year follow-up. The univariate logistic regression analysis identified 18 variables associated with all-cause mortality in AHF patients, while the multivariate logistic regression analysis identified 2 variables namely blood urea nitrogen and serum irisin. ROC curve analysis indicated that blood urea nitrogen and the most commonly used biomarker, NT-pro-BNP, displayed poor prognostic value for AHF (AUCs ≤ 0.700) compared to serum irisin (AUC = 0.753). Kaplan-Meier survival analysis demonstrated that AHF patients with higher serum irisin had significantly higher mortality (P<0.001). Collectively, our study identified serum irisin as a predictive biomarker for 1-year all-cause mortality in AHF patients though large multicenter studies are highly needed. © 2017 The Author(s). Published by S. Karger AG, Basel.

A knowledge-driven probabilistic framework for the prediction of protein-protein interaction networks.

PubMed

Browne, Fiona; Wang, Haiying; Zheng, Huiru; Azuaje, Francisco

2010-03-01

This study applied a knowledge-driven data integration framework for the inference of protein-protein interactions (PPI). Evidence from diverse genomic features is integrated using a knowledge-driven Bayesian network (KD-BN). Receiver operating characteristic (ROC) curves may not be the optimal assessment method to evaluate a classifier's performance in PPI prediction as the majority of the area under the curve (AUC) may not represent biologically meaningful results. It may be of benefit to interpret the AUC of a partial ROC curve whereby biologically interesting results are represented. Therefore, the novel application of the assessment method referred to as the partial ROC has been employed in this study to assess predictive performance of PPI predictions along with calculating the True positive/false positive rate and true positive/positive rate. By incorporating domain knowledge into the construction of the KD-BN, we demonstrate improvement in predictive performance compared with previous studies based upon the Naive Bayesian approach. Copyright (c) 2010 Elsevier Ltd. All rights reserved.

A principled approach to setting optimal diagnostic thresholds: where ROC and indifference curves meet.

PubMed

Irwin, R John; Irwin, Timothy C

2011-06-01

Making clinical decisions on the basis of diagnostic tests is an essential feature of medical practice and the choice of the decision threshold is therefore crucial. A test's optimal diagnostic threshold is the threshold that maximizes expected utility. It is given by the product of the prior odds of a disease and a measure of the importance of the diagnostic test's sensitivity relative to its specificity. Choosing this threshold is the same as choosing the point on the Receiver Operating Characteristic (ROC) curve whose slope equals this product. We contend that a test's likelihood ratio is the canonical decision variable and contrast diagnostic thresholds based on likelihood ratio with two popular rules of thumb for choosing a threshold. The two rules are appealing because they have clear graphical interpretations, but they yield optimal thresholds only in special cases. The optimal rule can be given similar appeal by presenting indifference curves, each of which shows a set of equally good combinations of sensitivity and specificity. The indifference curve is tangent to the ROC curve at the optimal threshold. Whereas ROC curves show what is feasible, indifference curves show what is desirable. Together they show what should be chosen. Copyright © 2010 European Federation of Internal Medicine. Published by Elsevier B.V. All rights reserved.

[Efficacy of storage phosphor-based digital mammography in diagnosis of breast cancer--comparison with film-screen mammography].

PubMed

Kitahama, H

1991-05-25

The aim of this study is to present efficacy of storage phosphor-based digital mammography (CR-mammography) in diagnosis of breast cancer. Ninety-seven cases with breast cancer including 44 cases less than 2 cm in macroscopic size (t1 cases) were evaluated using storage phosphor-based digital mammography (2000 x 2510 pixels by 10 bits). Abnormal findings on CR-mammography were detected in 86 cases (88.7%) of 97 women with breast cancer. Sensitivity of CR-mammography was 88.7%. It was superior to that of film-screen mammography. On t1 breast cancer cases, sensitivity on CR-mammography was 88.6%. False negative rate in t1 breast cancer cases was reduced by image processing using CR-mammography. To evaluate microcalcifications, CR-mammograms and film-screen mammograms were investigated in 22 cases of breast cancer proven pathologically the existence of microcalcifications and 11 paraffin tissue blocks of breast cancer. CR-mammography was superior to film-screen mammography in recognizing of microcalcifications. As regards the detectability for the number and the shape of microcalcifications, CR-mammography was equivalent to film-screen mammography. Receiver operating characteristic (ROC) analysis by eight observers was performed for CR-mammography and film-screen mammography with 54 breast cancer patients and 54 normal cases. The detectability of abnormal findings of breast cancer on CR-mammography (ROC area = 0.91) was better than that on film-screen mammography (ROC area = 0.88) (p less than 0.05). Efficacy of storage phosphor-based digital mammography in diagnosis of breast cancer was discussed and demonstrated in this study.

Accuracy of specific BIVA for the assessment of body composition in the United States population.

PubMed

Buffa, Roberto; Saragat, Bruno; Cabras, Stefano; Rinaldi, Andrea C; Marini, Elisabetta

2013-01-01

Bioelectrical impedance vector analysis (BIVA) is a technique for the assessment of hydration and nutritional status, used in the clinical practice. Specific BIVA is an analytical variant, recently proposed for the Italian elderly population, that adjusts bioelectrical values for body geometry. Evaluating the accuracy of specific BIVA in the adult U.S. population, compared to the 'classic' BIVA procedure, using DXA as the reference technique, in order to obtain an interpretative model of body composition. A cross-sectional sample of 1590 adult individuals (836 men and 754 women, 21-49 years old) derived from the NHANES 2003-2004 was considered. Classic and specific BIVA were applied. The sensitivity and specificity in recognizing individuals below the 5(th) and above the 95(th) percentiles of percent fat (FMDXA%) and extracellular/intracellular water (ECW/ICW) ratio were evaluated by receiver operating characteristic (ROC) curves. Classic and specific BIVA results were compared by a probit multiple-regression. Specific BIVA was significantly more accurate than classic BIVA in evaluating FMDXA% (ROC areas: 0.84-0.92 and 0.49-0.61 respectively; p = 0.002). The evaluation of ECW/ICW was accurate (ROC areas between 0.83 and 0.96) and similarly performed by the two procedures (p = 0.829). The accuracy of specific BIVA was similar in the two sexes (p = 0.144) and in FMDXA% and ECW/ICW (p = 0.869). Specific BIVA showed to be an accurate technique. The tolerance ellipses of specific BIVA can be used for evaluating FM% and ECW/ICW in the U.S. adult population.

Differentiating between Central Nervous System Lymphoma and High-grade Glioma Using Dynamic Susceptibility Contrast and Dynamic Contrast-enhanced MR Imaging with Histogram Analysis.

PubMed

Murayama, Kazuhiro; Nishiyama, Yuya; Hirose, Yuichi; Abe, Masato; Ohyu, Shigeharu; Ninomiya, Ayako; Fukuba, Takashi; Katada, Kazuhiro; Toyama, Hiroshi

2018-01-10

We evaluated the diagnostic performance of histogram analysis of data from a combination of dynamic susceptibility contrast (DSC)-MRI and dynamic contrast-enhanced (DCE)-MRI for quantitative differentiation between central nervous system lymphoma (CNSL) and high-grade glioma (HGG), with the aim of identifying useful perfusion parameters as objective radiological markers for differentiating between them. Eight lesions with CNSLs and 15 with HGGs who underwent MRI examination, including DCE and DSC-MRI, were enrolled in our retrospective study. DSC-MRI provides a corrected cerebral blood volume (cCBV), and DCE-MRI provides a volume transfer coefficient (K trans ) for transfer from plasma to the extravascular extracellular space. K trans and cCBV were measured from a round region-of-interest in the slice of maximum size on the contrast-enhanced lesion. The differences in t values between CNSL and HGG for determining the most appropriate percentile of K trans and cCBV were investigated. The differences in K trans , cCBV, and K trans /cCBV between CNSL and HGG were investigated using histogram analysis. Receiver operating characteristic (ROC) analysis of K trans , cCBV, and K trans /cCBV ratio was performed. The 30 th percentile (C30) in K trans and 80 th percentile (C80) in cCBV were the most appropriate percentiles for distinguishing between CNSL and HGG from the differences in t values. CNSL showed significantly lower C80 cCBV, significantly higher C30 K trans , and significantly higher C30 K trans /C80 cCBV than those of HGG. In ROC analysis, C30 K trans /C80 cCBV had the best discriminative value for differentiating between CNSL and HGG as compared to C30 K trans or C80 cCBV. The combination of K trans by DCE-MRI and cCBV by DSC-MRI was found to reveal the characteristics of vascularity and permeability of a lesion more precisely than either K trans or cCBV alone. Histogram analysis of these vascular microenvironments enabled quantitative differentiation between CNSL and HGG.

Whole-Body Barometric Plethysmography Characterizes Upper Airway Obstruction in 3 Brachycephalic Breeds of Dogs.

PubMed

Liu, N-C; Adams, V J; Kalmar, L; Ladlow, J F; Sargan, D R

2016-05-01

A novel test using whole-body barometric plethysmography (WBBP) was developed recently to diagnose brachycephalic obstructive airway syndrome (BOAS) in unsedated French bulldogs. The hypotheses of this study were: (1) respiratory characteristics are different between healthy nonbrachycephalic dogs and brachycephalic dogs; and among pugs, French bulldogs, and bulldogs; and (2) obesity and stenotic nares are risk factors for BOAS. The main objective was to establish a diagnostic test for BOAS in these 3 breeds. A total of 266 brachycephalic dogs (100 pugs, 100 French bulldogs, and 66 bulldogs) and 28 nonbrachycephalic dogs. Prospective study. Exercise tolerance tests with respiratory functional grading, and WBBP were performed on all dogs. Data from WBBP were associated with functional grades to train quadratic discriminant analysis tools to assign dogs to BOAS+ and BOAS- groups. A BOAS index (0-100%) was calculated for each dog. Receiver operating characteristic (ROC) curves were used to evaluate classification ability. Minute volume was decreased significantly in asymptomatic pugs (P = .009), French bulldogs (P = .026), and bulldogs (P < .0001) when compared to nonbrachycephalic controls. Respiratory characteristics were different among breeds and affected dogs had a significant increase in trace variation. The BOAS index predicted BOAS status for each breed with 94-97% (95% confidence interval [CI], 88.9-100%) accuracy (area under the ROC curve). Both obesity (P = .04) and stenotic nares (P = .004) were significantly associated with BOAS. The WBBP can be used as a clinical tool to diagnose BOAS noninvasively and objectively. Copyright © 2016 The Authors. Journal of Veterinary Internal Medicine published by Wiley Periodicals, Inc. on behalf of the American College of Veterinary Internal Medicine.

A Korean multicenter study of prenatal risk factors for overt diabetes during the postpartum period after gestational diabetes mellitus.

PubMed

Shin, Na-Ri; Yoon, So-Yeon; Cho, Geum Joon; Choi, Suk-Joo; Kwon, Han-Sung; Hong, Soon Cheol; Kwon, Ja-Young; Oh, Soo-Young

2016-03-01

To identify prenatal risk factors for postpartum diabetes among pregnant women with gestational diabetes mellitus (GDM). In a retrospective study, baseline characteristics and data from a postpartum 75-g glucose tolerance test (GTT) were reviewed for patients with GDM who had delivered in four Korean tertiary institutions from 2006 to 2012. Clinical characteristics were compared between women with and those without postpartum diabetes. Cutoffs to predict postpartum diabetes and diagnostic values were calculated from receiver operating characteristic (ROC) curves. Of 1637 patients with GDM, 498 (30.4%) underwent a postpartum 75-g GTT. Postpartum diabetes was diagnosed in 40 (8.0%) patients and impaired glucose intolerance in 157 (31.5%). Women with postpartum diabetes had higher glycated hemoglobin (HbA1c) levels at GDM diagnosis (P=0.008) and higher 100-g GTT values (P<0.05 for all). In ROC curve analysis, optimal cutoffs for predicting postpartum diabetes were 0.058 for HbA1c level and 5.3 mmol/L (fasting), 10.9 mmol/L (1h), 10.2 mmol/L (2h), and 8.6 mmol/L (3h) for 100-g GTT. The highest sensitivity was observed for 3-h 100-g GTT (76.9%) and the highest positive predictive value was for HbA1c at diagnosis (15.2%). HbA1c level at GDM diagnosis and 100-g GTT values could be used to identify patients at high risk of postpartum diabetes who should undergo postpartum screening. Copyright © 2015 International Federation of Gynecology and Obstetrics. Published by Elsevier Ireland Ltd. All rights reserved.

Usability verification of the Emergency Trauma Score (EMTRAS) and Rapid Emergency Medicine Score (REMS) in patients with trauma: A retrospective cohort study.

PubMed

Park, Hyun Oh; Kim, Jong Woo; Kim, Sung Hwan; Moon, Seong Ho; Byun, Joung Hun; Kim, Ki Nyun; Yang, Jun Ho; Lee, Chung Eun; Jang, In Seok; Kang, Dong Hun; Kim, Seong Chun; Kang, Changwoo; Choi, Jun Young

2017-11-01

Early estimation of mortality risk in patients with trauma is essential. In this study, we evaluate the validity of the Emergency Trauma Score (EMTRAS) and Rapid Emergency Medicine Score (REMS) for predicting in-hospital mortality in patients with trauma. Furthermore, we compared the REMS and the EMTRAS with 2 other scoring systems: the Revised Trauma Score (RTS) and Injury Severity score (ISS).We performed a retrospective chart review of 6905 patients with trauma reported between July 2011 and June 2016 at a large national university hospital in South Korea. We analyzed the associations between patient characteristics, treatment course, and injury severity scoring systems (ISS, RTS, EMTRAS, and REMS) with in-hospital mortality. Discriminating power was compared between scoring systems using the areas under the curve (AUC) of receiver operating characteristic (ROC) curves.The overall in-hospital mortality rate was 3.1%. Higher EMTRAS and REMS scores were associated with hospital mortality (P < .001). The ROC curve demonstrated adequate discrimination (AUC = 0.957 for EMTRAS and 0.9 for REMS). After performing AUC analysis followed by Bonferroni correction for multiple comparisons, EMTRAS was significantly superior to REMS and ISS in predicting in-hospital mortality (P < .001), but not significantly different from the RTS (P = .057). The other scoring systems were not significantly different from each other.The EMTRAS and the REMS are simple, accurate predictors of in-hospital mortality in patients with trauma.

Solid pulmonary nodule risk assessment and decision analysis: comparison of four prediction models in 285 cases.

PubMed

Perandini, Simone; Soardi, Gian Alberto; Motton, Massimiliano; Rossi, Arianna; Signorini, Manuel; Montemezzi, Stefania

2016-09-01

The aim of this study was to compare classification results from four major risk prediction models in a wide population of incidentally detected solitary pulmonary nodules (SPNs) which were selected to crossmatch inclusion criteria for the selected models. A total of 285 solitary pulmonary nodules with a definitive diagnosis were evaluated by means of four major risk assessment models developed from non-screening populations, namely the Mayo, Gurney, PKUPH and BIMC models. Accuracy was evaluated by receiver operating characteristic (ROC) area under the curve (AUC) analysis. Each model's fitness to provide reliable help in decision analysis was primarily assessed by adopting a surgical threshold of 65 % and an observation threshold of 5 % as suggested by ACCP guidelines. ROC AUC values, false positives, false negatives and indeterminate nodules were respectively 0.775, 3, 8, 227 (Mayo); 0.794, 41, 6, 125 (Gurney); 0.889, 42, 0, 144 (PKUPH); 0.898, 16, 0, 118 (BIMC). Resultant data suggests that the BIMC model may be of greater help than Mayo, Gurney and PKUPH models in preoperative SPN characterization when using ACCP risk thresholds because of overall better accuracy and smaller numbers of indeterminate nodules and false positive results. • The BIMC and PKUPH models offer better characterization than older prediction models • Both the PKUPH and BIMC models completely avoided false negative results • The Mayo model suffers from a large number of indeterminate results.

Circulating anti-mullerian hormone as predictor of ovarian response to clomiphene citrate in women with polycystic ovary syndrome.

PubMed

Xi, Wenyan; Yang, Yongkang; Mao, Hui; Zhao, Xiuhua; Liu, Ming; Fu, Shengyu

2016-02-11

To investigate the impact of high circulating AMH on the outcome of CC ovulation induction in women with PCOS. This prospective cohort observational study included 81 anovulatory women with PCOS who underwent 213 cycles of CC ovarian stimulation. Serum AMH concentrations were measured on cycle day 3 before the commencement of CC in the first cycle, which were compared between responders and CC-resistant anovulation (CRA). Logistic regression analysis was applied to study the value of serum AMH for the prediction of ovarian responsiveness to CC stimulation. The receiver-operating characteristic (ROC) curve was used to evaluate the prognostic value of circulating AMH. Serum AMH levels. Women who ovulated after CC therapy had a significantly lower AMH compared with the CRA (5.34 ± 1.97 vs.7.81 ± 3.49, P < 0.001). There was a significant gradient increase of serum AMH levels with the increasing dose of CC required to achieve ovulation (P < 0.05). In multivariate logistic regression analysis, AMH was an independent predictor of ovulation induction by CC in PCOS patients. ROC curve analysis showed AMH to be a useful predictor of ovulation induction by CC in PCOS patients, having 92 % specificity and 65 % sensitivity when the threshold AMH concentration was 7.77 ng/ml. Serum AMH may be clinically useful to predict which PCOS women are more likely to respond to CC treatment and thus to direct the selection of protocols of ovulation induction.

Waist circumference and insulin resistance: a cross-sectional study of Japanese men

PubMed Central

Tabata, Shinji; Yoshimitsu, Shinichiro; Hamachi, Tadamichi; Abe, Hiroshi; Ohnaka, Keizo; Kono, Suminori

2009-01-01

Background Visceral obesity is positively related to insulin resistance. The nature of the relationship between waist circumference and insulin resistance has not been known in Japanese populations. This study examined the relationship between waist circumference and insulin resistance and evaluated the optimal cutoff point for waist circumference in relation to insulin resistance in middle-aged Japanese men. Methods Study subjects included 4800 Japanese men aged 39 to 60 years. Insulin resistance was evaluated by the homeostasis model assessment of insulin resistance (HOMA-IR). The relationship of waist circumference with HOMA-IR was assessed by use of adjusted means of HOMA-IR and odds ratios of elevated HOMA-IR defined as the highest quintile (≥2.00). Receiver operating characteristics (ROC) curve analysis using Youden index and the area under curve (AUC) was employed to determine optimal cutoffs of waist circumference in relation to HOMA-IR. Results Adjusted geometric means of HOMA-IR and prevalence odds of elevated HOMA-IR were progressively higher with increasing levels of waist circumference. In the ROC curve analysis, the highest value of Youden index was obtained for a cutoff point of 85 cm in waist circumference across different values of HOMA-IR. Multiple logistic regression analysis also indicated that the AUC was consistently the largest for a waist circumference of 85 cm. Conclusion Waist circumference is linearly related to insulin resistance, and 85 cm in waist circumference is an optimal cutoff in predicting insulin resistance in middle-aged Japanese men. PMID:19138424

Optimizing the interpretation of CT for appendicitis: modeling health utilities for clinical practice.

PubMed

Blackmore, C Craig; Terasawa, Teruhiko

2006-02-01

Error in radiology can be reduced by standardizing the interpretation of imaging studies to the optimum sensitivity and specificity. In this report, the authors demonstrate how the optimal interpretation of appendiceal computed tomography (CT) can be determined and how it varies in different clinical scenarios. Utility analysis and receiver operating characteristic (ROC) curve modeling were used to determine the trade-off between false-positive and false-negative test results to determine the optimal operating point on the ROC curve for the interpretation of appendicitis CT. Modeling was based on a previous meta-analysis for the accuracy of CT and on literature estimates of the utilities of various health states. The posttest probability of appendicitis was derived using Bayes's theorem. At a low prevalence of disease (screening), appendicitis CT should be interpreted at high specificity (97.7%), even at the expense of lower sensitivity (75%). Conversely, at a high probability of disease, high sensitivity (97.4%) is preferred (specificity 77.8%). When the clinical diagnosis of appendicitis is equivocal, CT interpretation should emphasize both sensitivity and specificity (sensitivity 92.3%, specificity 91.5%). Radiologists can potentially decrease medical error and improve patient health by varying the interpretation of appendiceal CT on the basis of the clinical probability of appendicitis. This report is an example of how utility analysis can be used to guide radiologists in the interpretation of imaging studies and provide guidance on appropriate targets for the standardization of interpretation.

Effects of the ankle-brachial blood pressure index and skin perfusion pressure on mortality in hemodialysis patients.

PubMed

Otani, Yumi; Otsubo, Shigeru; Kimata, Naoki; Takano, Mari; Abe, Takayuki; Okajima, Tomoki; Miwa, Naoko; Tsuchiya, Ken; Nitta, Kosaku; Akiba, Takashi

2013-01-01

Clinically, the ankle-brachial blood pressure index (ABI) and skin perfusion pressure (SPP) are used to screen for subclinical peripheral artery disease. However, the association between the SPP and mortality in hemodialysis patients has not been previously reported. We investigated these factors and compared the ABI and SPP in patients receiving hemodialysis. A total of 102 patients receiving maintenance hemodialysis were enrolled in this study. The ABI was determined using an ABI-form (Colin, Japan). The SPP was measured using a SensiLase(TM) PAD3000 (Kaneka, Osaka, Japan). The mean follow-up period was 3.2 ± 1.4 years. A multivariate Cox analysis identified a low ABI (p=0.019) and a low SPP (p=0.047) as being independent predictors of mortality. A receiver operating characteristic (ROC) analysis of the ABI revealed a cutoff point of 1.1 and an area under the curve (AUC) of 0.79, with a sensitivity of 90% and a specificity of 62%. A ROC analysis of the SPP revealed a cutoff point of 54.0 mmHg and an AUC of 0.71, with a sensitivity of 55% and a specificity of 84%. Both low ABI and SPP values were found to be independent risk factors for mortality among hemodialysis patients. The cutoff point for ABI as a predictor of mortality was 1.1, while that for SPP was 54.0 mmHg.

Pre-transplantation glucose testing for predicting new-onset diabetes mellitus after renal transplantation.

PubMed

Ramesh Prasad, G V; Huang, M; Bandukwala, F; Nash, M M; Rapi, L; Montada-Atin, T; Meliton, G; Zaltzman, J S

2009-02-01

New-onset diabetes after renal transplantation (NODAT) adversely affects graft and patient survival. However, NODAT risk based on pre-transplant blood glucose (BG) levels has not been defined. Our goal was to identify the best pre-transplant testing method and cut-off values. We performed a case-control analysis of non-diabetic recipients who received a live donor allograft with at least 6 months post-transplant survival. Pre-transplant glucose abnormalities were excluded through 75 g oral glucose tolerance testing (OGTT) and random BG (RBG) measurement. NODAT was defined based on 2003 Canadian Diabetes Association criteria. Multivariate logistic and Cox regression analysis was performed to determine independent predictor variables for NODAT. Receiver-operating-characteristic (ROC) curves were constructed to determine threshold BG values for diabetes risk. 151 recipients met initial entry criteria. 12 had pre-transplant impaired fasting glucose and/or impaired glucose tolerance, among who 7 (58%) developed NODAT. In the remaining 139, 24 (17%) developed NODAT. NODAT risk exceeded 25% for those with pre-transplant RBG > 6.0 mmol/l and 50% if > 7.2 mmol/l. Pre-transplant RBG provided the highest AUC (0.69, p = 0.002) by ROC analysis. Increasing age (p = 0.025), acute rejection (p = 0.011), and RBG > 6.0 mmol/l (p = 0.001) were independent predictors of NODAT. Pre-transplant glucose testing is a specific marker for NODAT. Patients can be counseled of their incremental risk even within the normal BG range if the OGTT is normal.

Validation and factor structure of the Thai version of the EURO-D scale for depression among older psychiatric patients.

PubMed

Jirapramukpitak, Tawanchai; Darawuttimaprakorn, Niphon; Punpuing, Sureeporn; Abas, Melanie

2009-11-01

To assess the concurrent and the construct validity of the Euro-D in older Thai persons. Eight local psychiatrists used the major depressive episode section of the Mini International Neuropsychiatric Interview to interview 150 consecutive psychiatric clinic attendees. A trained interviewer administered the Euro-D. We used receiver operating characteristic (ROC) analysis to assess the overall discriminability of the Euro-D scale and principal components factor analysis to assess its construct validity. The area under the ROC curve for the Euro-D with respect to major depressive episode was 0.78 [95% confidence interval (CI) 0.70-0.90] indicating moderately good discriminability. At a cut-point of 5/6 the sensitivity for major depressive episodes is 84.3%, specificity 58.6%, and kappa 0.37 (95% CI 0.22-0.52) indicating fair concordance. However, at the 3/4 cut-point recommended from European studies there is high sensitivity (94%) but poor specificity (34%). The principal components analysis suggested four factors. The first two factors conformed to affective suffering (depression, suicidality and tearfulness) and motivation (interest, concentration and enjoyment). Sleep and appetite constituted a separate factor, whereas pessimism loaded on its own factor. Among Thai psychiatric clinic attendees Euro-D is moderately valid for major depression. A much higher cut-point may be required than that which is usually advocated. The Thai version also shares two common factors as reported from most of previous studies.

ROC analysis of diagnostic performance in liver scintigraphy.

PubMed

Fritz, S L; Preston, D F; Gallagher, J H

1981-02-01

Studies on the accuracy of liver scintigraphy for the detection of metastases were assembled from 38 sources in the medical literature. An ROC curve was fitted to the observed values of sensitivity and specificity using an algorithm developed by Ogilvie and Creelman. This ROC curve fitted the data better than average sensitivity and specificity values in each of four subsets of the data. For the subset dealing with Tc-99m sulfur colloid scintigraphy, performed for detection of suspected metastases and containing data on 2800 scans from 17 independent series, it was not possible to reject the hypothesis that interobserver variation was entirely due to the use of different decision thresholds by the reporting clinicians. Thus the ROC curve obtained is a reasonable baseline estimate of the performance potentially achievable in today's clinical setting. Comparison of new reports with these data is possible, but is limited by the small sample sizes in most reported series.

Anthropometric markers and their association with incident type 2 diabetes mellitus: which marker is best for prediction? Pooled analysis of four German population-based cohort studies and comparison with a nationwide cohort study

PubMed Central

Hartwig, Saskia; Kluttig, Alexander; Tiller, Daniel; Fricke, Julia; Müller, Grit; Schipf, Sabine; Völzke, Henry; Schunk, Michaela; Meisinger, Christa; Schienkiewitz, Anja; Heidemann, Christin; Moebus, Susanne; Pechlivanis, Sonali; Werdan, Karl; Kuss, Oliver; Tamayo, Teresa; Haerting, Johannes; Greiser, Karin Halina

2016-01-01

Objective To compare the association between different anthropometric measurements and incident type 2 diabetes mellitus (T2DM) and to assess their predictive ability in different regions of Germany. Methods Data of 10 258 participants from 4 prospective population-based cohorts were pooled to assess the association of body weight, body mass index (BMI), waist circumference (WC), waist-to-hip-ratio (WHR) and waist-to-height-ratio (WHtR) with incident T2DM by calculating HRs of the crude, adjusted and standardised markers, as well as providing receiver operator characteristic (ROC) curves. Differences between HRs and ROCs for the different anthropometric markers were calculated to compare their predictive ability. In addition, data of 3105 participants from the nationwide survey were analysed separately using the same methods to provide a nationally representative comparison. Results Strong associations were found for each anthropometric marker and incidence of T2DM. Among the standardised anthropometric measures, we found the strongest effect on incident T2DM for WC and WHtR in the pooled sample (HR for 1 SD difference in WC 1.97, 95% CI 1.75 to 2.22, HR for WHtR 1.93, 95% CI 1.71 to 2.17 in women) and in female DEGS participants (HR for WC 2.24, 95% CI 1.91 to 2.63, HR for WHtR 2.10, 95% CI 1.81 to 2.44), whereas the strongest association in men was found for WHR among DEGS participants (HR 2.29, 95% CI 1.89 to 2.78). ROC analysis showed WHtR to be the strongest predictor for incident T2DM. Differences in HR and ROCs between the different markers confirmed WC and WHtR to be the best predictors of incident T2DM. Findings were consistent across study regions and age groups (<65 vs ≥65 years). Conclusions We found stronger associations between anthropometric markers that reflect abdominal obesity (ie, WC and WHtR) and incident T2DM than for BMI and weight. The use of these measurements in risk prediction should be encouraged. PMID:26792214

Anthropometric markers and their association with incident type 2 diabetes mellitus: which marker is best for prediction? Pooled analysis of four German population-based cohort studies and comparison with a nationwide cohort study.

PubMed

Hartwig, Saskia; Kluttig, Alexander; Tiller, Daniel; Fricke, Julia; Müller, Grit; Schipf, Sabine; Völzke, Henry; Schunk, Michaela; Meisinger, Christa; Schienkiewitz, Anja; Heidemann, Christin; Moebus, Susanne; Pechlivanis, Sonali; Werdan, Karl; Kuss, Oliver; Tamayo, Teresa; Haerting, Johannes; Greiser, Karin Halina

2016-01-20

To compare the association between different anthropometric measurements and incident type 2 diabetes mellitus (T2DM) and to assess their predictive ability in different regions of Germany. Data of 10,258 participants from 4 prospective population-based cohorts were pooled to assess the association of body weight, body mass index (BMI), waist circumference (WC), waist-to-hip-ratio (WHR) and waist-to-height-ratio (WHtR) with incident T2DM by calculating HRs of the crude, adjusted and standardised markers, as well as providing receiver operator characteristic (ROC) curves. Differences between HRs and ROCs for the different anthropometric markers were calculated to compare their predictive ability. In addition, data of 3105 participants from the nationwide survey were analysed separately using the same methods to provide a nationally representative comparison. Strong associations were found for each anthropometric marker and incidence of T2DM. Among the standardised anthropometric measures, we found the strongest effect on incident T2DM for WC and WHtR in the pooled sample (HR for 1 SD difference in WC 1.97, 95% CI 1.75 to 2.22, HR for WHtR 1.93, 95% CI 1.71 to 2.17 in women) and in female DEGS participants (HR for WC 2.24, 95% CI 1.91 to 2.63, HR for WHtR 2.10, 95% CI 1.81 to 2.44), whereas the strongest association in men was found for WHR among DEGS participants (HR 2.29, 95% CI 1.89 to 2.78). ROC analysis showed WHtR to be the strongest predictor for incident T2DM. Differences in HR and ROCs between the different markers confirmed WC and WHtR to be the best predictors of incident T2DM. Findings were consistent across study regions and age groups (<65 vs ≥ 65 years). We found stronger associations between anthropometric markers that reflect abdominal obesity (ie, WC and WHtR) and incident T2DM than for BMI and weight. The use of these measurements in risk prediction should be encouraged. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Suppression of LH during ovarian stimulation: analysing threshold values and effects on ovarian response and the outcome of assisted reproduction in down-regulated women stimulated with recombinant FSH.

PubMed

Balasch, J; Vidal, E; Peñarrubia, J; Casamitjana, R; Carmona, F; Creus, M; Fábregues, F; Vanrell, J A

2001-08-01

It has been recently suggested that gonadotrophin-releasing hormone agonist down-regulation in some normogonadotrophic women may result in profound suppression of LH concentrations, impairing adequate oestradiol synthesis and IVF and pregnancy outcome. The aims of this study, where receiver-operating characteristic (ROC) analysis was used, were: (i) to assess the usefulness of serum LH measurement on stimulation day 7 (S7) as a predictor of ovarian response, IVF outcome, implantation, and the outcome of pregnancy in patients treated with recombinant FSH under pituitary suppression; and (ii) to define the best threshold value, if any, to discriminate between women with 'low' or 'normal' LH concentrations. A total of 144 infertile women undergoing IVF/intracytoplasmic sperm injection (ICSI) treatment were included. Seventy-two consecutive patients having a positive pregnancy test (including 58 ongoing pregnancies and 14 early pregnancy losses) were initially selected. As a control non-pregnant group, the next non-conception IVF/ICSI cycle after each conceptual cycle in our assisted reproduction programme was used. The median and range of LH values in non-conception cycles, conception cycles, ongoing pregnancies, and early pregnancy losses, clearly overlapped. ROC analysis showed that serum LH concentration on S7 was unable to discriminate between conception and non-conception cycles (AUC(ROC) = 0.52; 95% CI: 0.44 to 0.61) or ongoing pregnancy versus early pregnancy loss groups (AUC(ROC) = 0.59; 95% CI: 0.46 to 0.70). To assess further the potential impact of suppressed concentrations of circulating LH during ovarian stimulation on the outcome of IVF/ICSI treatment, the three threshold values of mid-follicular serum LH proposed in the literature (<1, < or =0.7, <0.5 IU/l) to discriminate between women with 'low' or 'normal' LH were applied to our study population. No significant differences were found with respect to ovarian response, IVF/ICSI outcome, implantation, and the outcome of pregnancy between 'low' and 'normal' S7 LH women as defined by those threshold values. Our results do not support the need for additional exogenous LH supplementation in down-regulated women receiving a recombinant FSH-only preparation.

Visualization of the significance of Receiver Operating Characteristics based on confidence ellipses

NASA Astrophysics Data System (ADS)

Sarlis, Nicholas V.; Christopoulos, Stavros-Richard G.

2014-03-01

The Receiver Operating Characteristics (ROC) is used for the evaluation of prediction methods in various disciplines like meteorology, geophysics, complex system physics, medicine etc. The estimation of the significance of a binary prediction method, however, remains a cumbersome task and is usually done by repeating the calculations by Monte Carlo. The FORTRAN code provided here simplifies this problem by evaluating the significance of binary predictions for a family of ellipses which are based on confidence ellipses and cover the whole ROC space. Catalogue identifier: AERY_v1_0 Program summary URL:http://cpc.cs.qub.ac.uk/summaries/AERY_v1_0.html Program obtainable from: CPC Program Library, Queen’s University, Belfast, N. Ireland Licensing provisions: Standard CPC licence, http://cpc.cs.qub.ac.uk/licence/licence.html No. of lines in distributed program, including test data, etc.: 11511 No. of bytes in distributed program, including test data, etc.: 72906 Distribution format: tar.gz Programming language: FORTRAN. Computer: Any computer supporting a GNU FORTRAN compiler. Operating system: Linux, MacOS, Windows. RAM: 1Mbyte Classification: 4.13, 9, 14. Nature of problem: The Receiver Operating Characteristics (ROC) is used for the evaluation of prediction methods in various disciplines like meteorology, geophysics, complex system physics, medicine etc. The estimation of the significance of a binary prediction method, however, remains a cumbersome task and is usually done by repeating the calculations by Monte Carlo. The FORTRAN code provided here simplifies this problem by evaluating the significance of binary predictions for a family of ellipses which are based on confidence ellipses and cover the whole ROC space. Solution method: Using the statistics of random binary predictions for a given value of the predictor threshold ɛt, one can construct the corresponding confidence ellipses. The envelope of these corresponding confidence ellipses is estimated when ɛt varies from 0 to 1. This way a new family of ellipses is obtained, named k-ellipses, which covers the whole ROC plane and leads to a well defined Area Under the Curve (AUC). For the latter quantity, Mason and Graham [1] have shown that it follows the Mann-Whitney U-statistics [2] which can be applied [3] for the estimation of the statistical significance of each k-ellipse. As the transformation is invertible, any point on the ROC plane corresponds to a unique value of k, thus to a unique p-value to obtain this point by chance. The present FORTRAN code provides this p-value field on the ROC plane as well as the k-ellipses corresponding to the (p=)10%, 5% and 1% significance levels using as input the number of the positive (P) and negative (Q) cases to be predicted. Unusual features: In some machines, the compiler directive -O2 or -O3 should be used to avoid NaN’s in some points of the p-field along the diagonal. Running time: Depending on the application, e.g., 4s for an Intel(R) Core(TM)2 CPU E7600 at 3.06 GHz with 2 GB RAM for the examples presented here References: [1] S.J. Mason, N.E. Graham, Quart. J. Roy. Meteor. Soc. 128 (2002) 2145. [2] H.B. Mann, D.R. Whitney, Ann. Math. Statist. 18 (1947) 50. [3] L.C. Dinneen, B.C. Blakesley, J. Roy. Stat. Soc. Ser. C Appl. Stat. 22 (1973) 269.

Is ozonation environmentally benign for reverse osmosis concentrate treatment? Four-level analysis on toxicity reduction based on organic matter fractionation.

PubMed

Weng, Jingxia; Jia, Huichao; Wu, Bing; Pan, Bingcai

2018-01-01

Ozonation is a promising option to treat reverse osmosis concentrate (ROC). However, a systematic understanding and assessment of ozonation on toxicity reduction is insufficient. In this study, ROC sampled from a typical industrial park wastewater treatment plant of China was fractionated into hydrophobic acid (HOA), hydrophobic base (HOB), hydrophobic neutral (HON), and hydrophilic fraction (HI). Systematic bioassays covering bacteria, algae, fish, and human cell lines were conducted to reveal the role of ozonation in toxicity variation of the four ROC fractions. HOA in the raw ROC exhibited the highest toxicity, followed by HON and HI. Ozonation significantly reduced total organic carbon (TOC) and UV 254 values in HOA, HON, and HI and their toxicity except in HOB. Correlation analysis indicated that chemical data (TOC and UV 254 ) of HOA and HON correlated well with their toxicities; however, poor correlations were observed for HOB and HI, suggesting that a battery of toxicity assays is necessary. This study indicates that TOC reduction during ozonation could not fully reflect the toxicity issue, and toxicity assessment is required in conjunction with the chemical data to evaluate the effectiveness of ozonation. Copyright © 2017 Elsevier Ltd. All rights reserved.

Easy and accurate variance estimation of the nonparametric estimator of the partial area under the ROC curve and its application.

PubMed

Yu, Jihnhee; Yang, Luge; Vexler, Albert; Hutson, Alan D

2016-06-15

The receiver operating characteristic (ROC) curve is a popular technique with applications, for example, investigating an accuracy of a biomarker to delineate between disease and non-disease groups. A common measure of accuracy of a given diagnostic marker is the area under the ROC curve (AUC). In contrast with the AUC, the partial area under the ROC curve (pAUC) looks into the area with certain specificities (i.e., true negative rate) only, and it can be often clinically more relevant than examining the entire ROC curve. The pAUC is commonly estimated based on a U-statistic with the plug-in sample quantile, making the estimator a non-traditional U-statistic. In this article, we propose an accurate and easy method to obtain the variance of the nonparametric pAUC estimator. The proposed method is easy to implement for both one biomarker test and the comparison of two correlated biomarkers because it simply adapts the existing variance estimator of U-statistics. In this article, we show accuracy and other advantages of the proposed variance estimation method by broadly comparing it with previously existing methods. Further, we develop an empirical likelihood inference method based on the proposed variance estimator through a simple implementation. In an application, we demonstrate that, depending on the inferences by either the AUC or pAUC, we can make a different decision on a prognostic ability of a same set of biomarkers. Copyright © 2016 John Wiley & Sons, Ltd. Copyright © 2016 John Wiley & Sons, Ltd.

Cerebrospinal fluid ferritin and albumin index: potential candidates for scoring system to differentiate between bacterial and viral meningitis in children.

PubMed

Jebamalar, Angelin A; Prabhat; Balakrishnapillai, Agiesh K; Parmeswaran, Narayanan; Dhiman, Pooja; Rajendiran, Soundravally

2016-07-01

To evaluate the diagnostic role of cerebrospinal fluid (CSF) ferritin and albumin index (AI = CSF albumin/serum albumin × 1000) in differentiating acute bacterial meningitis (ABM) from acute viral meningitis (AVM) in children. The study included 42 cases each of ABM and AVM in pediatric age group. Receiver operating characteristic (ROC) analysis was carried out for CSF ferritin and AI. Binary logistic regression was also done. CSF ferritin and AI were found significantly higher in ABM compared to AVM. Model obtained using AI and CSF ferritin along with conventional criteria is better than existing models.

The suicide assessment scale: an instrument assessing suicide risk of suicide attempters.

PubMed

Niméus, A; Alsén, M; Träskman-Bendz, L

2000-11-01

The Suicide Assessment Scale (SUAS), a scale constructed to measure suicidality over time, was administered to 191 suicide attempters. Its predictive validity was tested. SUAS ratings were compared to ratings from other scales, and related to age and psychiatric diagnoses including co-morbidity. Eight patients committed suicide within 12 months after the SUAS assessment. Apart from advanced age, high scores in the SUAS were significant predictors of suicide. From a receiver operating characteristic (ROC) analysis, we identified cutoff SUAS scores which alone and in combination with certain diagnostic and demographic factors are of apparent value in the clinical evaluation of suicide risk after a suicide attempt.

A metabolomics approach to the identification of biomarkers of sugar-sweetened beverage intake.

PubMed

Gibbons, Helena; McNulty, Breige A; Nugent, Anne P; Walton, Janette; Flynn, Albert; Gibney, Michael J; Brennan, Lorraine

2015-03-01

The association between sugar-sweetened beverages (SSBs) and health risks remains controversial. To clarify proposed links, reliable and accurate dietary assessment methods of food intakes are essential. The aim of this present work was to use a metabolomics approach to identify a panel of urinary biomarkers indicative of SSB consumption from a national food consumption survey and subsequently validate this panel in an acute intervention study. Heat map analysis was performed to identify correlations between ¹H nuclear magnetic resonance (NMR) spectral regions and SSB intakes in participants of the National Adult Nutrition Survey (n = 565). Metabolites were identified and receiver operating characteristic (ROC) analysis was performed to assess sensitivity and specificity of biomarkers. The panel of biomarkers was validated in an acute study (n = 10). A fasting first-void urine sample and postprandial samples (2, 4, 6 h) were collected after SSB consumption. After NMR spectroscopic profiling of the urine samples, multivariate data analysis was applied. A panel of 4 biomarkers-formate, citrulline, taurine, and isocitrate-were identified as markers of SSB intake. This panel of biomarkers had an area under the curve of 0.8 for ROC analysis and a sensitivity and specificity of 0.7 and 0.8, respectively. All 4 biomarkers were identified in the SSB sample. After acute consumption of an SSB drink, all 4 metabolites increased in the urine. The present metabolomics-based strategy proved to be successful in the identification of SSB biomarkers. Future work will ascertain how to translate this panel of markers for use in nutrition epidemiology. © 2015 American Society for Nutrition.

A local equation for differential diagnosis of β-thalassemia trait and iron deficiency anemia by logistic regression analysis in Southeast Iran.

PubMed

Sargolzaie, Narjes; Miri-Moghaddam, Ebrahim

2014-01-01

The most common differential diagnosis of β-thalassemia (β-thal) trait is iron deficiency anemia. Several red blood cell equations were introduced during different studies for differential diagnosis between β-thal trait and iron deficiency anemia. Due to genetic variations in different regions, these equations cannot be useful in all population. The aim of this study was to determine a native equation with high accuracy for differential diagnosis of β-thal trait and iron deficiency anemia for the Sistan and Baluchestan population by logistic regression analysis. We selected 77 iron deficiency anemia and 100 β-thal trait cases. We used binary logistic regression analysis and determined best equations for probability prediction of β-thal trait against iron deficiency anemia in our population. We compared diagnostic values and receiver operative characteristic (ROC) curve related to this equation and another 10 published equations in discriminating β-thal trait and iron deficiency anemia. The binary logistic regression analysis determined the best equation for best probability prediction of β-thal trait against iron deficiency anemia with area under curve (AUC) 0.998. Based on ROC curves and AUC, Green & King, England & Frazer, and then Sirdah indices, respectively, had the most accuracy after our equation. We suggest that to get the best equation and cut-off in each region, one needs to evaluate specific information of each region, specifically in areas where populations are homogeneous, to provide a specific formula for differentiating between β-thal trait and iron deficiency anemia.

Clinical utility of the Calgary Depression Scale for Schizophrenia in individuals at ultra-high risk of psychosis.

PubMed

Rekhi, Gurpreet; Ng, Wai Yee; Lee, Jimmy

2018-03-01

There is a pressing need for reliable and valid rating scales to assess and measure depression in individuals at ultra-high risk (UHR) of psychosis. The aim of this study was to examine the clinical utility of the Calgary Depression Scale for Schizophrenia (CDSS) in individuals at UHR of psychosis. 167 individuals at UHR of psychosis were included as participants in this study. The Structured Clinical Interview for DSM-IV Axis I Disorders, CDSS, Beck Anxiety Inventory and Global Assessment of Functioning were administered. A receiver operating characteristic (ROC) curve analysis and factor analyses were performed. Cronbach's alpha was computed. Correlations between CDSS factor scores and other clinical variables were examined. The median CDSS total score was 5.0 (IQR 1.0-9.0). The area under ROC curve was 0.886 and Cronbach's alpha was 0.855. A score of 7 on the CDSS yielded the highest sensitivity and specificity in detecting depression in UHR individuals. Exploratory factor analysis of the CDSS yielded two factors: depression-hopelessness and self depreciation-guilt, which was confirmed by confirmatory factor analysis. Further analysis showed that the depression-hopelessness factor predicted functioning; whereas the self depreciation-guilt factor was related to the severity of the attenuated psychotic symptoms. In conclusion, the CDSS demonstrates good psychometric properties when used to evaluate depression in individuals at UHR of psychosis. Our study results also support a two-factor structure of the CDSS in UHR individuals. Copyright © 2017 The Authors. Published by Elsevier B.V. All rights reserved.

Detecting mammographically occult cancer in women with dense breasts using Radon Cumulative Distribution Transform: a preliminary analysis

NASA Astrophysics Data System (ADS)

Lee, Juhun; Nishikawa, Robert M.; Rohde, Gustavo K.

2018-02-01

We propose using novel imaging biomarkers for detecting mammographically-occult (MO) cancer in women with dense breast tissue. MO cancer indicates visually occluded, or very subtle, cancer that radiologists fail to recognize as a sign of cancer. We used the Radon Cumulative Distribution Transform (RCDT) as a novel image transformation to project the difference between left and right mammograms into a space, increasing the detectability of occult cancer. We used a dataset of 617 screening full-field digital mammograms (FFDMs) of 238 women with dense breast tissue. Among 238 women, 173 were normal with 2 - 4 consecutive screening mammograms, 552 normal mammograms in total, and the remaining 65 women had an MO cancer with a negative screening mammogram. We used Principal Component Analysis (PCA) to find representative patterns in normal mammograms in the RCDT space. We projected all mammograms to the space constructed by the first 30 eigenvectors of the RCDT of normal cases. Under 10-fold crossvalidation, we conducted quantitative feature analysis to classify normal mammograms and mammograms with MO cancer. We used receiver operating characteristic (ROC) analysis to evaluate the classifier's output using the area under the ROC curve (AUC) as the figure of merit. Four eigenvectors were selected via a feature selection method. The mean and standard deviation of the AUC of the trained classifier on the test set were 0.74 and 0.08, respectively. In conclusion, we utilized imaging biomarkers to highlight differences between left and right mammograms to detect MO cancer using novel imaging transformation.

Diagnostic value of Tg and TgAb for metastasis following ablation in patients with differentiated thyroid carcinoma coexistent with Hashimoto thyroiditis.

PubMed

Chai, Hong; Zhu, Zhao-Jin; Chen, Ze-Quan; Yu, Yong-Li

2016-08-01

This study was designed to investigate the clinical value of serum thyroglobulin (Tg) and antithyroglobulin antibody (TgAb) measurements and the cutoff value after ablation in differentiated thyroid carcinoma (DTC) complicated by Hashimoto thyroiditis (HT) with metastasis. We measured serum Tg and TgAb levels and evaluated the disease status in 164 cases of DTC coexistent with HT in pathologically confirmed patients after surgery and post-remnant ablation during a 3-year follow-up. All Tg and TgAb levels were assessed by chemiluminescent immunoassay (IMA). Receiver operating characteristic (ROC) curve analysis was used to evaluate the prognostic value of Tg and TgAb for disease metastasis. The relationship between Tg and TgAb was analyzed using the scatter diagram distribution method. We found that the cutoff values of Tg and TgAb were 1.48 µg/L and 45 kIU/L, respectively. The area under the ROC curve (AUC) of Tg and TgAb was 0.907 and 0.650, respectively. In DTC coexistent with HT patients, the optimal cutoff value correlated with metastasis in Tg and TgAb was 1.48 µg/L and 45 kIU/L, respectively.

Remote CT reading using an ultramobile PC and web-based remote viewing over a wireless network.

PubMed

Choi, Hyuk Joong; Lee, Jeong Hun; Kang, Bo Seung

2012-01-01

We developed a new type of mobile teleradiology system using an ultramobile PC (UMPC) for web-based remote viewing over a wireless network. We assessed the diagnostic performance of this system for abdominal CT interpretation. Performance was compared with an emergency department clinical monitor using a DICOM viewer. A total of 100 abdominal CT examinations were presented to four observers. There were 56 examinations showing appendicitis and 44 which were normal. The observers viewed the images using a UMPC display and an LCD monitor and rated each examination on a five-point scale. Receiver operating characteristics (ROC) analysis was used to test for differences. The sensitivity and specificities of all observers were similarly high. The average area under the ROC curve for readings performed on the UMPC and the LCD monitor was 0.959 and 0.976, respectively. There were no significant differences between the two display systems for interpreting abdominal CTs. The web-based mobile teleradiology system appears to be feasible for reading abdominal CTs for diagnosing appendicitis and may be valuable in emergency teleconsultation. Copyright © 2012 by the Royal Society of Medicine Press Ltd

[Criterion Validity of the German Version of the CES-D in the General Population].

PubMed

Jahn, Rebecca; Baumgartner, Josef S; van den Nest, Miriam; Friedrich, Fabian; Alexandrowicz, Rainer W; Wancata, Johannes

2018-04-17

The "Center of Epidemiologic Studies - Depression scale" (CES-D) is a well-known screening tool for depression. Until now the criterion validity of the German version of the CES-D was not investigated in a sample of the adult general population. 508 study participants of the Austrian general population completed the CES-D. ICD-10 diagnoses were established by using the Schedules for Clinical Assessment in Neuropsychiatry (SCAN). Receiver Operating Characteristics (ROC) analysis was conducted. Possible gender differences were explored. Overall discriminating performance of the CES-D was sufficient (ROC-AUC 0,836). Using the traditional cut-off values of 15/16 and 21/22 respectively the sensitivity was 43.2 % and 32.4 %, respectively. The cut-off value developed on the basis of our sample was 9/10 with a sensitivity of 81.1 % und a specificity of 74.3 %. There were no significant gender differences. This is the first study investigating the criterion validity of the German version of the CES-D in the general population. The optimal cut-off values yielded sufficient sensitivity and specificity, comparable to the values of other screening tools. © Georg Thieme Verlag KG Stuttgart · New York.

Multiparametric MRI Apparent Diffusion Coefficient (ADC) Accuracy in Diagnosing Clinically Significant Prostate Cancer.

PubMed

Pepe, Pietro; D'Urso, Davide; Garufi, Antonio; Priolo, Giandomenico; Pennisi, Michele; Russo, Giorgio; Sabini, Maria Gabriella; Valastro, Lucia Maria; Galia, Antonio; Fraggetta, Filippo

2017-01-01

To evaluate the accuracy of multiparametric magnetic resonance imaging apparent diffusion coefficient (mpMRI ADC) in the diagnosis of clinically significant prostate cancer (PCa). From January 2016 to December 2016, 44 patients who underwent radical prostatectomy for PCa and mpMRI lesions suggestive of cancer were retrospectively evaluated at definitive specimen. The accuracy of suspicious mpMRI prostate imaging reporting and data system (PI-RADS ≥3) vs. ADC values in the diagnosis of Gleason score ≥7 was evaluated. Receiver operating characteristics (ROC) curve analysis gave back an ADC threshold of 0.747×10 -3 mm 2 /s to separate between Gleason Score 6 and ≥7. The diagnostic accuracy of ADC value (cut-off 0.747×10 -3 mm 2 /s) vs. PI-RADS score ≥3 in diagnosing PCa with Gleason score ≥7 was equal to 84% vs. 63.6% with an area under the curve (AUC) ROC of 0.81 vs. 0.71, respectively. ADC evaluation could support clinicians in decision making of patients with PI-RADS score <3 at risk for PCa. Copyright© 2017, International Institute of Anticancer Research (Dr. George J. Delinasios), All rights reserved.

Hsa_circ_0001649: A circular RNA and potential novel biomarker for hepatocellular carcinoma.

PubMed

Qin, Meilin; Liu, Gang; Huo, Xisong; Tao, Xuemei; Sun, Xiaomeng; Ge, Zhouhong; Yang, Juan; Fan, Jia; Liu, Lei; Qin, Wenxin

2016-01-01

It has been shown that circular RNA (circRNA) is associated with human cancers, however, few studies have been reported in hepatocellular carcinoma (HCC). To estimate clinical values of a circular RNA, Hsa_circ_0001649, in HCC. Expression level of hsa_circ_0001649 was detected in HCC and paired adjacent liver tissues by real-time quantitative reverse transcription-polymerase chain reactions (qRT-PCRs). Differences in expression level of hsa_circ_0001649 were analyzed using the paired t-test. Tests were performed between clinical information and hsa_circ_0001649 expression level by analysis of variance (ANOVA) or welch t-test and a receiver operating characteristics (ROC) curve was established to estimate the value of hsa_circ_0001649 expression as a biomarker in HCC. hsa_circ_0001649 expression was significantly downregulated in HCC tissues (p = 0.0014) based on an analysis of 89 paired samples of HCC and adjacent liver tissues and the area under the ROC curve (AUC) was 0.63. Furthermore, hsa_circ_0001649 expression was correlated with tumor size (p = 0.045) and the occurrence of tumor embolus (p = 0.017) in HCC. We first found hsa_circ_0001649 was significantly downregulated in HCC. Our findings indicate hsa_circ_0001649 might serve as a novel potential biomarker for HCC and may function in tumorigenesis and metastasis of HCC.

Diagnostic Validity of High-Density Barium Sulfate in Gastric Cancer Screening: Follow-up of Screenees by Record Linkage with the Osaka Cancer Registry

PubMed Central

Yamamoto, Kenyu; Yamazaki, Hideo; Kuroda, Chikazumi; Kubo, Tsugio; Oshima, Akira; Katsuda, Toshizo; Kuwano, Tadao; Takeda, Yoshihiro

2010-01-01

Background The use of high-density barium sulfate was recommended by the Japan Society of Gastroenterological Cancer Screening (JSGCS) in 2004. We evaluated the diagnostic validity of gastric cancer screening that used high-density barium sulfate. Methods The study subjects were 171 833 residents of Osaka, Japan who underwent gastric cancer screening tests at the Osaka Cancer Prevention and Detection Center during the period from 1 January 2000 through 31 December 2001. Screening was conducted using either high-density barium sulfate (n = 48 336) or moderate-density barium sulfate (n = 123 497). The subjects were followed up and their medical records were linked to those of the Osaka Cancer Registry through 31 December 2002. The results of follow-up during 1 year were defined as the gold standard, and test performance values were calculated. Results The sensitivity and specificity of the screening test using moderate-density barium sulfate were 92.3% and 91.0%, respectively, while the sensitivity and specificity of the high-density barium test were 91.8% and 91.4%, respectively. The results of area under receiver-operating-characteristic (ROC) curve analysis revealed no significant difference between the 2 screening tests. Conclusions Screening tests using high- and moderate-density barium sulfate had similar validity, as determined by sensitivity, specificity, and ROC curve analysis. PMID:20551581

The Pareidolia Test: A Simple Neuropsychological Test Measuring Visual Hallucination-Like Illusions.

PubMed

Mamiya, Yasuyuki; Nishio, Yoshiyuki; Watanabe, Hiroyuki; Yokoi, Kayoko; Uchiyama, Makoto; Baba, Toru; Iizuka, Osamu; Kanno, Shigenori; Kamimura, Naoto; Kazui, Hiroaki; Hashimoto, Mamoru; Ikeda, Manabu; Takeshita, Chieko; Shimomura, Tatsuo; Mori, Etsuro

2016-01-01

Visual hallucinations are a core clinical feature of dementia with Lewy bodies (DLB), and this symptom is important in the differential diagnosis and prediction of treatment response. The pareidolia test is a tool that evokes visual hallucination-like illusions, and these illusions may be a surrogate marker of visual hallucinations in DLB. We created a simplified version of the pareidolia test and examined its validity and reliability to establish the clinical utility of this test. The pareidolia test was administered to 52 patients with DLB, 52 patients with Alzheimer's disease (AD) and 20 healthy controls (HCs). We assessed the test-retest/inter-rater reliability using the intra-class correlation coefficient (ICC) and the concurrent validity using the Neuropsychiatric Inventory (NPI) hallucinations score as a reference. A receiver operating characteristic (ROC) analysis was used to evaluate the sensitivity and specificity of the pareidolia test to differentiate DLB from AD and HCs. The pareidolia test required approximately 15 minutes to administer, exhibited good test-retest/inter-rater reliability (ICC of 0.82), and moderately correlated with the NPI hallucinations score (rs = 0.42). Using an optimal cut-off score set according to the ROC analysis, and the pareidolia test differentiated DLB from AD with a sensitivity of 81% and a specificity of 92%. Our study suggests that the simplified version of the pareidolia test is a valid and reliable surrogate marker of visual hallucinations in DLB.

Potential role of liver enzymes levels as predictor markers of glucose metabolism disorders in Tunisian population.

PubMed

Bouhajja, Houda; Abdelhedi, Rania; Amouri, Ali; Hadj Kacem, Faten; Marrakchi, Rim; Safi, Wajdi; Mrabet, Houcem; Chtourou, Lassaad; Charfi, Nadia; Fourati, Mouna; Bensassi, Salwa; Jamoussi, Kamel; Abid, Mohamed; Ayadi, Hammadi; Feki, Mouna Mnif; Elleuch, Noura Bougacha

2018-03-10

The relationship between liver enzymes and type 2 diabetes (T2D) risk is inconclusive. We aimed to evaluate the association between liver markers and risk of carbohydrate metabolism disorders and their discriminatory power for T2D prediction. This cross-sectional study enrolled 216 participants classified as normoglycemic, prediabetes, newly-diagnosed diabetes and diagnosed diabetes. All participants underwent anthropometric and biochemical measurements. The relationship between hepatic enzymes and glucose metabolism markers was evaluated by ANCOVA analyses. The associations between liver enzymes and incident carbohydrate metabolism disorders were analyzed through logistic regression and their discriminatory capacity for T2D by receiver operating characteristic (ROC) analysis. High alkaline phosphatase (AP), alanine aminotransferase (ALT), γ-glutamyltransferase (γGT) and aspartate aminotrasferase (AST) levels were independently related to decreased insulin sensitivity. Interestingly, higher AP level was significantly associated with increased risk of prediabetes (p=0.017), newly-diagnosed diabetes (p=0.004) and T2D (p=0.007). Elevated γGT level was an independent risk factor for T2D (p=0.032) and undiagnosed-T2D (p=0.010) in prediabetic and normoglycemic subjects, respectively. In ROC analysis, AP was a powerful predictor of incident diabetes and significantly improved T2D prediction. Liver enzymes within normal range, specifically AP levels, are associated with increased risk of carbohydrate metabolism disorders and significantly improved T2D prediction.

Predictors of Gestational Diabetes Mellitus in Chinese Women with Polycystic Ovary Syndrome: A Cross-Sectional Study.

PubMed

Zhang, Ya-Jie; Jin, Hua; Qin, Zhen-Li; Ma, Jin-Long; Zhao, Han; Zhang, Ling; Chen, Zi-Jiang

2016-01-01

This study aims to explore the independent predictors of gestational diabetes mellitus (GDM) in Chinese women with polycystic ovary syndrome (PCOS). This cross-sectional study analyzed primigravid women with PCOS and classified them as those with and without GDM. Independent risk factors and model performance were analyzed using multivariate logistic regression and the area under the curve (AUC) of receiver operating characteristic (ROC), respectively. Maternal body mass index, waist circumference, waist-to-hip ratio (WHR), fasting glucose, insulin, sex hormone-binding globulin (SHBG), homeostasis model assessment-insulin resistance (HOMA-IR) before pregnancy, gestation weight gain before 24 weeks and the incidence of family history of diabetes were different in the 2 groups. Logistic regression analysis showed that pre-pregnancy WHR, SHBG, HOMA-IR and gestation weight gain before 24 weeks were the independent predictors of GDM. ROC curve analysis confirmed that gestation weight gain before 24 weeks (AUC 0.767, 95% CI 0.688-0.841), pre-pregnant WHR (AUC 0.725, 95% CI 0.649-0.802), HOMA-IR (AUC 0.711, 95% CI 0.632-0.790) and SHBG levels (AUC 0.709, 95% CI 0.625-0.793) were the strong risk factors. In Chinese women with PCOS, factors of gestation weight gain before 24 weeks, pre-pregnant WHR, HOMA-IR and SHBG levels are strongly associated with subsequent development of GDM. © 2015 S. Karger AG, Basel.

Assessing depression outcome in patients with moderate dementia: sensitivity of the HoNOS65+ scale.

PubMed

Canuto, Alessandra; Rudhard-Thomazic, Valérie; Herrmann, François R; Delaloye, Christophe; Giannakopoulos, Panteleimon; Weber, Kerstin

2009-08-15

To date, there is no widely accepted clinical scale to monitor the evolution of depressive symptoms in demented patients. We assessed the sensitivity to treatment of a validated French version of the Health of the Nation Outcome Scale (HoNOS) 65+ compared to five routinely used scales. Thirty elderly inpatients with ICD-10 diagnosis of dementia and depression were evaluated at admission and discharge using paired t-test. Using the Brief Psychiatric Rating Scale (BPRS) "depressive mood" item as gold standard, a receiver operating characteristic curve (ROC) analysis assessed the validity of HoNOS65+F "depressive symptoms" item score changes. Unlike Geriatric Depression Scale, Mini Mental State Examination and Activities of Daily Living scores, BPRS scores decreased and Global Assessment Functioning Scale score increased significantly from admission to discharge. Amongst HoNOS65+F items, "behavioural disturbance", "depressive symptoms", "activities of daily life" and "drug management" items showed highly significant changes between the first and last day of hospitalization. The ROC analysis revealed that changes in the HoNOS65+F "depressive symptoms" item correctly classified 93% of the cases with good sensitivity (0.95) and specificity (0.88) values. These data suggest that the HoNOS65+F "depressive symptoms" item may provide a valid assessment of the evolution of depressive symptoms in demented patients.

Effect of Reduced Tube Voltage on Diagnostic Accuracy of CT Colonography.

PubMed

Futamata, Yoshihiro; Koide, Tomoaki; Ihara, Riku

2017-01-01

The normal tube voltage in computed tomography colonography (CTC) is 120 kV. Some reports indicate that the use of a low tube voltage (lower than 120 kV) technique plays a significant role in reduction of radiation dose. However, to determine whether a lower tube voltage can reduce radiation dose without compromising diagnostic accuracy, an evaluation of images that are obtained while maintaining the volume CT dose index (CTDI vol ) is required. This study investigated the effect of reduced tube voltage in CTC, without modifying radiation dose (i.e. constant CTDI vol ), on image quality. Evaluation of image quality involved the shape of the noise power spectrum, surface profiling with volume rendering (VR), and receiver operating characteristic (ROC) analysis. The shape of the noise power spectrum obtained with a tube voltage of 80 kV and 100 kV was not similar to the one produced with a tube voltage of 120 kV. Moreover, a higher standard deviation was observed on volume-rendered images that were generated using the reduced tube voltages. In addition, ROC analysis revealed a statistically significant drop in diagnostic accuracy with reduced tube voltage, revealing that the modification of tube voltage affects volume-rendered images. The results of this study suggest that reduction of tube voltage in CTC, so as to reduce radiation dose, affects image quality and diagnostic accuracy.

High Tumor Volume to Fetal Weight Ratio Is Associated with Worse Fetal Outcomes and Increased Maternal Risk in Fetuses with Sacrococcygeal Teratoma.

PubMed

Gebb, Juliana S; Khalek, Nahla; Qamar, Huma; Johnson, Mark P; Oliver, Edward R; Coleman, Beverly G; Peranteau, William H; Hedrick, Holly L; Flake, Alan W; Adzick, N Scott; Moldenhauer, Julie S

2018-03-01

Tumor volume to fetal weight ratio (TFR) > 0.12 before 24 weeks has been associated with poor outcome in fetuses with sacrococcygeal teratoma (SCT). We evaluated TFR in predicting poor fetal outcome and increased maternal operative risk in our cohort of SCT pregnancies. This is a retrospective, single-center review of fetuses seen with SCT from 1997 to 2015. Patients who chose termination of pregnancy (TOP), delivered elsewhere, or had initial evaluation at > 24 weeks were excluded. Receiver operating characteristic (ROC) analysis determined the optimal TFR to predict poor fetal outcome and increased maternal operative risk. Poor fetal outcome included fetal demise, neonatal demise, or fetal deterioration warranting open fetal surgery or delivery < 32 weeks. Increased maternal operative risk included cases necessitating open fetal surgery, classical cesarean delivery, or ex utero intrapartum treatment (EXIT). Of 139 pregnancies with SCT, 27 chose TOP, 14 delivered elsewhere, and 40 had initial evaluation at > 24 weeks. Thus, 58 fetuses were reviewed. ROC analysis revealed that at ≤24 weeks, TFR > 0.095 was predictive of poor fetal outcome and TFR > 0.12 was predictive of increased maternal operative risk. This study supports the use of TFR at ≤24 weeks for risk stratification of pregnancies with SCT. © 2018 S. Karger AG, Basel.

Evaluation of image compression for computer-aided diagnosis of breast tumors in 3D sonography

NASA Astrophysics Data System (ADS)

Chen, We-Min; Huang, Yu-Len; Tao, Chi-Chuan; Chen, Dar-Ren; Moon, Woo-Kyung

2006-03-01

Medical imaging examinations form the basis for physicians diagnosing diseases, as evidenced by the increasing use of digital medical images for picture archiving and communications systems (PACS). However, with enlarged medical image databases and rapid growth of patients' case reports, PACS requires image compression to accelerate the image transmission rate and conserve disk space for diminishing implementation costs. For this purpose, JPEG and JPEG2000 have been accepted as legal formats for the digital imaging and communications in medicine (DICOM). The high compression ratio is felt to be useful for medical imagery. Therefore, this study evaluates the compression ratios of JPEG and JPEG2000 standards for computer-aided diagnosis (CAD) of breast tumors in 3-D medical ultrasound (US) images. The 3-D US data sets with various compression ratios are compressed using the two efficacious image compression standards. The reconstructed data sets are then diagnosed by a previous proposed CAD system. The diagnostic accuracy is measured based on receiver operating characteristic (ROC) analysis. Namely, the ROC curves are used to compare the diagnostic performance of two or more reconstructed images. Analysis results ensure a comparison of the compression ratios by using JPEG and JPEG2000 for 3-D US images. Results of this study provide the possible bit rates using JPEG and JPEG2000 for 3-D breast US images.

In vitro culture increases mechanical stability of human tissue engineered cartilage constructs by prevention of microscale scaffold buckling.

PubMed

Middendorf, Jill M; Shortkroff, Sonya; Dugopolski, Caroline; Kennedy, Stephen; Siemiatkoski, Joseph; Bartell, Lena R; Cohen, Itai; Bonassar, Lawrence J

2017-11-07

Many studies have measured the global compressive properties of tissue engineered (TE) cartilage grown on porous scaffolds. Such scaffolds are known to exhibit strain softening due to local buckling under loading. As matrix is deposited onto these scaffolds, the global compressive properties increase. However the relationship between the amount and distribution of matrix in the scaffold and local buckling is unknown. To address this knowledge gap, we studied how local strain and construct buckling in human TE constructs changes over culture times and GAG content. Confocal elastography techniques and digital image correlation (DIC) were used to measure and record buckling modes and local strains. Receiver operating characteristic (ROC) curves were used to quantify construct buckling. The results from the ROC analysis were placed into Kaplan-Meier survival function curves to establish the probability that any point in a construct buckled. These analysis techniques revealed the presence of buckling at early time points, but bending at later time points. An inverse correlation was observed between the probability of buckling and the total GAG content of each construct. This data suggests that increased GAG content prevents the onset of construct buckling and improves the microscale compressive tissue properties. This increase in GAG deposition leads to enhanced global compressive properties by prevention of microscale buckling. Copyright © 2017 Elsevier Ltd. All rights reserved.

Serum Squamous Cell Carcinoma Antigen in Psoriasis: A Potential Quantitative Biomarker for Disease Severity.

PubMed

Sun, Ziwen; Shi, Xiaomin; Wang, Yun; Zhao, Yi

2018-06-05

An objective and quantitative method to evaluate psoriasis severity is important for practice and research in the precision care of psoriasis. We aimed to explore serum biomarkers quantitatively in association with disease severity and treatment response in psoriasis patients, with serum squamous cell carcinoma antigen (SCCA) evaluated in this pilot study. 15 psoriasis patients were treated with adalimumab. At different visits before and after treatment, quantitative body surface area (qBSA) was obtained from standardized digital body images of the patients, and the psoriasis area severity index (PASI) was also monitored. SCCA were detected by using microparticle enzyme immunoassay. The serum biomarkers were also tested in healthy volunteers as normal controls. Receiver-operating characteristic (ROC) curve analysis was used to explore the optimal cutoff point of SCCA to differentiate mild and moderate-to-severe psoriasis. The serum SCCA level in the psoriasis group was significantly higher (p < 0.05) than in the normal control group. After treatment, the serum SCCA levels were significantly decreased (p < 0.05). The SCCA level was well correlated with PASI and qBSA. In ROC analysis, when taking PASI = 10 or qBSA = 10% as the threshold, an optimal cutoff point of SCCA was found at 2.0 ng/mL with the highest Youden index. Serum SCCA might be a useful quantitative biomarker for psoriasis disease severity. © 2018 S. Karger AG, Basel.

Three regularities of recognition memory: the role of bias.

PubMed

Hilford, Andrew; Maloney, Laurence T; Glanzer, Murray; Kim, Kisok

2015-12-01

A basic assumption of Signal Detection Theory is that decisions are made on the basis of likelihood ratios. In a preceding paper, Glanzer, Hilford, and Maloney (Psychonomic Bulletin & Review, 16, 431-455, 2009) showed that the likelihood ratio assumption implies that three regularities will occur in recognition memory: (1) the Mirror Effect, (2) the Variance Effect, (3) the normalized Receiver Operating Characteristic (z-ROC) Length Effect. The paper offered formal proofs and computational demonstrations that decisions based on likelihood ratios produce the three regularities. A survey of data based on group ROCs from 36 studies validated the likelihood ratio assumption by showing that its three implied regularities are ubiquitous. The study noted, however, that bias, another basic factor in Signal Detection Theory, can obscure the Mirror Effect. In this paper we examine how bias affects the regularities at the theoretical level. The theoretical analysis shows: (1) how bias obscures the Mirror Effect, not the other two regularities, and (2) four ways to counter that obscuring. We then report the results of five experiments that support the theoretical analysis. The analyses and the experimental results also demonstrate: (1) that the three regularities govern individual, as well as group, performance, (2) alternative explanations of the regularities are ruled out, and (3) that Signal Detection Theory, correctly applied, gives a simple and unified explanation of recognition memory data.

Can the pre-operative Western Ontario and McMaster score predict patient satisfaction following total hip arthroplasty?

PubMed

Rogers, B A; Alolabi, B; Carrothers, A D; Kreder, H J; Jenkinson, R J

2015-02-01

In this study we evaluated whether pre-operative Western Ontario and McMaster Universities (WOMAC) osteoarthritis scores can predict satisfaction following total hip arthroplasty (THA). Prospective data for a cohort of patients undergoing THA from two large academic centres were collected, and pre-operative and one-year post-operative WOMAC scores and a 25-point satisfaction questionnaire were obtained for 446 patients. Satisfaction scores were dichotomised into either improvement or deterioration. Scatter plots and Spearman's rank correlation coefficient were used to describe the association between pre-operative WOMAC and one-year post-operative WOMAC scores and patient satisfaction. Satisfaction was compared using receiver operating characteristic (ROC) analysis against pre-operative, post-operative and δ WOMAC scores. We found no relationship between pre-operative WOMAC scores and one-year post-operative WOMAC or satisfaction scores, with Spearman's rank correlation coefficients of 0.16 and -0.05, respectively. The ROC analysis showed areas under the curve (AUC) of 0.54 (pre-operative WOMAC), 0.67 (post-operative WOMAC) and 0.43 (δ WOMAC), respectively, for an improvement in satisfaction. We conclude that the pre-operative WOMAC score does not predict the post-operative WOMAC score or patient satisfaction after THA, and that WOMAC scores can therefore not be used to prioritise patient care. ©2015 The British Editorial Society of Bone & Joint Surgery.

Prognostic value of preoperative serum CA 242 in Esophageal squamous cell carcinoma cases.

PubMed

Feng, Ji-Feng; Huang, Ying; Chen, Qi-Xun

2013-01-01

Carbohydrate antigen (CA) 242 is inversely related to prognosis in many cancers. However, few data regarding CA 242 in esophageal cancer (EC) are available. The aim of this study was to determine the prognostic value of CA 242 and propose an optimum cut-off point in predicting survival difference in patients with esophageal squamous cell carcinoma (ESCC). A retrospective analysis was conducted of 192 cases. A receiver operating characteristic (ROC) curve for survival prediction was plotted to verify the optimum cuf- off point. Univariate and multivariate analyses were performed to evaluate prognostic parameters for survival. The positive rate for CA 242 was 7.3% (14/192). The ROC curve for survival prediction gave an optimum cut-off of 2.15 (U/ml). Patients with CA 242 ≤ 2.15 U/ml had significantly better 5-year survival than patients with CA 242 >2.15 U/ml (45.4% versus 22.6%; P=0.003). Multivariate analysis showed that differentiation (P=0.033), CA 242 (P=0.017), T grade (P=0.004) and N staging (P<0.001) were independent prognostic factors. Preoperative CA 242 is a predictive factor for long-term survival in ESCC, especially in nodal-negative patients. We conclude that 2.15 U/ml may be the optimum cuf-off point for CA 242 in predicting survival in ESCC.

Computer-aided diagnosis with textural features for breast lesions in sonograms.

PubMed

Chen, Dar-Ren; Huang, Yu-Len; Lin, Sheng-Hsiung

2011-04-01

Computer-aided diagnosis (CAD) systems provided second beneficial support reference and enhance the diagnostic accuracy. This paper was aimed to develop and evaluate a CAD with texture analysis in the classification of breast tumors for ultrasound images. The ultrasound (US) dataset evaluated in this study composed of 1020 sonograms of region of interest (ROI) subimages from 255 patients. Two-view sonogram (longitudinal and transverse views) and four different rectangular regions were utilized to analyze each tumor. Six practical textural features from the US images were performed to classify breast tumors as benign or malignant. However, the textural features always perform as a high dimensional vector; high dimensional vector is unfavorable to differentiate breast tumors in practice. The principal component analysis (PCA) was used to reduce the dimension of textural feature vector and then the image retrieval technique was performed to differentiate between benign and malignant tumors. In the experiments, all the cases were sampled with k-fold cross-validation (k=10) to evaluate the performance with receiver operating characteristic (ROC) curve. The area (A(Z)) under the ROC curve for the proposed CAD system with the specific textural features was 0.925±0.019. The classification ability for breast tumor with textural information is satisfactory. This system differentiates benign from malignant breast tumors with a good result and is therefore clinically useful to provide a second opinion. Copyright © 2010 Elsevier Ltd. All rights reserved.

Assessment of mortality by qSOFA in patients with sepsis outside ICU: A post hoc subgroup analysis by the Japanese Association for Acute Medicine Sepsis Registry Study Group.

PubMed

Umemura, Yutaka; Ogura, Hiroshi; Gando, Satoshi; Kushimoto, Shigeki; Saitoh, Daizoh; Mayumi, Toshihiko; Fujishima, Seitaro; Abe, Toshikazu; Ikeda, Hiroto; Kotani, Joji; Miki, Yasuo; Shiraishi, Shin-Ichiro; Shiraishi, Atsushi; Suzuki, Koichiro; Suzuki, Yasushi; Takeyama, Naoshi; Takuma, Kiyotsugu; Tsuruta, Ryosuke; Yamaguchi, Yoshihiro; Yamashita, Norio; Aikawa, Naoki

2017-11-01

Quick sequential organ failure assessment (qSOFA) was proposed in the new sepsis definition (Sepsis-3). Although qSOFA was created to identify patients with suspected infection and likely to have poor outcomes, the clinical utility of qSOFA to screen sepsis has not been fully evaluated. We investigated the number of patients diagnosed as having severe sepsis who could not be identified by the qSOFA criteria and what clinical signs could complement the qSOFA score. This retrospective analysis of a multicenter prospective registry included adult patients with severe sepsis diagnosed outside the intensive care unit (ICU) by conventional criteria proposed in 2003. We conducted receiver operating characteristic (ROC) analyses to assess the predictive value for in-hospital mortality and compared clinical characteristics between survivors and non-survivors with qSOFA score ≤ 1 point (qSOFA-negative). Among 387 eligible patients, 63 (16.3%) patients were categorized as qSOFA-negative, and 10 (15.9%) of these patients died. The area under the ROC curve for the qSOFA score was 0.615, which was superior to that for the systemic inflammatory response syndrome score (0.531, P = 0.019) but inferior to that for the SOFA score (0.702, P = 0.005). Multivariate logistic regression analysis showed that hypothermia might be associated with poor outcome independently of qSOFA criteria. Our findings suggested that qSOFA had a suboptimal level of predictive value outside the ICU and could not identify 16.3% of patients who were once actually diagnosed with sepsis. Hypothermia might be associated with an increased risk of death that cannot be identified by qSOFA. Copyright © 2017 Japanese Society of Chemotherapy and The Japanese Association for Infectious Diseases. Published by Elsevier Ltd. All rights reserved.

To what extent does the anxiety scale of the Four-Dimensional Symptom Questionnaire (4DSQ) detect specific types of anxiety disorder in primary care? A psychometric study

PubMed Central

2014-01-01

Background Anxiety scales may help primary care physicians to detect specific anxiety disorders among the many emotionally distressed patients presenting in primary care. The anxiety scale of the Four-Dimensional Symptom Questionnaire (4DSQ) consists of an admixture of symptoms of specific anxiety disorders. The research questions were: (1) Is the anxiety scale unidimensional or multidimensional? (2) To what extent does the anxiety scale detect specific DSM-IV anxiety disorders? (3) Which cut-off points are suitable to rule out or to rule in (which) anxiety disorders? Methods We analyzed 5 primary care datasets with standardized psychiatric diagnoses and 4DSQ scores. Unidimensionality was assessed through confirmatory factor analysis (CFA). We examined mean scores and anxiety score distributions per disorder. Receiver operating characteristic (ROC) analysis was used to determine optimal cut-off points. Results Total n was 969. CFA supported unidimensionality. The anxiety scale performed slightly better in detecting patients with panic disorder, agoraphobia, social phobia, obsessive compulsive disorder (OCD) and post traumatic stress disorder (PTSD) than patients with generalized anxiety disorder (GAD) and specific phobia. ROC-analysis suggested that ≥4 was the optimal cut-off point to rule out and ≥10 the cut-off point to rule in anxiety disorders. Conclusions The 4DSQ anxiety scale measures a common trait of pathological anxiety that is characteristic of anxiety disorders, in particular panic disorder, agoraphobia, social phobia, OCD and PTSD. The anxiety score detects the latter anxiety disorders to a slightly greater extent than GAD and specific phobia, without being able to distinguish between the different anxiety disorder types. The cut-off points ≥4 and ≥10 can be used to separate distressed patients in three groups with a relatively low, moderate and high probability of having one or more anxiety disorders. PMID:24761829

Exploratory metabolomics of biomarker identification for the internet gaming disorder in young Korean males.

PubMed

Cho, Yeo Ul; Lee, Deokjong; Lee, Jung-Eun; Kim, Kyoung Heon; Lee, Do Yup; Jung, Young-Chul

2017-07-01

The main aim of the current research is to characterize the molecular dynamics related to internet gaming disorder (IGD) using non-targeted plasma metabolite profiling based on gas-chromatography time-of-flight mass spectrometry (GC-TOF MS). IGD is a psychiatric disorder instigated by excessive and prolonged internet gaming, which shared many pathological symptoms with attention deficit hyperactivity disorder (ADHD). The prevalence of the disorder has been rapidly increased particularly in East Asia countries (5.9% in South Korea) compared to Europe or North America (0.3-1.0% in United States and 1.16% in Germany). Thus we comparably explored the correlation between plasma metabolites and internet addiction severity in IGD patients, and potential biomarker composite in combination with clinical parameters. The systematic metabolite profiling of 54 blood samples (normal user, N=28 and IGD, N=24) identified a total of 104 metabolites out of 1212 metabolic feature, and revealed unique relation of co-linearly regressed set of plasma metabolites (arabitol, myo-inositol, methionine, pyrrole-2-carboxylic acid, and aspartic acid) with internet addiction severity scale (R=0.795). In addition, orthogonal partial least squared discriminant analysis (OPLS-DA) and receiver operating characteristic (ROC) analysis identified the potential biomarker cluster that simultaneously discriminated the different types of the psychiatric status. The potential biomarker re-composite was comprehensively evaluated by a receiver operating characteristic (ROC) analysis where the AUCs were 0.890, 0.880, 1.000, and 0.935 for control, IGD, AD and IGD+AD, respectively (N=18, 19, 5, and 10) against the others. This exploratory method may provide robustness of predictive diagnosis in population screening of IGD. The identified metabolic features, the relatedness with clinical parameters, and the putative biochemical linkage will hopefully aid future pathological studies in IGD. Copyright © 2017. Published by Elsevier B.V.

Measurements of diagnostic examination performance and correlation analysis using microvascular leakage, cerebral blood volume, and blood flow derived from 3T dynamic susceptibility-weighted contrast-enhanced perfusion MR imaging in glial tumor grading.

PubMed

Server, Andrés; Graff, Bjørn A; Orheim, Tone E Døli; Schellhorn, Till; Josefsen, Roger; Gadmar, Øystein B; Nakstad, Per H

2011-06-01

To assess the diagnostic accuracy of microvascular leakage (MVL), cerebral blood volume (CBV) and blood flow (CBF) values derived from dynamic susceptibility-weighted contrast-enhanced perfusion MR imaging (DSC-MR imaging) for grading of cerebral glial tumors, and to estimate the correlation between vascular permeability/perfusion parameters and tumor grades. A prospective study of 79 patients with cerebral glial tumors underwent DSC-MR imaging. Normalized relative CBV (rCBV) and relative CBF (rCBF) from tumoral (rCBVt and rCBFt), peri-enhancing region (rCBVe and rCBFe), and the value in the tumor divided by the value in the peri-enhancing region (rCBVt/e and rCBFt/e), as well as MVL, expressed as the leakage coefficient K(2) were calculated. Hemodynamic variables and tumor grades were analyzed statistically and with Pearson correlations. Receiver operating characteristic (ROC) curve analyses were also performed for each of the variables. The differences in rCBVt and the maximum MVL (MVL(max)) values were statistically significant among all tumor grades. Correlation analysis using Pearson was as follows: rCBVt and tumor grade, r = 0.774; rCBFt and tumor grade, r = 0.417; MVL(max) and tumor grade, r = 0.559; MVL(max) and rCBVt, r = 0.440; MVL(max) and rCBFt, r = 0.192; and rCBVt and rCBFt, r = 0.605. According to ROC analyses for distinguishing tumor grade, rCBVt showed the largest areas under ROC curve (AUC), except for grade III from IV. Both rCBVt and MVL(max) showed good discriminative power in distinguishing all tumor grades. rCBVt correlated strongly with tumor grade; the correlation between MVL(max) and tumor grade was moderate.

14-3-3η Autoantibodies: Diagnostic Use in Early Rheumatoid Arthritis.

PubMed

Maksymowych, Walter P; Boire, Gilles; van Schaardenburg, Dirkjan; Wichuk, Stephanie; Turk, Samina; Boers, Maarten; Siminovitch, Katherine A; Bykerk, Vivian; Keystone, Ed; Tak, Paul Peter; van Kuijk, Arno W; Landewé, Robert; van der Heijde, Desiree; Murphy, Mairead; Marotta, Anthony

2015-09-01

To describe the expression and diagnostic use of 14-3-3η autoantibodies in early rheumatoid arthritis (RA). 14-3-3η autoantibody levels were measured using an electrochemiluminescent multiplexed assay in 500 subjects (114 disease-modifying antirheumatic drug-naive patients with early RA, 135 with established RA, 55 healthy, 70 autoimmune, and 126 other non-RA arthropathy controls). 14-3-3η protein levels were determined in an earlier analysis. Two-tailed Student t tests and Mann-Whitney U tests compared differences among groups. Receiver-operator characteristic (ROC) curves were generated and diagnostic performance was estimated by area under the curve (AUC), as well as specificity, sensitivity, and likelihood ratios (LR) for optimal cutoffs. Median serum 14-3-3η autoantibody concentrations were significantly higher (p < 0.0001) in patients with early RA (525 U/ml) when compared with healthy controls (235 U/ml), disease controls (274 U/ml), autoimmune disease controls (274 U/ml), patients with osteoarthritis (259 U/ml), and all controls (265 U/ml). ROC curve analysis comparing early RA with healthy controls demonstrated a significant (p < 0.0001) AUC of 0.90 (95% CI 0.85-0.95). At an optimal cutoff of ≥ 380 U/ml, the ROC curve yielded a sensitivity of 73%, a specificity of 91%, and a positive LR of 8.0. Adding 14-3-3η autoantibodies to 14-3-3η protein positivity enhanced the identification of patients with early RA from 59% to 90%; addition of 14-3-3η autoantibodies to anticitrullinated protein antibodies (ACPA) and/or rheumatoid factor (RF) increased identification from 72% to 92%. Seventy-two percent of RF- and ACPA-seronegative patients were positive for 14-3-3η autoantibodies. 14-3-3η autoantibodies, alone and in combination with the 14-3-3η protein, RF, and/or ACPA identified most patients with early RA.

Development and Validation of a Novel Scoring System for Predicting Technical Success of Chronic Total Occlusion Percutaneous Coronary Interventions: The PROGRESS CTO (Prospective Global Registry for the Study of Chronic Total Occlusion Intervention) Score.

PubMed

Christopoulos, Georgios; Kandzari, David E; Yeh, Robert W; Jaffer, Farouc A; Karmpaliotis, Dimitri; Wyman, Michael R; Alaswad, Khaldoon; Lombardi, William; Grantham, J Aaron; Moses, Jeffrey; Christakopoulos, Georgios; Tarar, Muhammad Nauman J; Rangan, Bavana V; Lembo, Nicholas; Garcia, Santiago; Cipher, Daisha; Thompson, Craig A; Banerjee, Subhash; Brilakis, Emmanouil S

2016-01-11

This study sought to develop a novel parsimonious score for predicting technical success of chronic total occlusion (CTO) percutaneous coronary intervention (PCI) performed using the hybrid approach. Predicting technical success of CTO PCI can facilitate clinical decision making and procedural planning. We analyzed clinical and angiographic parameters from 781 CTO PCIs included in PROGRESS CTO (Prospective Global Registry for the Study of Chronic Total Occlusion Intervention) using a derivation and validation cohort (2:1 sampling ratio). Variables with strong association with technical success in multivariable analysis were assigned 1 point, and a 4-point score was developed from summing all points. The PROGRESS CTO score was subsequently compared with the J-CTO (Multicenter Chronic Total Occlusion Registry in Japan) score in the validation cohort. Technical success was 92.9%. On multivariable analysis, factors associated with technical success included proximal cap ambiguity (beta coefficient [b] = 0.88), moderate/severe tortuosity (b = 1.18), circumflex artery CTO (b = 0.99), and absence of "interventional" collaterals (b = 0.88). The resulting score demonstrated good calibration and discriminatory capacity in the derivation (Hosmer-Lemeshow chi-square = 2.633; p = 0.268, and receiver-operator characteristic [ROC] area = 0.778) and validation (Hosmer-Lemeshow chi-square = 5.333; p = 0.070, and ROC area = 0.720) subset. In the validation cohort, the PROGRESS CTO and J-CTO scores performed similarly in predicting technical success (ROC area 0.720 vs. 0.746, area under the curve difference = 0.026, 95% confidence interval = -0.093 to 0.144). The PROGRESS CTO score is a novel useful tool for estimating technical success in CTO PCI performed using the hybrid approach. Copyright © 2016 American College of Cardiology Foundation. Published by Elsevier Inc. All rights reserved.

Proteomics to predict the response to tumour necrosis factor-α inhibitors in rheumatoid arthritis using a supervised cluster-analysis based protein score.

PubMed

Cuppen, Bvj; Fritsch-Stork, Rde; Eekhout, I; de Jager, W; Marijnissen, A C; Bijlsma, Jwj; Custers, M; van Laar, J M; Lafeber, Fpjg; Welsing, Pmj

2018-01-01

In rheumatoid arthritis (RA), it is of major importance to identify non-responders to tumour necrosis factor-α inhibitors (TNFi) before starting treatment, to prevent a delay in effective treatment. We developed a protein score for the response to TNFi treatment in RA and investigated its predictive value. In RA patients eligible for biological treatment included in the BiOCURA registry, 53 inflammatory proteins were measured using xMAP® technology. A supervised cluster analysis method, partial least squares (PLS), was used to select the best combination of proteins. Using logistic regression, a predictive model containing readily available clinical parameters was developed and the potential of this model with and without the protein score to predict European League Against Rheumatism (EULAR) response was assessed using the area under the receiving operating characteristics curve (AUC-ROC) and the net reclassification index (NRI). For the development step (n = 65 patient), PLS revealed 12 important proteins: CCL3 (macrophage inflammatory protein, MIP1a), CCL17 (thymus and activation-regulated chemokine), CCL19 (MIP3b), CCL22 (macrophage-derived chemokine), interleukin-4 (IL-4), IL-6, IL-7, IL-15, soluble cluster of differentiation 14 (sCD14), sCD74 (macrophage migration inhibitory factor), soluble IL-1 receptor I, and soluble tumour necrosis factor receptor II. The protein score scarcely improved the AUC-ROC (0.72 to 0.77) and the ability to improve classification and reclassification (NRI = 0.05). In validation (n = 185), the model including protein score did not improve the AUC-ROC (0.71 to 0.67) or the reclassification (NRI = -0.11). No proteomic predictors were identified that were more suitable than clinical parameters in distinguishing TNFi non-responders from responders before the start of treatment. As the results of previous studies and this study are disparate, we currently have no proteomic predictors for the response to TNFi.

Hyperglycemic clamp and oral glucose tolerance test for 3-year prediction of clinical onset in persistently autoantibody-positive offspring and siblings of type 1 diabetic patients.

PubMed

Balti, Eric V; Vandemeulebroucke, Evy; Weets, Ilse; Van De Velde, Ursule; Van Dalem, Annelien; Demeester, Simke; Verhaeghen, Katrijn; Gillard, Pieter; De Block, Christophe; Ruige, Johannes; Keymeulen, Bart; Pipeleers, Daniel G; Decochez, Katelijn; Gorus, Frans K

2015-02-01

In preparation of future prevention trials, we aimed to identify predictors of 3-year diabetes onset among oral glucose tolerance test (OGTT)- and hyperglycemic clamp-derived metabolic markers in persistently islet autoantibody positive (autoAb(+)) offspring and siblings of patients with type 1 diabetes (T1D). The design is a registry-based study. Functional tests were performed in a hospital setting. Persistently autoAb(+) first-degree relatives of patients with T1D (n = 81; age 5-39 years). We assessed 3-year predictive ability of OGTT- and clamp-derived markers using receiver operating characteristics (ROC) and Cox regression analysis. Area under the curve of clamp-derived first-phase C-peptide release (AUC(5-10 min); min 5-10) was determined in all relatives and second-phase release (AUC(120-150 min); min 120-150) in those aged 12-39 years (n = 62). Overall, the predictive ability of AUC(5-10 min) was better than that of peak C-peptide, the best predictor among OGTT-derived parameters (ROC-AUC [95%CI]: 0.89 [0.80-0.98] vs 0.81 [0.70-0.93]). Fasting blood glucose (FBG) and AUC(5-10 min) provided the best combination of markers for prediction of diabetes within 3 years; (ROC-AUC [95%CI]: 0.92 [0.84-1.00]). In multivariate Cox regression analysis, AUC(5-10 min)) (P = .001) was the strongest independent predictor and interacted significantly with all tested OGTT-derived parameters. AUC(5-10 min) below percentile 10 of controls was associated with 50-70% progression to T1D regardless of age. Similar results were obtained for AUC(120-150 min). Clamp-derived first-phase C-peptide release can be used as an efficient and simple screening strategy in persistently autoAb(+) offspring and siblings of T1D patients to predict impending diabetes.

Identification of benign and malignant thyroid nodules by in vivo iodine concentration measurement using single-source dual energy CT

PubMed Central

Gao, Shun-Yu; Zhang, Xiao-Yan; Wei, Wei; Li, Xiao-Ting; Li, Yan-Ling; Xu, Min; Sun, Ying-Shi; Zhang, Xiao-Peng

2016-01-01

Abstract This study proposed to determine whether in vivo iodine concentration measurement by single-source dual energy (SSDE) CT can improve differentiation between benign and malignant thyroid nodules. In total, 53 patients presenting with thyroid nodules underwent SSDE CT scanning. Iodine concentrations were measured for each nodule and normal thyroid tissue using the GSI-viewer image analysis software. A total of 26 thyroid nodules were malignant in 26 patients and confirmed by surgery; 33 nodules from 27 patients were benign, with 10 confirmed by surgery and others after follow-up. Iodine concentrations with plain CT were significantly lower in malignant than benign nodules (0.47 ± 0.20 vs 1.17 ± 0.38 mg/mL, P = 0.00). Receiver operating characteristic (ROC) curve showed an area under the curve (AUC) of 0.93; with a cutoff of 0.67, iodine concentration showed 92.3% sensitivity and 88.5% specificity in diagnosing malignancy. Iodine concentration obtained by enhanced and plain CT were significantly higher in malignant than benign nodules (9.05 ± 3.35 vs 3.46 ± 2.24 mg/mL, P = 0.00). ROC curve analysis showed an AUC of 0.93; with a cutoff value of 3.37, iodine concentration displayed 78% sensitivity, 95% specificity in diagnosing malignancy. Combining unenhanced with enhanced iodine concentrations, the diagnostic equation was: Y = –8.641 × unenhanced iodine concentration + 0.663 × iodine concentration. ROC curve showed an AUC of 0.98 (95% CI, 0.94, 1.00). With Y ≥ –2 considered malignancy, diagnostic sensitivity and specificity were 96%, 96.3%, respectively. This study concluded that SSDE CT can detect the differences in iodine uptake and blood supply between benign and malignant thyroid lesions. PMID:27684811

Survey on Tuberculosis Patients in Rural Areas in China: Tracing the Role of Stigma in Psychological Distress.

PubMed

Xu, Minlan; Markström, Urban; Lyu, Juncheng; Xu, Lingzhong

2017-10-04

Depressed patients had risks of non-adherence to medication, which brought a big challenge for the control of tuberculosis (TB). The stigma associated with TB may be the reason for distress. This study aimed to assess the psychological distress among TB patients living in rural areas in China and to further explore the relation of experienced stigma to distress. This study was a cross-sectional study with multi-stage randomized sampling for recruiting TB patients. Data was collected by the use of interviewer-led questionnaires. A total of 342 eligible and accessible TB patients being treated at home were included in the survey. Psychological distress was measured using the Kessler Psychological Distress Scale (K10). Experienced stigma was measured using a developed nine-item stigma questionnaire. Univariate analysis and multiple logistic regression were used to analyze the variables related to distress, respectively. Odds ratios (ORs) and 95% confidence intervals (CIs) were used to present the strength of the associations. Finally, the prediction of logistic model was assessed in form of the Receiver Operating Characteristic (ROC) curve and the area under the ROC curve (AUC). According to the referred cut-off point from K10, this study revealed that 65.2% (223/342) of the participants were categorized as having psychological distress. Both the stigma questionnaire and the K10 were proven to be reliable and valid in measurement. Further analysis found that experienced stigma and illness severity were significant variables to psychological distress in the model of logistic regression. The model was assessed well in predicting distress by use of experienced stigma and illness severity in form of ROC and AUC. Rural TB patients had a high prevalence of psychological distress. Experience of stigma played a significant role in psychological distress. To move the barrier of stigma from the surroundings could be a good strategy in reducing distress for the patients and TB controlling for public health management.

Metabolic tumour volume and total lesion glycolysis, measured using preoperative 18F-FDG PET/CT, predict the recurrence of endometrial cancer.

PubMed

Shim, S-H; Kim, D-Y; Lee, D-Y; Lee, S-W; Park, J-Y; Lee, J J; Kim, J-H; Kim, Y-M; Kim, Y-T; Nam, J-H

2014-08-01

To investigate the prognostic value of metabolic tumour volume (MTV) and total lesion glycolysis (TLG), measured by preoperative positron emission tomography and computerised tomography (PET/CT), in women with endometrial cancer. Retrospective cohort study. A tertiary referral centre. Women with endometrial cancer who underwent preoperative (18)F-FDG PET/CT in the period 2004-2009. Clinicopathological data for 84 women with endometrial cancer were reviewed from medical records. Cox proportional hazards modelling identified recurrence predictors. The receiver operating characteristic (ROC) curve was used to determine the cut-off value for predicting recurrence. Disease-free survival (DFS). The number of patients with International Federation of Gynecology and Obstetrics (FIGO) stages were: I (58); II (11); III (13); and IV (2). The median DFS was 48 (1-85) months. By univariate analysis, DFS was significantly associated with FIGO stage, histology, peritoneal cytology, myometrial invasion, nodal metastasis, serum CA-125, MTV, and TLG. Using multivariate analysis, the MTV (P = 0.010; hazard ratio, HR = 1.010; 95% confidence interval, 95% CI = 1.002-1.018) and TLG (P = 0.024; HR = 1.001; 95% CI = 1.000-1.002) were associated with DFS. The area under the ROC curve was 0.679 (95% CI = 0.505-0.836) after discriminating for recurrence using an MTV cut-off value of 17.15 ml. Regarding TLG, the cut-off value was 56.43 g and the area under the ROC plot was 0.661 (95% CI = 0.501-0.827). Kaplan-Meier survival graphs demonstrated a significant difference in DFS between groups categorised using the cut-off values for MTV and TLG (P < 0.022 for MTV and P < 0.047 for TLG, by log-rank test). Preoperative MTV and TLG could be independent prognostic factors predicting the recurrence of endometrial cancer. © 2014 Royal College of Obstetricians and Gynaecologists.

SU-F-R-14: PET Based Radiomics to Predict Outcomes in Patients with Hodgkin Lymphoma

DOE Office of Scientific and Technical Information (OSTI.GOV)

Lee, J; Aristophanous, M; Akhtari, M

Purpose: To identify PET-based radiomics features associated with high refractory/relapsed disease risk for Hodgkin lymphoma patients. Methods: A total of 251 Hodgkin lymphoma patients including 19 primary refractory and 9 relapsed patients were investigated. All patients underwent an initial pre-treatment diagnostic FDG PET/CT scan. All cancerous lymph node regions (ROIs) were delineated by an experienced physician based on thresholding each volume of disease in the anatomical regions to SUV>2.5. We extracted 122 image features and evaluated the effect of ROI selection (the largest ROI, the ROI with highest mean SUV, merged ROI, and a single anatomic region [e.g. mediastinum]) onmore » classification accuracy. Random forest was used as a classifier and ROC analysis was used to assess the relationship between selected features and patient’s outcome status. Results: Each patient had between 1 and 9 separate ROIs, with much intra-patient variability in PET features. The best model, which used features from a single anatomic region (the mediastinal ROI, only volumes>5cc: 169 patients with 12 primary refractory) had a classification accuracy of 80.5% for primary refractory disease. The top five features, based on Gini index, consist of shape features (max 3D-diameter and volume) and texture features (correlation and information measure of correlation1&2). In the ROC analysis, sensitivity and specificity of the best model were 0.92 and 0.80, respectively. The area under the ROC (AUC) and the accuracy were 0.86 and 0.86, respectively. The classification accuracy was less than 60% for other ROI models or when ROIs less than 5cc were included. Conclusion: This study showed that PET-based radiomics features from the mediastinal lymph region are associated with primary refractory disease and therefore may play an important role in predicting outcomes in Hodgkin lymphoma patients. These features could be additive beyond baseline tumor and clinical characteristics, and may warrant more aggressive treatment.« less

Circulating basal anti-Müllerian hormone levels as predictor of ovarian response in women undergoing ovarian stimulation for in vitro fertilization.

PubMed

Nardo, Luciano G; Gelbaya, Tarek A; Wilkinson, Hannah; Roberts, Stephen A; Yates, Allen; Pemberton, Phil; Laing, Ian

2009-11-01

To evaluate the clinical value of basal anti-Müllerian hormone (AMH) measurements compared with other available determinants, apart from chronologic age, in the prediction of ovarian response to gonadotrophin stimulation. Prospective cohort study. Tertiary referral center for reproductive medicine and an IVF unit. Women undergoing their first cycle of controlled ovarian hyperstimulation (COH) for in vitro fertilization (IVF). Basal levels of FSH and AMH as well as antral follicle count (AFC) were measured in 165 subjects. All patients were followed prospectively and their cycle outcomes recorded. Predictive value of FSH, AMH, and AFC for extremes of ovarian response to stimulation. Out of the 165 women, 134 were defined as normal responders, 15 as poor responders, and 16 as high responders. Subjects in the poor response group were significantly older then those in the other two groups. Anti-Müllerian hormone levels and AFC were markedly raised in the high responders and decreased in the poor responders. Compared with FSH and AFC, AMH performed better in the prediction of excessive response to ovarian stimulation-AMH area under receiver operating characteristic curve (ROC(AUC)) 0.81, FSH ROC(AUC) 0.66, AFC ROC(AUC) 0.69. For poor response, AMH (ROC(AUC) 0.88) was a significantly better predictor than FSH (ROC(AUC) 0.63) but not AFC (ROC(AUC) 0.81). AMH prediction of ovarian response was independent of age and PCOS. Anti-Müllerian hormone cutoffs of >3.75 ng/mL and <1.0 ng/mL would have modest sensitivity and specificity in predicting the extremes of response. Circulating AMH has the ability to predict excessive and poor response to stimulation with exogenous gonadotrophins. Overall, this biomarker is superior to basal FSH and AFC, and has the potential to be incorporated in to work-up protocols to predict patient's ovarian response to treatment and to individualize strategies aiming at reducing the cancellation rate and the iatrogenic complications of COH.

Using ROC Curves to Choose Minimally Important Change Thresholds when Sensitivity and Specificity Are Valued Equally: The Forgotten Lesson of Pythagoras. Theoretical Considerations and an Example Application of Change in Health Status

PubMed Central

Froud, Robert; Abel, Gary

2014-01-01

Background Receiver Operator Characteristic (ROC) curves are being used to identify Minimally Important Change (MIC) thresholds on scales that measure a change in health status. In quasi-continuous patient reported outcome measures, such as those that measure changes in chronic diseases with variable clinical trajectories, sensitivity and specificity are often valued equally. Notwithstanding methodologists agreeing that these should be valued equally, different approaches have been taken to estimating MIC thresholds using ROC curves. Aims and objectives We aimed to compare the different approaches used with a new approach, exploring the extent to which the methods choose different thresholds, and considering the effect of differences on conclusions in responder analyses. Methods Using graphical methods, hypothetical data, and data from a large randomised controlled trial of manual therapy for low back pain, we compared two existing approaches with a new approach that is based on the addition of the sums of squares of 1-sensitivity and 1-specificity. Results There can be divergence in the thresholds chosen by different estimators. The cut-point selected by different estimators is dependent on the relationship between the cut-points in ROC space and the different contours described by the estimators. In particular, asymmetry and the number of possible cut-points affects threshold selection. Conclusion Choice of MIC estimator is important. Different methods for choosing cut-points can lead to materially different MIC thresholds and thus affect results of responder analyses and trial conclusions. An estimator based on the smallest sum of squares of 1-sensitivity and 1-specificity is preferable when sensitivity and specificity are valued equally. Unlike other methods currently in use, the cut-point chosen by the sum of squares method always and efficiently chooses the cut-point closest to the top-left corner of ROC space, regardless of the shape of the ROC curve. PMID:25474472

ROC curves predicted by a model of visual search.

PubMed

Chakraborty, D P

2006-07-21

In imaging tasks where the observer is uncertain whether lesions are present, and where they could be present, the image is searched for lesions. In the free-response paradigm, which closely reflects this task, the observer provides data in the form of a variable number of mark-rating pairs per image. In a companion paper a statistical model of visual search has been proposed that has parameters characterizing the perceived lesion signal-to-noise ratio, the ability of the observer to avoid marking non-lesion locations, and the ability of the observer to find lesions. The aim of this work is to relate the search model parameters to receiver operating characteristic (ROC) curves that would result if the observer reported the rating of the most suspicious finding on an image as the overall rating. Also presented are the probability density functions (pdfs) of the underlying latent decision variables corresponding to the highest rating for normal and abnormal images. The search-model-predicted ROC curves are 'proper' in the sense of never crossing the chance diagonal and the slope is monotonically changing. They also have the interesting property of not allowing the observer to move the operating point continuously from the origin to (1, 1). For certain choices of parameters the operating points are predicted to be clustered near the initial steep region of the curve, as has been observed by other investigators. The pdfs are non-Gaussians, markedly so for the abnormal images and for certain choices of parameter values, and provide an explanation for the well-known observation that experimental ROC data generally imply a wider pdf for abnormal images than for normal images. Some features of search-model-predicted ROC curves and pdfs resemble those predicted by the contaminated binormal model, but there are significant differences. The search model appears to provide physical explanations for several aspects of experimental ROC curves.

Study of Aided Diagnosis of Hepatic Carcinoma Based on Artificial Neural Network Combined with Tumor Marker Group

NASA Astrophysics Data System (ADS)

Tan, Shanjuan; Feng, Feifei; Wu, Yongjun; Wu, Yiming

To develop a computer-aided diagnostic scheme by using an artificial neural network (ANN) combined with tumor markers for diagnosis of hepatic carcinoma (HCC) as a clinical assistant method. 140 serum samples (50 malignant, 40 benign and 50 normal) were analyzed for α-fetoprotein (AFP), carbohydrate antigen 125 (CA125), carcinoembryonic antigen (CEA), sialic acid (SA) and calcium (Ca). The five tumor marker values were then used as ANN inputs data. The result of ANN was compared with that of discriminant analysis by receiver operating characteristic (ROC) curve (AUC) analysis. The diagnostic accuracy of ANN and discriminant analysis among all samples of the test group was 95.5% and 79.3%, respectively. Analysis of multiple tumor markers based on ANN may be a better choice than the traditional statistical methods for differentiating HCC from benign or normal.

From Humans to Rats and Back Again: Bridging the Divide between Human and Animal Studies of Recognition Memory with Receiver Operating Characteristics

ERIC Educational Resources Information Center

Koen, Joshua D.; Yonelinas, Andrew P.

2011-01-01

Receiver operating characteristics (ROCs) have been used extensively to study the processes underlying human recognition memory, and this method has recently been applied in studies of rats. However, the extent to which the results from human and animal studies converge is neither entirely clear, nor is it known how the different methods used to…

Urine colorimetry for therapeutic drug monitoring of pyrazinamide during tuberculosis treatment.

PubMed

Zentner, Isaac; Modongo, Chawangwa; Zetola, Nicola M; Pasipanodya, Jotam G; Srivastava, Shashikant; Heysell, Scott K; Mpagama, Stellah; Schlect, Hans P; Gumbo, Tawanda; Bisson, Gregory P; Vinnard, Christopher

2018-03-01

Pyrazinamide is a key drug in the first-line treatment regimen for tuberculosis, with a potent sterilizing effect. Although low pyrazinamide peak serum concentrations (C max ) are associated with poor treatment outcomes, many resource-constrained settings do not have sufficient laboratory capacity to support therapeutic drug monitoring (TDM). The objective of this study was to determine whether a colorimetric test of urine can identify tuberculosis patients with adequate pyrazinamide exposures, as defined by serum C max above a target threshold. In the derivation study of healthy volunteers, three dose sizes of pyrazinamide were evaluated, and intensive pharmacokinetic blood sampling was performed over an 8-h period, with a timed urine void at 4h post-dosing. Pyrazinamide in urine was isolated by spin column centrifugation with an exchange resin, followed by colorimetric analysis; the absorbance peak at 495nm was measured. The urine assay was then evaluated in a study of 39 HIV/tuberculosis patients in Botswana enrolled in an intensive pharmacokinetic study. Receiver operating characteristics (ROC) curves were used to measure diagnostic accuracy. The guideline-recommended pyrazinamide serum C max target of 35mg/l was evaluated in the primary analysis; this target was found to be predictive of favorable outcomes in a clinical study. Following this, a higher serum C max target of 58mg/l was evaluated in the secondary analysis. At the optimal cut-off identified in the derivation sample, the urine colorimetric assay was 97% sensitive and 50% specific to identify 35 of 39 HIV/tuberculosis patients with pharmacokinetic target attainment, with an area under the ROC curve of 0.81 (95% confidence interval 0.60-0.97). Diagnostic accuracy was lower at the 58mg/l serum C max target, with an area under the ROC curve of 0.68 (95% confidence interval 0.48-0.84). Men were less likely than women to attain either serum pharmacokinetic target. The urine colorimetric assay was sensitive but not specific for the detection of adequate pyrazinamide pharmacokinetic exposures among HIV/tuberculosis patients in a high-burden setting. Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.

Immunohistochemistry of cytokeratins 7, 8, 17, 18, and 19, and GLUT-1 aids differentiation of desmoplastic malignant mesothelioma from fibrous pleuritis.

PubMed

Horiuchi, Toshikatsu; Ogata, Sho; Tominaga, Susumu; Hiroi, Sadayuki; Kawahara, Kunimitsu; Hebisawa, Akira; Irei, Isao; Ito, Ichiro; Kameya, Toru; Tsujimura, Tohru; Nakano, Takashi; Nakanishi, Kuniaki; Kawai, Toshiaki

2013-05-01

It is difficult to distinguish desmoplastic malignant mesothelioma (DMM) from fibrous pleuritis (FP). We investigated the utility of immunohistochemistry as a way of differentiating between DMM and FP. We examined 11 DMMs and 46 FPs with the aid of antibodies against 18 cytokeratin (CK) subtypes, calponin, caldesmon, desmin, and GLUT-1. The best sensitivity and specificity cut-off values in the receiver operating characteristic curves (ROC) for CKs 7, 8, 17, 18, and 19, and GLUT-1 were each above 60%. When cases with either DMM or FP were partitioned by the staining score associated with the best sensitivity and specificity cut-off values in ROC, the incidence of a positive expression for CKs 7, 8, 17, 18, and 19, and GLUT-1 was significantly higher in DMM than in FP. In conclusion, immunohistochemistry for CKs 7, 8, 17, 18, and 19, and GLUT-1 may be useful, alongside histological characteristics, for separating DMM from FP.

Whole-lesion apparent diffusion coefficient histogram analysis: significance in T and N staging of gastric cancers.

PubMed

Liu, Song; Zhang, Yujuan; Chen, Ling; Guan, Wenxian; Guan, Yue; Ge, Yun; He, Jian; Zhou, Zhengyang

2017-10-02

Whole-lesion apparent diffusion coefficient (ADC) histogram analysis has been introduced and proved effective in assessment of multiple tumors. However, the application of whole-volume ADC histogram analysis in gastrointestinal tumors has just started and never been reported in T and N staging of gastric cancers. Eighty patients with pathologically confirmed gastric carcinomas underwent diffusion weighted (DW) magnetic resonance imaging before surgery prospectively. Whole-lesion ADC histogram analysis was performed by two radiologists independently. The differences of ADC histogram parameters among different T and N stages were compared with independent-samples Kruskal-Wallis test. Receiver operating characteristic (ROC) analysis was performed to evaluate the performance of ADC histogram parameters in differentiating particular T or N stages of gastric cancers. There were significant differences of all the ADC histogram parameters for gastric cancers at different T (except ADC min and ADC max ) and N (except ADC max ) stages. Most ADC histogram parameters differed significantly between T1 vs T3, T1 vs T4, T2 vs T4, N0 vs N1, N0 vs N3, and some parameters (ADC 5% , ADC 10% , ADC min ) differed significantly between N0 vs N2, N2 vs N3 (all P < 0.05). Most parameters except ADC max performed well in differentiating different T and N stages of gastric cancers. Especially for identifying patients with and without lymph node metastasis, the ADC 10% yielded the largest area under the ROC curve of 0.794 (95% confidence interval, 0.677-0.911). All the parameters except ADC max showed excellent inter-observer agreement with intra-class correlation coefficients higher than 0.800. Whole-volume ADC histogram parameters held great potential in differentiating different T and N stages of gastric cancers preoperatively.

Radiological indeterminate vestibular schwannoma and meningioma in cerebellopontine angle area: differentiating using whole-tumor histogram analysis of apparent diffusion coefficient.

PubMed

Xu, Xiao-Quan; Li, Yan; Hong, Xun-Ning; Wu, Fei-Yun; Shi, Hai-Bin

2017-02-01

To assess the role of whole-tumor histogram analysis of apparent diffusion coefficient (ADC) maps in differentiating radiological indeterminate vestibular schwannoma (VS) from meningioma in cerebellopontine angle (CPA). Diffusion-weighted (DW) images (b = 0 and 1000 s/mm 2 ) of pathologically confirmed and radiological indeterminate CPA meningioma (CPAM) (n = 27) and VS (n = 12) were retrospectively collected and processed with mono-exponential model. Whole-tumor regions of interest were drawn on all slices of the ADC maps to obtain histogram parameters, including the mean ADC (ADC mean ), median ADC (ADC median ), 10th/25th/75th/90th percentile ADC (ADC 10 , ADC 25 , ADC 75 and ADC 90 ), skewness and kurtosis. The differences of ADC histogram parameters between CPAM and VS were compared using unpaired t-test. Multiple receiver operating characteristic (ROC) curves analysis was used to determine and compare the diagnostic value of each significant parameter. Significant differences were found on the ADC mean , ADC median , ADC 10 , ADC 25 , ADC 75 and ADC 90 between CPAM and VS (all p values < 0.001), while no significant difference was found on kurtosis (p = 0.562) and skewness (p = 0.047). ROC curves analysis revealed, a cut-off value of 1.126 × 10 -3 mm 2 /s for the ADC 90 value generated highest area under curves (AUC) for differentiating CPAM from VS (AUC, 0.975; sensitivity, 100%; specificity, 88.9%). Histogram analysis of ADC maps based on whole tumor can be a useful tool for differentiating radiological indeterminate CPAM from VS. The ADC 90 value was the most promising parameter for differentiating these two entities.

Multiresolution Local Binary Pattern texture analysis for false positive reduction in computerized detection of breast masses on mammograms

NASA Astrophysics Data System (ADS)

Choi, Jae Young; Kim, Dae Hoe; Choi, Seon Hyeong; Ro, Yong Man

2012-03-01

We investigated the feasibility of using multiresolution Local Binary Pattern (LBP) texture analysis to reduce falsepositive (FP) detection in a computerized mass detection framework. A new and novel approach for extracting LBP features is devised to differentiate masses and normal breast tissue on mammograms. In particular, to characterize the LBP texture patterns of the boundaries of masses, as well as to preserve the spatial structure pattern of the masses, two individual LBP texture patterns are then extracted from the core region and the ribbon region of pixels of the respective ROI regions, respectively. These two texture patterns are combined to produce the so-called multiresolution LBP feature of a given ROI. The proposed LBP texture analysis of the information in mass core region and its margin has clearly proven to be significant and is not sensitive to the precise location of the boundaries of masses. In this study, 89 mammograms were collected from the public MAIS database (DB). To perform a more realistic assessment of FP reduction process, the LBP texture analysis was applied directly to a total of 1,693 regions of interest (ROIs) automatically segmented by computer algorithm. Support Vector Machine (SVM) was applied for the classification of mass ROIs from ROIs containing normal tissue. Receiver Operating Characteristic (ROC) analysis was conducted to evaluate the classification accuracy and its improvement using multiresolution LBP features. With multiresolution LBP features, the classifier achieved an average area under the ROC curve, , z A of 0.956 during testing. In addition, the proposed LBP features outperform other state-of-the-arts features designed for false positive reduction.

Wavelets analysis for differentiating solid, non-macroscopic fat containing, enhancing renal masses: a pilot study

NASA Astrophysics Data System (ADS)

Varghese, Bino; Hwang, Darryl; Mohamed, Passant; Cen, Steven; Deng, Christopher; Chang, Michael; Duddalwar, Vinay

2017-11-01

Purpose: To evaluate potential use of wavelets analysis in discriminating benign and malignant renal masses (RM) Materials and Methods: Regions of interest of the whole lesion were manually segmented and co-registered from multiphase CT acquisitions of 144 patients (98 malignant RM: renal cell carcinoma (RCC) and 46 benign RM: oncocytoma, lipid-poor angiomyolipoma). Here, the Haar wavelet was used to analyze the grayscale images of the largest segmented tumor in the axial direction. Six metrics (energy, entropy, homogeneity, contrast, standard deviation (SD) and variance) derived from 3-levels of image decomposition in 3 directions (horizontal, vertical and diagonal) respectively, were used to quantify tumor texture. Independent t-test or Wilcoxon rank sum test depending on data normality were used as exploratory univariate analysis. Stepwise logistic regression and receiver operator characteristics (ROC) curve analysis were used to select predictors and assess prediction accuracy, respectively. Results: Consistently, 5 out of 6 wavelet-based texture measures (except homogeneity) were higher for malignant tumors compared to benign, when accounting for individual texture direction. Homogeneity was consistently lower in malignant than benign tumors irrespective of direction. SD and variance measured in the diagonal direction on the corticomedullary phase showed significant (p<0.05) difference between benign versus malignant tumors. The multivariate model with variance (3 directions) and SD (vertical direction) extracted from the excretory and pre-contrast phase, respectively showed an area under the ROC curve (AUC) of 0.78 (p < 0.05) in discriminating malignant from benign. Conclusion: Wavelet analysis is a valuable texture evaluation tool to add to a radiomics platforms geared at reliably characterizing and stratifying renal masses.

Evaluation of glioblastomas and lymphomas with whole-brain CT perfusion: Comparison between a delay-invariant singular-value decomposition algorithm and a Patlak plot.

PubMed

Hiwatashi, Akio; Togao, Osamu; Yamashita, Koji; Kikuchi, Kazufumi; Yoshimoto, Koji; Mizoguchi, Masahiro; Suzuki, Satoshi O; Yoshiura, Takashi; Honda, Hiroshi

2016-07-01

Correction of contrast leakage is recommended when enhancing lesions during perfusion analysis. The purpose of this study was to assess the diagnostic performance of computed tomography perfusion (CTP) with a delay-invariant singular-value decomposition algorithm (SVD+) and a Patlak plot in differentiating glioblastomas from lymphomas. This prospective study included 17 adult patients (12 men and 5 women) with pathologically proven glioblastomas (n=10) and lymphomas (n=7). CTP data were analyzed using SVD+ and a Patlak plot. The relative tumor blood volume and flow compared to contralateral normal-appearing gray matter (rCBV and rCBF derived from SVD+, and rBV and rFlow derived from the Patlak plot) were used to differentiate between glioblastomas and lymphomas. The Mann-Whitney U test and receiver operating characteristic (ROC) analyses were used for statistical analysis. Glioblastomas showed significantly higher rFlow (3.05±0.49, mean±standard deviation) than lymphomas (1.56±0.53; P<0.05). There were no statistically significant differences between glioblastomas and lymphomas in rBV (2.52±1.57 vs. 1.03±0.51; P>0.05), rCBF (1.38±0.41 vs. 1.29±0.47; P>0.05), or rCBV (1.78±0.47 vs. 1.87±0.66; P>0.05). ROC analysis showed the best diagnostic performance with rFlow (Az=0.871), followed by rBV (Az=0.771), rCBF (Az=0.614), and rCBV (Az=0.529). CTP analysis with a Patlak plot was helpful in differentiating between glioblastomas and lymphomas, but CTP analysis with SVD+ was not. Copyright © 2016 Elsevier Masson SAS. All rights reserved.

The value of "liver windows" settings in the detection of small renal cell carcinomas on unenhanced computed tomography.

PubMed

Sahi, Kamal; Jackson, Stuart; Wiebe, Edward; Armstrong, Gavin; Winters, Sean; Moore, Ronald; Low, Gavin

2014-02-01

To assess if "liver window" settings improve the conspicuity of small renal cell carcinomas (RCC). Patients were analysed from our institution's pathology-confirmed RCC database that included the following: (1) stage T1a RCCs, (2) an unenhanced computed tomography (CT) abdomen performed ≤ 6 months before histologic diagnosis, and (3) age ≥ 17 years. Patients with multiple tumours, prior nephrectomy, von Hippel-Lindau disease, and polycystic kidney disease were excluded. The unenhanced CT was analysed, and the tumour locations were confirmed by using corresponding contrast-enhanced CT or magnetic resonance imaging studies. Representative single-slice axial, coronal, and sagittal unenhanced CT images were acquired in "soft tissue windows" (width, 400 Hounsfield unit (HU); level, 40 HU) and liver windows (width, 150 HU; level, 88 HU). In addition, single-slice axial, coronal, and sagittal unenhanced CT images of nontumourous renal tissue (obtained from the same cases) were acquired in soft tissue windows and liver windows. These data sets were randomized, unpaired, and were presented independently to 3 blinded radiologists for analysis. The presence or absence of suspicious findings for tumour was scored on a 5-point confidence scale. Eighty-three of 415 patients met the study criteria. Receiver operating characteristics (ROC) analysis, t test analysis, and kappa analysis were used. ROC analysis showed statistically superior diagnostic performance for liver windows compared with soft tissue windows (area under the curve of 0.923 vs 0.879; P = .0002). Kappa statistics showed "good" vs "moderate" agreement between readers for liver windows compared with soft tissue windows. Use of liver windows settings improves the detection of small RCCs on the unenhanced CT. Copyright © 2014 Canadian Association of Radiologists. Published by Elsevier Inc. All rights reserved.

Predicting Ovarian Activity in Women Affected by Early Breast Cancer: A Meta-Analysis-Based Nomogram.

PubMed

Barnabei, Agnese; Strigari, Lidia; Marchetti, Paolo; Sini, Valentina; De Vecchis, Liana; Corsello, Salvatore Maria; Torino, Francesco

2015-10-01

The assessment of ovarian reserve in premenopausal women requiring anticancer gonadotoxic therapy can help clinicians address some challenging issues, including the probability of future pregnancies after the end of treatment. Anti-Müllerian hormone (AMH) and age can reliably estimate ovarian reserve. A limited number of studies have evaluated AMH and age as predictors of residual ovarian reserve following cytotoxic chemotherapy in breast cancer patients. To conduct a meta-analysis of published data on this topic, we searched the medical literature using the key MeSH terms "amenorrhea/chemically induced," "ovarian reserve," "anti-Mullerian hormone/blood," and "breast neoplasms/drug therapy." Preferred Reporting Items for Systematic Reviews and Meta-Analyses statements guided the search strategy. U.K. National Health Service guidelines were used in abstracting data and assessing data quality and validity. Area under the receiver operating characteristic curve (ROC/AUC) analysis was used to evaluate the predictive utility of baseline AMH and age model. The meta-analysis of data pooled from the selected studies showed that both age and serum AMH are reliable predictors of post-treatment ovarian activity in breast cancer patients. Importantly, ROC/AUC analysis indicated AMH was a more reliable predictor of post-treatment ovarian activity in patients aged younger than 40 years (0.753; 95% confidence interval [CI]: 0.602-0.904) compared with those older than 40 years (0.678; 95% CI: 0.491-0.866). We generated a nomogram describing the correlations among age, pretreatment AMH serum levels, and ovarian activity at 1 year from the end of chemotherapy. After the ongoing validation process, the proposed nomogram may help clinicians discern premenopausal women requiring cytotoxic chemotherapy who should be considered high priority for fertility preservation counseling and procedures. ©AlphaMed Press.

Body Image Satisfaction as a Physical Activity Indicator in University Students.

PubMed

Ramos-Jiménez, Arnulfo; Hernández-Torres, Rosa P; Urquidez-Romero, René; Wall-Medrano, Abraham; Villalobos-Molina, Rafael

2017-09-01

We examined the association of body image satisfaction (BIS) with physical activity (PA) in university athletes and non-athletes from northern Mexico. In a non-probability cross-sectional study, 294 participants (51% male, 41% athletes; 18-35 years old) completed 2 self-administered questionnaires to evaluate BIS and PA. We categorized somatotypes (endomorphy-mesomorphy-ectomorphy) by international standardized anthropometry. Data analysis included the Mann-Whitney U test, χ2test, Kendall's Tau-b correlation, binary logistic regression analysis, and receiver operating characteristic (ROC) curves. Self-perceived sports abilities and desirable body shape predicted 30% of sports participation in students, whereas an endomorphic shape (<5.4 units) and being male predicted 15.4% of sports participation. BIS was a reliable indicator of sports participation among these university students.

Does consideration of either psychological or material disadvantage improve coronary risk prediction? Prospective observational study of Scottish men.

PubMed

Macleod, John; Metcalfe, Chris; Smith, George Davey; Hart, Carole

2007-09-01

To assess the value of psychosocial risk factors in discriminating between individuals at higher and lower risk of coronary heart disease, using risk prediction equations. Prospective observational study. Scotland. 5191 employed men aged 35 to 64 years and free of coronary heart disease at study enrollment Area under receiver operating characteristic (ROC) curves for risk prediction equations including different risk factors for coronary heart disease. During the first 10 years of follow up, 203 men died of coronary heart disease and a further 200 were admitted to hospital with this diagnosis. Area under the ROC curve for the standard Framingham coronary risk factors was 74.5%. Addition of "vital exhaustion" and psychological stress led to areas under the ROC curve of 74.5% and 74.6%, respectively. Addition of current social class and lifetime social class to the standard Framingham equation gave areas under the ROC curve of 74.6% and 74.9%, respectively. In no case was there strong evidence for improved discrimination of the model containing the novel risk factor over the standard model. Consideration of psychosocial risk factors, including those that are strong independent predictors of heart disease, does not substantially influence the ability of risk prediction tools to discriminate between individuals at higher and lower risk of coronary heart disease.

Assessing multiple-group diagnostic problems with multi-dimensional receiver operating characteristic surfaces: Application to proton MR Spectroscopy (MRS) in HIV-related neurological injury

PubMed Central

Yiannoutsos, Constantin T.; Nakas, Christos T.; Navia, Bradford A.

2013-01-01

We present the multi-dimensional Receiver Operating Characteristic (ROC) surface, a plot of the true classification rates of tests based on levels of biological markers, for multi-group discrimination, as an extension of the ROC curve, commonly used in two-group diagnostic testing. The volume under this surface (VUS) is a global accuracy measure of a test to classify subjects in multiple groups and useful to detect trends in marker measurements. We used three-dimensional ROC surfaces, and associated VUS, to discriminate between HIV-negative (NEG), HIV-positive neurologically asymptomatic (NAS) subjects and patients with AIDS demential complex (ADC), using brain metabolites measured by proton MRS. These were ratios of markers of inflammation, Choline (Cho) and myoinositol (MI), and brain injury, N-acetyl aspartate (NAA), divided by Creatine (Cr), measured in the basal ganglia and the frontal white matter. Statistically significant trends were observed in the three groups with respect to MI/Cr (VUS=0.43; 95% confidence interval (CI) 0.33-0.53), Cho/Cr (0.36; 0.27-0.45) in the basal ganglia and NAA/Cr in the frontal white matter (FWM) (0.29; 0.20-0.38), suggesting a continuum of injury during the neurologically asymptomatic stage of HIV infection, particularly with respect to brain inflammation. Adjusting for age increased the combined classification accuracy of age and NAA/Cr (p=0.053). Pairwise comparisons suggested that neuronal damage associated with NAA/Cr decreases was mainly observed in individuals with ADC, raising issues of synergism between HIV infection and age and possible acceleration of neurological deterioration in an aging HIV-positive population. The three-dimensional ROC surface and its associated VUS are useful for assessing marker accuracy, detecting data trends and offering insight in disease processes affecting multiple groups. PMID:18191586

Multi-probe-based resonance-frequency electrical impedance spectroscopy for detection of suspicious breast lesions: improving performance using partial ROC optimization

NASA Astrophysics Data System (ADS)

Lederman, Dror; Zheng, Bin; Wang, Xingwei; Wang, Xiao Hui; Gur, David

2011-03-01

We have developed a multi-probe resonance-frequency electrical impedance spectroscope (REIS) system to detect breast abnormalities. Based on assessing asymmetry in REIS signals acquired between left and right breasts, we developed several machine learning classifiers to classify younger women (i.e., under 50YO) into two groups of having high and low risk for developing breast cancer. In this study, we investigated a new method to optimize performance based on the area under a selected partial receiver operating characteristic (ROC) curve when optimizing an artificial neural network (ANN), and tested whether it could improve classification performance. From an ongoing prospective study, we selected a dataset of 174 cases for whom we have both REIS signals and diagnostic status verification. The dataset includes 66 "positive" cases recommended for biopsy due to detection of highly suspicious breast lesions and 108 "negative" cases determined by imaging based examinations. A set of REIS-based feature differences, extracted from the two breasts using a mirror-matched approach, was computed and constituted an initial feature pool. Using a leave-one-case-out cross-validation method, we applied a genetic algorithm (GA) to train the ANN with an optimal subset of features. Two optimization criteria were separately used in GA optimization, namely the area under the entire ROC curve (AUC) and the partial area under the ROC curve, up to a predetermined threshold (i.e., 90% specificity). The results showed that although the ANN optimized using the entire AUC yielded higher overall performance (AUC = 0.83 versus 0.76), the ANN optimized using the partial ROC area criterion achieved substantially higher operational performance (i.e., increasing sensitivity level from 28% to 48% at 95% specificity and/ or from 48% to 58% at 90% specificity).

[Identification of green tea brand based on hyperspectra imaging technology].

PubMed

Zhang, Hai-Liang; Liu, Xiao-Li; Zhu, Feng-Le; He, Yong

2014-05-01

Hyperspectral imaging technology was developed to identify different brand famous green tea based on PCA information and image information fusion. First 512 spectral images of six brands of famous green tea in the 380 approximately 1 023 nm wavelength range were collected and principal component analysis (PCA) was performed with the goal of selecting two characteristic bands (545 and 611 nm) that could potentially be used for classification system. Then, 12 gray level co-occurrence matrix (GLCM) features (i. e., mean, covariance, homogeneity, energy, contrast, correlation, entropy, inverse gap, contrast, difference from the second-order and autocorrelation) based on the statistical moment were extracted from each characteristic band image. Finally, integration of the 12 texture features and three PCA spectral characteristics for each green tea sample were extracted as the input of LS-SVM. Experimental results showed that discriminating rate was 100% in the prediction set. The receiver operating characteristic curve (ROC) assessment methods were used to evaluate the LS-SVM classification algorithm. Overall results sufficiently demonstrate that hyperspectral imaging technology can be used to perform classification of green tea.

Filling in the blanks. An estimation of illicit cannabis growers' profits in Belgium.

PubMed

Vanhove, Wouter; Surmont, Tim; Van Damme, Patrick; De Ruyver, Brice

2014-05-01

As a result of increased pressure on cannabis cultivation in The Netherlands, the number of confiscated indoor cannabis plantations in Belgium is rising. Although increases are reported for all plantations sizes, half of the seized plantations contain less than 50 plants. In this study, factors and variables that influence costs and benefits of indoor cannabis cultivation are investigated as well as how these costs and benefits vary between different cannabis grower types. Real-situation data of four growers were used to perform financial analyses. Costs included fixed and variable material costs, as well as opportunity costs. Gross revenue per grow cycle was calculated based on most recent forensic findings for illicit Belgian cannabis plantations and was adjusted for the risk of getting caught. Finally, gross revenues and return on costs (ROC) were calculated over 1 year (4 cycles). Financial analysis shows that in all cases gross revenues as well as ROC are considerable, even after a single growth cycle. Highest profitability was found for large-scale (600 plants, ROC=6.8) and mid-scale plantations (150 plants, ROC=6.0). However, industrial plantations (23,000 plants, ROC=1.4) and micro-scale plantations (5 plants, ROC=2.8) are also highly remunerative. Shift of police focus away from micro-scale growers, least likely to be involved in criminal gangs, to large-scale and industrial scale plantations would influence costs as a result of changing risks of getting caught. However, sensitivity analysis shows that this does not significantly influence the conclusions on profitability of different types of indoor cannabis growers. Seizure and confiscation of profits are important elements in the integral and integrated policy approach required for tackling illicit indoor cannabis plantations. The large return of costs evidenced in the present study, underpin the policy relevance of confiscating those illicit profits as part of enforcement. Copyright © 2014 Elsevier B.V. All rights reserved.

Target Detection and Identification Using Canonical Correlations Analysis and Subspace Partitioning

DTIC Science & Technology

2008-04-01

Fig. 2. ROCs for DCC, DCC-P, NNLS, and NNLSP (Present chemical=t1, background= t56 , SNR= 5 dB) alarm, or 1−specificity, and PD is the probability of...discrimination values are given in each ROC plot. In Fig. 2, we use t56 as the background, and t1 as the target chemical. The SNR is 5 dB. For each

Decision curve analysis revisited: overall net benefit, relationships to ROC curve analysis, and application to case-control studies.

PubMed

Rousson, Valentin; Zumbrunn, Thomas

2011-06-22

Decision curve analysis has been introduced as a method to evaluate prediction models in terms of their clinical consequences if used for a binary classification of subjects into a group who should and into a group who should not be treated. The key concept for this type of evaluation is the "net benefit", a concept borrowed from utility theory. We recall the foundations of decision curve analysis and discuss some new aspects. First, we stress the formal distinction between the net benefit for the treated and for the untreated and define the concept of the "overall net benefit". Next, we revisit the important distinction between the concept of accuracy, as typically assessed using the Youden index and a receiver operating characteristic (ROC) analysis, and the concept of utility of a prediction model, as assessed using decision curve analysis. Finally, we provide an explicit implementation of decision curve analysis to be applied in the context of case-control studies. We show that the overall net benefit, which combines the net benefit for the treated and the untreated, is a natural alternative to the benefit achieved by a model, being invariant with respect to the coding of the outcome, and conveying a more comprehensive picture of the situation. Further, within the framework of decision curve analysis, we illustrate the important difference between the accuracy and the utility of a model, demonstrating how poor an accurate model may be in terms of its net benefit. Eventually, we expose that the application of decision curve analysis to case-control studies, where an accurate estimate of the true prevalence of a disease cannot be obtained from the data, is achieved with a few modifications to the original calculation procedure. We present several interrelated extensions to decision curve analysis that will both facilitate its interpretation and broaden its potential area of application.

Decision curve analysis revisited: overall net benefit, relationships to ROC curve analysis, and application to case-control studies

PubMed Central

2011-01-01

Background Decision curve analysis has been introduced as a method to evaluate prediction models in terms of their clinical consequences if used for a binary classification of subjects into a group who should and into a group who should not be treated. The key concept for this type of evaluation is the "net benefit", a concept borrowed from utility theory. Methods We recall the foundations of decision curve analysis and discuss some new aspects. First, we stress the formal distinction between the net benefit for the treated and for the untreated and define the concept of the "overall net benefit". Next, we revisit the important distinction between the concept of accuracy, as typically assessed using the Youden index and a receiver operating characteristic (ROC) analysis, and the concept of utility of a prediction model, as assessed using decision curve analysis. Finally, we provide an explicit implementation of decision curve analysis to be applied in the context of case-control studies. Results We show that the overall net benefit, which combines the net benefit for the treated and the untreated, is a natural alternative to the benefit achieved by a model, being invariant with respect to the coding of the outcome, and conveying a more comprehensive picture of the situation. Further, within the framework of decision curve analysis, we illustrate the important difference between the accuracy and the utility of a model, demonstrating how poor an accurate model may be in terms of its net benefit. Eventually, we expose that the application of decision curve analysis to case-control studies, where an accurate estimate of the true prevalence of a disease cannot be obtained from the data, is achieved with a few modifications to the original calculation procedure. Conclusions We present several interrelated extensions to decision curve analysis that will both facilitate its interpretation and broaden its potential area of application. PMID:21696604

Incidental Context Information Increases Recollection

ERIC Educational Resources Information Center

Ameen-Ali, Kamar E.; Norman, Liam J.; Eacott, Madeline J.; Easton, Alexander

2017-01-01

The current study describes a receiver-operating characteristic (ROC) task for human participants based on the spontaneous recognition memory paradigms typically used with rodents. Recollection was significantly higher when an object was in the same location and background as at encoding, a combination used to assess episodic-like memory in…

Strain ratio ultrasound elastography increases the accuracy of colour-Doppler ultrasound in the evaluation of Thy-3 nodules. A bi-centre university experience.

PubMed

Cantisani, Vito; Maceroni, Piero; D'Andrea, Vito; Patrizi, Gregorio; Di Segni, Mattia; De Vito, Corrado; Grazhdani, Hektor; Isidori, Andrea M; Giannetta, Elisa; Redler, Adriano; Frattaroli, Fabrizio; Giacomelli, Laura; Di Rocco, Giorgio; Catalano, Carlo; D'Ambrosio, Ferdinando

2016-05-01

To assess whether ultrasound elastography (USE) with strain ratio increases diagnostic accuracy of Doppler ultrasound in further characterisation of cytologically Thy3 thyroid nodules. In two different university diagnostic centres, 315 patients with indeterminate cytology (Thy3) in thyroid nodules aspirates were prospectively evaluated with Doppler ultrasound and strain ratio USE before surgery. Ultrasonographic features were analysed separately and together as ultrasound score, to assess sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV). Receiver operating characteristic (ROC) curves to identify optimal cut-off value of the strain ratio were also provided. Diagnosis on a surgical specimen was considered the standard of reference. Higher strain ratio values were found in malignant nodules, with an optimum strain ratio cut-off of 2.09 at ROC analysis. USE with strain ratio showed 90.6% sensitivity, 93% specificity, 82.8% PPV, 96.4% NPV, while US score yielded a sensitivity of 52.9%, specificity of 84.3%, PPV 55.6% and NPV 82.9%. The diagnostic gain with strain ratio was statistically significant as proved by ROC areas, which was 0.9182 for strain ratio and 0.6864 for US score. USE with strain ratio should be considered a useful additional tool to colour-Doppler US, since it improves characterisation of thyroid nodules with indeterminate cytology. • Strain ratio measurements improve differentiation of thyroid nodules with indeterminate cytology • Elastography with strain ratio is more reliable than ultrasound features and ultrasound score • Strain ratio may help to better select patients with Thy 3 nodules candidate for surgery.

Plasma long non-coding RNA BACE1 as a novel biomarker for diagnosis of Alzheimer disease.

PubMed

Feng, Liang; Liao, Yu-Ting; He, Jin-Cai; Xie, Cheng-Long; Chen, Si-Yan; Fan, Hui-Hui; Su, Zhi-Peng; Wang, Zhen

2018-01-09

Long non-coding RNA (LncRNA) have been reported to be involved in the pathogenesis of neurodegenerative diseases, but whether it can serve as a biomarker for Alzheimer disease (AD) is not yet known. The present study selected four specific LncRNA (17A, 51A, BACE1 and BC200) as possible AD biomarker. RT-qPCR was performed to validate the LncRNA. Receiver operating characteristic curve (ROC) and area under the ROC curve (AUC) were applied to study the potential of LncRNA as a biomarker in a population of 88 AD patients and 72 control individuals. We found that the plasma LncRNA BACE1 level of AD patients was significantly higher than that of healthy controls (p = 0.006). Plasma level of LncRNA 17A, 51A and BC200 did not show a significant difference between two groups (p = 0.098, p = 0.204 and p = 0.232, respectively). ROC curve analysis showed that LncRNA BACE1 was the best candidate of these LncRNA (95% CI: 0.553-0.781, p = 0.003). In addition, no correlation was found for expression of these LncRNA in both control and AD groups with age or MMSE scale (p > 0.05). Our present study compared the plasma level of four LncRNA between AD and non-AD patients, and found that the level of the BACE1 is increased in the plasma of AD patients and have a high specificity (88%) for AD, indicating BACE1 may be a potential candidate biomarker to predict AD.

A completely automated CAD system for mass detection in a large mammographic database.

PubMed

Bellotti, R; De Carlo, F; Tangaro, S; Gargano, G; Maggipinto, G; Castellano, M; Massafra, R; Cascio, D; Fauci, F; Magro, R; Raso, G; Lauria, A; Forni, G; Bagnasco, S; Cerello, P; Zanon, E; Cheran, S C; Lopez Torres, E; Bottigli, U; Masala, G L; Oliva, P; Retico, A; Fantacci, M E; Cataldo, R; De Mitri, I; De Nunzio, G

2006-08-01

Mass localization plays a crucial role in computer-aided detection (CAD) systems for the classification of suspicious regions in mammograms. In this article we present a completely automated classification system for the detection of masses in digitized mammographic images. The tool system we discuss consists in three processing levels: (a) Image segmentation for the localization of regions of interest (ROIs). This step relies on an iterative dynamical threshold algorithm able to select iso-intensity closed contours around gray level maxima of the mammogram. (b) ROI characterization by means of textural features computed from the gray tone spatial dependence matrix (GTSDM), containing second-order spatial statistics information on the pixel gray level intensity. As the images under study were recorded in different centers and with different machine settings, eight GTSDM features were selected so as to be invariant under monotonic transformation. In this way, the images do not need to be normalized, as the adopted features depend on the texture only, rather than on the gray tone levels, too. (c) ROI classification by means of a neural network, with supervision provided by the radiologist's diagnosis. The CAD system was evaluated on a large database of 3369 mammographic images [2307 negative, 1062 pathological (or positive), containing at least one confirmed mass, as diagnosed by an expert radiologist]. To assess the performance of the system, receiver operating characteristic (ROC) and free-response ROC analysis were employed. The area under the ROC curve was found to be Az = 0.783 +/- 0.008 for the ROI-based classification. When evaluating the accuracy of the CAD against the radiologist-drawn boundaries, 4.23 false positives per image are found at 80% of mass sensitivity.

External validation and comparison of three pediatric clinical dehydration scales.

PubMed

Jauregui, Joshua; Nelson, Daniel; Choo, Esther; Stearns, Branden; Levine, Adam C; Liebmann, Otto; Shah, Sachita P

2014-01-01

To prospectively validate three popular clinical dehydration scales and overall physician gestalt in children with vomiting or diarrhea relative to the criterion standard of percent weight change with rehydration. We prospectively enrolled a non-consecutive cohort of children ≤ 18 years of age with an acute episode of diarrhea or vomiting. Patient weight, clinical scale variables and physician clinical impression, or gestalt, were recorded before and after fluid resuscitation in the emergency department and upon hospital discharge. The percent weight change from presentation to discharge was used to calculate the degree of dehydration, with a weight change of ≥ 5% considered significant dehydration. Receiver operating characteristics (ROC) curves were constructed for each of the three clinical scales and physician gestalt. Sensitivity and specificity were calculated based on the best cut-points of the ROC curve. We approached 209 patients, and of those, 148 were enrolled and 113 patients had complete data for analysis. Of these, 10.6% had significant dehydration based on our criterion standard. The Clinical Dehydration Scale (CDS) and Gorelick scales both had an area under the ROC curve (AUC) statistically different from the reference line with AUCs of 0.72 (95% CI 0.60, 0.84) and 0.71 (95% CI 0.57, 0.85) respectively. The World Health Organization (WHO) scale and physician gestalt had AUCs of 0.61 (95% CI 0.45, 0.77) and 0.61 (0.44, 0.78) respectively, which were not statistically significant. The Gorelick scale and Clinical Dehydration Scale were fair predictors of dehydration in children with diarrhea or vomiting. The World Health Organization scale and physician gestalt were not helpful predictors of dehydration in our cohort.

External Validation and Comparison of Three Pediatric Clinical Dehydration Scales

PubMed Central

Jauregui, Joshua; Nelson, Daniel; Choo, Esther; Stearns, Branden; Levine, Adam C.; Liebmann, Otto; Shah, Sachita P.

2014-01-01

Objective To prospectively validate three popular clinical dehydration scales and overall physician gestalt in children with vomiting or diarrhea relative to the criterion standard of percent weight change with rehydration. Methods We prospectively enrolled a non-consecutive cohort of children ≤ 18 years of age with an acute episode of diarrhea or vomiting. Patient weight, clinical scale variables and physician clinical impression, or gestalt, were recorded before and after fluid resuscitation in the emergency department and upon hospital discharge. The percent weight change from presentation to discharge was used to calculate the degree of dehydration, with a weight change of ≥ 5% considered significant dehydration. Receiver operating characteristics (ROC) curves were constructed for each of the three clinical scales and physician gestalt. Sensitivity and specificity were calculated based on the best cut-points of the ROC curve. Results We approached 209 patients, and of those, 148 were enrolled and 113 patients had complete data for analysis. Of these, 10.6% had significant dehydration based on our criterion standard. The Clinical Dehydration Scale (CDS) and Gorelick scales both had an area under the ROC curve (AUC) statistically different from the reference line with AUCs of 0.72 (95% CI 0.60, 0.84) and 0.71 (95% CI 0.57, 0.85) respectively. The World Health Organization (WHO) scale and physician gestalt had AUCs of 0.61 (95% CI 0.45, 0.77) and 0.61 (0.44, 0.78) respectively, which were not statistically significant. Conclusion The Gorelick scale and Clinical Dehydration Scale were fair predictors of dehydration in children with diarrhea or vomiting. The World Health Organization scale and physician gestalt were not helpful predictors of dehydration in our cohort. PMID:24788134

Predisposing factors for postoperative nausea and vomiting in gynecologic tumor patients.

PubMed

de Souza, Daiane Spitz; Costa, Amine Farias; Chaves, Gabriela Villaça

2016-11-01

To evaluate the predictors of postoperative nausea and vomiting (PONV) in women with gynecologic tumor. The analysis was based on prospectively collected data of 82 adult patients with gynecologic tumor, who were submitted to open surgical treatment and undergoing general anesthesia. The predictors included were age ≥50 years, non-smoker, use of postoperative opioids, mechanical bowel preparation, intraoperative intravenous hydration (IH) ≥10 mL/kg/h, and IH in the immediate postoperative, first and second postoperative days (PO1 and PO2) ≥30 mL/kg. A score with predictor variables was built. A multiple logistic regression was fitted. To estimate the discriminating power of the chosen model, a receiver operating characteristic (ROC) curve was plotted and the area under the ROC curve (AUC) was calculated. Statistical significance was set at p value <0.05 and the confidence interval at 95 %. The incidence (%) of nausea, vomiting and both, in the general population, was 36.6, 28.1, 22.0, respectively. The highest incidences of PONV were found in non-smokers and in patients who received >30 mL/kg of IH in the PO2. The results of the adjusted model showed an increased risk of PONV for each 1-point increase in the score punctuation. The relative risk was higher than 2.0 for vomiting in all period and in the PO1. The ROC curve showed great discrimination of postoperative nausea and vomiting from the proposed score (AUC >0.75). The study population was at high risk of PONV. Therefore, institutional guidelines abolishing modificable variables following temporal evaluation of the effectiveness should be undertaken.

Accuracy of optical spectroscopy for the detection of cervical intraepithelial neoplasia: Testing a device as an adjunct to colposcopy.

PubMed

Cantor, Scott B; Yamal, Jose-Miguel; Guillaud, Martial; Cox, Dennis D; Atkinson, E Neely; Benedet, John L; Miller, Dianne; Ehlen, Thomas; Matisic, Jasenka; van Niekerk, Dirk; Bertrand, Monique; Milbourne, Andrea; Rhodes, Helen; Malpica, Anais; Staerkel, Gregg; Nader-Eftekhari, Shahla; Adler-Storthz, Karen; Scheurer, Michael E; Basen-Engquist, Karen; Shinn, Eileen; West, Loyd A; Vlastos, Anne-Therese; Tao, Xia; Beck, J Robert; Macaulay, Calum; Follen, Michele

2011-03-01

Testing emerging technologies involves the evaluation of biologic plausibility, technical efficacy, clinical effectiveness, patient satisfaction, and cost-effectiveness. The objective of this study was to select an effective classification algorithm for optical spectroscopy as an adjunct to colposcopy and obtain preliminary estimates of its accuracy for the detection of CIN 2 or worse. We recruited 1,000 patients from screening and prevention clinics and 850 patients from colposcopy clinics at two comprehensive cancer centers and a community hospital. Optical spectroscopy was performed, and 4,864 biopsies were obtained from the sites measured, including abnormal and normal colposcopic areas. The gold standard was the histologic report of biopsies, read 2 to 3 times by histopathologists blinded to the cytologic, histopathologic, and spectroscopic results. We calculated sensitivities, specificities, receiver operating characteristic (ROC) curves, and areas under the ROC curves. We identified a cutpoint for an algorithm based on optical spectroscopy that yielded an estimated sensitivity of 1.00 [95% confidence interval (CI) = 0.92-1.00] and an estimated specificity of 0.71 [95% CI = 0.62-0.79] in a combined screening and diagnostic population. The positive and negative predictive values were 0.58 and 1.00, respectively. The area under the ROC curve was 0.85 (95% CI = 0.81-0.89). The per-patient and per-site performance were similar in the diagnostic and poorer in the screening settings. Like colposcopy, the device performs best in a diagnostic population. Alternative statistical approaches demonstrate that the analysis is robust and that spectroscopy works as well as or slightly better than colposcopy for the detection of CIN 2 to cancer. Copyright © 2010 UICC.

Deriving the reference value from the circadian motor active patterns in the "non-dementia" population, compared to the "dementia" population: What is the amount of physical activity conducive to the good circadian rhythm.

PubMed

Kodama, Ayuto; Kume, Yu; Tsugaruya, Megumi; Ishikawa, Takashi

2016-01-01

The circadian rhythm in older adults is commonly known to change with a decrease in physical activity. However, the association between circadian rhythm metrics and physical activity remains unclear. The objective of this study was to examine circadian activity patterns in older people with and without dementia and to determine the amount of physical activity conducive to a good circadian measurement. Circadian parameters were collected from 117 older community-dwelling people (66 subjects without dementia and 52 subjects with dementia); the parameters were measured continuously using actigraphy for 7 days. A receiver operating characteristic (ROC) curve was applied to determine reference values for the circadian rhythm parameters, consisting of interdaily stability (IS), intradaily variability (IV), and relative amplitude (RA), in older subjects. The ROC curve revealed reference values of 0.55 for IS, 1.10 for IV, and 0.82 for RA. In addition, as a result of the ROC curve in the moderate-to-vigorous physical Activity (MVPA) conducive to the reference value of the Non-parametric Circadian Rhythm Analysis per day, the optimal reference values were 51 minutes for IV and 55 minutes for RA. However, the IS had no classification accuracy. Our results demonstrated the reference values derived from the circadian parameters of older Japanese population with or without dementia. Also, we determined the MVPA conducive to a good circadian rest-active pattern. This reference value for physical activity conducive to a good circadian rhythm might be useful for developing a new index for health promotion in the older community-dwelling population.

Holistic component of image perception in mammogram interpretation: gaze-tracking study.

PubMed

Kundel, Harold L; Nodine, Calvin F; Conant, Emily F; Weinstein, Susan P

2007-02-01

To test the hypothesis that rapid and accurate performance of the proficient observer in mammogram interpretation involves a shift in the mechanism of image perception from a relatively slow search-to-find mode to a relatively fast holistic mode. This HIPAA-compliant study had institutional review board approval, and participant informed consent was obtained; patient informed consent was not required. The eye positions of three full-time mammographers, one attending radiologist, two mammography fellows, and three radiology residents were recorded during the interpretation of 20 normal and 20 subtly abnormal mammograms. The search time required to first locate a cancer, as well as the initial eye scan path, was determined and compared with diagnostic performance as measured with receiver operating characteristic (ROC) analysis. The median time for all observers to fixate a cancer, regardless of the decision outcome, was 1.13 seconds, with a range of 0.68 second to 3.06 seconds. Even though most of the lesions were fixated, recognition of them as cancerous ranged from 85% (17 of 20) to 10% (two of 20), with corresponding areas under the ROC curve of 0.87-0.40. The ROC index of detectability, d(a), was linearly related to the time to first fixate a cancer with a correlation (r(2)) of 0.81. The rapid initial fixation of a true abnormality is evidence for a global perceptual process capable of analyzing the visual input of the entire retinal image and pinpointing the spatial location of an abnormality. It appears to be more highly developed in the most proficient observers, replacing the less efficient initial search-to-find strategies. (c) RSNA, 2007.

A comparative study of fire weather indices in a semiarid south-eastern Europe region. Case of study: Murcia (Spain).

PubMed

Pérez-Sánchez, Julio; Senent-Aparicio, Javier; Díaz-Palmero, José María; Cabezas-Cerezo, Juan de Dios

2017-07-15

Forest fires are an important distortion in forest ecosystems, linked to their development and whose effects proceed beyond the destruction of ecosystems and material properties, especially in semiarid regions. Prevention of forest fires has to lean on indices based on available parameters that quantify fire risk ignition and spreading. The present study was conducted to compare four fire weather indices in a semiarid region of 11,314km 2 located in southern Spain, characterised as being part of the most damaged area by fire in the Iberian Peninsula. The studied period comprises 3033 wildfires in the region during 15years (2000-2014), of which 80% are >100m 2 and 14% >1000m 2 , resulting around 40km 2 of burnt area in this period. The indices selected have been Angström Index, Forest Fire Drought Index, Forest Moisture Index and Fire Weather Index. Likewise, four selection methods have been applied to compare the results of the studied indices: Mahalanobis distance, percentile method, ranked percentile method and Relative Operating Characteristic curves (ROC). Angström index gives good results in the coastal areas with higher temperatures, low rainfall and wider range of variations while Fire Weather Index has better results in inland areas with higher rainfall, dense forest mass and fewer changes in meteorological conditions throughout the year. ROC space rejects all the indices except Fire Weather Index with good performance all over the region. ROC analysis ratios can be used to assess the success (or lack thereof) of fire indices; thus, it benefits operational wildfire predictions in semiarid regions similar to that of the case study. Copyright © 2017 Elsevier B.V. All rights reserved.

Diagnostic evaluation of three cardiac software packages using a consecutive group of patients

PubMed Central

2011-01-01

Purpose The aim of this study was to compare the diagnostic performance of the three software packages 4DMSPECT (4DM), Emory Cardiac Toolbox (ECTb), and Cedars Quantitative Perfusion SPECT (QPS) for quantification of myocardial perfusion scintigram (MPS) using a large group of consecutive patients. Methods We studied 1,052 consecutive patients who underwent 2-day stress/rest 99mTc-sestamibi MPS studies. The reference/gold-standard classifications for the MPS studies were obtained from three physicians, with more than 25 years each of experience in nuclear cardiology, who re-evaluated all MPS images. Automatic processing was carried out using 4DM, ECTb, and QPS software packages. Total stress defect extent (TDE) and summed stress score (SSS) based on a 17-segment model were obtained from the software packages. Receiver-operating characteristic (ROC) analysis was performed. Results A total of 734 patients were classified as normal and the remaining 318 were classified as having infarction and/or ischemia. The performance of the software packages calculated as the area under the SSS ROC curve were 0.87 for 4DM, 0.80 for QPS, and 0.76 for ECTb (QPS vs. ECTb p = 0.03; other differences p < 0.0001). The area under the TDE ROC curve were 0.87 for 4DM, 0.82 for QPS, and 0.76 for ECTb (QPS vs. ECTb p = 0.0005; other differences p < 0.0001). Conclusion There are considerable differences in performance between the three software packages with 4DM showing the best performance and ECTb the worst. These differences in performance should be taken in consideration when software packages are used in clinical routine or in clinical studies. PMID:22214226

ROC evaluation of SPECT myocardial lesion detectability with and without single iteration non-uniform Chang attenuation compensation using an anthropomorphic female phantom

NASA Astrophysics Data System (ADS)

Jang, Sunyoung; Jaszczak, R. J.; Tsui, B. M. W.; Metz, C. E.; Gilland, D. R.; Turkington, T. G.; Coleman, R. E.

1998-08-01

The purpose of this work was to evaluate lesion detectability with and without nonuniform attenuation compensation (AC) in myocardial perfusion SPECT imaging in women using an anthropomorphic phantom and receiver operating characteristics (ROC) methodology. Breast attenuation causes artifacts in reconstructed images and may increase the difficulty of diagnosis of myocardial perfusion imaging in women. The null hypothesis tested using the ROC study was that nonuniform AC does not change the lesion detectability in myocardial perfusion SPECT imaging in women. The authors used a filtered backprojection (FBP) reconstruction algorithm and Chang's (1978) single iteration method for AC. In conclusion, with the authors' proposed myocardial defect model nuclear medicine physicians demonstrated no significant difference for the detection of the anterior wall defect; however, a greater accuracy for the detection of the inferior wall defect was observed without nonuniform AC than with it (P-value=0.0034). Medical physicists did not demonstrate any statistically significant difference in defect detection accuracy with or without nonuniform AC in the female phantom.

Laser confocal measurement system for curvature radius of lenses based on grating ruler

NASA Astrophysics Data System (ADS)

Tian, Jiwei; Wang, Yun; Zhou, Nan; Zhao, Weirui; Zhao, Weiqian

2015-02-01

In the modern optical measurement field, the radius of curvature (ROC) is one of the fundamental parameters of optical lens. Its measurement accuracy directly affects the other optical parameters, such as focal length, aberration and so on, which significantly affect the overall performance of the optical system. To meet the demand of measurement instruments for radius of curvature (ROC) with high accuracy in the market, we develop a laser confocal radius measurement system with grating ruler. The system uses the peak point of the confocal intensity curve to precisely identify the cat-eye and confocal positions and then measure the distance between these two positions by using the grating ruler, thereby achieving the high-precision measurement for the ROC. The system has advantages of high focusing sensitivity and anti-environment disturbance ability. And the preliminary theoretical analysis and experiments show that the measuring repeatability can be up to 0.8 um, which can provide an effective way for the accurate measurement of ROC.

Exploring the clonal evolution of CD133/aldehyde-dehydrogenase-1 (ALDH1)-positive cancer stem-like cells from primary to recurrent high-grade serous ovarian cancer (HGSOC). A study of the Ovarian Cancer Therapy-Innovative Models Prolong Survival (OCTIPS) Consortium.

PubMed

Ruscito, Ilary; Cacsire Castillo-Tong, Dan; Vergote, Ignace; Ignat, Iulia; Stanske, Mandy; Vanderstichele, Adriaan; Ganapathi, Ram N; Glajzer, Jacek; Kulbe, Hagen; Trillsch, Fabian; Mustea, Alexander; Kreuzinger, Caroline; Benedetti Panici, Pierluigi; Gourley, Charlie; Gabra, Hani; Kessler, Mirjana; Sehouli, Jalid; Darb-Esfahani, Silvia; Braicu, Elena Ioana

2017-07-01

High-grade serous ovarian cancer (HGSOC) causes 80% of all ovarian cancer (OC) deaths. In this setting, the role of cancer stem-like cells (CSCs) is still unclear. In particular, the evolution of CSC biomarkers from primary (pOC) to recurrent (rOC) HGSOCs is unknown. Aim of this study was to investigate changes in CD133 and aldehyde dehydrogenase-1 (ALDH1) CSC biomarker expression in pOC and rOC HGSOCs. Two-hundred and twenty-four pOC and rOC intrapatient paired tissue samples derived from 112 HGSOC patients were evaluated for CD133 and ALDH1 expression using immunohistochemistry (IHC); pOCs and rOCs were compared for CD133 and/or ALDH1 levels. Expression profiles were also correlated with patients' clinicopathological and survival data. Some 49.1% of the patient population (55/112) and 37.5% (42/112) pOCs were CD133+ and ALDH1+ respectively. CD133+ and ALDH1+ samples were detected in 33.9% (38/112) and 36.6% (41/112) rOCs. CD133/ALDH1 coexpression was observed in 23.2% (26/112) and 15.2% (17/112) of pOCs and rOCs respectively. Pairwise analysis showed a significant shift of CD133 staining from higher (pOCs) to lower expression levels (rOCs) (p < 0.0001). Furthermore, all CD133 + pOC patients were International Federation of Gynaecology and Obstetrics (FIGO)-stage III/IV (p < 0.0001) and had significantly worse progression-free interval (PFI) (p = 0.04) and overall survival (OS) (p = 0.02). On multivariate analysis, CD133/ALDH1 coexpression in pOCs was identified as independent prognostic factor for PFI (HR: 1.64; 95% CI: 1.03-2.60; p = 0.036) and OS (HR: 1.71; 95% CI: 1.01-2.88; p = 0.045). Analysis on 52 pts patients with known somatic BRCA status revealed that BRCA mutations did not influence CSC biomarker expression. The study showed that CD133/ALDH1 expression impacts HGSOC patients' survival and first suggests that CSCs might undergo phenotypic change during the disease course similarly to non stem-like cancer cells, providing also a first evidence that there is no correlation between CSCs and BRCA status. Copyright © 2017 Elsevier Ltd. All rights reserved.

Comparison of anthropometric indices for predicting the risk of metabolic syndrome and its components in Chinese adults: a prospective, longitudinal study

PubMed Central

Wang, Haoyu; Liu, Aihua; Zhao, Tong; Gong, Xun; Pang, Tianxiao; Zhou, Yingying; Xiao, Yue; Yan, Yumeng; Fan, Chenling; Teng, Weiping; Lai, Yaxin; Shan, Zhongyan

2017-01-01

Objectives Our study aimed to distinguish the ability of anthropometric indices to assess the risk of metabolic syndrome (MetS). Design Prospective cohort study. Setting Shenyang, China. Participants A total of 379 residents aged between 40 and 65 were enrolled. 253 of them were free of MetS and had been followed up for 4.5 years. Methods At baseline, all the participants underwent a thorough medical examination. A variety of anthropometric parameters were measured and calculated, including waist circumference (WC), body mass index (BMI), a body shape index (ABSI), abdominal volume index (AVI), body adiposity index, body roundness index, conicity index, waist-to-hip ratio and visceral adiposity index (VAI). After 4.5 year follow-up, we re-examined whether participants were suffering from MetS. A receiver operating characteristic (ROC) curve was applied to examine the potential of the above indices to identify the status and risk of MetS. Outcomes Occurrence of MetS. Results At baseline, 33.2% participants suffered from MetS. All of the anthropometric indices showed clinical significance, and VAI was superior to the other indices as it was found to have the largest area under the ROC curve. After a 4.5 year follow-up, 37.8% of men and 23.9% of women developed MetS. ROC curve analysis suggested that baseline BMI was the strongest predictor of MetS for men (0.77 (0.68–0.85)), and AVI was the strongest for women (0.72 (0.64–0.79)). However, no significant difference was observed between WC and both indices. In contrast, the baseline ABSI did not predict MetS in both genders. Conclusions The present study indicated that these different indices derived from anthropometric parameters have different discriminatory abilities for MetS. Although WC did not have the largest area under the ROC curve for diagnosing and predicting MetS, it may remain a better index of MetS status and risk because of its simplicity and wide use. PMID:28928179

Exploratory Use of Decision Tree Analysis in Classification of Outcome in Hypoxic-Ischemic Brain Injury.

PubMed

Phan, Thanh G; Chen, Jian; Singhal, Shaloo; Ma, Henry; Clissold, Benjamin B; Ly, John; Beare, Richard

2018-01-01

Prognostication following hypoxic ischemic encephalopathy (brain injury) is important for clinical management. The aim of this exploratory study is to use a decision tree model to find clinical and MRI associates of severe disability and death in this condition. We evaluate clinical model and then the added value of MRI data. The inclusion criteria were as follows: age ≥17 years, cardio-respiratory arrest, and coma on admission (2003-2011). Decision tree analysis was used to find clinical [Glasgow Coma Score (GCS), features about cardiac arrest, therapeutic hypothermia, age, and sex] and MRI (infarct volume) associates of severe disability and death. We used the area under the ROC (auROC) to determine accuracy of model. There were 41 (63.7% males) patients having MRI imaging with the average age 51.5 ± 18.9 years old. The decision trees showed that infarct volume and age were important factors for discrimination between mild to moderate disability and severe disability and death at day 0 and day 2. The auROC for this model was 0.94 (95% CI 0.82-1.00). At day 7, GCS value was the only predictor; the auROC was 0.96 (95% CI 0.86-1.00). Our findings provide proof of concept for further exploration of the role of MR imaging and decision tree analysis in the early prognostication of hypoxic ischemic brain injury.

Computer-Based Image Analysis for Plus Disease Diagnosis in Retinopathy of Prematurity

PubMed Central

Wittenberg, Leah A.; Jonsson, Nina J.; Chan, RV Paul; Chiang, Michael F.

2014-01-01

Presence of plus disease in retinopathy of prematurity (ROP) is an important criterion for identifying treatment-requiring ROP. Plus disease is defined by a standard published photograph selected over 20 years ago by expert consensus. However, diagnosis of plus disease has been shown to be subjective and qualitative. Computer-based image analysis, using quantitative methods, has potential to improve the objectivity of plus disease diagnosis. The objective was to review the published literature involving computer-based image analysis for ROP diagnosis. The PubMed and Cochrane library databases were searched for the keywords “retinopathy of prematurity” AND “image analysis” AND/OR “plus disease.” Reference lists of retrieved articles were searched to identify additional relevant studies. All relevant English-language studies were reviewed. There are four main computer-based systems, ROPtool (AU ROC curve, plus tortuosity 0.95, plus dilation 0.87), RISA (AU ROC curve, arteriolar TI 0.71, venular diameter 0.82), Vessel Map (AU ROC curve, arteriolar dilation 0.75, venular dilation 0.96), and CAIAR (AU ROC curve, arteriole tortuosity 0.92, venular dilation 0.91), attempting to objectively analyze vessel tortuosity and dilation in plus disease in ROP. Some of them show promise for identification of plus disease using quantitative methods. This has potential to improve the diagnosis of plus disease, and may contribute to the management of ROP using both traditional binocular indirect ophthalmoscopy and image-based telemedicine approaches. PMID:21366159

Association between Platelet Counts before and during Pharmacological Therapy for Patent Ductus Arteriosus and Treatment Failure in Preterm Infants.

PubMed

Sallmon, Hannes; Weber, Sven C; Dirks, Juliane; Schiffer, Tamara; Klippstein, Tamara; Stein, Anja; Felderhoff-Müser, Ursula; Metze, Boris; Hansmann, Georg; Bührer, Christoph; Cremer, Malte; Koehne, Petra

2018-01-01

The role of platelets for mediating closure of the ductus arteriosus in human preterm infants is controversial. Especially, the effect of low platelet counts on pharmacological treatment failure is still unclear. In this retrospective study of 471 preterm infants [<1,500 g birth weight (BW)], who were treated for a patent ductus arteriosus (PDA) with indomethacin or ibuprofen, we investigated whether platelet counts before or during pharmacological treatment had an impact on the successful closure of a hemodynamically significant PDA. The effects of other factors, such as sepsis, preeclampsia, gestational age, BW, and gender, were also evaluated. Platelet counts before initiation of pharmacological PDA treatment did not differ between infants with later treatment success or failure. However, we found significant associations between low platelet counts during pharmacological PDA therapy and treatment failure ( p  < 0.05). Receiver operating characteristic (ROC) curve analysis showed that platelet counts after the first, and before and after the second cyclooxygenase inhibitor (COXI) cycle were significantly associated with treatment failure (area under the curve of >0.6). However, ROC curve analysis did not reveal a specific platelet cutoff-value that could predict PDA treatment failure. Multivariate logistic regression analysis showed that lower platelet counts, a lower BW, and preeclampsia were independently associated with COXI treatment failure. We provide further evidence for an association between low platelet counts during pharmacological therapy for symptomatic PDA and treatment failure, while platelet counts before initiation of therapy did not affect treatment outcome.

Protein induced by vitamin K absence or antagonist-II (PIVKA-II) specifically increased in Italian hepatocellular carcinoma patients.

PubMed

Viggiani, Valentina; Palombi, Sara; Gennarini, Giuseppina; D'Ettorre, Gabriella; De Vito, Corrado; Angeloni, Antonio; Frati, Luigi; Anastasi, Emanuela

2016-10-01

As a marker for Hepatocellular Carcinoma (HCC), Protein Induced by Vitamin K Absence II (PIVKA-II) seems to be superior to alpha fetoprotein (AFP). To better characterize the role of PIVKA-II, both AFP and PIVKA-II have been measured in Italian patients with diagnosis of HCC compared with patients affected by non-oncological liver pathologies. Sixty serum samples from patients with HCC, 60 samples from patients with benign liver disease and 60 samples obtained from healthy blood donors were included in the study. PIVKA-II and AFP were measured by LUMIPULSE(®) G1200 (Fujirebio-Europe, Belgium). We considered as PIVKA-II cutoff 70 mAU/ml (mean +3SD) of the values observed in healthy subjects. The evaluation of PIVKA-II showed a positivity of 70% in patients with HCC and 5% in patients with benign diseases (p < 0.0001) whereas high levels of AFP were observed in 55% of HCC patients and in 47% of patients with benign diseases. The combined Receiver Operating Characteristic (ROC) analysis of the two analytes revealed a higher sensitivity (75%) compared to those observed for the individual biomarkers. In conclusion, we demonstrate that as a marker for HCC, PIVKA-II is more specific for HCC and less prone to elevation during chronic liver diseases. The combination of the two biomarkers, evaluated by the ROC analysis, improved the specificity compared to a single marker. These data suggest that the combined analysis of the two markers could be a useful tool in clinical practice.

Intact protein analysis of ubiquitin in cerebrospinal fluid by multiple reaction monitoring reveals differences in Alzheimer's disease and frontotemporal lobar degeneration.

PubMed

Oeckl, Patrick; Steinacker, Petra; von Arnim, Christine A F; Straub, Sarah; Nagl, Magdalena; Feneberg, Emily; Weishaupt, Jochen H; Ludolph, Albert C; Otto, Markus

2014-11-07

The impairment of the ubiquitin-proteasome system (UPS) is thought to be an early event in neurodegeneration, and monitoring UPS alterations might serve as a disease biomarker. Our aim was to establish an alternate method to antibody-based assays for the selective measurement of free monoubiquitin in cerebrospinal fluid (CSF). Free monoubiquitin was measured with liquid chromatography-multiple reaction monitoring mass spectrometry (LC-MS/MS) in CSF of patients with Alzheimer's disease (AD), amyotrophic lateral sclerosis (ALS), behavioral variant of frontotemporal dementia (bvFTD), Creutzfeldt-Jakob disease (CJD), Parkinson's disease (PD), primary progressive aphasia (PPA), and progressive supranuclear palsy (PSP). The LC-MS/MS method showed excellent intra- and interassay precision (4.4-7.4% and 4.9-10.3%) and accuracy (100-107% and 100-106%). CSF ubiquitin concentration was increased compared with that of controls (33.0 ± 9.7 ng/mL) in AD (47.5 ± 13.1 ng/mL, p < 0.05) and CJD patients (171.5 ± 103.5 ng/mL, p < 0.001) but not in other neurodegenerative diseases. Receiver operating characteristic curve (ROC) analysis of AD vs control patients revealed an area under the curve (AUC) of 0.832, and the specificity and sensitivity were 75 and 75%, respectively. ROC analysis of AD and FTLD patients yielded an AUC of 0.776, and the specificity and sensitivity were 53 and 100%, respectively. In conclusion, our LC-MS/MS method may facilitate ubiquitin determination to a broader community and might help to discriminate AD, CJD, and FTLD patients.

Defining a new diagnostic assessment parameter for wound care: Elevated protease activity, an indicator of nonhealing, for targeted protease-modulating treatment.

PubMed

Serena, Thomas E; Cullen, Breda M; Bayliff, Simon W; Gibson, Molly C; Carter, Marissa J; Chen, Lingyun; Yaakov, Raphael A; Samies, John; Sabo, Matthew; DeMarco, Daniel; Le, Namchi; Galbraith, James

2016-05-01

It is widely accepted that elevated protease activity (EPA) in chronic wounds impedes healing. However, little progress has occurred in quantifying the level of protease activity that is detrimental for healing. The aim of this study was to determine the relationship between inflammatory protease activity and wound healing status, and to establish the level of EPA above which human neutrophil-derived elastase (HNE) and matrix metalloproteases (MMP) activities correlate with nonhealing wounds. Chronic wound swab samples (n = 290) were collected from four wound centers across the USA to measure HNE and MMP activity. Healing status was determined according to percentage reduction in wound area over the previous 2-4 weeks; this was available for 211 wounds. Association between protease activity and nonhealing wounds was determined by receiver operating characteristic analysis (ROC), a statistical technique used for visualizing and analyzing the performance of diagnostic tests. ROC analysis showed that area under the curve (AUC) for HNE were 0.69 for all wounds and 0.78 for wounds with the most reliable wound trajectory information, respectively. For MMP, the corresponding AUC values were 0.70 and 0.82. Analysis suggested that chronic wounds having values of HNE >5 and/or MMP ≥13, should be considered wound healing impaired. EPA is indicative of nonhealing wounds. Use of a diagnostic test to detect EPA in clinical practice could enable clinicians to identify wounds that are nonhealing, thus enabling targeted treatment with protease modulating therapies. © 2016 by the Wound Healing Society.

Tumour xenograft detection through quantitative analysis of the metabolic profile of urine in mice

NASA Astrophysics Data System (ADS)

Moroz, Jennifer; Turner, Joan; Slupsky, Carolyn; Fallone, Gino; Syme, Alasdair

2011-02-01

The metabolic content of urine from NIH III nude mice (n = 22) was analysed before and after inoculation with human glioblastoma multiforme (GBM) cancer cells. An age- and gender-matched control population (n = 14) was also studied to identify non-tumour-related changes. Urine samples were collected daily for 6 weeks, beginning 1 week before cell injection. Metabolite concentrations were obtained via targeted profiling with Chenomx Suite 5.1, based on nuclear magnetic resonance (NMR) spectra acquired on an Oxford 800 MHz cold probe NMR spectrometer. The Wilcoxon rank sum test was used to evaluate the significance of the change in metabolite concentration between the two time points. Both the metabolite concentrations and the ratios of pairs of metabolites were studied. The complicated inter-relationships between metabolites were assessed through partial least-squares discriminant analysis (PLS-DA). Receiver operating characteristic (ROC) curves were generated for all variables and the area under the curve (AUC) calculated. The data indicate that the number of statistically significant changes in metabolite concentrations was more pronounced in the tumour-bearing population than in the control animals. This was also true of the ratios of pairs of metabolites. ROC analysis suggests that the ratios were better able to differentiate between the pre- and post-injection samples compared to the metabolite concentrations. PLS-DA models produced good separation between the populations and had the best AUC results (all models exceeded 0.937). These results demonstrate that metabolomics may be used as a screening tool for GBM cells grown in xenograft models in mice.

Can upstaging of ductal carcinoma in situ be predicted at biopsy by histologic and mammographic features?

NASA Astrophysics Data System (ADS)

Shi, Bibo; Grimm, Lars J.; Mazurowski, Maciej A.; Marks, Jeffrey R.; King, Lorraine M.; Maley, Carlo C.; Hwang, E. Shelley; Lo, Joseph Y.

2017-03-01

Reducing the overdiagnosis and overtreatment associated with ductal carcinoma in situ (DCIS) requires accurate prediction of the invasive potential at cancer screening. In this work, we investigated the utility of pre-operative histologic and mammographic features to predict upstaging of DCIS. The goal was to provide intentionally conservative baseline performance using readily available data from radiologists and pathologists and only linear models. We conducted a retrospective analysis on 99 patients with DCIS. Of those 25 were upstaged to invasive cancer at the time of definitive surgery. Pre-operative factors including both the histologic features extracted from stereotactic core needle biopsy (SCNB) reports and the mammographic features annotated by an expert breast radiologist were investigated with statistical analysis. Furthermore, we built classification models based on those features in an attempt to predict the presence of an occult invasive component in DCIS, with generalization performance assessed by receiver operating characteristic (ROC) curve analysis. Histologic features including nuclear grade and DCIS subtype did not show statistically significant differences between cases with pure DCIS and with DCIS plus invasive disease. However, three mammographic features, i.e., the major axis length of DCIS lesion, the BI-RADS level of suspicion, and radiologist's assessment did achieve the statistical significance. Using those three statistically significant features as input, a linear discriminant model was able to distinguish patients with DCIS plus invasive disease from those with pure DCIS, with AUC-ROC equal to 0.62. Overall, mammograms used for breast screening contain useful information that can be perceived by radiologists and help predict occult invasive components in DCIS.

Diagnosis of human malignancies using laser-induced breakdown spectroscopy in combination with chemometric methods

NASA Astrophysics Data System (ADS)

Chen, Xue; Li, Xiaohui; Yu, Xin; Chen, Deying; Liu, Aichun

2018-01-01

Diagnosis of malignancies is a challenging clinical issue. In this work, we present quick and robust diagnosis and discrimination of lymphoma and multiple myeloma (MM) using laser-induced breakdown spectroscopy (LIBS) conducted on human serum samples, in combination with chemometric methods. The serum samples collected from lymphoma and MM cancer patients and healthy controls were deposited on filter papers and ablated with a pulsed 1064 nm Nd:YAG laser. 24 atomic lines of Ca, Na, K, H, O, and N were selected for malignancy diagnosis. Principal component analysis (PCA), linear discriminant analysis (LDA), quadratic discriminant analysis (QDA), and k nearest neighbors (kNN) classification were applied to build the malignancy diagnosis and discrimination models. The performances of the models were evaluated using 10-fold cross validation. The discrimination accuracy, confusion matrix and receiver operating characteristic (ROC) curves were obtained. The values of area under the ROC curve (AUC), sensitivity and specificity at the cut-points were determined. The kNN model exhibits the best performances with overall discrimination accuracy of 96.0%. Distinct discrimination between malignancies and healthy controls has been achieved with AUC, sensitivity and specificity for healthy controls all approaching 1. For lymphoma, the best discrimination performance values are AUC = 0.990, sensitivity = 0.970 and specificity = 0.956. For MM, the corresponding values are AUC = 0.986, sensitivity = 0.892 and specificity = 0.994. The results show that the serum-LIBS technique can serve as a quick, less invasive and robust method for diagnosis and discrimination of human malignancies.

Signal detection in animal psychoacoustics: Analysis and simulation of sensory and decision-related influences

PubMed Central

Alves-Pinto, A.; Sollini, J.; Sumner, C.J.

2012-01-01

Signal detection theory (SDT) provides a framework for interpreting psychophysical experiments, separating the putative internal sensory representation and the decision process. SDT was used to analyse ferret behavioural responses in a (yes–no) tone-in-noise detection task. Instead of measuring the receiver-operating characteristic (ROC), we tested SDT by comparing responses collected using two common psychophysical data collection methods. These (Constant Stimuli, Limits) differ in the set of signal levels presented within and across behavioural sessions. The results support the use of SDT as a method of analysis: SDT sensory component was unchanged between the two methods, even though decisions depended on the stimuli presented within a behavioural session. Decision criterion varied trial-by-trial: a ‘yes’ response was more likely after a correct rejection trial than a hit trial. Simulation using an SDT model with several decision components reproduced the experimental observations accurately, leaving only ∼10% of the variance unaccounted for. The model also showed that trial-by-trial dependencies were unlikely to influence measured psychometric functions or thresholds. An additional model component suggested that inattention did not contribute substantially. Further analysis showed that ferrets were changing their decision criteria, almost optimally, to maximise the reward obtained in a session. The data suggest trial-by-trial reward-driven optimization of the decision process. Understanding the factors determining behavioural responses is important for correlating neural activity and behaviour. SDT provides a good account of animal psychoacoustics, and can be validated using standard psychophysical methods and computer simulations, without recourse to ROC measurements. PMID:22698686

An explorative childhood pneumonia analysis based on ultrasonic imaging texture features

NASA Astrophysics Data System (ADS)

Zenteno, Omar; Diaz, Kristians; Lavarello, Roberto; Zimic, Mirko; Correa, Malena; Mayta, Holger; Anticona, Cynthia; Pajuelo, Monica; Oberhelman, Richard; Checkley, William; Gilman, Robert H.; Figueroa, Dante; Castañeda, Benjamín.

2015-12-01

According to World Health Organization, pneumonia is the respiratory disease with the highest pediatric mortality rate accounting for 15% of all deaths of children under 5 years old worldwide. The diagnosis of pneumonia is commonly made by clinical criteria with support from ancillary studies and also laboratory findings. Chest imaging is commonly done with chest X-rays and occasionally with a chest CT scan. Lung ultrasound is a promising alternative for chest imaging; however, interpretation is subjective and requires adequate training. In the present work, a two-class classification algorithm based on four Gray-level co-occurrence matrix texture features (i.e., Contrast, Correlation, Energy and Homogeneity) extracted from lung ultrasound images from children aged between six months and five years is presented. Ultrasound data was collected using a L14-5/38 linear transducer. The data consisted of 22 positive- and 68 negative-diagnosed B-mode cine-loops selected by a medical expert and captured in the facilities of the Instituto Nacional de Salud del Niño (Lima, Peru), for a total number of 90 videos obtained from twelve children diagnosed with pneumonia. The classification capacity of each feature was explored independently and the optimal threshold was selected by a receiver operator characteristic (ROC) curve analysis. In addition, a principal component analysis was performed to evaluate the combined performance of all the features. Contrast and correlation resulted the two more significant features. The classification performance of these two features by principal components was evaluated. The results revealed 82% sensitivity, 76% specificity, 78% accuracy and 0.85 area under the ROC.

Should We Be Anxious When Assessing Anxiety Using the Beck Anxiety Inventory in Clinical Insomnia Patients?

PubMed Central

Carney, Colleen E.; Moss, Taryn G.; Harris, Andrea L.; Edinger, Jack D.; Krystal, Andrew D.

2011-01-01

Assessing for clinical levels of anxiety is crucial, as comorbid insomnias far outnumber primary insomnias (PI). Such assessment is complex since those with Anxiety Disorders (AD) and those with PI have overlapping symptoms. Because of this overlap, we need studies that examine the assessment of anxiety in clinical insomnia groups. Participants (N = 207) were classified as having insomnia: 1) without an anxiety disorder (I-ND), or 2) with an anxiety disorder (I-AD). Mean Beck Anxiety Inventory (BAI) item responses were compared using multivariate analysis of variance (MANOVA) and follow-up ANOVAs. As a validity check, a receiver operating characteristic (ROC) curve analysis was conducted to determine if the BAI suggested clinical cutoff was valid for identifying clinical levels of anxiety in this comorbid patient group. The I-ND had lower mean BAI scores than I-AD. There were significant group differences on 12 BAI items. The ROC curve analysis revealed the suggested BAI cutoff (≥16) had 55% sensitivity and 78% specificity. Although anxiety scores were highest in those with insomnia and an anxiety disorder, those with insomnia only had scores in the mild range for anxiety. Nine items did not distinguish between those insomnia sufferers with and without an anxiety disorder. Additionally, published cutoffs for the BAI were not optimal for identifying anxiety disorders in those with insomnia. Such limitations must be considered before using this measure in insomnia patient groups. In addition, the poor specificity and high number of overlapping symptoms between insomnia and anxiety highlight the diagnostic challenges facing clinicians. PMID:21482427

FAST for blunt abdominal trauma: Correlation between positive findings and admission acid-base measurement.

PubMed

Heidari, Kamran; Taghizadeh, Mehrdad; Mahmoudi, Sadrollah; Panahi, Hamidreza; Ghaffari Shad, Ensieh; Asadollahi, Shadi

2017-06-01

This study aimed to determine any association between positive findings in ultrasonography examination and initial BD value with regard to diagnosis of intra-abdominal bleeding following blunt abdominal trauma. A prospective, multi-center study of consecutive adult patients was performed from April to September 2015. Demographics, initial vital signs and arterial BD were evaluated with respect to presence of any association with intra-abdominal bleeding and in-hospital mortality. FAST study was performed to find intra-abdominal bleeding. Receiver operating characteristic (ROC) curves tested the ability of BD to identify patients with intra-abdominal hemorrhage and probable mortality. A total of 879 patients were included in final analysis. The mean (SD) age was 36.68 (15.7) years and 714 patients (81.2%) were male. According to multivariable analysis, statistically significant association was observed between negative admission BD and both intra-abdominal bleeding (OR 3.48, 95% CI 2.06-5.88, p<0.001) and in-hospital mortality (OR 1.55, 95% CI 1.49-1.63, p<0.001). ROC curve analysis demonstrated sensitivity of 92.7% and specificity of 22.1% for the best cut-off value of BD (-8mEq/L) to diagnose internal hemorrhage. Further, a cut-off value of -7mEq/L demonstrated significant predictive performance, 94.8% sensitivity and 53.6% specificity for in-hospital mortality. This study revealed that arterial BD is an early accessible important marker to identify intra-abdominal bleeding, as well as to predict overall in-hospital mortality in patients with blunt abdominal trauma. Copyright © 2017. Published by Elsevier Inc.

Proteomic Analysis of Serum from Patients with Major Depressive Disorder to Compare Their Depressive and Remission Statuses

PubMed Central

Lee, Jiyeong; Joo, Eun-Jeong; Lim, Hee-Joung; Park, Jong-Moon; Lee, Kyu Young; Park, Arum; Seok, AeEun

2015-01-01

Objective Currently, there are a few biological markers to aid in the diagnosis and treatment of depression. However, it is not sufficient for diagnosis. We attempted to identify differentially expressed proteins during depressive moods as putative diagnostic biomarkers by using quantitative proteomic analysis of serum. Methods Blood samples were collected twice from five patients with major depressive disorder (MDD) at depressive status before treatment and at remission status during treatment. Samples were individually analyzed by liquid chromatography-tandem mass spectrometry for protein profiling. Differentially expressed proteins were analyzed by label-free quantification. Enzyme-linked immunosorbent assay (ELISA) results and receiver-operating characteristic (ROC) curves were used to validate the differentially expressed proteins. For validation, 8 patients with MDD including 3 additional patients and 8 matched normal controls were analyzed. Results The quantitative proteomic studies identified 10 proteins that were consistently upregulated or downregulated in 5 MDD patients. ELISA yielded results consistent with the proteomic analysis for 3 proteins. Expression levels were significantly different between normal controls and MDD patients. The 3 proteins were ceruloplasmin, inter-alpha-trypsin inhibitor heavy chain H4 and complement component 1qC, which were upregulated during the depressive status. The depressive status could be distinguished from the euthymic status from the ROC curves for these proteins, and this discrimination was enhanced when all 3 proteins were analyzed together. Conclusion This is the first proteomic study in MDD patients to compare intra-individual differences dependent on mood. This technique could be a useful approach to identify MDD biomarkers, but requires additional proteomic studies for validation. PMID:25866527

Model-based Bayesian inference for ROC data analysis

NASA Astrophysics Data System (ADS)

Lei, Tianhu; Bae, K. Ty

2013-03-01

This paper presents a study of model-based Bayesian inference to Receiver Operating Characteristics (ROC) data. The model is a simple version of general non-linear regression model. Different from Dorfman model, it uses a probit link function with a covariate variable having zero-one two values to express binormal distributions in a single formula. Model also includes a scale parameter. Bayesian inference is implemented by Markov Chain Monte Carlo (MCMC) method carried out by Bayesian analysis Using Gibbs Sampling (BUGS). Contrast to the classical statistical theory, Bayesian approach considers model parameters as random variables characterized by prior distributions. With substantial amount of simulated samples generated by sampling algorithm, posterior distributions of parameters as well as parameters themselves can be accurately estimated. MCMC-based BUGS adopts Adaptive Rejection Sampling (ARS) protocol which requires the probability density function (pdf) which samples are drawing from be log concave with respect to the targeted parameters. Our study corrects a common misconception and proves that pdf of this regression model is log concave with respect to its scale parameter. Therefore, ARS's requirement is satisfied and a Gaussian prior which is conjugate and possesses many analytic and computational advantages is assigned to the scale parameter. A cohort of 20 simulated data sets and 20 simulations from each data set are used in our study. Output analysis and convergence diagnostics for MCMC method are assessed by CODA package. Models and methods by using continuous Gaussian prior and discrete categorical prior are compared. Intensive simulations and performance measures are given to illustrate our practice in the framework of model-based Bayesian inference using MCMC method.

Application of fractal and grey level co-occurrence matrix analysis in evaluation of brain corpus callosum and cingulum architecture.

PubMed

Pantic, Igor; Dacic, Sanja; Brkic, Predrag; Lavrnja, Irena; Pantic, Senka; Jovanovic, Tomislav; Pekovic, Sanja

2014-10-01

This aim of this study was to assess the discriminatory value of fractal and grey level co-occurrence matrix (GLCM) analysis methods in standard microscopy analysis of two histologically similar brain white mass regions that have different nerve fiber orientation. A total of 160 digital micrographs of thionine-stained rat brain white mass were acquired using a Pro-MicroScan DEM-200 instrument. Eighty micrographs from the anterior corpus callosum and eighty from the anterior cingulum areas of the brain were analyzed. The micrographs were evaluated using the National Institutes of Health ImageJ software and its plugins. For each micrograph, seven parameters were calculated: angular second moment, inverse difference moment, GLCM contrast, GLCM correlation, GLCM variance, fractal dimension, and lacunarity. Using the Receiver operating characteristic analysis, the highest discriminatory value was determined for inverse difference moment (IDM) (area under the receiver operating characteristic (ROC) curve equaled 0.925, and for the criterion IDM≤0.610 the sensitivity and specificity were 82.5 and 87.5%, respectively). Most of the other parameters also showed good sensitivity and specificity. The results indicate that GLCM and fractal analysis methods, when applied together in brain histology analysis, are highly capable of discriminating white mass structures that have different axonal orientation.

The diagnostic efficiency of the extended German Brøset Violence Checklist to assess the risk of violence.

PubMed

Rechenmacher, Josef; Müller, Gerhard; Abderhalden, Christoph; Schulc, Eva

2014-01-01

The prevention of aggression and violence of patients is part of the challenge for the psychiatric inpatient care. Resources needed are a systematic risk assessment and taking preventive measures according to the risk. The extended Brøset Violence Checklist (BVC-CH) is an assessment instrument for the short-term assessment of the risk of violence for physical attacks toward medical staff and other patients. Until now, the instrument was only validated in the context of the development phase of the instrument. The aim of this study was to investigate how valid the BVC-CH scale is for adult psychiatry in acute inpatient care facilities. In a prospective cohort study, 232 consecutively admitted patients were assessed using the BVC-CH. The calculation of the predictive values was based on a contingency table. The discriminatory power of the instrument and the determination of the cutoff point were done using the receiver operating characteristic (ROC) curve analysis. Physical attacks were registered with the Staff Observation of Aggression Scale-Revised (SOAS-R). The sensitivity was 58.8% and the specificity was 96.8% by a cutoff point of > or = 7. By choosing a cutoff point of > or = 6, the sensitivity was 64.7% and the specificity was 95.1%. A value of .93 was determined for the area under the curve receiver operating characteristic (AUC(ROC)). Overall, the BVC-CH is a valid instrument for the short-term prediction of physical attacks. Further research of the BVC-CH is recommended but in particular for the cutoff point.

Landslide susceptibility analysis with logistic regression model based on FCM sampling strategy

NASA Astrophysics Data System (ADS)

Wang, Liang-Jie; Sawada, Kazuhide; Moriguchi, Shuji

2013-08-01

Several mathematical models are used to predict the spatial distribution characteristics of landslides to mitigate damage caused by landslide disasters. Although some studies have achieved excellent results around the world, few studies take the inter-relationship of the selected points (training points) into account. In this paper, we present the Fuzzy c-means (FCM) algorithm as an optimal method for choosing the appropriate input landslide points as training data. Based on different combinations of the Fuzzy exponent (m) and the number of clusters (c), five groups of sampling points were derived from formal seed cells points and applied to analyze the landslide susceptibility in Mizunami City, Gifu Prefecture, Japan. A logistic regression model is applied to create the models of the relationships between landslide-conditioning factors and landslide occurrence. The pre-existing landslide bodies and the area under the relative operative characteristic (ROC) curve were used to evaluate the performance of all the models with different m and c. The results revealed that Model no. 4 (m=1.9, c=4) and Model no. 5 (m=1.9, c=5) have significantly high classification accuracies, i.e., 90.0%. Moreover, over 30% of the landslide bodies were grouped under the very high susceptibility zone. Otherwise, Model no. 4 and Model no. 5 had higher area under the ROC curve (AUC) values, which were 0.78 and 0.79, respectively. Therefore, Model no. 4 and Model no. 5 offer better model results for landslide susceptibility mapping. Maps derived from Model no. 4 and Model no. 5 would offer the local authorities crucial information for city planning and development.

Comparison of radiologist performance with photon-counting full-field digital mammography to conventional full-field digital mammography.

PubMed

Cole, Elodia B; Toledano, Alicia Y; Lundqvist, Mats; Pisano, Etta D

2012-08-01

The purpose of this study was to assess the performance of a MicroDose photon-counting full-field digital mammography (PCM) system in comparison to full-field digital mammography (FFDM) for area under the receiver-operating characteristic (ROC) curve (AUC), sensitivity, specificity, and feature analysis of standard-view mammography for women presenting for screening mammography, diagnostic mammography, or breast biopsy. A total of 133 women were enrolled in this study at two European medical centers, with 67 women who had a pre-existing 10-36 months FFDM enrolled prospectively into the study and 66 women who underwent breast biopsy and had screening PCM and diagnostic FFDM, including standard craniocaudal and mediolateral oblique views of the breast with the lesion, enrolled retrospectively. The case mix consisted of 49 cancers, 17 biopsy-benign cases, and 67 normal cases. Sixteen radiologists participated in the reader study and interpreted all 133 cases in both conditions, separated by washout period of ≥4 weeks. ROC curve and free-response ROC curve analyses were performed for noninferiority of PCM compared to FFDM using a noninferiority margin Δ value of 0.10. Feature analysis of the 66 cases with lesions was conducted with all 16 readers at the conclusion of the blinded reads. Mean glandular dose was recorded for all cases. The AUC for PCM was 0.947 (95% confidence interval [CI], 0.920-0.974) and for FFDM was 0.931 (95% CI, 0.898-0.964). Sensitivity per case for PCM was 0.936 (95% CI, 0.897-0.976) and for FFDM was 0.908 (95% CI, 0.856-0.960). Specificity per case for PCM was 0.764 (95% CI, 0.688-0.841) and for FFDM was 0.749 (95% CI, 0.668-0.830). Free-response ROC curve figures of merit were 0.920 (95% CI, 0.881-0.959) and 0.903 (95% CI, 0.858-0.948) for PCM and FFDM, respectively. Sensitivity per lesion was 0.903 (95% CI, 0.846-0.960) and 0.883 (95% CI, 0.823-0.944) for PCM and FFDM, respectively. The average false-positive marks per image of noncancer cases were 0.265 (95% CI, 0.171-0.359) and 0.281 (95% CI, 0.188-0.374) for PCM and FFDM, respectively. Noninferiority P values for AUC, sensitivity (per case and per lesion), specificity, and average false-positive marks per image were all statistically significant (P < .001). The noninferiority P value for free-response ROC was <.025, from the 95% CI for the difference. Feature analysis resulted in PCM being preferred to FFDM by the readers for ≥70% of the cases. The average mean glandular dose for PCM was 0.74 mGy (95% CI, 0.722-0.759 mGy) and for FFDM was 1.23 mGy (95% CI, 1.199-1.262 mGy). In this study, radiologist performance with PCM was not inferior to that with conventional FFDM at an average 40% lower mean glandular dose. Copyright © 2012 AUR. Published by Elsevier Inc. All rights reserved.

Fast discrimination of hydroxypropyl methyl cellulose using portable Raman spectrometer and multivariate methods

NASA Astrophysics Data System (ADS)

Song, Biao; Lu, Dan; Peng, Ming; Li, Xia; Zou, Ye; Huang, Meizhen; Lu, Feng

2017-02-01

Raman spectroscopy is developed as a fast and non-destructive method for the discrimination and classification of hydroxypropyl methyl cellulose (HPMC) samples. 44 E series and 41 K series of HPMC samples are measured by a self-developed portable Raman spectrometer (Hx-Raman) which is excited by a 785 nm diode laser and the spectrum range is 200-2700 cm-1 with a resolution (FWHM) of 6 cm-1. Multivariate analysis is applied for discrimination of E series from K series. By methods of principal components analysis (PCA) and Fisher discriminant analysis (FDA), a discrimination result with sensitivity of 90.91% and specificity of 95.12% is achieved. The corresponding receiver operating characteristic (ROC) is 0.99, indicting the accuracy of the predictive model. This result demonstrates the prospect of portable Raman spectrometer for rapid, non-destructive classification and discrimination of E series and K series samples of HPMC.

Prediction of BRAF mutation status of craniopharyngioma using magnetic resonance imaging features.

PubMed

Yue, Qi; Yu, Yang; Shi, Zhifeng; Wang, Yongfei; Zhu, Wei; Du, Zunguo; Yao, Zhenwei; Chen, Liang; Mao, Ying

2017-10-06

OBJECTIVE Treatment with a BRAF mutation inhibitor might shrink otherwise refractory craniopharyngiomas and is a promising preoperative treatment to facilitate tumor resection. The aim of this study was to investigate the noninvasive diagnosis of BRAF-mutated craniopharyngiomas based on MRI characteristics. METHODS Fifty-two patients with pathologically diagnosed craniopharyngioma were included in this study. Polymerase chain reaction was performed on tumor tissue specimens to detect BRAF and CTNNB1 mutations. MRI manifestations-including tumor location, size, shape, and composition; signal intensity of cysts; enhancement pattern; pituitary stalk morphology; and encasement of the internal carotid artery-were analyzed by 2 neuroradiologists blinded to patient identity and clinical characteristics, including BRAF mutation status. Results were compared between the BRAF-mutated and wild-type (WT) groups. Characteristics that were significantly more prevalent (p < 0.05) in the BRAF-mutated craniopharyngiomas were defined as diagnostic features. The minimum number of diagnostic features needed to make a diagnosis was determined by analyzing the receiver operating characteristic (ROC) curve. RESULTS Eight of the 52 patients had BRAF-mutated craniopharyngiomas, and the remaining 44 had BRAF WT tumors. The clinical characteristics did not differ significantly between the 2 groups. Interobserver agreement for MRI data analysis was relatively reliable, with values of Cohen κ ranging from 0.65 to 0.97 (p < 0.001). A comparison of findings in the 2 patient groups showed that BRAF-mutated craniopharyngiomas tended to be suprasellar (p < 0.001), spherical (p = 0.005), predominantly solid (p = 0.003), and homogeneously enhancing (p < 0.001), and that patients with these tumors tended to have a thickened pituitary stalk (p = 0.014). When at least 3 of these 5 features were present, a tumor might be identified as BRAF mutated with a sensitivity of 1.00 and a specificity of 0.91. The area under the ROC curve for the sum of all 5 diagnostic criteria was 0.989 (p < 0.001). CONCLUSIONS The BRAF mutation status of craniopharyngiomas might be predicted using certain MRI features with relatively high sensitivity and specificity, thus offering potential guidance for the preoperative administration of BRAF mutation inhibitors.

Diagnostic Utility of the Social Skills Improvement System Performance Screening Guide

ERIC Educational Resources Information Center

Krach, S. Kathleen; McCreery, Michael P.; Wang, Ye; Mohammadiamin, Houra; Cirks, Christen K.

2017-01-01

Researchers investigated the diagnostic utility of the Social Skills Improvement System: Performance Screening Guide (SSIS-PSG). Correlational, regression, receiver operating characteristic (ROC), and conditional probability analyses were run to compare ratings on the SSIS-PSG subscales of Prosocial Behavior, Reading Skills, and Math Skills, to…

Testing a Neurocomputational Model of Recollection, Familiarity, and Source Recognition

ERIC Educational Resources Information Center

Elfman, Kane W.; Parks, Colleen M.; Yonelinas, Andrew P.

2008-01-01

The authors assess whether the complementary learning systems model of the medial temporal lobes (Norman & O'Reilly, 2003) is able to account for source recognition receiver operating characteristics (ROCs). The model assumes that recognition reflects the contribution of a hippocampally mediated recollection process and a cortically mediated…

Recognition Memory: Adding a Response Deadline Eliminates Recollection but Spares Familiarity

ERIC Educational Resources Information Center

Sauvage, Magdalena M.; Beer, Zachery; Eichenbaum, Howard

2010-01-01

A current controversy in memory research concerns whether recognition is supported by distinct processes of familiarity and recollection, or instead by a single process wherein familiarity and recollection reflect weak and strong memories, respectively. Recent studies using receiver operating characteristic (ROC) analyses in an animal model have…

The Variance Reaction Time Model

ERIC Educational Resources Information Center

Sikstrom, Sverker

2004-01-01

The variance reaction time model (VRTM) is proposed to account for various recognition data on reaction time, the mirror effect, receiver-operating-characteristic (ROC) curves, etc. The model is based on simple and plausible assumptions within a neural network: VRTM is a two layer neural network where one layer represents items and one layer…

Development and Testing of a Single Frequency Terahertz Imaging System for Breast Cancer Detection

PubMed Central

St. Peter, Benjamin; Yngvesson, Sigfrid; Siqueira, Paul; Kelly, Patrick; Khan, Ashraf; Glick, Stephen; Karellas, Andrew

2013-01-01

The ability to discern malignant from benign tissue in excised human breast specimens in Breast Conservation Surgery (BCS) was evaluated using single frequency terahertz radiation. Terahertz (THz) images of the specimens in reflection mode were obtained by employing a gas laser source and mechanical scanning. The images were correlated with optical histological micrographs of the same specimens, and a mean discrimination of 73% was found for five out of six samples using Receiver Operating Characteristic (ROC) analysis. The system design and characterization is discussed in detail. The initial results are encouraging but further development of the technology and clinical evaluation is needed to evaluate its feasibility in the clinical environment. PMID:25055306

3D quantitative breast ultrasound analysis for differentiating fibroadenomas and carcinomas smaller than 1cm.

PubMed

Meel-van den Abeelen, A S S; Weijers, G; van Zelst, J C M; Thijssen, J M; Mann, R M; de Korte, C L

2017-03-01

In (3D) ultrasound, accurate discrimination of small solid masses is difficult, resulting in a high frequency of biopsies for benign lesions. In this study, we investigate whether 3D quantitative breast ultrasound (3DQBUS) analysis can be used for improving non-invasive discrimination between benign and malignant lesions. 3D US studies of 112 biopsied solid breast lesions (size <1cm), were included (34 fibroadenomas and 78 invasive ductal carcinomas). The lesions were manually delineated and, based on sonographic criteria used by radiologists, 3 regions of interest were defined in 3D for analysis: ROI (ellipsoid covering the inside of the lesion), PER (peritumoural surrounding: 0.5mm around the lesion), and POS (posterior-tumoural acoustic phenomena: region below the lesion with the same size as delineated for the lesion). After automatic gain correction (AGC), the mean and standard deviation of the echo level within the regions were calculated. For the ROI and POS also the residual attenuation coefficient was estimated in decibel per cm [dB/cm]. The resulting eight features were used for classification of the lesions by a logistic regression analysis. The classification accuracy was evaluated by leave-one-out cross-validation. Receiver operating characteristic (ROC) curves were constructed to assess the performance of the classification. All lesions were delineated by two readers and results were compared to assess the effect of the manual delineation. The area under the ROC curve was 0.86 for both readers. At 100% sensitivity, a specificity of 26% and 50% was achieved for reader 1 and 2, respectively. Inter-reader variability in lesion delineation was marginal and did not affect the accuracy of the technique. The area under the ROC curve of 0.86 was reached for the second reader when the results of the first reader were used as training set yielding a sensitivity of 100% and a specificity of 40%. Consequently, 3DQBUS would have achieved a 40% reduction in biopsies for benign lesions for reader 2, without a decrease in sensitivity. This study shows that 3DQBUS is a promising technique to classify suspicious breast lesions as benign, potentially preventing unnecessary biopsies. Copyright © 2017 Elsevier B.V. All rights reserved.

Validation of the German Diabetes Risk Score among the general adult population: findings from the German Health Interview and Examination Surveys

PubMed Central

Paprott, Rebecca; Mühlenbruch, Kristin; Mensink, Gert B M; Thiele, Silke; Schulze, Matthias B; Scheidt-Nave, Christa; Heidemann, Christin

2016-01-01

Objective To evaluate the German Diabetes Risk Score (GDRS) among the general adult German population for prediction of incident type 2 diabetes and detection of prevalent undiagnosed diabetes. Methods The longitudinal sample for prediction of incident diagnosed type 2 diabetes included 3625 persons who participated both in the examination survey in 1997–1999 and the examination survey in 2008–2011. Incident diagnosed type 2 diabetes was defined as first-time physician diagnosis or antidiabetic medication during 5 years of follow-up excluding potential incident type 1 and gestational diabetes. The cross-sectional sample for detection of prevalent undiagnosed diabetes included 6048 participants without diagnosed diabetes of the examination survey in 2008–2011. Prevalent undiagnosed diabetes was defined as glycated haemoglobin ≥6.5% (48 mmol/mol). We assessed discrimination as area under the receiver operating characteristic curve (ROC-AUC (95% CI)) and calibration through calibration plots. Results In longitudinal analyses, 82 subjects with incident diagnosed type 2 diabetes were identified after 5 years of follow-up. For prediction of incident diagnosed diabetes, the GDRS yielded an ROC-AUC of 0.87 (0.83 to 0.90). Calibration plots indicated excellent prediction for low diabetes risk and overestimation for intermediate and high diabetes risk. When considering the entire follow-up period of 11.9 years (ROC-AUC: 0.84 (0.82 to 0.86)) and including incident undiagnosed diabetes (ROC-AUC: 0.81 (0.78 to 0.84)), discrimination decreased somewhat. A previously simplified paper version of the GDRS yielded a similar predictive ability (ROC-AUC: 0.86 (0.82 to 0.89)). In cross-sectional analyses, 128 subjects with undiagnosed diabetes were identified. For detection of prevalent undiagnosed diabetes, the ROC-AUC was 0.84 (0.81 to 0.86). Again, the simplified version yielded a similar result (ROC-AUC: 0.83 (0.80 to 0.86)). Conclusions The GDRS might be applied for public health monitoring of diabetes risk in the German adult population. Future research needs to evaluate whether the GDRS is useful to improve diabetes risk awareness and prevention among the general population. PMID:27933187

A comparison of logistic regression analysis and an artificial neural network using the BI-RADS lexicon for ultrasonography in conjunction with introbserver variability.

PubMed

Kim, Sun Mi; Han, Heon; Park, Jeong Mi; Choi, Yoon Jung; Yoon, Hoi Soo; Sohn, Jung Hee; Baek, Moon Hee; Kim, Yoon Nam; Chae, Young Moon; June, Jeon Jong; Lee, Jiwon; Jeon, Yong Hwan

2012-10-01

To determine which Breast Imaging Reporting and Data System (BI-RADS) descriptors for ultrasound are predictors for breast cancer using logistic regression (LR) analysis in conjunction with interobserver variability between breast radiologists, and to compare the performance of artificial neural network (ANN) and LR models in differentiation of benign and malignant breast masses. Five breast radiologists retrospectively reviewed 140 breast masses and described each lesion using BI-RADS lexicon and categorized final assessments. Interobserver agreements between the observers were measured by kappa statistics. The radiologists' responses for BI-RADS were pooled. The data were divided randomly into train (n = 70) and test sets (n = 70). Using train set, optimal independent variables were determined by using LR analysis with forward stepwise selection. The LR and ANN models were constructed with the optimal independent variables and the biopsy results as dependent variable. Performances of the models and radiologists were evaluated on the test set using receiver-operating characteristic (ROC) analysis. Among BI-RADS descriptors, margin and boundary were determined as the predictors according to stepwise LR showing moderate interobserver agreement. Area under the ROC curves (AUC) for both of LR and ANN were 0.87 (95% CI, 0.77-0.94). AUCs for the five radiologists ranged 0.79-0.91. There was no significant difference in AUC values among the LR, ANN, and radiologists (p > 0.05). Margin and boundary were found as statistically significant predictors with good interobserver agreement. Use of the LR and ANN showed similar performance to that of the radiologists for differentiation of benign and malignant breast masses.

Switching from subcutaneous insulin injection to oral vildagliptin administration in hemodialysis patients with type 2 diabetes: a pilot study.

PubMed

Yoshida, Naoshi; Babazono, Tetsuya; Hanai, Ko; Uchigata, Yasuko

2016-08-01

We conducted this pilot study to examine efficacy and safety of switching from subcutaneous injection of insulin to oral administration of a DPP-4 inhibitor, vildagliptin, in type 2 diabetic patients undergoing hemodialysis. Consecutive type 2 diabetic patients on hemodialysis who were switched from insulin to vildagliptin between August 2010 and April 2011 were extracted from the hospital database. In patients whose post-switch increase in glycated albumin (GA) levels was <1.5 % without resuming insulin at least 24 weeks, the switch was defined as efficacious. In patients who resumed insulin therapy due to worsening of glycemic control or in patients whose GA levels increased by 1.5 % or more, the switch was considered inefficacious. To predict patients in whom switch to vildagliptin proved efficacious, receiver-operating characteristic (ROC) analysis and logistic regression analysis were performed. A total of 20 patients were extracted; insulin dose was 12 ± 4 units/day; levels of GA and HbA1c was 21.0 ± 3.7 % and 6.5 ± 0.6 %, respectively. Among them, 11 patients were efficaciously switched to vildagliptin. ROC analysis and logistic analysis showed that patients with a shorter duration of diabetes, as well as lower levels of GA and HbA1c, appeared to have a higher likelihood of successful treatment switches. None of the patients developed hypoglycemic symptoms, ketoacidosis, or serious adverse events. In conclusion, efficacious change from insulin to vildagliptin was possible in approximately a half of type 2 diabetic dialysis patients. Long-term follow-up studies including large number of patients are needed to confirm these results.

Lower Quarter Y-Balance Test Scores and Lower Extremity Injury in NCAA Division I Athletes.

PubMed

Lai, Wilson C; Wang, Dean; Chen, James B; Vail, Jeremy; Rugg, Caitlin M; Hame, Sharon L

2017-08-01

Functional movement tests that are predictive of injury risk in National Collegiate Athletic Association (NCAA) athletes are useful tools for sports medicine professionals. The Lower Quarter Y-Balance Test (YBT-LQ) measures single-leg balance and reach distances in 3 directions. To assess whether the YBT-LQ predicts the laterality and risk of sports-related lower extremity (LE) injury in NCAA athletes. Case-control study; Level of evidence, 3. The YBT-LQ was administered to 294 NCAA Division I athletes from 21 sports during preparticipation physical examinations at a single institution. Athletes were followed prospectively over the course of the corresponding season. Correlation analysis was performed between the laterality of reach asymmetry and composite scores (CS) versus the laterality of injury. Receiver operating characteristic (ROC) analysis was used to determine the optimal asymmetry cutoff score for YBT-LQ. A multivariate regression analysis adjusting for sex, sport type, body mass index, and history of prior LE surgery was performed to assess predictors of earlier and higher rates of injury. Neither the laterality of reach asymmetry nor the CS correlated with the laterality of injury. ROC analysis found optimal cutoff scores of 2, 9, and 3 cm for anterior, posteromedial, and posterolateral reach, respectively. All of these potential cutoff scores, along with a cutoff score of 4 cm used in the majority of prior studies, were associated with poor sensitivity and specificity. Furthermore, none of the asymmetric cutoff scores were associated with earlier or increased rate of injury in the multivariate analyses. YBT-LQ scores alone do not predict LE injury in this collegiate athlete population. Sports medicine professionals should be cautioned against using the YBT-LQ alone to screen for injury risk in collegiate athletes.

Quantitative DNA methylation analysis of paired box gene 1 and LIM homeobox transcription factor 1 α genes in cervical cancer

PubMed Central

Xu, Ling; Xu, Jun; Hu, Zheng; Yang, Baohua; Wang, Lifeng; Lin, Xiao; Xia, Ziyin; Zhang, Zhiling; Zhu, Yunheng

2018-01-01

DNA methylation is associated with tumorigenesis and may act as a potential biomarker for detecting cervical cancer. The aim of the present study was to explore the methylation status of the paired box gene 1 (PAX1) and the LIM homeobox transcription factor 1 α (LMX1A) gene in a spectrum of cervical lesions in an Eastern Chinese population. This single-center study involved 121 patients who were divided into normal cervix (NC; n=28), low-grade squamous intraepithelial lesion (LSIL; n=32), high-grade squamous intraepithelial lesion (HSIL; n=34) and cervical squamous cell carcinoma (CSCC; n=27) groups, according to biopsy results. Following extraction and modification of the DNA, quantitative assessment of the PAX1 and LMX1A genes in exfoliated cells was performed using pyrosequencing analysis. Receiver operating characteristic (ROC) curves were generated to calculate the sensitivity and specificity of each parameter and cut-off values of the percentage of methylation reference (PMR) for differentiation diagnosis. Analysis of variance was used to identify differences among groups. The PMR of the two genes was significantly higher in the HSIL and CSCC groups compared with that in the NC and LSIL groups (P<0.001). ROC curve analysis demonstrated that the sensitivity, specificity and accuracy for detection of CSCC were 0.790, 0.837 and 0.809, respectively, using PAX1; and 0.633, 0.357 and 0.893, respectively, using LMX1A. These results indicated that quantitative PAX1 methylation demonstrates potential for cervical cancer screening, while further investigation is required to determine the potential of LMX1A methylation. PMID:29541217

A New Reassigned Spectrogram Method in Interference Detection for GNSS Receivers.

PubMed

Sun, Kewen; Jin, Tian; Yang, Dongkai

2015-09-02

Interference detection is very important for Global Navigation Satellite System (GNSS) receivers. Current work on interference detection in GNSS receivers has mainly focused on time-frequency (TF) analysis techniques, such as spectrogram and Wigner-Ville distribution (WVD), where the spectrogram approach presents the TF resolution trade-off problem, since the analysis window is used, and the WVD method suffers from the very serious cross-term problem, due to its quadratic TF distribution nature. In order to solve the cross-term problem and to preserve good TF resolution in the TF plane at the same time, in this paper, a new TF distribution by using a reassigned spectrogram has been proposed in interference detection for GNSS receivers. This proposed reassigned spectrogram method efficiently combines the elimination of the cross-term provided by the spectrogram itself according to its inherent nature and the improvement of the TF aggregation property achieved by the reassignment method. Moreover, a notch filter has been adopted in interference mitigation for GNSS receivers, where receiver operating characteristics (ROCs) are used as metrics for the characterization of interference mitigation performance. The proposed interference detection method by using a reassigned spectrogram is evaluated by experiments on GPS L1 signals in the disturbing scenarios in comparison to the state-of-the-art TF analysis approaches. The analysis results show that the proposed interference detection technique effectively overcomes the cross-term problem and also keeps good TF localization properties, which has been proven to be valid and effective to enhance the interference Sensors 2015, 15 22168 detection performance; in addition, the adoption of the notch filter in interference mitigation has shown a significant acquisition performance improvement in terms of ROC curves for GNSS receivers in jamming environments.

A New Reassigned Spectrogram Method in Interference Detection for GNSS Receivers

PubMed Central

Sun, Kewen; Jin, Tian; Yang, Dongkai

2015-01-01

Interference detection is very important for Global Navigation Satellite System (GNSS) receivers. Current work on interference detection in GNSS receivers has mainly focused on time-frequency (TF) analysis techniques, such as spectrogram and Wigner–Ville distribution (WVD), where the spectrogram approach presents the TF resolution trade-off problem, since the analysis window is used, and the WVD method suffers from the very serious cross-term problem, due to its quadratic TF distribution nature. In order to solve the cross-term problem and to preserve good TF resolution in the TF plane at the same time, in this paper, a new TF distribution by using a reassigned spectrogram has been proposed in interference detection for GNSS receivers. This proposed reassigned spectrogram method efficiently combines the elimination of the cross-term provided by the spectrogram itself according to its inherent nature and the improvement of the TF aggregation property achieved by the reassignment method. Moreover, a notch filter has been adopted in interference mitigation for GNSS receivers, where receiver operating characteristics (ROCs) are used as metrics for the characterization of interference mitigation performance. The proposed interference detection method by using a reassigned spectrogram is evaluated by experiments on GPS L1 signals in the disturbing scenarios in comparison to the state-of-the-art TF analysis approaches. The analysis results show that the proposed interference detection technique effectively overcomes the cross-term problem and also keeps good TF localization properties, which has been proven to be valid and effective to enhance the interference detection performance; in addition, the adoption of the notch filter in interference mitigation has shown a significant acquisition performance improvement in terms of ROC curves for GNSS receivers in jamming environments. PMID:26364637

Detection of cervical lesions by multivariate analysis of diffuse reflectance spectra: a clinical study.

PubMed

Prabitha, Vasumathi Gopala; Suchetha, Sambasivan; Jayanthi, Jayaraj Lalitha; Baiju, Kamalasanan Vijayakumary; Rema, Prabhakaran; Anuraj, Koyippurath; Mathews, Anita; Sebastian, Paul; Subhash, Narayanan

2016-01-01

Diffuse reflectance (DR) spectroscopy is a non-invasive, real-time, and cost-effective tool for early detection of malignant changes in squamous epithelial tissues. The present study aims to evaluate the diagnostic power of diffuse reflectance spectroscopy for non-invasive discrimination of cervical lesions in vivo. A clinical trial was carried out on 48 sites in 34 patients by recording DR spectra using a point-monitoring device with white light illumination. The acquired data were analyzed and classified using multivariate statistical analysis based on principal component analysis (PCA) and linear discriminant analysis (LDA). Diagnostic accuracies were validated using random number generators. The receiver operating characteristic (ROC) curves were plotted for evaluating the discriminating power of the proposed statistical technique. An algorithm was developed and used to classify non-diseased (normal) from diseased sites (abnormal) with a sensitivity of 72 % and specificity of 87 %. While low-grade squamous intraepithelial lesion (LSIL) could be discriminated from normal with a sensitivity of 56 % and specificity of 80 %, and high-grade squamous intraepithelial lesion (HSIL) from normal with a sensitivity of 89 % and specificity of 97 %, LSIL could be discriminated from HSIL with 100 % sensitivity and specificity. The areas under the ROC curves were 0.993 (95 % confidence interval (CI) 0.0 to 1) and 1 (95 % CI 1) for the discrimination of HSIL from normal and HSIL from LSIL, respectively. The results of the study show that DR spectroscopy could be used along with multivariate analytical techniques as a non-invasive technique to monitor cervical disease status in real time.

Feasibility of histogram analysis of susceptibility-weighted MRI for staging of liver fibrosis

PubMed Central

Yang, Zhao-Xia; Liang, He-Yue; Hu, Xin-Xing; Huang, Ya-Qin; Ding, Ying; Yang, Shan; Zeng, Meng-Su; Rao, Sheng-Xiang

2016-01-01

PURPOSE We aimed to evaluate whether histogram analysis of susceptibility-weighted imaging (SWI) could quantify liver fibrosis grade in patients with chronic liver disease (CLD). METHODS Fifty-three patients with CLD who underwent multi-echo SWI (TEs of 2.5, 5, and 10 ms) were included. Histogram analysis of SWI images were performed and mean, variance, skewness, kurtosis, and the 1st, 10th, 50th, 90th, and 99th percentiles were derived. Quantitative histogram parameters were compared. For significant parameters, further receiver operating characteristic (ROC) analyses were performed to evaluate the potential diagnostic performance for differentiating liver fibrosis stages. RESULTS The number of patients in each pathologic fibrosis grade was 7, 3, 5, 5, and 33 for F0, F1, F2, F3, and F4, respectively. The results of variance (TE: 10 ms), 90th percentile (TE: 10 ms), and 99th percentile (TE: 10 and 5 ms) in F0–F3 group were significantly lower than in F4 group, with areas under the ROC curves (AUCs) of 0.84 for variance and 0.70–0.73 for the 90th and 99th percentiles, respectively. The results of variance (TE: 10 and 5 ms), 99th percentile (TE: 10 ms), and skewness (TE: 2.5 and 5 ms) in F0–F2 group were smaller than those of F3/F4 group, with AUCs of 0.88 and 0.69 for variance (TE: 10 and 5 ms, respectively), 0.68 for 99th percentile (TE: 10 ms), and 0.73 and 0.68 for skewness (TE: 2.5 and 5 ms, respectively). CONCLUSION Magnetic resonance histogram analysis of SWI, particularly the variance, is promising for predicting advanced liver fibrosis and cirrhosis. PMID:27113421

Identifying clinically important difference on the Epworth Sleepiness Scale: results from a narcolepsy clinical trial of JZP-110.

PubMed

Scrima, Lawrence; Emsellem, Helene A; Becker, Philip M; Ruoff, Chad; Lankford, Alan; Bream, Gary; Khayrallah, Moise; Lu, Yuan; Black, Jed

2017-10-01

While scores ≤10 on the Epworth Sleepiness Scale (ESS) are within the normal range, the reduction in elevated ESS score that is clinically meaningful in patients with narcolepsy has not been established. This post hoc analysis of a clinical trial of patients with narcolepsy evaluated correlations between Patient Global Impression of Change (PGI-C) and ESS. Data of adult patients with narcolepsy from a double-blind, 12-week placebo-controlled study of JZP-110, a wake-promoting agent, were used in this analysis. Descriptive statistics and receiver operating characteristic (ROC) analysis compared PGI-C (anchor measure) to percent change from baseline in ESS to establish the responder criterion from patients taking either placebo or JZP-110 (treatments). At week 12, patients (n = 10) who reported being "very much improved" on the PGI-C had a mean 76.7% reduction in ESS score, and patients (n = 33) who reported being "much improved" on the PGI-C had a mean 49.1% reduction in ESS score. ROC analysis showed that patients who improved were almost exclusively from JZP-110 treatment group, with an area-under-the-curve of 0.9, and revealed that a 25% reduction in ESS (sensitivity, 81.4%; specificity, 80.9%) may be an appropriate threshold for defining a meaningful patient response to JZP-110 and placebo. A ≥25% reduction in patients' subjective ESS score may be useful as a threshold to identify patients with narcolepsy who respond to JZP-110 treatment. Copyright © 2017 The Authors. Published by Elsevier B.V. All rights reserved.

Superoxide dismutase: a predicting factor for boar semen characteristics for short-term preservation.

PubMed

Zakošek Pipan, Maja; Mrkun, Janko; Kosec, Marjan; Nemec Svete, Alenka; Zrimšek, Petra

2014-01-01

Superoxide dismutase (SOD), total antioxidant capacity (TAC), and thiobarbituric acid reactive substances (TBARS) in seminal plasma were evaluated on the basis of receiver operating characteristics (ROC) analysis as predictors for distinguishing satisfactory from unsatisfactory boar semen samples after storage. SOD on day 0 correlated significantly with progressive motility (r=-0.686; P<0.05) and viability (r=-0.513; P<0.05) after storage; TBARS correlated only with motility (r=-0.480; P<0.05). Semen samples that, after 3 days of storage, fulfilled all criteria for semen characteristics (viability>85%, motility>70%, progressive motility>25%, and normal morphology>50%) had significantly lower SOD levels on the day 0 than those with at least one criterion not fulfilled (P<0.05) following storage. SOD levels of less than 1.05 U/mL predicted with 87.5% accuracy that fresh semen will suit the requirements for satisfactory semen characteristics after storage, while semen with SOD levels higher than 1.05 U/mL will not fulfill with 100% accuracy at least one semen characteristic after storage. These results support the proposal that SOD in fresh boar semen can be used as a predictor of semen quality after storage.

Potential Role of Circulating MiR-21 in the Diagnosis and Prognosis of Digestive System Cancer: A Systematic Review and Meta-Analysis.

PubMed

Yin, Chengqiang; Zhou, Xiaoying; Dang, Yini; Yan, Jin; Zhang, Guoxin

2015-12-01

Recent evidences indicate that circulating microRNAs (miRNAs) exhibit aberrant expression in the plasma of patients suffering from cancer compared to normal individuals, suggesting that it may be a useful noninvasion diagnostic method. MiR-21 plays crucial roles in carcinogenesis and can be served as a biomarker for the detection of various cancers. Therefore, the aim of this meta-analysis is to assess the potential role of miR-21 for digestive system cancer. By searching the PubMed, Embase, and Web of Science for publications concerning the diagnostic value of miR-21 for digestive system cancer, total of 23 publications were included in this meta-analysis. Receiver operating characteristic curves (ROC) were used to check the overall test performance. For prognostic meta-analysis, pooled hazard ratios (HRs) of circulating miR-21 for survival were calculated. Totally 23 eligible publications were included in this meta-analysis (15 articles for diagnosis and 8 articles for prognosis). For diagnostic meta-analysis, the summary estimates revealed that the pooled sensitivity and specificity were 0.76 (95% CI = 0.70-0.82) and 0.84 (95% CI = 0.78-0.89). Besides, the area under the summary ROC curve (AUC) is 0.87. For prognostic meta-analysis, the pooled HR of higher miR-21 expression in circulation was 1.94 (95% CI = 0.99-3.82, P = 0.055), which indicated higher miR-21 expression could be likely to predict poorer survival in digestive system cancer. The subgroup analysis implied the higher expression of miR-21 was correlated with worse overall survival in the Asian population in digestive system cancer (HR = 2.41, 95% CI = 1.21-4.77, P = 0.012). The current evidence suggests circulating miR-21 may be suitable to be a diagnostic and prognostic biomarker for digestive system cancer in the Asians.

Usefulness of Cellular Analysis of Bronchoalveolar Lavage Fluid for Predicting the Etiology of Pneumonia in Critically Ill Patients

PubMed Central

Hong, Hyo-Lim; Kim, Sung-Han; Huh, Jin Won; Sung, Heungsup; Lee, Sang-Oh; Kim, Mi-Na; Jeong, Jin-Yong; Lim, Chae-Man; Kim, Yang Soo; Woo, Jun Hee; Koh, Younsuck

2014-01-01

Background The usefulness of bronchoalveolar lavage (BAL) fluid cellular analysis in pneumonia has not been adequately evaluated. This study investigated the ability of cellular analysis of BAL fluid to differentially diagnose bacterial pneumonia from viral pneumonia in adult patients who are admitted to intensive care unit. Methods BAL fluid cellular analysis was evaluated in 47 adult patients who underwent bronchoscopic BAL following less than 24 hours of antimicrobial agent exposure. The abilities of BAL fluid total white blood cell (WBC) counts and differential cell counts to differentiate between bacterial and viral pneumonia were evaluated using receiver operating characteristic (ROC) curve analysis. Results Bacterial pneumonia (n = 24) and viral pneumonia (n = 23) were frequently associated with neutrophilic pleocytosis in BAL fluid. BAL fluid median total WBC count (2,815/µL vs. 300/µL, P<0.001) and percentage of neutrophils (80.5% vs. 54.0%, P = 0.02) were significantly higher in the bacterial pneumonia group than in the viral pneumonia group. In ROC curve analysis, BAL fluid total WBC count showed the best discrimination, with an area under the curve of 0.855 (95% CI, 0.750–0.960). BAL fluid total WBC count ≥510/µL had a sensitivity of 83.3%, specificity of 78.3%, positive likelihood ratio (PLR) of 3.83, and negative likelihood ratio (NLR) of 0.21. When analyzed in combination with serum procalcitonin or C-reactive protein, sensitivity was 95.8%, specificity was 95.7%, PLR was 8.63, and NLR was 0.07. BAL fluid total WBC count ≥510/µL was an independent predictor of bacterial pneumonia with an adjusted odds ratio of 13.5 in multiple logistic regression analysis. Conclusions Cellular analysis of BAL fluid can aid early differential diagnosis of bacterial pneumonia from viral pneumonia in critically ill patients. PMID:24824328

Optimal Hemoglobin A1c Levels for Screening of Diabetes and Prediabetes in the Japanese Population.

PubMed

Shimodaira, Masanori; Okaniwa, Shinji; Hanyu, Norinao; Nakayama, Tomohiro

2015-01-01

The aim of this study was to evaluate the utility of hemoglobin A1c (HbA1c) to identify individuals with diabetes and prediabetes in the Japanese population. A total of 1372 individuals without known diabetes were selected for this study. A 75 g oral glucose tolerance test (OGTT) was used to diagnose diabetes and prediabetes. The ability of HbA1c to detect diabetes and prediabetes was investigated using receiver operating characteristic (ROC) analysis. The kappa (κ) coefficient was used to test the agreement between HbA1c categorization and OGTT-based diagnosis. ROC analysis demonstrated that HbA1c was a good test to identify diabetes and prediabetes, with areas under the curve of 0.918 and 0.714, respectively. Optimal HbA1c cutoffs for diagnosing diabetes and prediabetes were 6.0% (sensitivity 83.7%, specificity 87.6%) and 5.7% (sensitivity 60.6%, specificity 72.1%), respectively, although the cutoff for prediabetes showed low accuracy (67.6%) and a high false-negative rate (39.4%). Agreement between HbA1c categorization and OGTT-based diagnosis was low in diabetes (κ = 0.399) and prediabetes (κ = 0.324). In Japanese subjects, the HbA1c cutoff of 6.0% had appropriate sensitivity and specificity for diabetes screening, whereas the cutoff of 5.7% had modest sensitivity and specificity in identifying prediabetes. Thus, HbA1c may be inadequate as a screening tool for prediabetes.

Memorial familiarity remains intact for pictures but not for words in patients with amnestic mild cognitive impairment.

PubMed

Embree, Lindsay M; Budson, Andrew E; Ally, Brandon A

2012-07-01

Understanding how memory breaks down in the earliest stages of Alzheimer's disease (AD) process has significant implications, both clinically and with respect to intervention development. Previous work has highlighted a robust picture superiority effect in patients with amnestic mild cognitive impairment (aMCI). However, it remains unclear as to how pictures improve memory compared to words in this patient population. In the current study, we utilized receiver operating characteristic (ROC) curves to obtain estimates of familiarity and recollection for pictures and words in patients with aMCI and healthy older controls. Analysis of accuracy shows that even when performance is matched between pictures and words in the healthy control group, patients with aMCI continue to show a significant picture superiority effect. The results of the ROC analysis showed that patients demonstrated significantly impaired recollection and familiarity for words compared controls. In contrast, patients with aMCI demonstrated impaired recollection, but intact familiarity for pictures, compared to controls. Based on previous work from our lab, we speculate that patients can utilize the rich conceptual information provided by pictures to enhance familiarity, and perceptual information may allow for post-retrieval monitoring or verification of the enhanced sense of familiarity. Alternatively, the combination of enhanced conceptual and perceptual fluency of the test item might drive a stronger or more robust sense of familiarity that can be accurately attributed to a studied item. Copyright © 2012 Elsevier Ltd. All rights reserved.