Automated determination of wakefulness and sleep in rats based on non-invasively acquired measures of movement and respiratory activity

PubMed Central

Zeng, Tao; Mott, Christopher; Mollicone, Daniel; Sanford, Larry D.

2012-01-01

The current standard for monitoring sleep in rats requires labor intensive surgical procedures and the implantation of chronic electrodes which have the potential to impact behavior and sleep. With the goal of developing a non-invasive method to determine sleep and wakefulness, we constructed a non-contact monitoring system to measure movement and respiratory activity using signals acquired with pulse Doppler radar and from digitized video analysis. A set of 23 frequency and time-domain features were derived from these signals and were calculated in 10 s epochs. Based on these features, a classification method for automated scoring of wakefulness, non-rapid eye movement sleep (NREM) and REM in rats was developed using a support vector machine (SVM). We then assessed the utility of the automated scoring system in discriminating wakefulness and sleep by comparing the results to standard scoring of wakefulness and sleep based on concurrently recorded EEG and EMG. Agreement between SVM automated scoring based on selected features and visual scores based on EEG and EMG were approximately 91% for wakefulness, 84% for NREM and 70% for REM. The results indicate that automated scoring based on non-invasively acquired movement and respiratory activity will be useful for studies requiring discrimination of wakefulness and sleep. However, additional information or signals will be needed to improve discrimination of NREM and REM episodes within sleep. PMID:22178621

Misclassification of OSA severity with automated scoring of home sleep recordings.

PubMed

Aurora, R Nisha; Swartz, Rachel; Punjabi, Naresh M

2015-03-01

The advent of home sleep testing has allowed for the development of an ambulatory care model for OSA that most health-care providers can easily deploy. Although automated algorithms that accompany home sleep monitors can identify and classify disordered breathing events, it is unclear whether manual scoring followed by expert review of home sleep recordings is of any value. Thus, this study examined the agreement between automated and manual scoring of home sleep recordings. Two type 3 monitors (ApneaLink Plus [ResMed] and Embletta [Embla Systems]) were examined in distinct study samples. Data from manual and automated scoring were available for 200 subjects. Two thresholds for oxygen desaturation (≥ 3% and ≥ 4%) were used to define disordered breathing events. Agreement between manual and automated scoring was examined using Pearson correlation coefficients and Bland-Altman analyses. Automated scoring consistently underscored disordered breathing events compared with manual scoring for both sleep monitors irrespective of whether a ≥ 3% or ≥ 4% oxygen desaturation threshold was used to define the apnea-hypopnea index (AHI). For the ApneaLink Plus monitor, Bland-Altman analyses revealed an average AHI difference between manual and automated scoring of 6.1 (95% CI, 4.9-7.3) and 4.6 (95% CI, 3.5-5.6) events/h for the ≥ 3% and ≥ 4% oxygen desaturation thresholds, respectively. Similarly for the Embletta monitor, the average difference between manual and automated scoring was 5.3 (95% CI, 3.2-7.3) and 8.4 (95% CI, 7.2-9.6) events/h, respectively. Although agreement between automated and manual scoring of home sleep recordings varies based on the device used, modest agreement was observed between the two approaches. However, manual review of home sleep test recordings can decrease the misclassification of OSA severity, particularly for those with mild disease. ClinicalTrials.gov; No.: NCT01503164; www.clinicaltrials.gov.

Misclassification of OSA Severity With Automated Scoring of Home Sleep Recordings

PubMed Central

Aurora, R. Nisha; Swartz, Rachel

2015-01-01

BACKGROUND: The advent of home sleep testing has allowed for the development of an ambulatory care model for OSA that most health-care providers can easily deploy. Although automated algorithms that accompany home sleep monitors can identify and classify disordered breathing events, it is unclear whether manual scoring followed by expert review of home sleep recordings is of any value. Thus, this study examined the agreement between automated and manual scoring of home sleep recordings. METHODS: Two type 3 monitors (ApneaLink Plus [ResMed] and Embletta [Embla Systems]) were examined in distinct study samples. Data from manual and automated scoring were available for 200 subjects. Two thresholds for oxygen desaturation (≥ 3% and ≥ 4%) were used to define disordered breathing events. Agreement between manual and automated scoring was examined using Pearson correlation coefficients and Bland-Altman analyses. RESULTS: Automated scoring consistently underscored disordered breathing events compared with manual scoring for both sleep monitors irrespective of whether a ≥ 3% or ≥ 4% oxygen desaturation threshold was used to define the apnea-hypopnea index (AHI). For the ApneaLink Plus monitor, Bland-Altman analyses revealed an average AHI difference between manual and automated scoring of 6.1 (95% CI, 4.9-7.3) and 4.6 (95% CI, 3.5-5.6) events/h for the ≥ 3% and ≥ 4% oxygen desaturation thresholds, respectively. Similarly for the Embletta monitor, the average difference between manual and automated scoring was 5.3 (95% CI, 3.2-7.3) and 8.4 (95% CI, 7.2-9.6) events/h, respectively. CONCLUSIONS: Although agreement between automated and manual scoring of home sleep recordings varies based on the device used, modest agreement was observed between the two approaches. However, manual review of home sleep test recordings can decrease the misclassification of OSA severity, particularly for those with mild disease. TRIAL REGISTRY: ClinicalTrials.gov; No.: NCT01503164; www.clinicaltrials.gov PMID:25411804

Iterative User Interface Design for Automated Sequential Organ Failure Assessment Score Calculator in Sepsis Detection

PubMed Central

Herasevich, Vitaly

2017-01-01

Background The new sepsis definition has increased the need for frequent sequential organ failure assessment (SOFA) score recalculation and the clerical burden of information retrieval makes this score ideal for automated calculation. Objective The aim of this study was to (1) estimate the clerical workload of manual SOFA score calculation through a time-motion analysis and (2) describe a user-centered design process for an electronic medical record (EMR) integrated, automated SOFA score calculator with subsequent usability evaluation study. Methods First, we performed a time-motion analysis by recording time-to-task-completion for the manual calculation of 35 baseline and 35 current SOFA scores by 14 internal medicine residents over a 2-month period. Next, we used an agile development process to create a user interface for a previously developed automated SOFA score calculator. The final user interface usability was evaluated by clinician end users with the Computer Systems Usability Questionnaire. Results The overall mean (standard deviation, SD) time-to-complete manual SOFA score calculation time was 61.6 s (33). Among the 24% (12/50) usability survey respondents, our user-centered user interface design process resulted in >75% favorability of survey items in the domains of system usability, information quality, and interface quality. Conclusions Early stakeholder engagement in our agile design process resulted in a user interface for an automated SOFA score calculator that reduced clinician workload and met clinicians’ needs at the point of care. Emerging interoperable platforms may facilitate dissemination of similarly useful clinical score calculators and decision support algorithms as “apps.” A user-centered design process and usability evaluation should be considered during creation of these tools. PMID:28526675

Iterative User Interface Design for Automated Sequential Organ Failure Assessment Score Calculator in Sepsis Detection.

PubMed

Aakre, Christopher Ansel; Kitson, Jaben E; Li, Man; Herasevich, Vitaly

2017-05-18

The new sepsis definition has increased the need for frequent sequential organ failure assessment (SOFA) score recalculation and the clerical burden of information retrieval makes this score ideal for automated calculation. The aim of this study was to (1) estimate the clerical workload of manual SOFA score calculation through a time-motion analysis and (2) describe a user-centered design process for an electronic medical record (EMR) integrated, automated SOFA score calculator with subsequent usability evaluation study. First, we performed a time-motion analysis by recording time-to-task-completion for the manual calculation of 35 baseline and 35 current SOFA scores by 14 internal medicine residents over a 2-month period. Next, we used an agile development process to create a user interface for a previously developed automated SOFA score calculator. The final user interface usability was evaluated by clinician end users with the Computer Systems Usability Questionnaire. The overall mean (standard deviation, SD) time-to-complete manual SOFA score calculation time was 61.6 s (33). Among the 24% (12/50) usability survey respondents, our user-centered user interface design process resulted in >75% favorability of survey items in the domains of system usability, information quality, and interface quality. Early stakeholder engagement in our agile design process resulted in a user interface for an automated SOFA score calculator that reduced clinician workload and met clinicians' needs at the point of care. Emerging interoperable platforms may facilitate dissemination of similarly useful clinical score calculators and decision support algorithms as "apps." A user-centered design process and usability evaluation should be considered during creation of these tools. ©Christopher Ansel Aakre, Jaben E Kitson, Man Li, Vitaly Herasevich. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 18.05.2017.

Multivariate Generalizability Analysis of Automated Scoring for Short Answer Items of Social Studies in Large-Scale Assessment

ERIC Educational Resources Information Center

Sung, Kyung Hee; Noh, Eun Hee; Chon, Kyong Hee

2017-01-01

With increased use of constructed response items in large scale assessments, the cost of scoring has been a major consideration (Noh et al. in KICE Report RRE 2012-6, 2012; Wainer and Thissen in "Applied Measurement in Education" 6:103-118, 1993). In response to the scoring cost issues, various forms of automated system for scoring…

Automated Grading System for Evaluation of Superficial Punctate Keratitis Associated With Dry Eye.

PubMed

Rodriguez, John D; Lane, Keith J; Ousler, George W; Angjeli, Endri; Smith, Lisa M; Abelson, Mark B

2015-04-01

To develop an automated method of grading fluorescein staining that accurately reproduces the clinical grading system currently in use. From the slit lamp photograph of the fluorescein-stained cornea, the region of interest was selected and punctate dot number calculated using software developed with the OpenCV computer vision library. Images (n = 229) were then divided into six incremental severity categories based on computed scores. The final selection of 54 photographs represented the full range of scores: nine images from each of six categories. These were then evaluated by three investigators using a clinical 0 to 4 corneal staining scale. Pearson correlations were calculated to compare investigator scores, and mean investigator and automated scores. Lin's Concordance Correlation Coefficients (CCC) and Bland-Altman plots were used to assess agreement between methods and between investigators. Pearson's correlation between investigators was 0.914; mean CCC between investigators was 0.882. Bland-Altman analysis indicated that scores assessed by investigator 3 were significantly higher than those of investigators 1 and 2 (paired t-test). The predicted grade was calculated to be: Gpred = 1.48log(Ndots) - 0.206. The two-point Pearson's correlation coefficient between the methods was 0.927 (P < 0.0001). The CCC between predicted automated score Gpred and mean investigator score was 0.929, 95% confidence interval (0.884-0.957). Bland-Altman analysis did not indicate bias. The difference in SD between clinical and automated methods was 0.398. An objective, automated analysis of corneal staining provides a quality assurance tool to be used to substantiate clinical grading of key corneal staining endpoints in multicentered clinical trials of dry eye.

Automated Essay Scoring: Psychometric Guidelines and Practices

ERIC Educational Resources Information Center

Ramineni, Chaitanya; Williamson, David M.

2013-01-01

In this paper, we provide an overview of psychometric procedures and guidelines Educational Testing Service (ETS) uses to evaluate automated essay scoring for operational use. We briefly describe the e-rater system, the procedures and criteria used to evaluate e-rater, implications for a range of potential uses of e-rater, and directions for…

Monitoring the Performance of Human and Automated Scores for Spoken Responses

ERIC Educational Resources Information Center

Wang, Zhen; Zechner, Klaus; Sun, Yu

2018-01-01

As automated scoring systems for spoken responses are increasingly used in language assessments, testing organizations need to analyze their performance, as compared to human raters, across several dimensions, for example, on individual items or based on subgroups of test takers. In addition, there is a need in testing organizations to establish…

Computer-Automated Approach for Scoring Short Essays in an Introductory Statistics Course

ERIC Educational Resources Information Center

Zimmerman, Whitney Alicia; Kang, Hyun Bin; Kim, Kyung; Gao, Mengzhao; Johnson, Glenn; Clariana, Roy; Zhang, Fan

2018-01-01

Over two semesters short essay prompts were developed for use with the Graphical Interface for Knowledge Structure (GIKS), an automated essay scoring system. Participants were students in an undergraduate-level online introductory statistics course. The GIKS compares students' writing samples with an expert's to produce keyword occurrence and…

Automated detection and classification of dice

NASA Astrophysics Data System (ADS)

Correia, Bento A. B.; Silva, Jeronimo A.; Carvalho, Fernando D.; Guilherme, Rui; Rodrigues, Fernando C.; de Silva Ferreira, Antonio M.

1995-03-01

This paper describes a typical machine vision system in an unusual application, the automated visual inspection of a Casino's playing tables. The SORTE computer vision system was developed at INETI under a contract with the Portuguese Gaming Inspection Authorities IGJ. It aims to automate the tasks of detection and classification of the dice's scores on the playing tables of the game `Banca Francesa' (which means French Banking) in Casinos. The system is based on the on-line analysis of the images captured by a monochrome CCD camera placed over the playing tables, in order to extract relevant information concerning the score indicated by the dice. Image processing algorithms for real time automatic throwing detection and dice classification were developed and implemented.

High‐throughput automated scoring of Ki67 in breast cancer tissue microarrays from the Breast Cancer Association Consortium

PubMed Central

Howat, William J; Daley, Frances; Zabaglo, Lila; McDuffus, Leigh‐Anne; Blows, Fiona; Coulson, Penny; Raza Ali, H; Benitez, Javier; Milne, Roger; Brenner, Herman; Stegmaier, Christa; Mannermaa, Arto; Chang‐Claude, Jenny; Rudolph, Anja; Sinn, Peter; Couch, Fergus J; Tollenaar, Rob A.E.M.; Devilee, Peter; Figueroa, Jonine; Sherman, Mark E; Lissowska, Jolanta; Hewitt, Stephen; Eccles, Diana; Hooning, Maartje J; Hollestelle, Antoinette; WM Martens, John; HM van Deurzen, Carolien; Investigators, kConFab; Bolla, Manjeet K; Wang, Qin; Jones, Michael; Schoemaker, Minouk; Broeks, Annegien; van Leeuwen, Flora E; Van't Veer, Laura; Swerdlow, Anthony J; Orr, Nick; Dowsett, Mitch; Easton, Douglas; Schmidt, Marjanka K; Pharoah, Paul D; Garcia‐Closas, Montserrat

2016-01-01

Abstract Automated methods are needed to facilitate high‐throughput and reproducible scoring of Ki67 and other markers in breast cancer tissue microarrays (TMAs) in large‐scale studies. To address this need, we developed an automated protocol for Ki67 scoring and evaluated its performance in studies from the Breast Cancer Association Consortium. We utilized 166 TMAs containing 16,953 tumour cores representing 9,059 breast cancer cases, from 13 studies, with information on other clinical and pathological characteristics. TMAs were stained for Ki67 using standard immunohistochemical procedures, and scanned and digitized using the Ariol system. An automated algorithm was developed for the scoring of Ki67, and scores were compared to computer assisted visual (CAV) scores in a subset of 15 TMAs in a training set. We also assessed the correlation between automated Ki67 scores and other clinical and pathological characteristics. Overall, we observed good discriminatory accuracy (AUC = 85%) and good agreement (kappa = 0.64) between the automated and CAV scoring methods in the training set. The performance of the automated method varied by TMA (kappa range= 0.37–0.87) and study (kappa range = 0.39–0.69). The automated method performed better in satisfactory cores (kappa = 0.68) than suboptimal (kappa = 0.51) cores (p‐value for comparison = 0.005); and among cores with higher total nuclei counted by the machine (4,000–4,500 cells: kappa = 0.78) than those with lower counts (50–500 cells: kappa = 0.41; p‐value = 0.010). Among the 9,059 cases in this study, the correlations between automated Ki67 and clinical and pathological characteristics were found to be in the expected directions. Our findings indicate that automated scoring of Ki67 can be an efficient method to obtain good quality data across large numbers of TMAs from multicentre studies. However, robust algorithm development and rigorous pre‐ and post‐analytical quality control procedures are necessary in order to ensure satisfactory performance. PMID:27499923

Microcomputer Applications for Library Instruction: Automation of Test and Assignment Scoring, and Student Record Keeping.

ERIC Educational Resources Information Center

Sugranes, Maria R.; Snider, Larry C.

1985-01-01

Describes the development of an automated library instruction records management system using microcomputer technology. Development described includes assessment of need, exploration of options, system design, and operational development. System products are identified and operational results are reported based on actual system performance.…

The Nature of Automated Essay Scoring Feedback

ERIC Educational Resources Information Center

Dikli, Semire

2010-01-01

The purpose of this study is to explore the nature of feedback that English as a Second Language (ESL) students received on their writings either from an automated essay scoring (AES) system or from the teacher. The participants were 12 adult ESL students who were attending an intensive English center at a university in Florida. The drafts of the…

Managing What We Can Measure: Quantifying the Susceptibility of Automated Scoring Systems to Gaming Behavior

ERIC Educational Resources Information Center

Higgins, Derrick; Heilman, Michael

2014-01-01

As methods for automated scoring of constructed-response items become more widely adopted in state assessments, and are used in more consequential operational configurations, it is critical that their susceptibility to gaming behavior be investigated and managed. This article provides a review of research relevant to how construct-irrelevant…

Simultaneous automatic scoring and co-registration of hormone receptors in tumor areas in whole slide images of breast cancer tissue slides.

PubMed

Trahearn, Nicholas; Tsang, Yee Wah; Cree, Ian A; Snead, David; Epstein, David; Rajpoot, Nasir

2017-06-01

Automation of downstream analysis may offer many potential benefits to routine histopathology. One area of interest for automation is in the scoring of multiple immunohistochemical markers to predict the patient's response to targeted therapies. Automated serial slide analysis of this kind requires robust registration to identify common tissue regions across sections. We present an automated method for co-localized scoring of Estrogen Receptor and Progesterone Receptor (ER/PR) in breast cancer core biopsies using whole slide images. Regions of tumor in a series of fifty consecutive breast core biopsies were identified by annotation on H&E whole slide images. Sequentially cut immunohistochemical stained sections were scored manually, before being digitally scanned and then exported into JPEG 2000 format. A two-stage registration process was performed to identify the annotated regions of interest in the immunohistochemistry sections, which were then scored using the Allred system. Overall correlation between manual and automated scoring for ER and PR was 0.944 and 0.883, respectively, with 90% of ER and 80% of PR scores within in one point or less of agreement. This proof of principle study indicates slide registration can be used as a basis for automation of the downstream analysis for clinically relevant biomarkers in the majority of cases. The approach is likely to be improved by implantation of safeguarding analysis steps post registration. © 2016 International Society for Advancement of Cytometry. © 2016 International Society for Advancement of Cytometry.

An Evaluation of the IntelliMetric[SM] Essay Scoring System

ERIC Educational Resources Information Center

Rudner, Lawrence M.; Garcia, Veronica; Welch, Catherine

2006-01-01

This report provides a two-part evaluation of the IntelliMetric[SM] automated essay scoring system based on its performance scoring essays from the Analytic Writing Assessment of the Graduate Management Admission Test[TM] (GMAT[TM]). The IntelliMetric system performance is first compared to that of individual human raters, a Bayesian system…

Automated LSA Assessment of Summaries in Distance Education: Some Variables to Be Considered

ERIC Educational Resources Information Center

Jorge-Botana, Guillermo; Luzón, José M.; Gómez-Veiga, Isabel; Martín-Cordero, Jesús I.

2015-01-01

A latent semantic analysis-based automated summary assessment is described; this automated system is applied to a real learning from text task in a Distance Education context. We comment on the use of automated content, plagiarism, text coherence measures, and word weights average and their impact on predicting human judges summary scoring. A…

Evaluating the Validity and Applicability of Automated Essay Scoring in Two Massive Open Online Courses

ERIC Educational Resources Information Center

Reilly, Erin Dawna; Stafford, Rose Eleanore; Williams, Kyle Marie; Corliss, Stephanie Brooks

2014-01-01

The use of massive open online courses (MOOCs) to expand students' access to higher education has raised questions regarding the extent to which this course model can provide and assess authentic, higher level student learning. In response to this need, MOOC platforms have begun utilizing automated essay scoring (AES) systems that allow…

Automated Subscores for TOEFL iBT[R] Independent Essays. Research Report. ETS RR-11-39

ERIC Educational Resources Information Center

Attali, Yigal

2011-01-01

The e-rater[R] automated essay scoring system is used operationally in the scoring of TOEFL iBT[R] independent essays. Previous research has found support for a 3-factor structure of the e-rater features. This 3-factor structure has an attractive hierarchical linguistic interpretation with a word choice factor, a grammatical convention within a…

Automated respiratory sinus arrhythmia measurement: Demonstration using executive function assessment.

PubMed

Hegarty-Craver, Meghan; Gilchrist, Kristin H; Propper, Cathi B; Lewis, Gregory F; DeFilipp, Samuel J; Coffman, Jennifer L; Willoughby, Michael T

2017-08-08

Respiratory sinus arrhythmia (RSA) is a quantitative metric that reflects autonomic nervous system regulation and provides a physiological marker of attentional engagement that supports cognitive and affective regulatory processes. RSA can be added to executive function (EF) assessments with minimal participant burden because of the commercial availability of lightweight, wearable electrocardiogram (ECG) sensors. However, the inclusion of RSA data in large data collection efforts has been hindered by the time-intensive processing of RSA. In this study we evaluated the performance of an automated RSA-scoring method in the context of an EF study in preschool-aged children. The absolute differences in RSA across both scoring methods were small (mean RSA differences = -0.02-0.10), with little to no evidence of bias for the automated relative to the hand-scoring approach. Moreover, the relative rank-ordering of RSA across both scoring methods was strong (rs = .96-.99). Reliable changes in RSA from baseline to the EF task were highly similar across both scoring methods (96%-100% absolute agreement; Kappa = .83-1.0). On the basis of these findings, the automated RSA algorithm appears to be a suitable substitute for hand-scoring in the context of EF assessment.

Manual versus Automated Rodent Behavioral Assessment: Comparing Efficacy and Ease of Bederson and Garcia Neurological Deficit Scores to an Open Field Video-Tracking System.

PubMed

Desland, Fiona A; Afzal, Aqeela; Warraich, Zuha; Mocco, J

2014-01-01

Animal models of stroke have been crucial in advancing our understanding of the pathophysiology of cerebral ischemia. Currently, the standards for determining neurological deficit in rodents are the Bederson and Garcia scales, manual assessments scoring animals based on parameters ranked on a narrow scale of severity. Automated open field analysis of a live-video tracking system that analyzes animal behavior may provide a more sensitive test. Results obtained from the manual Bederson and Garcia scales did not show significant differences between pre- and post-stroke animals in a small cohort. When using the same cohort, however, post-stroke data obtained from automated open field analysis showed significant differences in several parameters. Furthermore, large cohort analysis also demonstrated increased sensitivity with automated open field analysis versus the Bederson and Garcia scales. These early data indicate use of automated open field analysis software may provide a more sensitive assessment when compared to traditional Bederson and Garcia scales.

Recommendations, evaluation and validation of a semi-automated, fluorescent-based scoring protocol for micronucleus testing in human cells.

PubMed

Seager, Anna L; Shah, Ume-Kulsoom; Brüsehafer, Katja; Wills, John; Manshian, Bella; Chapman, Katherine E; Thomas, Adam D; Scott, Andrew D; Doherty, Ann T; Doak, Shareen H; Johnson, George E; Jenkins, Gareth J S

2014-05-01

Micronucleus (MN) induction is an established cytogenetic end point for evaluating structural and numerical chromosomal alterations in genotoxicity testing. A semi-automated scoring protocol for the assessment of MN preparations from human cell lines and a 3D skin cell model has been developed and validated. Following exposure to a range of test agents, slides were stained with 4'-6-diamidino-2-phenylindole (DAPI) and scanned by use of the MicroNuc module of metafer 4, after the development of a modified classifier for selecting MN in binucleate cells. A common difficulty observed with automated systems is an artefactual output of high false positives, in the case of the metafer system this is mainly due to the loss of cytoplasmic boundaries during slide preparation. Slide quality is paramount to obtain accurate results. We show here that to avoid elevated artefactual-positive MN outputs, diffuse cell density and low-intensity nuclear staining are critical. Comparisons between visual (Giemsa stained) and automated (DAPI stained) MN frequencies and dose-response curves were highly correlated (R (2) = 0.70 for hydrogen peroxide, R (2) = 0.98 for menadione, R (2) = 0.99 for mitomycin C, R (2) = 0.89 for potassium bromate and R (2) = 0.68 for quantum dots), indicating the system is adequate to produce biologically relevant and reliable results. Metafer offers many advantages over conventional scoring including increased output and statistical power, and reduced scoring subjectivity, labour and costs. Further, the metafer system is easily adaptable for use with a range of different cells, both suspension and adherent human cell lines. Awareness of the points raised here reduces the automatic positive errors flagged and drastically reduces slide scoring time, making metafer an ideal candidate for genotoxic biomonitoring and population studies and regulatory genotoxic testing.

A Framework for Evaluation and Use of Automated Scoring

ERIC Educational Resources Information Center

Williamson, David M.; Xi, Xiaoming; Breyer, F. Jay

2012-01-01

A framework for evaluation and use of automated scoring of constructed-response tasks is provided that entails both evaluation of automated scoring as well as guidelines for implementation and maintenance in the context of constantly evolving technologies. Consideration of validity issues and challenges associated with automated scoring are…

Automated scoring system of standard uptake value for torso FDG-PET images

NASA Astrophysics Data System (ADS)

Hara, Takeshi; Kobayashi, Tatsunori; Kawai, Kazunao; Zhou, Xiangrong; Itoh, Satoshi; Katafuchi, Tetsuro; Fujita, Hiroshi

2008-03-01

The purpose of this work was to develop an automated method to calculate the score of SUV for torso region on FDG-PET scans. The three dimensional distributions for the mean and the standard deviation values of SUV were stored in each volume to score the SUV in corresponding pixel position within unknown scans. The modeling methods is based on SPM approach using correction technique of Euler characteristic and Resel (Resolution element). We employed 197 nor-mal cases (male: 143, female: 54) to assemble the normal metabolism distribution of FDG. The physique were registered each other in a rectangular parallelepiped shape using affine transformation and Thin-Plate-Spline technique. The regions of the three organs were determined based on semi-automated procedure. Seventy-three abnormal spots were used to estimate the effectiveness of the scoring methods. As a result, the score images correctly represented that the scores for normal cases were between zeros to plus/minus 2 SD. Most of the scores of abnormal spots associated with cancer were lager than the upper of the SUV interval of normal organs.

Taking Advantage of Automated Assessment of Student-Constructed Graphs in Science

ERIC Educational Resources Information Center

Vitale, Jonathan M.; Lai, Kevin; Linn, Marcia C.

2015-01-01

We present a new system for automated scoring of graph construction items that address complex science concepts, feature qualitative prompts, and support a range of possible solutions. This system utilizes analysis of spatial features (e.g., slope of a line) to evaluate potential student ideas represented within graphs. Student ideas are then…

Statistically Comparing the Performance of Multiple Automated Raters across Multiple Items

ERIC Educational Resources Information Center

Kieftenbeld, Vincent; Boyer, Michelle

2017-01-01

Automated scoring systems are typically evaluated by comparing the performance of a single automated rater item-by-item to human raters. This presents a challenge when the performance of multiple raters needs to be compared across multiple items. Rankings could depend on specifics of the ranking procedure; observed differences could be due to…

An Investigation of the "e-rater"® Automated Scoring Engine's Grammar, Usage, Mechanics, and Style Microfeatures and Their Aggregation Model. Research Report. ETS RR-17-04

ERIC Educational Resources Information Center

Chen, Jing; Zhang, Mo; Bejar, Isaac I.

2017-01-01

Automated essay scoring (AES) generally computes essay scores as a function of macrofeatures derived from a set of microfeatures extracted from the text using natural language processing (NLP). In the "e-rater"® automated scoring engine, developed at "Educational Testing Service" (ETS) for the automated scoring of essays, each…

Automated Scoring of L2 Spoken English with Random Forests

ERIC Educational Resources Information Center

Kobayashi, Yuichiro; Abe, Mariko

2016-01-01

The purpose of the present study is to assess second language (L2) spoken English using automated scoring techniques. Automated scoring aims to classify a large set of learners' oral performance data into a small number of discrete oral proficiency levels. In automated scoring, objectively measurable features such as the frequencies of lexical and…

Statistical analysis to assess automated level of suspicion scoring methods in breast ultrasound

NASA Astrophysics Data System (ADS)

Galperin, Michael

2003-05-01

A well-defined rule-based system has been developed for scoring 0-5 the Level of Suspicion (LOS) based on qualitative lexicon describing the ultrasound appearance of breast lesion. The purposes of the research are to asses and select one of the automated LOS scoring quantitative methods developed during preliminary studies in benign biopsies reduction. The study has used Computer Aided Imaging System (CAIS) to improve the uniformity and accuracy of applying the LOS scheme by automatically detecting, analyzing and comparing breast masses. The overall goal is to reduce biopsies on the masses with lower levels of suspicion, rather that increasing the accuracy of diagnosis of cancers (will require biopsy anyway). On complex cysts and fibroadenoma cases experienced radiologists were up to 50% less certain in true negatives than CAIS. Full correlation analysis was applied to determine which of the proposed LOS quantification methods serves CAIS accuracy the best. This paper presents current results of applying statistical analysis for automated LOS scoring quantification for breast masses with known biopsy results. It was found that First Order Ranking method yielded most the accurate results. The CAIS system (Image Companion, Data Companion software) is developed by Almen Laboratories and was used to achieve the results.

The Impact of Sampling Approach on Population Invariance in Automated Scoring of Essays. Research Report. ETS RR-13-18

ERIC Educational Resources Information Center

Zhang, Mo

2013-01-01

Many testing programs use automated scoring to grade essays. One issue in automated essay scoring that has not been examined adequately is population invariance and its causes. The primary purpose of this study was to investigate the impact of sampling in model calibration on population invariance of automated scores. This study analyzed scores…

Automated outcome scoring in a virtual reality simulator for endodontic surgery.

PubMed

Yin, Myat Su; Haddawy, Peter; Suebnukarn, Siriwan; Rhienmora, Phattanapon

2018-01-01

We address the problem of automated outcome assessment in a virtual reality (VR) simulator for endodontic surgery. Outcome assessment is an essential component of any system that provides formative feedback, which requires assessing the outcome, relating it to the procedure, and communicating in a language natural to dental students. This study takes a first step toward automated generation of such comprehensive feedback. Virtual reference templates are computed based on tooth anatomy and the outcome is assessed with a 3D score cube volume which consists of voxel-level non-linear weighted scores based on the templates. The detailed scores are transformed into standard scoring language used by dental schools. The system was evaluated on fifteen outcome samples that contained optimal results and those with errors including perforation of the walls, floor, and both, as well as various combinations of major and minor over and under drilling errors. Five endodontists who had professional training and varying levels of experiences in root canal treatment participated as raters in the experiment. Results from evaluation of our system with expert endodontists show a high degree of agreement with expert scores (information based measure of disagreement 0.04-0.21). At the same time they show some disagreement among human expert scores, reflecting the subjective nature of human outcome scoring. The discriminatory power of the AOS scores analyzed with three grade tiers (A, B, C) using the area under the receiver operating characteristic curve (AUC). The AUC values are generally highest for the {AB: C} cutoff which is cutoff at the boundary between clinically acceptable (B) and clinically unacceptable (C) grades. The objective consistency of computed scores and high degree of agreement with experts make the proposed system a promising addition to existing VR simulators. The translation of detailed level scores into terminology commonly used in dental surgery supports natural communication with students and instructors. With the reference virtual templates created automatically, the approach is robust and is applicable in scoring the outcome of any dental surgery procedure involving the act of drilling. Copyright © 2017 Elsevier B.V. All rights reserved.

Facilities Engineering Management System Study. Volume 1. An Automation Survey of Army Installation Directorates of Engineering and Housing

DTIC Science & Technology

1988-05-01

C and Task Reference List 42 APPENDIX C: FE Tasks, Rating Scores , and ID Codes for Forms A and B 54 APPENDIX D: Nonstandard ADP Systems From Form B...DISTRIBUTION 4a "U p o:.U TABLES Number Page 1 Questionnaire Distribution and Response Rate 12 2 Mean Rating Scores for Standard System 13 3 Frequency of...Standard System Use 14 4 Use of System by Division: Standard Systems 16 5 Mean Rating Scores for Nonstandard Systems 22 6 Frequency of Nonstandard

Validation of Automated Scoring of Science Assessments

ERIC Educational Resources Information Center

Liu, Ou Lydia; Rios, Joseph A.; Heilman, Michael; Gerard, Libby; Linn, Marcia C.

2016-01-01

Constructed response items can both measure the coherence of student ideas and serve as reflective experiences to strengthen instruction. We report on new automated scoring technologies that can reduce the cost and complexity of scoring constructed-response items. This study explored the accuracy of c-rater-ML, an automated scoring engine…

Kohonen Self-Organizing Maps in Validity Maintenance for Automated Scoring of Constructed Response.

ERIC Educational Resources Information Center

Williamson, David M.; Bejar, Isaac I.

As the automated scoring of constructed responses reaches operational status, monitoring the scoring process becomes a primary concern, particularly if automated scoring is intended to operate completely unassisted by humans. Using actual candidate selections from the Architectural Registration Examination (n=326), this study uses Kohonen…

Beyond Essay Length: Evaluating e-rater[R]'s Performance on TOEFL[R] Essays. Research Reports. Report 73. RR-04-04

ERIC Educational Resources Information Center

Chodorow, Martin; Burstein, Jill

2004-01-01

This study examines the relation between essay length and holistic scores assigned to Test of English as a Foreign Language[TM] (TOEFL[R]) essays by e-rater[R], the automated essay scoring system developed by ETS. Results show that an early version of the system, e-rater99, accounted for little variance in human reader scores beyond that which…

Classification Trees for Quality Control Processes in Automated Constructed Response Scoring.

ERIC Educational Resources Information Center

Williamson, David M.; Hone, Anne S.; Miller, Susan; Bejar, Isaac I.

As the automated scoring of constructed responses reaches operational status, the issue of monitoring the scoring process becomes a primary concern, particularly when the goal is to have automated scoring operate completely unassisted by humans. Using a vignette from the Architectural Registration Examination and data for 326 cases with both human…

Evaluation of an automated karyotyping system for chromosome aberration analysis

NASA Technical Reports Server (NTRS)

Prichard, Howard M.

1987-01-01

Chromosome aberration analysis is a promising complement to conventional radiation dosimetry, particularly in the complex radiation fields encountered in the space environment. The capabilities of a recently developed automated karyotyping system were evaluated both to determine current capabilities and limitations and to suggest areas where future development should be emphasized. Cells exposed to radiometric chemicals and to photon and particulate radiation were evaluated by manual inspection and by automated karyotyping. It was demonstrated that the evaluated programs were appropriate for image digitization, storage, and transmission. However, automated and semi-automated scoring techniques must be advanced significantly if in-flight chromosome aberration analysis is to be practical. A degree of artificial intelligence may be necessary to realize this goal.

Validation of Automated Scoring of Oral Reading

ERIC Educational Resources Information Center

Balogh, Jennifer; Bernstein, Jared; Cheng, Jian; Van Moere, Alistair; Townshend, Brent; Suzuki, Masanori

2012-01-01

A two-part experiment is presented that validates a new measurement tool for scoring oral reading ability. Data collected by the U.S. government in a large-scale literacy assessment of adults were analyzed by a system called VersaReader that uses automatic speech recognition and speech processing technologies to score oral reading fluency. In the…

Protein Crystal Growth

NASA Technical Reports Server (NTRS)

2003-01-01

In order to rapidly and efficiently grow crystals, tools were needed to automatically identify and analyze the growing process of protein crystals. To meet this need, Diversified Scientific, Inc. (DSI), with the support of a Small Business Innovation Research (SBIR) contract from NASA s Marshall Space Flight Center, developed CrystalScore(trademark), the first automated image acquisition, analysis, and archiving system designed specifically for the macromolecular crystal growing community. It offers automated hardware control, image and data archiving, image processing, a searchable database, and surface plotting of experimental data. CrystalScore is currently being used by numerous pharmaceutical companies and academic and nonprofit research centers. DSI, located in Birmingham, Alabama, was awarded the patent Method for acquiring, storing, and analyzing crystal images on March 4, 2003. Another DSI product made possible by Marshall SBIR funding is VaporPro(trademark), a unique, comprehensive system that allows for the automated control of vapor diffusion for crystallization experiments.

A Validity-Based Approach to Quality Control and Assurance of Automated Scoring

ERIC Educational Resources Information Center

Bejar, Isaac I.

2011-01-01

Automated scoring of constructed responses is already operational in several testing programmes. However, as the methodology matures and the demand for the utilisation of constructed responses increases, the volume of automated scoring is likely to increase at a fast pace. Quality assurance and control of the scoring process will likely be more…

The Application of the Cumulative Logistic Regression Model to Automated Essay Scoring

ERIC Educational Resources Information Center

Haberman, Shelby J.; Sinharay, Sandip

2010-01-01

Most automated essay scoring programs use a linear regression model to predict an essay score from several essay features. This article applied a cumulative logit model instead of the linear regression model to automated essay scoring. Comparison of the performances of the linear regression model and the cumulative logit model was performed on a…

The Automated Assessment of Postural Stability: Balance Detection Algorithm.

PubMed

Napoli, Alessandro; Glass, Stephen M; Tucker, Carole; Obeid, Iyad

2017-12-01

Impaired balance is a common indicator of mild traumatic brain injury, concussion and musculoskeletal injury. Given the clinical relevance of such injuries, especially in military settings, it is paramount to develop more accurate and reliable on-field evaluation tools. This work presents the design and implementation of the automated assessment of postural stability (AAPS) system, for on-field evaluations following concussion. The AAPS is a computer system, based on inexpensive off-the-shelf components and custom software, that aims to automatically and reliably evaluate balance deficits, by replicating a known on-field clinical test, namely, the Balance Error Scoring System (BESS). The AAPS main innovation is its balance error detection algorithm that has been designed to acquire data from a Microsoft Kinect ® sensor and convert them into clinically-relevant BESS scores, using the same detection criteria defined by the original BESS test. In order to assess the AAPS balance evaluation capability, a total of 15 healthy subjects (7 male, 8 female) were required to perform the BESS test, while simultaneously being tracked by a Kinect 2.0 sensor and a professional-grade motion capture system (Qualisys AB, Gothenburg, Sweden). High definition videos with BESS trials were scored off-line by three experienced observers for reference scores. AAPS performance was assessed by comparing the AAPS automated scores to those derived by three experienced observers. Our results show that the AAPS error detection algorithm presented here can accurately and precisely detect balance deficits with performance levels that are comparable to those of experienced medical personnel. Specifically, agreement levels between the AAPS algorithm and the human average BESS scores ranging between 87.9% (single-leg on foam) and 99.8% (double-leg on firm ground) were detected. Moreover, statistically significant differences in balance scores were not detected by an ANOVA test with alpha equal to 0.05. Despite some level of disagreement between human and AAPS-generated scores, the use of an automated system yields important advantages over currently available human-based alternatives. These results underscore the value of using the AAPS, that can be quickly deployed in the field and/or in outdoor settings with minimal set-up time. Finally, the AAPS can record multiple error types and their time course with extremely high temporal resolution. These features are not achievable by humans, who cannot keep track of multiple balance errors with such a high resolution. Together, these results suggest that computerized BESS calculation may provide more accurate and consistent measures of balance than those derived from human experts.

AN INTERACTIVE INQUIRER.

ERIC Educational Resources Information Center

STONE, PHILIP J.

AUTOMATED LANGUAGE PROCESSING (CONTENT ANALYSIS) IS ENGAGED IN NEW VENTURES IN COMPUTER DIALOG AS A RESULT OF NEW TECHNIQUES IN CATEGORIZING RESPONSES. A COMPUTER "NEED-ACHIEVEMENT" SCORING SYSTEM HAS BEEN DEVELOPED. A SET OF COMPUTER PROGRAMS, LABELED "THE GENERAL INQUIRER," WILL SCORE COMPUTER INPUTS WITH RESPONSES FED FROM…

Increasing Perioperative Communication With Automated Mobile Phone Messaging in Total Joint Arthroplasty.

PubMed

Day, Molly A; Anthony, Christopher A; Bedard, Nicholas A; Glass, Natalie A; Clark, Charles R; Callaghan, John J; Noiseux, Nicolas O

2018-01-01

Automated mobile phone messaging has not been reported in total joint arthroplasty (TJA). Our purpose was to compare Press Ganey (PG) and Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) scores between TJA patients who did and did not receive perioperative automated mobile phone messages. Patients were prospectively enrolled and received messages for 1 week prior until 2 weeks after TJA. Message content included reminders, activity, and pain control. Patients answered select PG/HCAHPS and questions regarding their experience with the automated communication platform. Average PG/HCAHPS scores were compared to historical TJA patients in the 3-year window prior (control group) with significance P < .05. Thirty-seven consecutive patients were approached and 92% (n = 34) were enrolled. The experimental group was 47% male, with 80% patients between 51 and 75 years. The experimental (n = 30) and control groups (n = 26) were similar. Patients receiving messages were more likely to have a good understanding of health responsibilities (P = .024) and feel that the care team demonstrated shared decision-making (P = .024). Of patients enrolled, 87% felt messages helped them be more prepared for surgery, 100% felt messages kept them better informed, and 97% would participate again. TJA patients who received perioperative communication via automated mobile phone messaging had improved patient satisfaction scores postoperatively. Patients perceived this form of communication was useful and kept them better informed. Automated mobile phone messaging can be an easily integrated, helpful adjunct to surgeons, healthcare systems, and case managers to more effectively communicate with patients undergoing TJA in this era of value-based care. Copyright © 2017 Elsevier Inc. All rights reserved.

Comparison of Automated Scoring Methods for a Computerized Performance Assessment of Clinical Judgment

ERIC Educational Resources Information Center

Harik, Polina; Baldwin, Peter; Clauser, Brian

2013-01-01

Growing reliance on complex constructed response items has generated considerable interest in automated scoring solutions. Many of these solutions are described in the literature; however, relatively few studies have been published that "compare" automated scoring strategies. Here, comparisons are made among five strategies for…

Investigating the impact of automated feedback on students' scientific argumentation

NASA Astrophysics Data System (ADS)

Zhu, Mengxiao; Lee, Hee-Sun; Wang, Ting; Liu, Ou Lydia; Belur, Vinetha; Pallant, Amy

2017-08-01

This study investigates the role of automated scoring and feedback in supporting students' construction of written scientific arguments while learning about factors that affect climate change in the classroom. The automated scoring and feedback technology was integrated into an online module. Students' written scientific argumentation occurred when they responded to structured argumentation prompts. After submitting the open-ended responses, students received scores generated by a scoring engine and written feedback associated with the scores in real-time. Using the log data that recorded argumentation scores as well as argument submission and revisions activities, we answer three research questions. First, how students behaved after receiving the feedback; second, whether and how students' revisions improved their argumentation scores; and third, did item difficulties shift with the availability of the automated feedback. Results showed that the majority of students (77%) made revisions after receiving the feedback, and students with higher initial scores were more likely to revise their responses. Students who revised had significantly higher final scores than those who did not, and each revision was associated with an average increase of 0.55 on the final scores. Analysis on item difficulty shifts showed that written scientific argumentation became easier after students used the automated feedback.

TOEFL iBT Speaking Test Scores as Indicators of Oral Communicative Language Proficiency

ERIC Educational Resources Information Center

Bridgeman, Brent; Powers, Donald; Stone, Elizabeth; Mollaun, Pamela

2012-01-01

Scores assigned by trained raters and by an automated scoring system (SpeechRater[TM]) on the speaking section of the TOEFL iBT[TM] were validated against a communicative competence criterion. Specifically, a sample of 555 undergraduate students listened to speech samples from 184 examinees who took the Test of English as a Foreign Language…

Automated Assessment of Non-Native Learner Essays: Investigating the Role of Linguistic Features

ERIC Educational Resources Information Center

Vajjala, Sowmya

2018-01-01

Automatic essay scoring (AES) refers to the process of scoring free text responses to given prompts, considering human grader scores as the gold standard. Writing such essays is an essential component of many language and aptitude exams. Hence, AES became an active and established area of research, and there are many proprietary systems used in…

Multichannel Convolutional Neural Network for Biological Relation Extraction.

PubMed

Quan, Chanqin; Hua, Lei; Sun, Xiao; Bai, Wenjun

2016-01-01

The plethora of biomedical relations which are embedded in medical logs (records) demands researchers' attention. Previous theoretical and practical focuses were restricted on traditional machine learning techniques. However, these methods are susceptible to the issues of "vocabulary gap" and data sparseness and the unattainable automation process in feature extraction. To address aforementioned issues, in this work, we propose a multichannel convolutional neural network (MCCNN) for automated biomedical relation extraction. The proposed model has the following two contributions: (1) it enables the fusion of multiple (e.g., five) versions in word embeddings; (2) the need for manual feature engineering can be obviated by automated feature learning with convolutional neural network (CNN). We evaluated our model on two biomedical relation extraction tasks: drug-drug interaction (DDI) extraction and protein-protein interaction (PPI) extraction. For DDI task, our system achieved an overall f -score of 70.2% compared to the standard linear SVM based system (e.g., 67.0%) on DDIExtraction 2013 challenge dataset. And for PPI task, we evaluated our system on Aimed and BioInfer PPI corpus; our system exceeded the state-of-art ensemble SVM system by 2.7% and 5.6% on f -scores.

Examination of Automation-Induced Complacency and Individual Difference Variates

NASA Technical Reports Server (NTRS)

Prinzel, Lawrence J., III; DeVries, Holly; Freeman, Fred G.; Mikulka, Peter

2001-01-01

Automation-induced complacency has been documented as a cause or contributing factor in many airplane accidents throughout the last two decades. It is surmised that the condition results when a crew is working in highly reliable automated environments in which they serve as supervisory controllers monitoring system states for occasional automation failures. Although many reports have discussed the dangers of complacency, little empirical research has been produced to substantiate its harmful effects on performance as well as what factors produce complacency. There have been some suggestions, however, that individual characteristics could serve as possible predictors of performance in automated systems. The present study examined relationship between the individual differences of complacency potential, boredom proneness, and cognitive failure, automation-induced complacency. Workload and boredom scores were also collected and analyzed in relation to the three individual differences. The results of the study demonstrated that there are personality individual differences that are related to whether an individual will succumb to automation-induced complacency. Theoretical and practical implications are discussed.

75 FR 60478 - In the Matter of Certain Machine Vision Software, Machine Vision Systems, and Products Containing...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-09-30

... Automation, Inc. (``Amistar'') of San Marcos, California; Techno Soft Systemnics, Inc. (``Techno Soft'') of... the claim terms ``test,'' ``match score surface,'' and ``gradient direction,'' all of his infringement... complainants' proposed construction for the claim terms ``test,'' ``match score surface,'' and ``gradient...

The Impact of Rater Variability on Relationships among Different Effect-Size Indices for Inter-Rater Agreement between Human and Automated Essay Scoring

ERIC Educational Resources Information Center

Yun, Jiyeo

2017-01-01

Since researchers investigated automatic scoring systems in writing assessments, they have dealt with relationships between human and machine scoring, and then have suggested evaluation criteria for inter-rater agreement. The main purpose of my study is to investigate the magnitudes of and relationships among indices for inter-rater agreement used…

Automated Essay Scoring versus Human Scoring: A Comparative Study

ERIC Educational Resources Information Center

Wang, Jinhao; Brown, Michelle Stallone

2007-01-01

The current research was conducted to investigate the validity of automated essay scoring (AES) by comparing group mean scores assigned by an AES tool, IntelliMetric [TM] and human raters. Data collection included administering the Texas version of the WriterPlacer "Plus" test and obtaining scores assigned by IntelliMetric [TM] and by…

Assessing Text-Based Writing of Low-Skilled College Students

ERIC Educational Resources Information Center

Perin, Dolores; Lauterbach, Mark

2018-01-01

The problem of poor writing skills at the postsecondary level is a large and troubling one. This study investigated the writing skills of low-skilled adults attending college developmental education courses by determining whether variables from an automated scoring system were predictive of human scores on writing quality rubrics. The human-scored…

Use of Automated Scoring in Spoken Language Assessments for Test Takers with Speech Impairments. Research Report. ETS RR-17-42

ERIC Educational Resources Information Center

Loukina, Anastassia; Buzick, Heather

2017-01-01

This study is an evaluation of the performance of automated speech scoring for speakers with documented or suspected speech impairments. Given that the use of automated scoring of open-ended spoken responses is relatively nascent and there is little research to date that includes test takers with disabilities, this small exploratory study focuses…

Automated Measurement of Visual Acuity in Pediatric Ophthalmic Patients Using Principles of Game Design and Tablet Computers.

PubMed

Aslam, Tariq M; Tahir, Humza J; Parry, Neil R A; Murray, Ian J; Kwak, Kun; Heyes, Richard; Salleh, Mahani M; Czanner, Gabriela; Ashworth, Jane

2016-10-01

To report on the utility of a computer tablet-based method for automated testing of visual acuity in children based on the principles of game design. We describe the testing procedure and present repeatability as well as agreement of the score with accepted visual acuity measures. Reliability and validity study. Setting: Manchester Royal Eye Hospital Pediatric Ophthalmology Outpatients Department. Total of 112 sequentially recruited patients. For each patient 1 eye was tested with the Mobile Assessment of Vision by intERactIve Computer for Children (MAVERIC-C) system, consisting of a software application running on a computer tablet, housed in a bespoke viewing chamber. The application elicited touch screen responses using a game design to encourage compliance and automatically acquire visual acuity scores of participating patients. Acuity was then assessed by an examiner with a standard chart-based near ETDRS acuity test before the MAVERIC-C assessment was repeated. Reliability of MAVERIC-C near visual acuity score and agreement of MAVERIC-C score with near ETDRS chart for visual acuity. Altogether, 106 children (95%) completed the MAVERIC-C system without assistance. The vision scores demonstrated satisfactory reliability, with test-retest VA scores having a mean difference of 0.001 (SD ±0.136) and limits of agreement of 2 SD (LOA) of ±0.267. Comparison with the near EDTRS chart showed agreement with a mean difference of -0.0879 (±0.106) with LOA of ±0.208. This study demonstrates promising utility for software using a game design to enable automated testing of acuity in children with ophthalmic disease in an objective and accurate manner. Copyright © 2016 Elsevier Inc. All rights reserved.

Automated Analysis of Fluorescence Microscopy Images to Identify Protein-Protein Interactions

DOE PAGES

Venkatraman, S.; Doktycz, M. J.; Qi, H.; ...

2006-01-01

The identification of protein interactions is important for elucidating biological networks. One obstacle in comprehensive interaction studies is the analyses of large datasets, particularly those containing images. Development of an automated system to analyze an image-based protein interaction dataset is needed. Such an analysis system is described here, to automatically extract features from fluorescence microscopy images obtained from a bacterial protein interaction assay. These features are used to relay quantitative values that aid in the automated scoring of positive interactions. Experimental observations indicate that identifying at least 50% positive cells in an image is sufficient to detect a protein interaction.more » Based on this criterion, the automated system presents 100% accuracy in detecting positive interactions for a dataset of 16 images. Algorithms were implemented using MATLAB and the software developed is available on request from the authors.« less

Towards more reliable automated multi-dose dispensing: retrospective follow-up study on medication dose errors and product defects.

PubMed

Palttala, Iida; Heinämäki, Jyrki; Honkanen, Outi; Suominen, Risto; Antikainen, Osmo; Hirvonen, Jouni; Yliruusi, Jouko

2013-03-01

To date, little is known on applicability of different types of pharmaceutical dosage forms in an automated high-speed multi-dose dispensing process. The purpose of the present study was to identify and further investigate various process-induced and/or product-related limitations associated with multi-dose dispensing process. The rates of product defects and dose dispensing errors in automated multi-dose dispensing were retrospectively investigated during a 6-months follow-up period. The study was based on the analysis of process data of totally nine automated high-speed multi-dose dispensing systems. Special attention was paid to the dependence of multi-dose dispensing errors/product defects and pharmaceutical tablet properties (such as shape, dimensions, weight, scored lines, coatings, etc.) to profile the most suitable forms of tablets for automated dose dispensing systems. The relationship between the risk of errors in dose dispensing and tablet characteristics were visualized by creating a principal component analysis (PCA) model for the outcome of dispensed tablets. The two most common process-induced failures identified in the multi-dose dispensing are predisposal of tablet defects and unexpected product transitions in the medication cassette (dose dispensing error). The tablet defects are product-dependent failures, while the tablet transitions are dependent on automated multi-dose dispensing systems used. The occurrence of tablet defects is approximately twice as common as tablet transitions. Optimal tablet preparation for the high-speed multi-dose dispensing would be a round-shaped, relatively small/middle-sized, film-coated tablet without any scored line. Commercial tablet products can be profiled and classified based on their suitability to a high-speed multi-dose dispensing process.

Open-Source Logic-Based Automated Sleep Scoring Software using Electrophysiological Recordings in Rats

PubMed Central

Gross, Brooks A.; Walsh, Christine M.; Turakhia, Apurva A.; Booth, Victoria; Mashour, George; Poe, Gina R.

2009-01-01

Manual state scoring of physiological recordings in sleep studies is time-consuming, resulting in a data backlog, research delays and increased personnel costs. We developed MATLAB-based software to automate scoring of sleep/waking states in rats, potentially extendable to other animals, from a variety of recording systems. The software contains two programs, Sleep Scorer and Auto-Scorer, for manual and automated scoring. Auto-Scorer is a logic-based program that displays power spectral densities of an electromyographic signal and σ, δ, and θ frequency bands of an electroencephalographic signal, along with the δ/θ ratio and σ ×θ, for every epoch. The user defines thresholds from the training file state definitions which the Auto-Scorer uses with logic to discriminate the state of every epoch in the file. Auto-Scorer was evaluated by comparing its output to manually scored files from 6 rats under 2 experimental conditions by 3 users. Each user generated a training file, set thresholds, and autoscored the 12 files into 4 states (waking, non-REM, transition-to-REM, and REM sleep) in ¼ the time required to manually score the file. Overall performance comparisons between Auto-Scorer and manual scoring resulted in a mean agreement of 80.24 +/− 7.87%, comparable to the average agreement among 3 manual scorers (83.03 +/− 4.00%). There was no significant difference between user-user and user-Auto-Scorer agreement ratios. These results support the use of our open-source Auto-Scorer, coupled with user review, to rapidly and accurately score sleep/waking states from rat recordings. PMID:19615408

High-Throughput In Vivo Genotoxicity Testing: An Automated Readout System for the Somatic Mutation and Recombination Test (SMART)

PubMed Central

Kwak, Jihoon; Genovesio, Auguste; Kang, Myungjoo; Hansen, Michael Adsett Edberg; Han, Sung-Jun

2015-01-01

Genotoxicity testing is an important component of toxicity assessment. As illustrated by the European registration, evaluation, authorization, and restriction of chemicals (REACH) directive, it concerns all the chemicals used in industry. The commonly used in vivo mammalian tests appear to be ill adapted to tackle the large compound sets involved, due to throughput, cost, and ethical issues. The somatic mutation and recombination test (SMART) represents a more scalable alternative, since it uses Drosophila, which develops faster and requires less infrastructure. Despite these advantages, the manual scoring of the hairs on Drosophila wings required for the SMART limits its usage. To overcome this limitation, we have developed an automated SMART readout. It consists of automated imaging, followed by an image analysis pipeline that measures individual wing genotoxicity scores. Finally, we have developed a wing score-based dose-dependency approach that can provide genotoxicity profiles. We have validated our method using 6 compounds, obtaining profiles almost identical to those obtained from manual measures, even for low-genotoxicity compounds such as urethane. The automated SMART, with its faster and more reliable readout, fulfills the need for a high-throughput in vivo test. The flexible imaging strategy we describe and the analysis tools we provide should facilitate the optimization and dissemination of our methods. PMID:25830368

Automated Essay Scoring versus Human Scoring: A Correlational Study

ERIC Educational Resources Information Center

Wang, Jinhao; Brown, Michelle Stallone

2008-01-01

The purpose of the current study was to analyze the relationship between automated essay scoring (AES) and human scoring in order to determine the validity and usefulness of AES for large-scale placement tests. Specifically, a correlational research design was used to examine the correlations between AES performance and human raters' performance.…

Investigating the Impact of Automated Feedback on Students' Scientific Argumentation

ERIC Educational Resources Information Center

Zhu, Mengxiao; Lee, Hee-Sun; Wang, Ting; Liu, Ou Lydia; Belur, Vinetha; Pallant, Amy

2017-01-01

This study investigates the role of automated scoring and feedback in supporting students' construction of written scientific arguments while learning about factors that affect climate change in the classroom. The automated scoring and feedback technology was integrated into an online module. Students' written scientific argumentation occurred…

Automated Assessment of Postural Stability (AAPS)

DTIC Science & Technology

2016-10-01

with human volunteers and used our preliminary data to quantify system calibration and limitations of performance. We have also compared our system’s...scoring. Furthermore, we have begun the process of testing with human volunteers and used our preliminary data to quantify system calibration and

Harnessing Technology for School Accountability: A Case Study of Implementing a Management Information System

ERIC Educational Resources Information Center

Enomoto, Ernestine K.; Conley, Sharon

2007-01-01

Schools employ educational technology to comply with pressures for greater accountability and efficiency in conducting operations. Specifically, schools use "management information systems" designed to automate data collection of student attendance, grades, test scores, and so on. These management information systems (MIS) employed…

Automated estimation of image quality for coronary computed tomographic angiography using machine learning.

PubMed

Nakanishi, Rine; Sankaran, Sethuraman; Grady, Leo; Malpeso, Jenifer; Yousfi, Razik; Osawa, Kazuhiro; Ceponiene, Indre; Nazarat, Negin; Rahmani, Sina; Kissel, Kendall; Jayawardena, Eranthi; Dailing, Christopher; Zarins, Christopher; Koo, Bon-Kwon; Min, James K; Taylor, Charles A; Budoff, Matthew J

2018-03-23

Our goal was to evaluate the efficacy of a fully automated method for assessing the image quality (IQ) of coronary computed tomography angiography (CCTA). The machine learning method was trained using 75 CCTA studies by mapping features (noise, contrast, misregistration scores, and un-interpretability index) to an IQ score based on manual ground truth data. The automated method was validated on a set of 50 CCTA studies and subsequently tested on a new set of 172 CCTA studies against visual IQ scores on a 5-point Likert scale. The area under the curve in the validation set was 0.96. In the 172 CCTA studies, our method yielded a Cohen's kappa statistic for the agreement between automated and visual IQ assessment of 0.67 (p < 0.01). In the group where good to excellent (n = 163), fair (n = 6), and poor visual IQ scores (n = 3) were graded, 155, 5, and 2 of the patients received an automated IQ score > 50 %, respectively. Fully automated assessment of the IQ of CCTA data sets by machine learning was reproducible and provided similar results compared with visual analysis within the limits of inter-operator variability. • The proposed method enables automated and reproducible image quality assessment. • Machine learning and visual assessments yielded comparable estimates of image quality. • Automated assessment potentially allows for more standardised image quality. • Image quality assessment enables standardization of clinical trial results across different datasets.

An automated sleep-state classification algorithm for quantifying sleep timing and sleep-dependent dynamics of electroencephalographic and cerebral metabolic parameters

PubMed Central

Rempe, Michael J; Clegern, William C; Wisor, Jonathan P

2015-01-01

Introduction Rodent sleep research uses electroencephalography (EEG) and electromyography (EMG) to determine the sleep state of an animal at any given time. EEG and EMG signals, typically sampled at >100 Hz, are segmented arbitrarily into epochs of equal duration (usually 2–10 seconds), and each epoch is scored as wake, slow-wave sleep (SWS), or rapid-eye-movement sleep (REMS), on the basis of visual inspection. Automated state scoring can minimize the burden associated with state and thereby facilitate the use of shorter epoch durations. Methods We developed a semiautomated state-scoring procedure that uses a combination of principal component analysis and naïve Bayes classification, with the EEG and EMG as inputs. We validated this algorithm against human-scored sleep-state scoring of data from C57BL/6J and BALB/CJ mice. We then applied a general homeostatic model to characterize the state-dependent dynamics of sleep slow-wave activity and cerebral glycolytic flux, measured as lactate concentration. Results More than 89% of epochs scored as wake or SWS by the human were scored as the same state by the machine, whether scoring in 2-second or 10-second epochs. The majority of epochs scored as REMS by the human were also scored as REMS by the machine. However, of epochs scored as REMS by the human, more than 10% were scored as SWS by the machine and 18 (10-second epochs) to 28% (2-second epochs) were scored as wake. These biases were not strain-specific, as strain differences in sleep-state timing relative to the light/dark cycle, EEG power spectral profiles, and the homeostatic dynamics of both slow waves and lactate were detected equally effectively with the automated method or the manual scoring method. Error associated with mathematical modeling of temporal dynamics of both EEG slow-wave activity and cerebral lactate either did not differ significantly when state scoring was done with automated versus visual scoring, or was reduced with automated state scoring relative to manual classification. Conclusions Machine scoring is as effective as human scoring in detecting experimental effects in rodent sleep studies. Automated scoring is an efficient alternative to visual inspection in studies of strain differences in sleep and the temporal dynamics of sleep-related physiological parameters. PMID:26366107

Astronomical algorithms for automated analysis of tissue protein expression in breast cancer

PubMed Central

Ali, H R; Irwin, M; Morris, L; Dawson, S-J; Blows, F M; Provenzano, E; Mahler-Araujo, B; Pharoah, P D; Walton, N A; Brenton, J D; Caldas, C

2013-01-01

Background: High-throughput evaluation of tissue biomarkers in oncology has been greatly accelerated by the widespread use of tissue microarrays (TMAs) and immunohistochemistry. Although TMAs have the potential to facilitate protein expression profiling on a scale to rival experiments of tumour transcriptomes, the bottleneck and imprecision of manually scoring TMAs has impeded progress. Methods: We report image analysis algorithms adapted from astronomy for the precise automated analysis of IHC in all subcellular compartments. The power of this technique is demonstrated using over 2000 breast tumours and comparing quantitative automated scores against manual assessment by pathologists. Results: All continuous automated scores showed good correlation with their corresponding ordinal manual scores. For oestrogen receptor (ER), the correlation was 0.82, P<0.0001, for BCL2 0.72, P<0.0001 and for HER2 0.62, P<0.0001. Automated scores showed excellent concordance with manual scores for the unsupervised assignment of cases to ‘positive' or ‘negative' categories with agreement rates of up to 96%. Conclusion: The adaptation of astronomical algorithms coupled with their application to large annotated study cohorts, constitutes a powerful tool for the realisation of the enormous potential of digital pathology. PMID:23329232

Automated Scoring of Chromogenic Media for Detection of Methicillin-Resistant Staphylococcus aureus by Use of WASPLab Image Analysis Software.

PubMed

Faron, Matthew L; Buchan, Blake W; Vismara, Chiara; Lacchini, Carla; Bielli, Alessandra; Gesu, Giovanni; Liebregts, Theo; van Bree, Anita; Jansz, Arjan; Soucy, Genevieve; Korver, John; Ledeboer, Nathan A

2016-03-01

Recently, systems have been developed to create total laboratory automation for clinical microbiology. These systems allow for the automation of specimen processing, specimen incubation, and imaging of bacterial growth. In this study, we used the WASPLab to validate software that discriminates and segregates positive and negative chromogenic methicillin-resistant Staphylococcus aureus (MRSA) plates by recognition of pigmented colonies. A total of 57,690 swabs submitted for MRSA screening were enrolled in the study. Four sites enrolled specimens following their standard of care. Chromogenic agar used at these sites included MRSASelect (Bio-Rad Laboratories, Redmond, WA), chromID MRSA (bioMérieux, Marcy l'Etoile, France), and CHROMagar MRSA (BD Diagnostics, Sparks, MD). Specimens were plated and incubated using the WASPLab. The digital camera took images at 0 and 16 to 24 h and the WASPLab software determined the presence of positive colonies based on a hue, saturation, and value (HSV) score. If the HSV score fell within a defined threshold, the plate was called positive. The performance of the digital analysis was compared to manual reading. Overall, the digital software had a sensitivity of 100% and a specificity of 90.7% with the specificity ranging between 90.0 and 96.0 across all sites. The results were similar using the three different agars with a sensitivity of 100% and specificity ranging between 90.7 and 92.4%. These data demonstrate that automated digital analysis can be used to accurately sort positive from negative chromogenic agar cultures regardless of the pigmentation produced. Copyright © 2016 Faron et al.

Automated smartphone audiometry: Validation of a word recognition test app.

PubMed

Dewyer, Nicholas A; Jiradejvong, Patpong; Henderson Sabes, Jennifer; Limb, Charles J

2018-03-01

Develop and validate an automated smartphone word recognition test. Cross-sectional case-control diagnostic test comparison. An automated word recognition test was developed as an app for a smartphone with earphones. English-speaking adults with recent audiograms and various levels of hearing loss were recruited from an audiology clinic and were administered the smartphone word recognition test. Word recognition scores determined by the smartphone app and the gold standard speech audiometry test performed by an audiologist were compared. Test scores for 37 ears were analyzed. Word recognition scores determined by the smartphone app and audiologist testing were in agreement, with 86% of the data points within a clinically acceptable margin of error and a linear correlation value between test scores of 0.89. The WordRec automated smartphone app accurately determines word recognition scores. 3b. Laryngoscope, 128:707-712, 2018. © 2017 The American Laryngological, Rhinological and Otological Society, Inc.

The Impact of Anonymization for Automated Essay Scoring

ERIC Educational Resources Information Center

Shermis, Mark D.; Lottridge, Sue; Mayfield, Elijah

2015-01-01

This study investigated the impact of anonymizing text on predicted scores made by two kinds of automated scoring engines: one that incorporates elements of natural language processing (NLP) and one that does not. Eight data sets (N = 22,029) were used to form both training and test sets in which the scoring engines had access to both text and…

Computer-automated dementia screening using a touch-tone telephone.

PubMed

Mundt, J C; Ferber, K L; Rizzo, M; Greist, J H

2001-11-12

This study investigated the sensitivity and specificity of a computer-automated telephone system to evaluate cognitive impairment in elderly callers to identify signs of early dementia. The Clinical Dementia Rating Scale was used to assess 155 subjects aged 56 to 93 years (n = 74, 27, 42, and 12, with a Clinical Dementia Rating Scale score of 0, 0.5, 1, and 2, respectively). These subjects performed a battery of tests administered by an interactive voice response system using standard Touch-Tone telephones. Seventy-four collateral informants also completed an interactive voice response version of the Symptoms of Dementia Screener. Sixteen cognitively impaired subjects were unable to complete the telephone call. Performances on 6 of 8 tasks were significantly influenced by Clinical Dementia Rating Scale status. The mean (SD) call length was 12 minutes 27 seconds (2 minutes 32 seconds). A subsample (n = 116) was analyzed using machine-learning methods, producing a scoring algorithm that combined performances across 4 tasks. Results indicated a potential sensitivity of 82.0% and specificity of 85.5%. The scoring model generalized to a validation subsample (n = 39), producing 85.0% sensitivity and 78.9% specificity. The kappa agreement between predicted and actual group membership was 0.64 (P<.001). Of the 16 subjects unable to complete the call, 11 provided sufficient information to permit us to classify them as impaired. Standard scoring of the interactive voice response-administered Symptoms of Dementia Screener (completed by informants) produced a screening sensitivity of 63.5% and 100% specificity. A lower criterion found a 90.4% sensitivity, without lowering specificity. Computer-automated telephone screening for early dementia using either informant or direct assessment is feasible. Such systems could provide wide-scale, cost-effective screening, education, and referral services to patients and caregivers.

Performance of an Additional Task During Level 2 Automated Driving: An On-Road Study Comparing Drivers With and Without Experience With Partial Automation.

PubMed

Solís-Marcos, Ignacio; Ahlström, Christer; Kircher, Katja

2018-05-01

To investigate the influence of prior experience with Level 2 automation on additional task performance during manual and Level 2 partially automated driving. Level 2 automation is now on the market, but its effects on driver behavior remain unclear. Based on previous studies, we could expect an increase in drivers' engagement in secondary tasks during Level 2 automated driving, but it is yet unknown how drivers will integrate all the ongoing demands in such situations. Twenty-one drivers (12 without, 9 with Level 2 automation experience) drove on a highway manually and with Level 2 automation (exemplified by Volvo Pilot Assist generation 2; PA2) while performing an additional task. In half of the conditions, the task could be interrupted (self-paced), and in the other half, it could not (system-paced). Drivers' visual attention, additional task performance, and other compensatory strategies were analyzed. Driving with PA2 led to decreased scores in the additional task and more visual attention to the dashboard. In the self-paced condition, all drivers looked more to the task and perceived a lower mental demand. The drivers experienced with PA2 used the system and the task more than the novice group and performed more overtakings. The additional task interfered more with Level 2 automation than with manual driving. The drivers, particularly the automation novice drivers, used some compensatory strategies. Automation designers need to consider these potential effects in the development of future automated systems.

An entirely automated method to score DSS-induced colitis in mice by digital image analysis of pathology slides

PubMed Central

Kozlowski, Cleopatra; Jeet, Surinder; Beyer, Joseph; Guerrero, Steve; Lesch, Justin; Wang, Xiaoting; DeVoss, Jason; Diehl, Lauri

2013-01-01

SUMMARY The DSS (dextran sulfate sodium) model of colitis is a mouse model of inflammatory bowel disease. Microscopic symptoms include loss of crypt cells from the gut lining and infiltration of inflammatory cells into the colon. An experienced pathologist requires several hours per study to score histological changes in selected regions of the mouse gut. In order to increase the efficiency of scoring, Definiens Developer software was used to devise an entirely automated method to quantify histological changes in the whole H&E slide. When the algorithm was applied to slides from historical drug-discovery studies, automated scores classified 88% of drug candidates in the same way as pathologists’ scores. In addition, another automated image analysis method was developed to quantify colon-infiltrating macrophages, neutrophils, B cells and T cells in immunohistochemical stains of serial sections of the H&E slides. The timing of neutrophil and macrophage infiltration had the highest correlation to pathological changes, whereas T and B cell infiltration occurred later. Thus, automated image analysis enables quantitative comparisons between tissue morphology changes and cell-infiltration dynamics. PMID:23580198

End-tidal CO2-guided automated robot CPR system in the pig. Preliminary communication.

PubMed

Suh, Gil Joon; Park, Jaeheung; Lee, Jung Chan; Na, Sang Hoon; Kwon, Woon Yong; Kim, Kyung Su; Kim, Taegyun; Jung, Yoon Sun; Ko, Jung-In; Shin, So Mi; You, Kyoung Min

2018-06-01

Our aim was to compare the efficacy of the end-tidal CO 2 -guided automated robot CPR (robot CPR) system with manual CPR and mechanical device CPR. We developed the algorithm of the robot CPR system which automatically finds the optimal compression position under the guidance of end-tidal CO 2 feedback in swine models of cardiac arrest. Then, 18 pigs after 11 min of cardiac arrest were randomly assigned to one of three groups, robot CPR, LUCAS CPR, and manual CPR groups (n = 6 each group). Return of spontaneous circulation (ROSC) and Neurological Deficit Score 48 h after ROSC were compared. A ROSC was achieved in 5 pigs, 4 pigs, and 3 pigs in the robot CPR, LUCAS CPR, and manual CPR groups, respectively (p = 0.47). Robot CPR showed a significant difference in Neurological Deficit Score 48 h after ROSC compared to manual CPR, whereas LUCAS CPR showed no significant difference over manual CPR. (p = 0.01; Robot versus Manual adjusted p = 0.04, Robot versus LUCAS adjusted p = 0.07, Manual versus LUCAS adjusted p = 1.00). The end-tidal CO 2 -guided automated robot CPR system did not significantly improve ROSC rate in a swine model of cardiac arrest. However, robot CPR showed significant improvement of Neurological Deficit Score 48 h after ROSC compared to Manual CPR while LUCAS CPR showed no significant improvement compared to Manual CPR. Copyright © 2018 Elsevier B.V. All rights reserved.

Automated aortic calcification detection in low-dose chest CT images

NASA Astrophysics Data System (ADS)

Xie, Yiting; Htwe, Yu Maw; Padgett, Jennifer; Henschke, Claudia; Yankelevitz, David; Reeves, Anthony P.

2014-03-01

The extent of aortic calcification has been shown to be a risk indicator for vascular events including cardiac events. We have developed a fully automated computer algorithm to segment and measure aortic calcification in low-dose noncontrast, non-ECG gated, chest CT scans. The algorithm first segments the aorta using a pre-computed Anatomy Label Map (ALM). Then based on the segmented aorta, aortic calcification is detected and measured in terms of the Agatston score, mass score, and volume score. The automated scores are compared with reference scores obtained from manual markings. For aorta segmentation, the aorta is modeled as a series of discrete overlapping cylinders and the aortic centerline is determined using a cylinder-tracking algorithm. Then the aortic surface location is detected using the centerline and a triangular mesh model. The segmented aorta is used as a mask for the detection of aortic calcification. For calcification detection, the image is first filtered, then an elevated threshold of 160 Hounsfield units (HU) is used within the aorta mask region to reduce the effect of noise in low-dose scans, and finally non-aortic calcification voxels (bony structures, calcification in other organs) are eliminated. The remaining candidates are considered as true aortic calcification. The computer algorithm was evaluated on 45 low-dose non-contrast CT scans. Using linear regression, the automated Agatston score is 98.42% correlated with the reference Agatston score. The automated mass and volume score is respectively 98.46% and 98.28% correlated with the reference mass and volume score.

Automated Extraction of Substance Use Information from Clinical Texts.

PubMed

Wang, Yan; Chen, Elizabeth S; Pakhomov, Serguei; Arsoniadis, Elliot; Carter, Elizabeth W; Lindemann, Elizabeth; Sarkar, Indra Neil; Melton, Genevieve B

2015-01-01

Within clinical discourse, social history (SH) includes important information about substance use (alcohol, drug, and nicotine use) as key risk factors for disease, disability, and mortality. In this study, we developed and evaluated a natural language processing (NLP) system for automated detection of substance use statements and extraction of substance use attributes (e.g., temporal and status) based on Stanford Typed Dependencies. The developed NLP system leveraged linguistic resources and domain knowledge from a multi-site social history study, Propbank and the MiPACQ corpus. The system attained F-scores of 89.8, 84.6 and 89.4 respectively for alcohol, drug, and nicotine use statement detection, as well as average F-scores of 82.1, 90.3, 80.8, 88.7, 96.6, and 74.5 respectively for extraction of attributes. Our results suggest that NLP systems can achieve good performance when augmented with linguistic resources and domain knowledge when applied to a wide breadth of substance use free text clinical notes.

Adapting for Scalability: Automating the Video Assessment of Instructional Learning

ERIC Educational Resources Information Center

Roberts , Amy M.; LoCasale-Crouch, Jennifer; Hamre, Bridget K.; Buckrop, Jordan M.

2017-01-01

Although scalable programs, such as online courses, have the potential to reach broad audiences, they may pose challenges to evaluating learners' knowledge and skills. Automated scoring offers a possible solution. In the current paper, we describe the process of creating and testing an automated means of scoring a validated measure of teachers'…

Sperm Scoring Using Multi-Spectral Flow Imaging and FISH-IS Final Report CRADA No. TC02088.0

DOE Office of Scientific and Technical Information (OSTI.GOV)

Marchetti, F.; Morrissey, P. J.

This was to be a collaborative effort between The Regents of the University of California, Lawrence Livermore National Laboratory (LLNL) and Amnis Corporation, to develop an automated system for scoring sperm interphase cells for the presence of chromosomal abnormalities using fluorescence in situ hybridization and the Amnis ImageStream technology platform.

The Effect of Specific Language Features on the Complexity of Systems for Automated Essay Scoring.

ERIC Educational Resources Information Center

Cohen, Yoav; Ben-Simon, Anat; Hovav, Myra

This paper focuses on the relationship between different aspects of the linguistic structure of a given language and the complexity of the computer program, whether existing or prospective, that is to be used for the scoring of essays in that language. The first part of the paper discusses common scales used to assess writing products, then…

Evaluating the Advisory Flags and Machine Scoring Difficulty in the "e-rater"® Automated Scoring Engine. Research Report. ETS RR-16-30

ERIC Educational Resources Information Center

Zhang, Mo; Chen, Jing; Ruan, Chunyi

2016-01-01

Successful detection of unusual responses is critical for using machine scoring in the assessment context. This study evaluated the utility of approaches to detecting unusual responses in automated essay scoring. Two research questions were pursued. One question concerned the performance of various prescreening advisory flags, and the other…

Prospective validation of a near real-time EHR-integrated automated SOFA score calculator.

PubMed

Aakre, Christopher; Franco, Pablo Moreno; Ferreyra, Micaela; Kitson, Jaben; Li, Man; Herasevich, Vitaly

2017-07-01

We created an algorithm for automated Sequential Organ Failure Assessment (SOFA) score calculation within the Electronic Health Record (EHR) to facilitate detection of sepsis based on the Third International Consensus Definitions for Sepsis and Septic Shock (SEPSIS-3) clinical definition. We evaluated the accuracy of near real-time and daily automated SOFA score calculation compared with manual score calculation. Automated SOFA scoring computer programs were developed using available EHR data sources and integrated into a critical care focused patient care dashboard at Mayo Clinic in Rochester, Minnesota. We prospectively compared the accuracy of automated versus manual calculation for a sample of patients admitted to the medical intensive care unit at Mayo Clinic Hospitals in Rochester, Minnesota and Jacksonville, Florida. Agreement was calculated with Cohen's kappa statistic. Reason for discrepancy was tabulated during manual review. Random spot check comparisons were performed 134 times on 27 unique patients, and daily SOFA score comparisons were performed for 215 patients over a total of 1206 patient days. Agreement between automatically scored and manually scored SOFA components for both random spot checks (696 pairs, κ=0.89) and daily calculation (5972 pairs, κ=0.89) was high. The most common discrepancies were in the respiratory component (inaccurate fraction of inspired oxygen retrieval; 200/1206) and creatinine (normal creatinine in patients with no urine output on dialysis; 128/1094). 147 patients were at risk of developing sepsis after intensive care unit admission, 10 later developed sepsis confirmed by chart review. All were identified before onset of sepsis with the ΔSOFA≥2 point criterion and 46 patients were false-positives. Near real-time automated SOFA scoring was found to have strong agreement with manual score calculation and may be useful for the detection of sepsis utilizing the new SEPSIS-3 definition. Copyright © 2017 Elsevier B.V. All rights reserved.

Using Automated Scores of Student Essays to Support Teacher Guidance in Classroom Inquiry

ERIC Educational Resources Information Center

Gerard, Libby F.; Linn, Marcia C.

2016-01-01

Computer scoring of student written essays about an inquiry topic can be used to diagnose student progress both to alert teachers to struggling students and to generate automated guidance. We identify promising ways for teachers to add value to automated guidance to improve student learning. Three teachers from two schools and their 386 students…

Utility in a Fallible Tool: A Multi-Site Case Study of Automated Writing Evaluation

ERIC Educational Resources Information Center

Grimes, Douglas; Warschauer, Mark

2010-01-01

Automated writing evaluation (AWE) software uses artificial intelligence (AI) to score student essays and support revision. We studied how an AWE program called MY Access![R] was used in eight middle schools in Southern California over a three-year period. Although many teachers and students considered automated scoring unreliable, and teachers'…

Semi-automated scoring of triple-probe FISH in human sperm using confocal microscopy.

PubMed

Branch, Francesca; Nguyen, GiaLinh; Porter, Nicholas; Young, Heather A; Martenies, Sheena E; McCray, Nathan; Deloid, Glen; Popratiloff, Anastas; Perry, Melissa J

2017-09-01

Structural and numerical sperm chromosomal aberrations result from abnormal meiosis and are directly linked to infertility. Any live births that arise from aneuploid conceptuses can result in syndromes such as Kleinfelter, Turners, XYY and Edwards. Multi-probe fluorescence in situ hybridization (FISH) is commonly used to study sperm aneuploidy, however manual FISH scoring in sperm samples is labor-intensive and introduces errors. Automated scoring methods are continuously evolving. One challenging aspect for optimizing automated sperm FISH scoring has been the overlap in excitation and emission of the fluorescent probes used to enumerate the chromosomes of interest. Our objective was to demonstrate the feasibility of combining confocal microscopy and spectral imaging with high-throughput methods for accurately measuring sperm aneuploidy. Our approach used confocal microscopy to analyze numerical chromosomal abnormalities in human sperm using enhanced slide preparation and rigorous semi-automated scoring methods. FISH for chromosomes X, Y, and 18 was conducted to determine sex chromosome disomy in sperm nuclei. Application of online spectral linear unmixing was used for effective separation of four fluorochromes while decreasing data acquisition time. Semi-automated image processing, segmentation, classification, and scoring were performed on 10 slides using custom image processing and analysis software and results were compared with manual methods. No significant differences in disomy frequencies were seen between the semi automated and manual methods. Samples treated with pepsin were observed to have reduced background autofluorescence and more uniform distribution of cells. These results demonstrate that semi-automated methods using spectral imaging on a confocal platform are a feasible approach for analyzing numerical chromosomal aberrations in sperm, and are comparable to manual methods. © 2017 International Society for Advancement of Cytometry. © 2017 International Society for Advancement of Cytometry.

75 FR 71146 - In the Matter of Certain Machine Vision Software, Machine Vision Systems, and Products Containing...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-11-22

...''); Amistar Automation, Inc. (``Amistar'') of San Marcos, California; Techno Soft Systemnics, Inc. (``Techno..., the ALJ's construction of the claim terms ``test,'' ``match score surface,'' and ``gradient direction...

Standardized Ki67 Diagnostics Using Automated Scoring--Clinical Validation in the GeparTrio Breast Cancer Study.

PubMed

Klauschen, Frederick; Wienert, Stephan; Schmitt, Wolfgang D; Loibl, Sibylle; Gerber, Bernd; Blohmer, Jens-Uwe; Huober, Jens; Rüdiger, Thomas; Erbstößer, Erhard; Mehta, Keyur; Lederer, Bianca; Dietel, Manfred; Denkert, Carsten; von Minckwitz, Gunter

2015-08-15

Scoring proliferation through Ki67 immunohistochemistry is an important component in predicting therapy response to chemotherapy in patients with breast cancer. However, recent studies have cast doubt on the reliability of "visual" Ki67 scoring in the multicenter setting, particularly in the lower, yet clinically important, proliferation range. Therefore, an accurate and standardized Ki67 scoring is pivotal both in routine diagnostics and larger multicenter studies. We validated a novel fully automated Ki67 scoring approach that relies on only minimal a priori knowledge on cell properties and requires no training data for calibration. We applied our approach to 1,082 breast cancer samples from the neoadjuvant GeparTrio trial and compared the performance of automated and manual Ki67 scoring. The three groups of autoKi67 as defined by low (≤ 15%), medium (15.1%-35%), and high (>35%) automated scores showed pCR rates of 5.8%, 16.9%, and 29.5%, respectively. AutoKi67 was significantly linked to prognosis with overall and progression-free survival P values P(OS) < 0.0001 and P(PFS) < 0.0002, compared with P(OS) < 0.0005 and P(PFS) < 0.0001 for manual Ki67 scoring. Moreover, automated Ki67 scoring was an independent prognosticator in the multivariate analysis with P(OS) = 0.002, P(PFS) = 0.009 (autoKi67) versus P(OS) = 0.007, PPFS = 0.004 (manual Ki67). The computer-assisted Ki67 scoring approach presented here offers a standardized means of tumor cell proliferation assessment in breast cancer that correlated with clinical endpoints and is deployable in routine diagnostics. It may thus help to solve recently reported reliability concerns in Ki67 diagnostics. ©2014 American Association for Cancer Research.

Technical note on the validation of a semi-automated image analysis software application for estrogen and progesterone receptor detection in breast cancer.

PubMed

Krecsák, László; Micsik, Tamás; Kiszler, Gábor; Krenács, Tibor; Szabó, Dániel; Jónás, Viktor; Császár, Gergely; Czuni, László; Gurzó, Péter; Ficsor, Levente; Molnár, Béla

2011-01-18

The immunohistochemical detection of estrogen (ER) and progesterone (PR) receptors in breast cancer is routinely used for prognostic and predictive testing. Whole slide digitalization supported by dedicated software tools allows quantization of the image objects (e.g. cell membrane, nuclei) and an unbiased analysis of immunostaining results. Validation studies of image analysis applications for the detection of ER and PR in breast cancer specimens provided strong concordance between the pathologist's manual assessment of slides and scoring performed using different software applications. The effectiveness of two connected semi-automated image analysis software (NuclearQuant v. 1.13 application for Pannoramic™ Viewer v. 1.14) for determination of ER and PR status in formalin-fixed paraffin embedded breast cancer specimens immunostained with the automated Leica Bond Max system was studied. First the detection algorithm was calibrated to the scores provided an independent assessors (pathologist), using selected areas from 38 small digital slides (created from 16 cases) containing a mean number of 195 cells. Each cell was manually marked and scored according to the Allred-system combining frequency and intensity scores. The performance of the calibrated algorithm was tested on 16 cases (14 invasive ductal carcinoma, 2 invasive lobular carcinoma) against the pathologist's manual scoring of digital slides. The detection was calibrated to 87 percent object detection agreement and almost perfect Total Score agreement (Cohen's kappa 0.859, quadratic weighted kappa 0.986) from slight or moderate agreement at the start of the study, using the un-calibrated algorithm. The performance of the application was tested against the pathologist's manual scoring of digital slides on 53 regions of interest of 16 ER and PR slides covering all positivity ranges, and the quadratic weighted kappa provided almost perfect agreement (κ = 0.981) among the two scoring schemes. NuclearQuant v. 1.13 application for Pannoramic™ Viewer v. 1.14 software application proved to be a reliable image analysis tool for pathologists testing ER and PR status in breast cancer.

Automated Scoring for the "TOEFL Junior"® Comprehensive Writing and Speaking Test. Research Report. ETS RR-15-09

ERIC Educational Resources Information Center

Evanini, Keelan; Heilman, Michael; Wang, Xinhao; Blanchard, Daniel

2015-01-01

This report describes the initial automated scoring results that were obtained using the constructed responses from the Writing and Speaking sections of the pilot forms of the "TOEFL Junior"® Comprehensive test administered in late 2011. For all of the items except one (the edit item in the Writing section), existing automated scoring…

Using Writing Process and Product Features to Assess Writing Quality and Explore How Those Features Relate to Other Literacy Tasks. Research Report. ETS RR-14-03

ERIC Educational Resources Information Center

Deane, Paul

2014-01-01

This paper explores automated methods for measuring features of student writing and determining their relationship to writing quality and other features of literacy, such as reading rest scores. In particular, it uses the "e-rater"™ automatic essay scoring system to measure "product" features (measurable traits of the final…

How to assess driver's interaction with partially automated driving systems - A framework for early concept assessment.

PubMed

van den Beukel, Arie P; van der Voort, Mascha C

2017-03-01

The introduction of partially automated driving systems changes the driving task into supervising the automation with an occasional need to intervene. To develop interface solutions that adequately support drivers in this new role, this study proposes and evaluates an assessment framework that allows designers to evaluate driver-support within relevant real-world scenarios. Aspects identified as requiring assessment in terms of driver-support within the proposed framework are Accident Avoidance, gained Situation Awareness (SA) and Concept Acceptance. Measurement techniques selected to operationalise these aspects and the associated framework are pilot-tested with twenty-four participants in a driving simulator experiment. The objective of the test is to determine the reliability of the applied measurements for the assessment of the framework and whether the proposed framework is effective in predicting the level of support offered by the concepts. Based on the congruency between measurement scores produced in the test and scores with predefined differences in concept-support, this study demonstrates the framework's reliability. A remaining concern is the framework's weak sensitivity to small differences in offered support. The article concludes that applying the framework is especially advantageous for evaluating early design phases and can successfully contribute to the efficient development of driver's in-control and safe means of operating partially automated vehicles. Copyright © 2016 Elsevier Ltd. All rights reserved.

Evaluation of a New Scoring System for Retinal Nerve Fiber Layer Photography Using HRA1 in 964 Eyes

PubMed Central

Hong, Samin; Moon, Jong Wook; Ha, Seung Joo; Kim, Chan Yun; Seong, Gong Je

2007-01-01

Purpose To evaluate retinal nerve fiber layer (RNFL) defect by a new scoring system for RNFL photography using the Heidelberg Retina Angiograph 1 (HRA1). Methods This retrospective study included 128 healthy eyes and 836 primary open-angle glaucoma eyes. The RNFL photography using HRA1 was interpreted using a new scoring system, and correlated with visual field indices of standard automated perimetry (SAP). Using the presence of RNFL defect, darkness, width, and location, we established the new scoring system of RNFL photos. Results The mean RNFL defect score I in the early, moderate, severe, and control groups were 7.3, 9.2, 10.4, and 3.6, respectively. The mean RNFL defect score II in the early, moderate, severe, and control groups were 14.5, 28.5, 43.4, and 3.4, respectively. Correlations between the RNFL defect score II and the mean deviation of SAP was the strongest of the various combinations (r=-0.675, P<.001). Conclusions Using a new scoring system, we propose a method for semi-quantitative interpretation of RNFL photographs. This scoring system may be helpful to distinguish between normal and glaucomatous eyes, and the score is associated with the severity of visual field loss. PMID:18063886

Automated Scoring of Short-Answer Reading Items: Implications for Constructs

ERIC Educational Resources Information Center

Carr, Nathan T.; Xi, Xiaoming

2010-01-01

This article examines how the use of automated scoring procedures for short-answer reading tasks can affect the constructs being assessed. In particular, it highlights ways in which the development of scoring algorithms intended to apply the criteria used by human raters can lead test developers to reexamine and even refine the constructs they…

Validating Automated Essay Scoring: A (Modest) Refinement of the "Gold Standard"

ERIC Educational Resources Information Center

Powers, Donald E.; Escoffery, David S.; Duchnowski, Matthew P.

2015-01-01

By far, the most frequently used method of validating (the interpretation and use of) automated essay scores has been to compare them with scores awarded by human raters. Although this practice is questionable, human-machine agreement is still often regarded as the "gold standard." Our objective was to refine this model and apply it to…

Assessing Writing in MOOCs: Automated Essay Scoring and Calibrated Peer Review™

ERIC Educational Resources Information Center

Balfour, Stephen P.

2013-01-01

Two of the largest Massive Open Online Course (MOOC) organizations have chosen different methods for the way they will score and provide feedback on essays students submit. EdX, MIT and Harvard's non-profit MOOC federation, recently announced that they will use a machine-based Automated Essay Scoring (AES) application to assess written work in…

Fully Automated Fluorescent in situ Hybridization (FISH) Staining and Digital Analysis of HER2 in Breast Cancer: A Validation Study

PubMed Central

van der Logt, Elise M. J.; Kuperus, Deborah A. J.; van Setten, Jan W.; van den Heuvel, Marius C.; Boers, James. E.; Schuuring, Ed; Kibbelaar, Robby E.

2015-01-01

HER2 assessment is routinely used to select patients with invasive breast cancer that might benefit from HER2-targeted therapy. The aim of this study was to validate a fully automated in situ hybridization (ISH) procedure that combines the automated Leica HER2 fluorescent ISH system for Bond with supervised automated analysis with the Visia imaging D-Sight digital imaging platform. HER2 assessment was performed on 328 formalin-fixed/paraffin-embedded invasive breast cancer tumors on tissue microarrays (TMA) and 100 (50 selected IHC 2+ and 50 random IHC scores) full-sized slides of resections/biopsies obtained for diagnostic purposes previously. For digital analysis slides were pre-screened at 20x and 100x magnification for all fluorescent signals and supervised-automated scoring was performed on at least two pictures (in total at least 20 nuclei were counted) with the D-Sight HER2 FISH analysis module by two observers independently. Results were compared to data obtained previously with the manual Abbott FISH test. The overall agreement with Abbott FISH data among TMA samples and 50 selected IHC 2+ cases was 98.8% (κ = 0.94) and 93.8% (κ = 0.88), respectively. The results of 50 additionally tested unselected IHC cases were concordant with previously obtained IHC and/or FISH data. The combination of the Leica FISH system with the D-Sight digital imaging platform is a feasible method for HER2 assessment in routine clinical practice for patients with invasive breast cancer. PMID:25844540

Automated Essay Grading using Machine Learning Algorithm

NASA Astrophysics Data System (ADS)

Ramalingam, V. V.; Pandian, A.; Chetry, Prateek; Nigam, Himanshu

2018-04-01

Essays are paramount for of assessing the academic excellence along with linking the different ideas with the ability to recall but are notably time consuming when they are assessed manually. Manual grading takes significant amount of evaluator’s time and hence it is an expensive process. Automated grading if proven effective will not only reduce the time for assessment but comparing it with human scores will also make the score realistic. The project aims to develop an automated essay assessment system by use of machine learning techniques by classifying a corpus of textual entities into small number of discrete categories, corresponding to possible grades. Linear regression technique will be utilized for training the model along with making the use of various other classifications and clustering techniques. We intend to train classifiers on the training set, make it go through the downloaded dataset, and then measure performance our dataset by comparing the obtained values with the dataset values. We have implemented our model using java.

THE RABIT: A RAPID AUTOMATED BIODOSIMETRY TOOL FOR RADIOLOGICAL TRIAGE

PubMed Central

Garty, Guy; Chen, Youhua; Salerno, Alessio; Turner, Helen; Zhang, Jian; Lyulko, Oleksandra; Bertucci, Antonella; Xu, Yanping; Wang, Hongliang; Simaan, Nabil; Randers-Pehrson, Gerhard; Yao, Y. Lawrence; Amundson, Sally A.; Brenner, David J.

2010-01-01

In response to the recognized need for high throughput biodosimetry methods for use after large scale radiological events, a logical approach is complete automation of standard biodosimetric assays that are currently performed manually. We describe progress to date on the RABIT (Rapid Automated BIodosimetry Tool), designed to score micronuclei or γ-H2AX fluorescence in lymphocytes derived from a single drop of blood from a fingerstick. The RABIT system is designed to be completely automated, from the input of the capillary blood sample into the machine, to the output of a dose estimate. Improvements in throughput are achieved through use of a single drop of blood, optimization of the biological protocols for in-situ analysis in multi-well plates, implementation of robotic plate and liquid handling, and new developments in high-speed imaging. Automating well-established bioassays represents a promising approach to high-throughput radiation biodosimetry, both because high throughputs can be achieved, but also because the time to deployment is potentially much shorter than for a new biological assay. Here we describe the development of each of the individual modules of the RABIT system, and show preliminary data from key modules. Ongoing is system integration, followed by calibration and validation. PMID:20065685

ISSLS PRIZE IN BIOENGINEERING SCIENCE 2017: Automation of reading of radiological features from magnetic resonance images (MRIs) of the lumbar spine without human intervention is comparable with an expert radiologist.

PubMed

Jamaludin, Amir; Lootus, Meelis; Kadir, Timor; Zisserman, Andrew; Urban, Jill; Battié, Michele C; Fairbank, Jeremy; McCall, Iain

2017-05-01

Investigation of the automation of radiological features from magnetic resonance images (MRIs) of the lumbar spine. To automate the process of grading lumbar intervertebral discs and vertebral bodies from MRIs. MR imaging is the most common imaging technique used in investigating low back pain (LBP). Various features of degradation, based on MRIs, are commonly recorded and graded, e.g., Modic change and Pfirrmann grading of intervertebral discs. Consistent scoring and grading is important for developing robust clinical systems and research. Automation facilitates this consistency and reduces the time of radiological analysis considerably and hence the expense. 12,018 intervertebral discs, from 2009 patients, were graded by a radiologist and were then used to train: (1) a system to detect and label vertebrae and discs in a given scan, and (2) a convolutional neural network (CNN) model that predicts several radiological gradings. The performance of the model, in terms of class average accuracy, was compared with the intra-observer class average accuracy of the radiologist. The detection system achieved 95.6% accuracy in terms of disc detection and labeling. The model is able to produce predictions of multiple pathological gradings that consistently matched those of the radiologist. The model identifies 'Evidence Hotspots' that are the voxels that most contribute to the degradation scores. Automation of radiological grading is now on par with human performance. The system can be beneficial in aiding clinical diagnoses in terms of objectivity of gradings and the speed of analysis. It can also draw the attention of a radiologist to regions of degradation. This objectivity and speed is an important stepping stone in the investigation of the relationship between MRIs and clinical diagnoses of back pain in large cohorts. Level 3.

Large-Scale Assessment, Locally-Developed Measures, and Automated Scoring of Essays: Fishing for Red Herrings?

ERIC Educational Resources Information Center

Condon, William

2013-01-01

Automated Essay Scoring (AES) has garnered a great deal of attention from the rhetoric and composition/writing studies community since the Educational Testing Service began using e-rater[R] and the "Criterion"[R] Online Writing Evaluation Service as products in scoring writing tests, and most of the responses have been negative. While the…

Comparing Human and Automated Essay Scoring for Prospective Graduate Students with Learning Disabilities and/or ADHD

ERIC Educational Resources Information Center

Buzick, Heather; Oliveri, Maria Elena; Attali, Yigal; Flor, Michael

2016-01-01

Automated essay scoring is a developing technology that can provide efficient scoring of large numbers of written responses. Its use in higher education admissions testing provides an opportunity to collect validity and fairness evidence to support current uses and inform its emergence in other areas such as K-12 large-scale assessment. In this…

Automation of a high risk medication regime algorithm in a home health care population.

PubMed

Olson, Catherine H; Dierich, Mary; Westra, Bonnie L

2014-10-01

Create an automated algorithm for predicting elderly patients' medication-related risks for readmission and validate it by comparing results with a manual analysis of the same patient population. Outcome and Assessment Information Set (OASIS) and medication data were reused from a previous, manual study of 911 patients from 15 Medicare-certified home health care agencies. The medication data was converted into standardized drug codes using APIs managed by the National Library of Medicine (NLM), and then integrated in an automated algorithm that calculates patients' high risk medication regime scores (HRMRs). A comparison of the results between algorithm and manual process was conducted to determine how frequently the HRMR scores were derived which are predictive of readmission. HRMR scores are composed of polypharmacy (number of drugs), Potentially Inappropriate Medications (PIM) (drugs risky to the elderly), and Medication Regimen Complexity Index (MRCI) (complex dose forms, instructions or administration). The algorithm produced polypharmacy, PIM, and MRCI scores that matched with 99%, 87% and 99% of the scores, respectively, from the manual analysis. Imperfect match rates resulted from discrepancies in how drugs were classified and coded by the manual analysis vs. the automated algorithm. HRMR rules lack clarity, resulting in clinical judgments for manual coding that were difficult to replicate in the automated analysis. The high comparison rates for the three measures suggest that an automated clinical tool could use patients' medication records to predict their risks of avoidable readmissions. Copyright © 2014 Elsevier Inc. All rights reserved.

7th Annual CMMI Technology Conference Volume 3 Thursday Presentations

DTIC Science & Technology

2007-11-15

Inc. - US Corporate Research Effective Systems Engineering: What’s the Payoff for Program Performance?, NDIA Systems EngineeringsEffectiveness What’s...Inc. - US Corporate Research CMMI, Configuration Management, and Baseball – How to Score, Ms. Julie Schmarje, Raytheon Company Automated Systems for...Dr. Aldo Dagnino, ABB, Inc. US Corporate Research Systems Assurance – Practices Make Perfect – How Your Engineering and Management Practices Can Help

Computational technique for stepwise quantitative assessment of equation correctness

NASA Astrophysics Data System (ADS)

Othman, Nuru'l Izzah; Bakar, Zainab Abu

2017-04-01

Many of the computer-aided mathematics assessment systems that are available today possess the capability to implement stepwise correctness checking of a working scheme for solving equations. The computational technique for assessing the correctness of each response in the scheme mainly involves checking the mathematical equivalence and providing qualitative feedback. This paper presents a technique, known as the Stepwise Correctness Checking and Scoring (SCCS) technique that checks the correctness of each equation in terms of structural equivalence and provides quantitative feedback. The technique, which is based on the Multiset framework, adapts certain techniques from textual information retrieval involving tokenization, document modelling and similarity evaluation. The performance of the SCCS technique was tested using worked solutions on solving linear algebraic equations in one variable. 350 working schemes comprising of 1385 responses were collected using a marking engine prototype, which has been developed based on the technique. The results show that both the automated analytical scores and the automated overall scores generated by the marking engine exhibit high percent agreement, high correlation and high degree of agreement with manual scores with small average absolute and mixed errors.

The Operational Use of an Automated High Frequency Radio System Incorporating Automatic Link Establishment and Single-Tone Serial Modem Technology for U.S. Navy Ship-Shore Communications

DTIC Science & Technology

1993-10-01

between the link chronologically in the following sections. quality analysis ( LQA ) score measured by ALE and single- tone serial modem performance. A...receiving ends in turn and (propagation permitting), pass traffic and terminate the are used to calculate a combined link quality analysis ( LQA ...score. The LQA score is displayed to the operator NCCOSC RDTE DIV installation team accomplished the as a number on an arbitrary scale of 0 to 120, with a

Performance of Automated Speech Scoring on Different Low- to Medium-Entropy Item Types for Low-Proficiency English Learners. Research Report. ETS RR-17-12

ERIC Educational Resources Information Center

Loukina, Anastassia; Zechner, Klaus; Yoon, Su-Youn; Zhang, Mo; Tao, Jidong; Wang, Xinhao; Lee, Chong Min; Mulholland, Matthew

2017-01-01

This report presents an overview of the "SpeechRater"? automated scoring engine model building and evaluation process for several item types with a focus on a low-English-proficiency test-taker population. We discuss each stage of speech scoring, including automatic speech recognition, filtering models for nonscorable responses, and…

SU-E-P-49: Evaluation of Image Quality and Radiation Dose of Various Unenhanced Head CT Protocols

DOE Office of Scientific and Technical Information (OSTI.GOV)

Chen, L; Khan, M; Alapati, K

2015-06-15

Purpose: To evaluate the diagnostic value of various unenhanced head CT protocols and predicate acceptable radiation dose level for head CT exam. Methods: Our retrospective analysis included 3 groups, 20 patients per group, who underwent clinical routine unenhanced adult head CT examination. All exams were performed axially with 120 kVp. Three protocols, 380 mAs without iterative reconstruction and automAs, 340 mAs with iterative reconstruction without automAs, 340 mAs with iterative reconstruction and automAs, were applied on each group patients respectively. The images were reconstructed with H30, J30 for brain window and H60, J70 for bone window. Images acquired with threemore » protocols were randomized and blindly reviewed by three radiologists. A 5 point scale was used to rate each exam The percentage of exam score above 3 and average scores of each protocol were calculated for each reviewer and tissue types. Results: For protocols without automAs, the average scores of bone window with iterative reconstruction were higher than those without iterative reconstruction for each reviewer although the radiation dose was 10 percentage lower. 100 percentage exams were scored 3 or higher and the average scores were above 4 for both brain and bone reconstructions. The CTDIvols are 64.4 and 57.8 mGy of 380 and 340 mAs, respectively. With automAs, the radiation dose varied with head size, resulting in 47.5 mGy average CTDIvol between 39.5 and 56.5 mGy. 93 and 98 percentage exams were scored great than 3 for brain and bone windows, respectively. The diagnostic confidence level and image quality of exams with AutomAs were less than those without AutomAs for each reviewer. Conclusion: According to these results, the mAs was reduced to 300 with automAs OFF for head CT exam. The radiation dose was 20 percentage lower than the original protocol and the CTDIvol was reduced to 51.2 mGy.« less

Takeover Time in Highly Automated Vehicles: Noncritical Transitions to and From Manual Control.

PubMed

Eriksson, Alexander; Stanton, Neville A

2017-06-01

The aim of this study was to review existing research into driver control transitions and to determine the time it takes drivers to resume control from a highly automated vehicle in noncritical scenarios. Contemporary research has moved from an inclusive design approach to adhering only to mean/median values when designing control transitions in automated driving. Research into control transitions in highly automated driving has focused on urgent scenarios where drivers are given a relatively short time span to respond to a request to resume manual control. We found a paucity in research into more frequent scenarios for control transitions, such as planned exits from highway systems. Twenty-six drivers drove two scenarios with an automated driving feature activated. Drivers were asked to read a newspaper, or to monitor the system, and to relinquish, or resume, control from the automation when prompted by vehicle systems. Significantly longer control transition times were found between driving with and without secondary tasks. Control transition times were substantially longer than those reported in the peer-reviewed literature. We found that drivers take longer to resume control when under no time pressure compared with that reported in the literature. Moreover, we found that drivers occupied by a secondary task exhibit larger variance and slower responses to requests to resume control. Workload scores implied optimal workload. Intra- and interindividual differences need to be accommodated by vehicle manufacturers and policy makers alike to ensure inclusive design of contemporary systems and safety during control transitions.

Comparison of manual sleep staging with automated neural network-based analysis in clinical practice.

PubMed

Caffarel, Jennifer; Gibson, G John; Harrison, J Phil; Griffiths, Clive J; Drinnan, Michael J

2006-03-01

We have compared sleep staging by an automated neural network (ANN) system, BioSleep (Oxford BioSignals) and a human scorer using the Rechtschaffen and Kales scoring system. Sleep study recordings from 114 patients with suspected obstructed sleep apnoea syndrome (OSA) were analysed by ANN and by a blinded human scorer. We also examined human scorer reliability by calculating the agreement between the index scorer and a second independent blinded scorer for 28 of the 114 studies. For each study, we built contingency tables on an epoch-by-epoch (30 s epochs) comparison basis. From these, we derived kappa (kappa) coefficients for different combinations of sleep stages. The overall agreement of automatic and manual scoring for the 114 studies for the classification {wake / light-sleep / deep-sleep / REM} was poor (median kappa = 0.305) and only a little better (kappa = 0.449) for the crude {wake / sleep} distinction. For the subgroup of 28 randomly selected studies, the overall agreement of automatic and manual scoring was again relatively low (kappa = 0.331 for {wake light-sleep / deep-sleep REM} and kappa = 0.505 for {wake / sleep}), whereas inter-scorer reliability was higher (kappa = -0.641 for {wake / light-sleep / deep-sleep / REM} and kappa = 0.737 for {wake / sleep}). We conclude that such an ANN-based analysis system is not sufficiently accurate for sleep study analyses using the R&K classification system.

FMEA of manual and automated methods for commissioning a radiotherapy treatment planning system.

PubMed

Wexler, Amy; Gu, Bruce; Goddu, Sreekrishna; Mutic, Maya; Yaddanapudi, Sridhar; Olsen, Lindsey; Harry, Taylor; Noel, Camille; Pawlicki, Todd; Mutic, Sasa; Cai, Bin

2017-09-01

To evaluate the level of risk involved in treatment planning system (TPS) commissioning using a manual test procedure, and to compare the associated process-based risk to that of an automated commissioning process (ACP) by performing an in-depth failure modes and effects analysis (FMEA). The authors collaborated to determine the potential failure modes of the TPS commissioning process using (a) approaches involving manual data measurement, modeling, and validation tests and (b) an automated process utilizing application programming interface (API) scripting, preloaded, and premodeled standard radiation beam data, digital heterogeneous phantom, and an automated commissioning test suite (ACTS). The severity (S), occurrence (O), and detectability (D) were scored for each failure mode and the risk priority numbers (RPN) were derived based on TG-100 scale. Failure modes were then analyzed and ranked based on RPN. The total number of failure modes, RPN scores and the top 10 failure modes with highest risk were described and cross-compared between the two approaches. RPN reduction analysis is also presented and used as another quantifiable metric to evaluate the proposed approach. The FMEA of a MTP resulted in 47 failure modes with an RPN ave of 161 and S ave of 6.7. The highest risk process of "Measurement Equipment Selection" resulted in an RPN max of 640. The FMEA of an ACP resulted in 36 failure modes with an RPN ave of 73 and S ave of 6.7. The highest risk process of "EPID Calibration" resulted in an RPN max of 576. An FMEA of treatment planning commissioning tests using automation and standardization via API scripting, preloaded, and pre-modeled standard beam data, and digital phantoms suggests that errors and risks may be reduced through the use of an ACP. © 2017 American Association of Physicists in Medicine.

Identifying Speech Acts in E-Mails: Toward Automated Scoring of the "TOEIC"® E-Mail Task. Research Report. ETS RR-12-16

ERIC Educational Resources Information Center

De Felice, Rachele; Deane, Paul

2012-01-01

This study proposes an approach to automatically score the "TOEIC"® Writing e-mail task. We focus on one component of the scoring rubric, which notes whether the test-takers have used particular speech acts such as requests, orders, or commitments. We developed a computational model for automated speech act identification and tested it…

Validating Automated Essay Scoring for Online Writing Placement

ERIC Educational Resources Information Center

Ramineni, Chaitanya

2013-01-01

In this paper, I describe the design and evaluation of automated essay scoring (AES) models for an institution's writing placement program. Information was gathered on admitted student writing performance at a science and technology research university in the northeastern United States. Under timed conditions, first-year students (N = 879) were…

Automated Scoring in Context: Rapid Assessment for Placed Students

ERIC Educational Resources Information Center

Klobucar, Andrew; Elliot, Norbert; Deess, Perry; Rudniy, Oleksandr; Joshi, Kamal

2013-01-01

This study investigated the use of automated essay scoring (AES) to identify at-risk students enrolled in a first-year university writing course. An application of AES, the "Criterion"[R] Online Writing Evaluation Service was evaluated through a methodology focusing on construct modelling, response processes, disaggregation, extrapolation,…

Automated Essay Scoring

ERIC Educational Resources Information Center

Dikli, Semire

2006-01-01

The impacts of computers on writing have been widely studied for three decades. Even basic computers functions, i.e. word processing, have been of great assistance to writers in modifying their essays. The research on Automated Essay Scoring (AES) has revealed that computers have the capacity to function as a more effective cognitive tool (Attali,…

Lameness Detection in Dairy Cows: Part 1. How to Distinguish between Non-Lame and Lame Cows Based on Differences in Locomotion or Behavior

PubMed Central

Van Nuffel, Annelies; Zwertvaegher, Ingrid; Pluym, Liesbet; Van Weyenberg, Stephanie; Thorup, Vivi M.; Pastell, Matti; Sonck, Bart; Saeys, Wouter

2015-01-01

Simple Summary Scoring cattle for lameness based on changes in locomotion or behavior is essential for farmers to find and treat their lame animals. This review discusses the normal locomotion of cows in order to define abnormal locomotion due to lameness. It furthermore provides an overview of various relevant visual locomotion scoring systems that are currently being used as well as practical considerations when assessing lameness on a commercial farm. Abstract Due to its detrimental effect on cow welfare, health and production, lameness in dairy cows has received quite a lot of attention in the last few decades—not only in terms of prevention and treatment of lameness but also in terms of detection, as early treatment might decrease the number of severely lame cows in the herds as well as decrease the direct and indirect costs associated with lameness cases. Generally, lame cows are detected by the herdsman, hoof trimmer or veterinarian based on abnormal locomotion, abnormal behavior or the presence of hoof lesions during routine trimming. In the scientific literature, several guidelines are proposed to detect lame cows based on visual interpretation of the locomotion of individual cows (i.e., locomotion scoring systems). Researchers and the industry have focused on automating such observations to support the farmer in finding the lame cows in their herds, but until now, such automated systems have rarely been used in commercial herds. This review starts with the description of normal locomotion of cows in order to define ‘abnormal’ locomotion caused by lameness. Cow locomotion (gait and posture) and behavioral features that change when a cow becomes lame are described and linked to the existing visual scoring systems. In addition, the lack of information of normal cow gait and a clear description of ‘abnormal’ gait are discussed. Finally, the different set-ups used during locomotion scoring and their influence on the resulting locomotion scores are evaluated. PMID:26479389

The Impact of Misspelled Words on Automated Computer Scoring: A Case Study of Scientific Explanations

NASA Astrophysics Data System (ADS)

Ha, Minsu; Nehm, Ross H.

2016-06-01

Automated computerized scoring systems (ACSSs) are being increasingly used to analyze text in many educational settings. Nevertheless, the impact of misspelled words (MSW) on scoring accuracy remains to be investigated in many domains, particularly jargon-rich disciplines such as the life sciences. Empirical studies confirm that MSW are a pervasive feature of human-generated text and that despite improvements, spell-check and auto-replace programs continue to be characterized by significant errors. Our study explored four research questions relating to MSW and text-based computer assessments: (1) Do English language learners (ELLs) produce equivalent magnitudes and types of spelling errors as non-ELLs? (2) To what degree do MSW impact concept-specific computer scoring rules? (3) What impact do MSW have on computer scoring accuracy? and (4) Are MSW more likely to impact false-positive or false-negative feedback to students? We found that although ELLs produced twice as many MSW as non-ELLs, MSW were relatively uncommon in our corpora. The MSW in the corpora were found to be important features of the computer scoring models. Although MSW did not significantly or meaningfully impact computer scoring efficacy across nine different computer scoring models, MSW had a greater impact on the scoring algorithms for naïve ideas than key concepts. Linguistic and concept redundancy in student responses explains the weak connection between MSW and scoring accuracy. Lastly, we found that MSW tend to have a greater impact on false-positive feedback. We discuss the implications of these findings for the development of next-generation science assessments.

Automated measurement of estrogen receptor in breast cancer: a comparison of fluorescent and chromogenic methods of measurement

PubMed Central

Zarrella, Elizabeth; Coulter, Madeline; Welsh, Allison; Carvajal, Daniel; Schalper, Kurt; Harigopal, Malini; Rimm, David; Neumeister, Veronique

2016-01-01

While FDA approved methods of assessment of Estrogen Receptor (ER) are “fit for purpose”, they represent a 30-year-old technology. New quantitative methods, both chromogenic and fluorescent, have been developed and studies have shown that these methods increase the accuracy of assessment of ER. Here, we compare three methods of ER detection and assessment on two retrospective tissue microarray cohorts of breast cancer patients: estimates of percent nuclei positive by pathologists and by Aperio’s nuclear algorithm (standard chromogenic immunostaining), and immunofluorescence as quantified with the AQUA® method of quantitative immunofluorescence (QIF). Reproducibility was excellent (R2 > 0.95) between users for both automated analysis methods, and the Aperio and QIF scoring results were also highly correlated, despite the different detection systems. The subjective readings show lower levels of reproducibility and a discontinuous, bimodal distribution of scores not seen by either mechanized method. Kaplan-Meier analysis of 10-year disease-free survival was significant for each method (Pathologist, P=0.0019; Aperio, P=0.0053, AQUA, P=0.0026), but there were discrepancies in patient classification in 19 out of 233 cases analyzed. Out of these, 11 were visually positive by both chromogenic and fluorescent detection. In 10 cases, the Aperio nuclear algorithm labeled the nuclei as negative, in 1 case, the AQUA score was just under the cutoff for positivity (determined by an Index TMA). In contrast, 8 out of 19 discrepant cases had clear nuclear positivity by fluorescence that was unable to be visualized by chromogenic detection, perhaps due to low positivity masked by the hematoxylin counterstain. These results demonstrate that automated systems enable objective, precise quantification of ER. Furthermore immunofluorescence detection offers the additional advantage of a signal that cannot be masked by a counterstaining agent. These data support the usage of automated methods for measurement of this and other biomarkers that may be used in companion diagnostic tests. PMID:27348626

The assessment of post-vasectomy pain in mice using behaviour and the Mouse Grimace Scale.

PubMed

Leach, Matthew C; Klaus, Kristel; Miller, Amy L; Scotto di Perrotolo, Maud; Sotocinal, Susana G; Flecknell, Paul A

2012-01-01

Current behaviour-based pain assessments for laboratory rodents have significant limitations. Assessment of facial expression changes, as a novel means of pain scoring, may overcome some of these limitations. The Mouse Grimace Scale appears to offer a means of assessing post-operative pain in mice that is as effective as manual behavioural-based scoring, without the limitations of such schemes. Effective assessment of post-operative pain is not only critical for animal welfare, but also the validity of science using animal models. This study compared changes in behaviour assessed using both an automated system ("HomeCageScan") and using manual analysis with changes in facial expressions assessed using the Mouse Grimace Scale (MGS). Mice (n = 6/group) were assessed before and after surgery (scrotal approach vasectomy) and either received saline, meloxicam or bupivacaine. Both the MGS and manual scoring of pain behaviours identified clear differences between the pre and post surgery periods and between those animals receiving analgesia (20 mg/kg meloxicam or 5 mg/kg bupivacaine) or saline post-operatively. Both of these assessments were highly correlated with those showing high MGS scores also exhibiting high frequencies of pain behaviours. Automated behavioural analysis in contrast was only able to detect differences between the pre and post surgery periods. In conclusion, both the Mouse Grimace Scale and manual scoring of pain behaviours are assessing the presence of post-surgical pain, whereas automated behavioural analysis could be detecting surgical stress and/or post-surgical pain. This study suggests that the Mouse Grimace Scale could prove to be a quick and easy means of assessing post-surgical pain, and the efficacy of analgesic treatment in mice that overcomes some of the limitations of behaviour-based assessment schemes.

Effect of online formative assessment on summative performance in integrated musculoskeletal system module.

PubMed

Mitra, Nilesh Kumar; Barua, Ankur

2015-03-03

The impact of web-based formative assessment practices on performance of undergraduate medical students in summative assessments is not widely studied. This study was conducted among third-year undergraduate medical students of a designated university in Malaysia to compare the effect, on performance in summative assessment, of repeated computer-based formative assessment with automated feedback with that of single paper-based formative assessment with face-to face feedback. This quasi-randomized trial was conducted among two groups of undergraduate medical students who were selected by stratified random technique from a cohort undertaking the Musculoskeletal module. The control group C (n = 102) was subjected to a paper-based formative MCQ test. The experimental group E (n = 65) was provided three online formative MCQ tests with automated feedback. The summative MCQ test scores for both these groups were collected after the completion of the module. In this study, no significant difference was observed between the mean summative scores of the two groups. However, Band 1 students from group E with higher entry qualification showed higher mean score in the summative assessment. A trivial, but significant and positive correlation (r(2) = +0.328) was observed between the online formative test scores and summative assessment scores of group E. The proportionate increase of performance in group E was found to be almost double than group C. The use of computer based formative test with automated feedback improved the performance of the students with better academic background in the summative assessment. Computer-based formative test can be explored as an optional addition to the curriculum of pre-clinical integrated medical program to improve the performance of the students with higher academic ability.

Does Automated Feedback Improve Writing Quality?

ERIC Educational Resources Information Center

Wilson, Joshua; Olinghouse, Natalie G.; Andrada, Gilbert N.

2014-01-01

The current study examines data from students in grades 4-8 who participated in a statewide computer-based benchmark writing assessment that featured automated essay scoring and automated feedback. We examined whether the use of automated feedback was associated with gains in writing quality across revisions to an essay, and with transfer effects…

Implementation of a novel postoperative monitoring system using automated Modified Early Warning Scores (MEWS) incorporating end-tidal capnography.

PubMed

Blankush, Joseph M; Freeman, Robbie; McIlvaine, Joy; Tran, Trung; Nassani, Stephen; Leitman, I Michael

2017-10-01

Modified Early Warning Scores (MEWS) provide real-time vital sign (VS) trending and reduce ICU admissions in post-operative patients. These early warning calculations classically incorporate oxygen saturation, heart rate, respiratory rate, systolic blood pressure, and temperature but have not previously included end-tidal CO2 (EtCO 2 ), more recently identified as an independent predictor of critical illness. These systems may be subject to failure when physiologic data is incorrectly measured, leading to false alarms and increased workload. This study investigates whether the implementation of automated devices that utilize ongoing vital signs monitoring and MEWS calculations, inclusive of a score for end-tidal CO 2 (EtCO 2 ), can be feasibly implemented on the general care hospital floor and effectively identify derangements in a post-operative patient's condition while limiting the amount of false alarms that would serve to increase provider workload. From July to November 2014, post-operative patients meeting the inclusion criteria (BMI > 30 kg/m 2 , history of obstructive sleep apnea, or the use of patient-controlled analgesia (PCA) or epidural narcotics) were monitored using automated devices that record minute-by-minute VS included in classic MEWS calculations as well as EtCO 2 . Automated messages via pagers were sent to providers for instances when the device measured elevated MEWS, abnormal EtCO 2 , and oxygen desaturations below 85 %. Data, including alarm and message details from the first 133 patients, were recorded and analyzed. Overall, 3.3 alarms and pages sounded per hour of monitoring. Device-only alarms sounded 2.7 times per hour-21 % were technical alarms. The remaining device-only alarms for concerning VS sounded 2.0/h, 70 % for falsely recorded VS. Pages for abnormal EtCO 2 sounded 0.4/h (82 % false recordings) while pages for low blood oxygen saturation sounded 0.1/h (55 % false alarms). 143 times (0.1 pages/h) the devices calculated a MEWS warranting a page (rise in MEWS by 2 or 5 or greater)-62 % were false scores inclusive of falsely recorded VS. An abnormal EtCO 2 value resulted in or added to an elevated MEWS score in 29 % of notifications, but 50 % of these included a falsely abnormal EtCO 2 value. To date, no adverse events have occurred. There were no statistically significant demographic, post-operative condition, or pre-existing comorbidity differences between patients who had a majority of true alarms from those who had mostly false-positive alarms. Although not statistically significant, the group of patients in whom automated MEWS suggested greater utility included those with a history of hypertension (p = 0.072) and renal disease (p = 0.084). EtCO 2 monitoring was more likely to be useful in patients with a history of type 2 diabetes, coronary artery disease, and obstructive sleep apnea (p < 0.05). These patients were also more likely to have been on a PCA post-operatively (p < 0.05). Overall, non-invasive physiologic monitoring incorporating an automated MEWS system, modified to include end-tidal CO2 can be feasibly implemented in a hospital ward. Further study is needed to evaluate its clinical utility, including an end-tidal CO 2 score, is feasibly implemented and can be useful in monitoring select post-operative patients for derangements in physiologic metrics. Like any other monitoring system, false alarms may occur at high rates. While further study is needed to determine the additive utility of EtCO 2 in MEWS calculations, this study suggests utility of EtCO 2 in select post-operative patients.

Use of Automated Scoring Features to Generate Hypotheses Regarding Language-Based DIF

ERIC Educational Resources Information Center

Shermis, Mark D.; Mao, Liyang; Mulholland, Matthew; Kieftenbeld, Vincent

2017-01-01

This study uses the feature sets employed by two automated scoring engines to determine if a "linguistic profile" could be formulated that would help identify items that are likely to exhibit differential item functioning (DIF) based on linguistic features. Sixteen items were administered to 1200 students where demographic information…

Validation of Automated Scoring for a Formative Assessment That Employs Scientific Argumentation

ERIC Educational Resources Information Center

Mao, Liyang; Liu, Ou Lydia; Roohr, Katrina; Belur, Vinetha; Mulholland, Matthew; Lee, Hee-Sun; Pallant, Amy

2018-01-01

Scientific argumentation is one of the core practices for teachers to implement in science classrooms. We developed a computer-based formative assessment to support students' construction and revision of scientific arguments. The assessment is built upon automated scoring of students' arguments and provides feedback to students and teachers.…

Designing an Automated Assessment of Public Speaking Skills Using Multimodal Cues

ERIC Educational Resources Information Center

Chen, Lei; Feng, Gary; Leong, Chee Wee; Joe, Jilliam; Kitchen, Christopher; Lee, Chong Min

2016-01-01

Traditional assessments of public speaking skills rely on human scoring. We report an initial study on the development of an automated scoring model for public speaking performances using multimodal technologies. Task design, rubric development, and human rating were conducted according to standards in educational assessment. An initial corpus of…

Using Automated Scores of Student Essays to Support Teacher Guidance in Classroom Inquiry

NASA Astrophysics Data System (ADS)

Gerard, Libby F.; Linn, Marcia C.

2016-02-01

Computer scoring of student written essays about an inquiry topic can be used to diagnose student progress both to alert teachers to struggling students and to generate automated guidance. We identify promising ways for teachers to add value to automated guidance to improve student learning. Three teachers from two schools and their 386 students participated. We draw on evidence from student progress, observations of how teachers interact with students, and reactions of teachers. The findings suggest that alerts for teachers prompted rich teacher-student conversations about energy in photosynthesis. In one school, the combination of the automated guidance plus teacher guidance was more effective for student science learning than two rounds of personalized, automated guidance. In the other school, both approaches resulted in equal learning gains. These findings suggest optimal combinations of automated guidance and teacher guidance to support students to revise explanations during inquiry and build integrated understanding of science.

Diagnostic Ability of Automated Pupillography in Glaucoma.

PubMed

Rao, Harsha L; Kadambi, Sujatha V; Mehta, Pooja; Dasari, Srilakshmi; Puttaiah, Narendra K; Pradhan, Zia S; Rao, Dhanraj A S; Shetty, Rohit

2017-05-01

To evaluate the diagnostic ability of automated pupillography measurements in glaucoma and study the effect of inter-eye asymmetry in glaucomatous damage on the diagnostic ability. In an observational, cross-sectional study, 47 glaucoma patients and 42 control subjects underwent automated pupillography using a commercially available device. Diagnostic abilities of the pupillary response measurements were evaluated using area under receiver operating characteristic (ROC) curves (AUC) and sensitivities at fixed specificities. Influence of inter-eye asymmetry in glaucoma [inter-eye mean deviation (MD) difference on visual fields (VF)] on the diagnostic ability of pupillography parameters was evaluated by ROC regression approach. The AUCs of automated pupillography parameters ranged from 0.60 (amplitude score with peripheral blue stimulus) to 0.82 (amplitude score with full field white stimulus, Amp-FF-W). Sensitivity at 95% specificity ranged between 5% (amplitude score with full field blue stimulus) and 45% (amplitude score with full field green stimulus). Inter-eye MD difference significantly affected the diagnostic performance of automated pupillography parameters (p < 0.05). AUCs of Amp-FF-W at inter-eye MD difference of 0 dB, 5 dB, 10 dB and 15 dB were 0.71, 0.80, 0.87 and 0.93, respectively, according to the regression model. The corresponding sensitivities at 95% specificity were 20%, 34%, 50% and 66%, respectively. The diagnostic abilities of even the best automated pupillography parameters were only moderate in glaucoma. The performance of these pupillography measurements in detecting glaucoma significantly increased with greater inter-eye asymmetry in the glaucomatous damage.

The RABiT: a rapid automated biodosimetry tool for radiological triage. II. Technological developments.

PubMed

Garty, Guy; Chen, Youhua; Turner, Helen C; Zhang, Jian; Lyulko, Oleksandra V; Bertucci, Antonella; Xu, Yanping; Wang, Hongliang; Simaan, Nabil; Randers-Pehrson, Gerhard; Lawrence Yao, Y; Brenner, David J

2011-08-01

Over the past five years the Center for Minimally Invasive Radiation Biodosimetry at Columbia University has developed the Rapid Automated Biodosimetry Tool (RABiT), a completely automated, ultra-high throughput biodosimetry workstation. This paper describes recent upgrades and reliability testing of the RABiT. The RABiT analyses fingerstick-derived blood samples to estimate past radiation exposure or to identify individuals exposed above or below a cut-off dose. Through automated robotics, lymphocytes are extracted from fingerstick blood samples into filter-bottomed multi-well plates. Depending on the time since exposure, the RABiT scores either micronuclei or phosphorylation of the histone H2AX, in an automated robotic system, using filter-bottomed multi-well plates. Following lymphocyte culturing, fixation and staining, the filter bottoms are removed from the multi-well plates and sealed prior to automated high-speed imaging. Image analysis is performed online using dedicated image processing hardware. Both the sealed filters and the images are archived. We have developed a new robotic system for lymphocyte processing, making use of an upgraded laser power and parallel processing of four capillaries at once. This system has allowed acceleration of lymphocyte isolation, the main bottleneck of the RABiT operation, from 12 to 2 sec/sample. Reliability tests have been performed on all robotic subsystems. Parallel handling of multiple samples through the use of dedicated, purpose-built, robotics and high speed imaging allows analysis of up to 30,000 samples per day.

The RABiT: A Rapid Automated Biodosimetry Tool For Radiological Triage. II. Technological Developments

PubMed Central

Garty, Guy; Chen, Youhua; Turner, Helen; Zhang, Jian; Lyulko, Oleksandra; Bertucci, Antonella; Xu, Yanping; Wang, Hongliang; Simaan, Nabil; Randers-Pehrson, Gerhard; Yao, Y. Lawrence; Brenner, David J.

2011-01-01

Purpose Over the past five years the Center for Minimally Invasive Radiation Biodosimetry at Columbia University has developed the Rapid Automated Biodosimetry Tool (RABiT), a completely automated, ultra-high throughput biodosimetry workstation. This paper describes recent upgrades and reliability testing of the RABiT. Materials and methods The RABiT analyzes fingerstick-derived blood samples to estimate past radiation exposure or to identify individuals exposed above or below a cutoff dose. Through automated robotics, lymphocytes are extracted from fingerstick blood samples into filter-bottomed multi-well plates. Depending on the time since exposure, the RABiT scores either micronuclei or phosphorylation of the histone H2AX, in an automated robotic system, using filter-bottomed multi-well plates. Following lymphocyte culturing, fixation and staining, the filter bottoms are removed from the multi-well plates and sealed prior to automated high-speed imaging. Image analysis is performed online using dedicated image processing hardware. Both the sealed filters and the images are archived. Results We have developed a new robotic system for lymphocyte processing, making use of an upgraded laser power and parallel processing of four capillaries at once. This system has allowed acceleration of lymphocyte isolation, the main bottleneck of the RABiT operation, from 12 to 2 sec/sample. Reliability tests have been performed on all robotic subsystems. Conclusions Parallel handling of multiple samples through the use of dedicated, purpose-built, robotics and high speed imaging allows analysis of up to 30,000 samples per day. PMID:21557703

The use of automated Ki67 analysis to predict Oncotype DX risk-of-recurrence categories in early-stage breast cancer.

PubMed

Thakur, Satbir Singh; Li, Haocheng; Chan, Angela M Y; Tudor, Roxana; Bigras, Gilbert; Morris, Don; Enwere, Emeka K; Yang, Hua

2018-01-01

Ki67 is a commonly used marker of cancer cell proliferation, and has significant prognostic value in breast cancer. In spite of its clinical importance, assessment of Ki67 remains a challenge, as current manual scoring methods have high inter- and intra-user variability. A major reason for this variability is selection bias, in that different observers will score different regions of the same tumor. Here, we developed an automated Ki67 scoring method that eliminates selection bias, by using whole-slide analysis to identify and score the tumor regions with the highest proliferative rates. The Ki67 indices calculated using this method were highly concordant with manual scoring by a pathologist (Pearson's r = 0.909) and between users (Pearson's r = 0.984). We assessed the clinical validity of this method by scoring Ki67 from 328 whole-slide sections of resected early-stage, hormone receptor-positive, human epidermal growth factor receptor 2-negative breast cancer. All patients had Oncotype DX testing performed (Genomic Health) and available Recurrence Scores. High Ki67 indices correlated significantly with several clinico-pathological correlates, including higher tumor grade (1 versus 3, P<0.001), higher mitotic score (1 versus 3, P<0.001), and lower Allred scores for estrogen and progesterone receptors (P = 0.002, 0.008). High Ki67 indices were also significantly correlated with higher Oncotype DX risk-of-recurrence group (low versus high, P<0.001). Ki67 index was the major contributor to a machine learning model which, when trained solely on clinico-pathological data and Ki67 scores, identified Oncotype DX high- and low-risk patients with 97% accuracy, 98% sensitivity and 80% specificity. Automated scoring of Ki67 can thus successfully address issues of consistency, reproducibility and accuracy, in a manner that integrates readily into the workflow of a pathology laboratory. Furthermore, automated Ki67 scores contribute significantly to models that predict risk of recurrence in breast cancer.

Automated assessment of mobility in bedridden patients.

PubMed

Bennett, Stephanie; Goubran, Rafik; Rockwood, Kenneth; Knoefel, Frank

2013-01-01

Immobility in older patients is a costly problem for both patients and healthcare workers. The Hierarchical Assessment of Balance and Mobility (HABAM) is a clinical tool able to assess immobile patients and predict morbidity, yet could become more reliable and informative through automation. This paper proposes an algorithm to automatically determine which of three enacted HABAM scores (associated with bedridden patients) had been performed by volunteers. A laptop was used to gather pressure data from three mats placed on a standard hospital bed frame while five volunteers performed three enactments each. A system of algorithms was created, consisting of three subsystems. The first subsystem used mattress data to calculate individual sensor sums and eliminate the weight of the mattress. The second subsystem established a baseline pressure reading for each volunteer and used percentage change to identify and distinguish between two enactments. The third subsystem used calculated weight distribution ratios to determine if the data represented the remaining enactment. The system was tested for accuracy by inputting the volunteer data and recording the assessment output (a score per data set). The system identified 13 of 15 sets of volunteer data as expected. Examination of these results indicated that the two sets of data were not misidentified; rather, the volunteers had made mistakes in performance. These results suggest that this system of algorithms is effective in distinguishing between the three HABAM score enactments examined here, and emphasizes the potential for pervasive computing to improve traditional healthcare.

The Influence of Rater Effects in Training Sets on the Psychometric Quality of Automated Scoring for Writing Assessments

ERIC Educational Resources Information Center

Wind, Stefanie A.; Wolfe, Edward W.; Engelhard, George, Jr.; Foltz, Peter; Rosenstein, Mark

2018-01-01

Automated essay scoring engines (AESEs) are becoming increasingly popular as an efficient method for performance assessments in writing, including many language assessments that are used worldwide. Before they can be used operationally, AESEs must be "trained" using machine-learning techniques that incorporate human ratings. However, the…

On-the-Fly Customization of Automated Essay Scoring. Research Report. ETS RR-07-42

ERIC Educational Resources Information Center

Attali, Yigal

2007-01-01

Because there is no commonly accepted view of what makes for good writing, automated essay scoring (AES) ideally should be able to accommodate different theoretical positions, certainly at the level of state standards but also perhaps among teachers at the classroom level. This paper presents a practical approach and an interactive computer…

Using Automated Essay Scores as an Anchor When Equating Constructed Response Writing Tests

ERIC Educational Resources Information Center

Almond, Russell G.

2014-01-01

Assessments consisting of only a few extended constructed response items (essays) are not typically equated using anchor test designs as there are typically too few essay prompts in each form to allow for meaningful equating. This article explores the idea that output from an automated scoring program designed to measure writing fluency (a common…

Identification of suitable fundus images using automated quality assessment methods.

PubMed

Şevik, Uğur; Köse, Cemal; Berber, Tolga; Erdöl, Hidayet

2014-04-01

Retinal image quality assessment (IQA) is a crucial process for automated retinal image analysis systems to obtain an accurate and successful diagnosis of retinal diseases. Consequently, the first step in a good retinal image analysis system is measuring the quality of the input image. We present an approach for finding medically suitable retinal images for retinal diagnosis. We used a three-class grading system that consists of good, bad, and outlier classes. We created a retinal image quality dataset with a total of 216 consecutive images called the Diabetic Retinopathy Image Database. We identified the suitable images within the good images for automatic retinal image analysis systems using a novel method. Subsequently, we evaluated our retinal image suitability approach using the Digital Retinal Images for Vessel Extraction and Standard Diabetic Retinopathy Database Calibration level 1 public datasets. The results were measured through the F1 metric, which is a harmonic mean of precision and recall metrics. The highest F1 scores of the IQA tests were 99.60%, 96.50%, and 85.00% for good, bad, and outlier classes, respectively. Additionally, the accuracy of our suitable image detection approach was 98.08%. Our approach can be integrated into any automatic retinal analysis system with sufficient performance scores.

Automated Assessment of Patients' Self-Narratives for Posttraumatic Stress Disorder Screening Using Natural Language Processing and Text Mining.

PubMed

He, Qiwei; Veldkamp, Bernard P; Glas, Cees A W; de Vries, Theo

2017-03-01

Patients' narratives about traumatic experiences and symptoms are useful in clinical screening and diagnostic procedures. In this study, we presented an automated assessment system to screen patients for posttraumatic stress disorder via a natural language processing and text-mining approach. Four machine-learning algorithms-including decision tree, naive Bayes, support vector machine, and an alternative classification approach called the product score model-were used in combination with n-gram representation models to identify patterns between verbal features in self-narratives and psychiatric diagnoses. With our sample, the product score model with unigrams attained the highest prediction accuracy when compared with practitioners' diagnoses. The addition of multigrams contributed most to balancing the metrics of sensitivity and specificity. This article also demonstrates that text mining is a promising approach for analyzing patients' self-expression behavior, thus helping clinicians identify potential patients from an early stage.

Microscopic image analysis for reticulocyte based on watershed algorithm

NASA Astrophysics Data System (ADS)

Wang, J. Q.; Liu, G. F.; Liu, J. G.; Wang, G.

2007-12-01

We present a watershed-based algorithm in the analysis of light microscopic image for reticulocyte (RET), which will be used in an automated recognition system for RET in peripheral blood. The original images, obtained by micrography, are segmented by modified watershed algorithm and are recognized in term of gray entropy and area of connective area. In the process of watershed algorithm, judgment conditions are controlled according to character of the image, besides, the segmentation is performed by morphological subtraction. The algorithm was simulated with MATLAB software. It is similar for automated and manual scoring and there is good correlation(r=0.956) between the methods, which is resulted from 50 pieces of RET images. The result indicates that the algorithm for peripheral blood RETs is comparable to conventional manual scoring, and it is superior in objectivity. This algorithm avoids time-consuming calculation such as ultra-erosion and region-growth, which will speed up the computation consequentially.

Automated brain computed tomographic densitometry of early ischemic changes in acute stroke

PubMed Central

Stoel, Berend C.; Marquering, Henk A.; Staring, Marius; Beenen, Ludo F.; Slump, Cornelis H.; Roos, Yvo B.; Majoie, Charles B.

2015-01-01

Abstract. The Alberta Stroke Program Early CT score (ASPECTS) scoring method is frequently used for quantifying early ischemic changes (EICs) in patients with acute ischemic stroke in clinical studies. Varying interobserver agreement has been reported, however, with limited agreement. Therefore, our goal was to develop and evaluate an automated brain densitometric method. It divides CT scans of the brain into ASPECTS regions using atlas-based segmentation. EICs are quantified by comparing the brain density between contralateral sides. This method was optimized and validated using CT data from 10 and 63 patients, respectively. The automated method was validated against manual ASPECTS, stroke severity at baseline and clinical outcome after 7 to 10 days (NIH Stroke Scale, NIHSS) and 3 months (modified Rankin Scale). Manual and automated ASPECTS showed similar and statistically significant correlations with baseline NIHSS (R=−0.399 and −0.277, respectively) and with follow-up mRS (R=−0.256 and −0.272), except for the follow-up NIHSS. Agreement between automated and consensus ASPECTS reading was similar to the interobserver agreement of manual ASPECTS (differences <1 point in 73% of cases). The automated ASPECTS method could, therefore, be used as a supplementary tool to assist manual scoring. PMID:26158082

Diagnostic value of a novel fully automated immunochemistry assay for detection of ALK rearrangement in primary lung adenocarcinoma.

PubMed

Ying, J; Guo, L; Qiu, T; Shan, L; Ling, Y; Liu, X; Lu, N

2013-10-01

To evaluate the diagnostic value of a novel fully automated immunohistochemistry (IHC) assay for detection of anaplastic lymphoma kinase (ALK) fusion in a large number of ALK-positive lung adenocarcinoma (ADC) patients. We tested 196 lung ADCs for ALK rearrangement by two IHC assays (Ventana pre-diluted ALK D5F3 antibody with the Optiview DAB IHC detection kit and Optiview Amplification kit, D5F3 by Cell Signaling Technology (CST) with Ultraview DAB detection kit by Ventana), fluorescence in situ hybridization (FISH) and real-time reverse transcription-PCR (RT-PCR). CST ALK IHC was scored using the scoring scheme of 0, no staining; 1+, faint; 2+, moderate; and 3+, strong cytoplasmic reactivity in ≥ 10% of tumor cells. As for Ventana IHC, a binary scoring system (positive or negative for ALK status) was adopted for evaluating the staining results. Among 196 cases tested, 63 (32%), 65 (33%), 70 (36%), and 69 (35%) cases were ALK positive by FISH, Ventana IHC, CST IHC, and RT-PCR, respectively. The sensitivity and specificity of Ventana IHC were 100% and 98%, respectively. Two Ventana IHC-positive cases, which were also CST IHC score of 3+, showed FISH negative, but their ALK rearrangement was confirmed by RT-PCR and direct sequencing. The sensitivity and specificity of CST IHC with staining intensity score of 1+ or more were 100% and 95%, respectively. Five (25%, of 20) patients with CST IHC score of 1+ were both FISH and RT-PCR negative. The sensitivity and specificity of RT-PCR for detection of ALK fusion were 98% and 95%, respectively. The total accordance rate between ALK RT-PCR and Ventana IHC was 97%. The novel fully automated IHC assay is a reliable screening tool in routine pathologic laboratories for identification of patients with ALK rearrangement for targeted therapy in lung ADC.

Performance evaluation of an automated single-channel sleep–wake detection algorithm

PubMed Central

Kaplan, Richard F; Wang, Ying; Loparo, Kenneth A; Kelly, Monica R; Bootzin, Richard R

2014-01-01

Background A need exists, from both a clinical and a research standpoint, for objective sleep measurement systems that are both easy to use and can accurately assess sleep and wake. This study evaluates the output of an automated sleep–wake detection algorithm (Z-ALG) used in the Zmachine (a portable, single-channel, electroencephalographic [EEG] acquisition and analysis system) against laboratory polysomnography (PSG) using a consensus of expert visual scorers. Methods Overnight laboratory PSG studies from 99 subjects (52 females/47 males, 18–60 years, median age 32.7 years), including both normal sleepers and those with a variety of sleep disorders, were assessed. PSG data obtained from the differential mastoids (A1–A2) were assessed by Z-ALG, which determines sleep versus wake every 30 seconds using low-frequency, intermediate-frequency, and high-frequency and time domain EEG features. PSG data were independently scored by two to four certified PSG technologists, using standard Rechtschaffen and Kales guidelines, and these score files were combined on an epoch-by-epoch basis, using a majority voting rule, to generate a single score file per subject to compare against the Z-ALG output. Both epoch-by-epoch and standard sleep indices (eg, total sleep time, sleep efficiency, latency to persistent sleep, and wake after sleep onset) were compared between the Z-ALG output and the technologist consensus score files. Results Overall, the sensitivity and specificity for detecting sleep using the Z-ALG as compared to the technologist consensus are 95.5% and 92.5%, respectively, across all subjects, and the positive predictive value and the negative predictive value for detecting sleep are 98.0% and 84.2%, respectively. Overall κ agreement is 0.85 (approaching the level of agreement observed among sleep technologists). These results persist when the sleep disorder subgroups are analyzed separately. Conclusion This study demonstrates that the Z-ALG automated sleep–wake detection algorithm, using the single A1–A2 EEG channel, has a level of accuracy that is similar to PSG technologists in the scoring of sleep and wake, thereby making it suitable for a variety of in-home monitoring applications, such as in conjunction with the Zmachine system. PMID:25342922

Colometer: a real-time quality feedback system for screening colonoscopy.

PubMed

Filip, Dobromir; Gao, Xuexin; Angulo-Rodríguez, Leticia; Mintchev, Martin P; Devlin, Shane M; Rostom, Alaa; Rosen, Wayne; Andrews, Christopher N

2012-08-28

To investigate the performance of a new software-based colonoscopy quality assessment system. The software-based system employs a novel image processing algorithm which detects the levels of image clarity, withdrawal velocity, and level of the bowel preparation in a real-time fashion from live video signal. Threshold levels of image blurriness and the withdrawal velocity below which the visualization could be considered adequate have initially been determined arbitrarily by review of sample colonoscopy videos by two experienced endoscopists. Subsequently, an overall colonoscopy quality rating was computed based on the percentage of the withdrawal time with adequate visualization (scored 1-5; 1, when the percentage was 1%-20%; 2, when the percentage was 21%-40%, etc.). In order to test the proposed velocity and blurriness thresholds, screening colonoscopy withdrawal videos from a specialized ambulatory colon cancer screening center were collected, automatically processed and rated. Quality ratings on the withdrawal were compared to the insertion in the same patients. Then, 3 experienced endoscopists reviewed the collected videos in a blinded fashion and rated the overall quality of each withdrawal (scored 1-5; 1, poor; 3, average; 5, excellent) based on 3 major aspects: image quality, colon preparation, and withdrawal velocity. The automated quality ratings were compared to the averaged endoscopist quality ratings using Spearman correlation coefficient. Fourteen screening colonoscopies were assessed. Adenomatous polyps were detected in 4/14 (29%) of the collected colonoscopy video samples. As a proof of concept, the Colometer software rated colonoscope withdrawal as having better visualization than the insertion in the 10 videos which did not have any polyps (average percent time with adequate visualization: 79% ± 5% for withdrawal and 50% ± 14% for insertion, P < 0.01). Withdrawal times during which no polyps were removed ranged from 4-12 min. The median quality rating from the automated system and the reviewers was 3.45 [interquartile range (IQR), 3.1-3.68] and 3.00 (IQR, 2.33-3.67) respectively for all colonoscopy video samples. The automated rating revealed a strong correlation with the reviewer's rating (ρ coefficient= 0.65, P = 0.01). There was good correlation of the automated overall quality rating and the mean endoscopist withdrawal speed rating (Spearman r coefficient= 0.59, P = 0.03). There was no correlation of automated overall quality rating with mean endoscopists image quality rating (Spearman r coefficient= 0.41, P = 0.15). The results from a novel automated real-time colonoscopy quality feedback system strongly agreed with the endoscopists' quality assessments. Further study is required to validate this approach.

Automated Error Detection in Physiotherapy Training.

PubMed

Jovanović, Marko; Seiffarth, Johannes; Kutafina, Ekaterina; Jonas, Stephan M

2018-01-01

Manual skills teaching, such as physiotherapy education, requires immediate teacher feedback for the students during the learning process, which to date can only be performed by expert trainers. A machine-learning system trained only on correct performances to classify and score performed movements, to identify sources of errors in the movement and give feedback to the learner. We acquire IMU and sEMG sensor data from a commercial-grade wearable device and construct an HMM-based model for gesture classification, scoring and feedback giving. We evaluate the model on publicly available and self-generated data of an exemplary movement pattern executions. The model achieves an overall accuracy of 90.71% on the public dataset and 98.9% on our dataset. An AUC of 0.99 for the ROC of the scoring method could be achieved to discriminate between correct and untrained incorrect executions. The proposed system demonstrated its suitability for scoring and feedback in manual skills training.

Toward the Automated Scoring of Written Arguments: Developing an Innovative Approach for Annotation. Research Report. ETS RR-17-11

ERIC Educational Resources Information Center

Song, Yi; Deane, Paul; Beigman Klebanov, Beata

2017-01-01

This project focuses on laying the foundations for automated analysis of argumentation schemes, supporting identification and classification of the arguments being made in a text, for the purpose of scoring the quality of written analyses of arguments. We developed annotation protocols for 20 argument prompts from a college-level test under the…

The Roles of Suprasegmental Features in Predicting English Oral Proficiency with an Automated System

ERIC Educational Resources Information Center

Kang, Okim; Johnson, David

2018-01-01

Suprasegmental features have received growing attention in the field of oral assessment. In this article we describe a set of computer algorithms that automatically scores the oral proficiency of non-native speakers using unconstrained English speech. The algorithms employ machine learning and 11 suprasegmental measures divided into four groups…

Meaning-Based Scoring: A Systemic Functional Linguistics Model for Automated Test Tasks

ERIC Educational Resources Information Center

Gleason, Jesse

2014-01-01

Communicative approaches to language teaching that emphasize the importance of speaking (e.g., task-based language teaching) require innovative and evidence-based means of assessing oral language. Nonetheless, research has yet to produce an adequate assessment model for oral language (Chun 2006; Downey et al. 2008). Limited by automatic speech…

Variations in the perception of trauma-related complications between attending surgeons, surgery residents, critical care nurses, and medical students.

PubMed

Dissanaike, Sharmila; Berry, Matthew; Ginos, Jason; Paige, Robert; McNabb, Wendi; Griswold, John

2009-06-01

The morbidity and mortality conference (M&M) is a key component of the performance improvement process. The audience response system (ARS) has been shown to improve audience participation and promote more truthful responses in various settings. We implemented the ARS in our trauma M&M and evaluated the responses we received from different categories of participants. This was a prospective observational study undertaken between November 2006 and July 2007. Cases were graded based on the American College of Surgeons scoring system. We evaluated the responses of attending surgeons, residents, critical care nurses, and medical students using the ARS. We had 695 responses for complications and 936 responses for deaths. Residents consistently scored complications as more severe than other groups (P = .03). There was no difference in the scoring of deaths. Surgical residents assign higher severity to trauma-related complications than other groups when using an anonymous automated scoring system.

Lameness scoring system for dairy cows using force plates and artificial intelligence.

PubMed

Ghotoorlar, S Mokaram; Ghamsari, S Mehdi; Nowrouzian, I; Ghotoorlar, S Mokaram; Ghidary, S Shiry

2012-02-04

Lameness scoring is a routine procedure in dairy industry to screen the herds for new cases of lameness. Subjective lameness scoring, which is the most popular lameness detection and screening method in dairy herds, has several limitations. They include low intra-observer and inter-observer agreement and the discrete nature of the scores which limits its usage in monitoring the lameness. The aim of this study is to develop an automated lameness scoring system comparable with conventional subjective lameness scoring by means of artificial neural networks. The system is composed of four balanced force plates installed in a hoof-trimming box. A group of 105 dairy cows was used for the study. Twenty-three features extracted from ground reaction force (GRF) data were used in a computer training process which was performed on 60 per cent of the data. The remaining 40 per cent of the data were used to test the trained system. Repeatability of the lameness scoring system was determined by GRF samples from 25 cows, captured at two different times from the same animals. The mean sd was 0.31 and the mean coefficient of variation was 14.55 per cent, which represents a high repeatability in comparison with subjective vision-based scoring methods. Although the highest sensitivity and specificity values were seen in locomotion score groups 1 and 4, the automatic lameness system was both sensitive and specific in all groups. The sensitivity and specificity were higher than 72 per cent in locomotion score groups 1 to 4, and it was 100 per cent specific and 50 per cent sensitive for group 5.

Assessment of pharmacy information system performance in selected hospitals in isfahan city during 2011.

PubMed

Saqaeian Nejad Isfahani, Sakineh; Mirzaeian, Razieh; Habibi, Mahbobe

2013-01-01

In supporting a therapeutic approach and medication therapy management, pharmacy information system acts as one of the central pillars of information system. This ensures that medication therapy is being supported and evaluated with an optimal level of safety and quality similar to other treatments and services. This research aims to evaluate the performance of pharmacy information system in three types of teaching, private and social affiliated hospitals. The present study is an applied, descriptive and analytical study which was conducted on the pharmacy information system in use in the selected hospitals. The research population included all the users of pharmacy information systems in the selected hospitals. The research sample is the same as the research population. Researchers collected data using a self-designed checklist developed following the guidelines of the American Society of Health-System Pharmacists, Australia pharmaceutical Society and Therapeutic guidelines of the Drug Commission of the German Medical Association. The checklist validity was assessed by research supervisors and pharmacy information system pharmacists and users. To collect data besides observation, the questionnaires were distributed among pharmacy information system pharmacists and users. Finally, the analysis of the data was performed using the SPSS software. Pharmacy information system was found to be semi-automated in 16 hospitals and automated in 3 ones. Regarding the standards in the guidelines issued by the Society of Pharmacists, the highest rank in observing the input standards belonged to the Social Services associated hospitals with a mean score of 32.75. While teaching hospitals gained the highest score both in processing standards with a mean score of 29.15 and output standards with a mean score of 43.95, and the private hospitals had the lowest mean scores of 23.32, 17.78, 24.25 in input, process and output standards respectively. Based on the findings, the studied hospitals had minimal compliance with the input, output and processing standards related to the pharmacy information system. It is suggested that the establishment of a team composed of operational managers, computer fields experts, health information managers, pharmacists as well as physicians may contribute to the promotion of the capabilities of pharmacy information system to be able to focus on health care practitioners' and users' requirements.

Automatic scoring of dicentric chromosomes as a tool in large scale radiation accidents.

PubMed

Romm, H; Ainsbury, E; Barnard, S; Barrios, L; Barquinero, J F; Beinke, C; Deperas, M; Gregoire, E; Koivistoinen, A; Lindholm, C; Moquet, J; Oestreicher, U; Puig, R; Rothkamm, K; Sommer, S; Thierens, H; Vandersickel, V; Vral, A; Wojcik, A

2013-08-30

Mass casualty scenarios of radiation exposure require high throughput biological dosimetry techniques for population triage in order to rapidly identify individuals who require clinical treatment. The manual dicentric assay is a highly suitable technique, but it is also very time consuming and requires well trained scorers. In the framework of the MULTIBIODOSE EU FP7 project, semi-automated dicentric scoring has been established in six European biodosimetry laboratories. Whole blood was irradiated with a Co-60 gamma source resulting in 8 different doses between 0 and 4.5Gy and then shipped to the six participating laboratories. To investigate two different scoring strategies, cell cultures were set up with short term (2-3h) or long term (24h) colcemid treatment. Three classifiers for automatic dicentric detection were applied, two of which were developed specifically for these two different culture techniques. The automation procedure included metaphase finding, capture of cells at high resolution and detection of dicentric candidates. The automatically detected dicentric candidates were then evaluated by a trained human scorer, which led to the term 'semi-automated' being applied to the analysis. The six participating laboratories established at least one semi-automated calibration curve each, using the appropriate classifier for their colcemid treatment time. There was no significant difference between the calibration curves established, regardless of the classifier used. The ratio of false positive to true positive dicentric candidates was dose dependent. The total staff effort required for analysing 150 metaphases using the semi-automated approach was 2 min as opposed to 60 min for manual scoring of 50 metaphases. Semi-automated dicentric scoring is a useful tool in a large scale radiation accident as it enables high throughput screening of samples for fast triage of potentially exposed individuals. Furthermore, the results from the participating laboratories were comparable which supports networking between laboratories for this assay. Copyright © 2013 Elsevier B.V. All rights reserved.

Designing Automated Guidance for Concept Diagrams in Inquiry Instruction

ERIC Educational Resources Information Center

Ryoo, Kihyun; Linn, Marcia C.

2016-01-01

Advances in automated scoring technologies have the potential to support student learning during inquiry instruction by providing timely and adaptive guidance on individual students' responses. To identify which forms of automated guidance can be beneficial for inquiry learning, we compared reflective guidance to directive guidance for…

Automated Assessment of the Quality of Depression Websites

PubMed Central

Tang, Thanh Tin; Hawking, David; Christensen, Helen

2005-01-01

Background Since health information on the World Wide Web is of variable quality, methods are needed to assist consumers to identify health websites containing evidence-based information. Manual assessment tools may assist consumers to evaluate the quality of sites. However, these tools are poorly validated and often impractical. There is a need to develop better consumer tools, and in particular to explore the potential of automated procedures for evaluating the quality of health information on the web. Objective This study (1) describes the development of an automated quality assessment procedure (AQA) designed to automatically rank depression websites according to their evidence-based quality; (2) evaluates the validity of the AQA relative to human rated evidence-based quality scores; and (3) compares the validity of Google PageRank and the AQA as indicators of evidence-based quality. Method The AQA was developed using a quality feedback technique and a set of training websites previously rated manually according to their concordance with statements in the Oxford University Centre for Evidence-Based Mental Health’s guidelines for treating depression. The validation phase involved 30 websites compiled from the DMOZ, Yahoo! and LookSmart Depression Directories by randomly selecting six sites from each of the Google PageRank bands of 0, 1-2, 3-4, 5-6 and 7-8. Evidence-based ratings from two independent raters (based on concordance with the Oxford guidelines) were then compared with scores derived from the automated AQA and Google algorithms. There was no overlap in the websites used in the training and validation phases of the study. Results The correlation between the AQA score and the evidence-based ratings was high and significant (r=0.85, P<.001). Addition of a quadratic component improved the fit, the combined linear and quadratic model explaining 82 percent of the variance. The correlation between Google PageRank and the evidence-based score was lower than that for the AQA. When sites with zero PageRanks were included the association was weak and non-significant (r=0.23, P=.22). When sites with zero PageRanks were excluded, the correlation was moderate (r=.61, P=.002). Conclusions Depression websites of different evidence-based quality can be differentiated using an automated system. If replicable, generalizable to other health conditions and deployed in a consumer-friendly form, the automated procedure described here could represent an important advance for consumers of Internet medical information. PMID:16403723

Semi-automated method to measure pneumonia severity in mice through computed tomography (CT) scan analysis

NASA Astrophysics Data System (ADS)

Johri, Ansh; Schimel, Daniel; Noguchi, Audrey; Hsu, Lewis L.

2010-03-01

Imaging is a crucial clinical tool for diagnosis and assessment of pneumonia, but quantitative methods are lacking. Micro-computed tomography (micro CT), designed for lab animals, provides opportunities for non-invasive radiographic endpoints for pneumonia studies. HYPOTHESIS: In vivo micro CT scans of mice with early bacterial pneumonia can be scored quantitatively by semiautomated imaging methods, with good reproducibility and correlation with bacterial dose inoculated, pneumonia survival outcome, and radiologists' scores. METHODS: Healthy mice had intratracheal inoculation of E. coli bacteria (n=24) or saline control (n=11). In vivo micro CT scans were performed 24 hours later with microCAT II (Siemens). Two independent radiologists scored the extent of airspace abnormality, on a scale of 0 (normal) to 24 (completely abnormal). Using the Amira 5.2 software (Mercury Computer Systems), a histogram distribution of voxel counts between the Hounsfield range of -510 to 0 was created and analyzed, and a segmentation procedure was devised. RESULTS: A t-test was performed to determine whether there was a significant difference in the mean voxel value of each mouse in the three experimental groups: Saline Survivors, Pneumonia Survivors, and Pneumonia Non-survivors. It was found that the voxel count method was able to statistically tell apart the Saline Survivors from the Pneumonia Survivors, the Saline Survivors from the Pneumonia Non-survivors, but not the Pneumonia Survivors vs. Pneumonia Non-survivors. The segmentation method, however, was successfully able to distinguish the two Pneumonia groups. CONCLUSION: We have pilot-tested an evaluation of early pneumonia in mice using micro CT and a semi-automated method for lung segmentation and scoring system. Statistical analysis indicates that the system is reliable and merits further evaluation.

Automated and visual scoring methods of cerebral white matter hyperintensities: relation with age and cognitive function.

PubMed

Tiehuis, A M; Vincken, K L; Mali, W P T M; Kappelle, L J; Anbeek, P; Algra, A; Biessels, G J

2008-01-01

A reliable scoring method for ischemic cerebral white matter hyperintensities (WMH) will help to clarify the causes and consequences of these brain lesions. We compared an automated and two visual WMH scoring methods in their relations with age and cognitive function. MRI of the brain was performed on 154 participants of the Utrecht Diabetic Encephalopathy Study. WMH volumes were obtained with an automated segmentation method. Visual rating of deep and periventricular WMH (DWMH and PWMH) was performed with the Scheltens scale and the Rotterdam Scan Study (RSS) scale, respectively. Cognition was assessed with a battery of 11 tests. Within the whole study group, the association with age was most evident for the automated measured WMH volume (beta = 0.43, 95% CI = 0.29-0.57). With regard to cognition, automated measured WMH volume and Scheltens DWMH were significantly associated with information processing speed (beta = -0.22, 95% CI = -0.40 to -0.06; beta = -0.26, 95% CI = -0.42 to -0.10), whereas RSS PWMH were associated with attention and executive function (beta = -0.19, 95% CI = -0.36 to -0.02). Measurements of WMH with an automated quantitative segmentation method are comparable with visual rating scales and highly suitable for use in future studies to assess the relationship between WMH and subtle impairments in cognitive function. (c) 2007 S. Karger AG, Basel.

Relationship between automation trust and operator performance for the novice and expert in spacecraft rendezvous and docking (RVD).

PubMed

Niu, Jianwei; Geng, He; Zhang, Yijing; Du, Xiaoping

2018-09-01

Operator trust in automation is a crucial factor influencing its use and operational performance. However, the relationship between automation trust and performance remains poorly understood and requires further investigation. The objective of this paper is to explore the difference in trust and performance on automation-aided spacecraft rendezvous and docking (RVD) between the novice and the expert and to investigate the relationship between automation trust and performance as well. We employed a two-factor mixed design, with training skill (novice and expert) and automation mode (manual RVD and automation aided RVD) serving as the two factors. Twenty participants, 10 novices and 10 experts, were recruited to conduct six RVD tasks for two automation levels. After the tasks, operator performance was recorded by the desktop hand-held docking training equipment. Operator trust was also measured by a 12-items questionnaire at the beginning and end of each trial. As a result, automation narrowed the performance gap significantly between the novice and the expert, and the automation trust showed a marginally significant difference between the novice and the expert. Furthermore, the result demonstrated that the attitude angle control error of the expert was related to the total trust score, whereas other automation performance indicators were not related to the total score of trust. However, automation performance was related to the dimensions of trust, such as entrust, harmful, and dependable. Copyright © 2018 Elsevier Ltd. All rights reserved.

An automated machine vision system for the histological grading of cervical intraepithelial neoplasia (CIN).

PubMed

Keenan, S J; Diamond, J; McCluggage, W G; Bharucha, H; Thompson, D; Bartels, P H; Hamilton, P W

2000-11-01

The histological grading of cervical intraepithelial neoplasia (CIN) remains subjective, resulting in inter- and intra-observer variation and poor reproducibility in the grading of cervical lesions. This study has attempted to develop an objective grading system using automated machine vision. The architectural features of cervical squamous epithelium are quantitatively analysed using a combination of computerized digital image processing and Delaunay triangulation analysis; 230 images digitally captured from cases previously classified by a gynaecological pathologist included normal cervical squamous epithelium (n=30), koilocytosis (n=46), CIN 1 (n=52), CIN 2 (n=56), and CIN 3 (n=46). Intra- and inter-observer variation had kappa values of 0.502 and 0.415, respectively. A machine vision system was developed in KS400 macro programming language to segment and mark the centres of all nuclei within the epithelium. By object-oriented analysis of image components, the positional information of nuclei was used to construct a Delaunay triangulation mesh. Each mesh was analysed to compute triangle dimensions including the mean triangle area, the mean triangle edge length, and the number of triangles per unit area, giving an individual quantitative profile of measurements for each case. Discriminant analysis of the geometric data revealed the significant discriminatory variables from which a classification score was derived. The scoring system distinguished between normal and CIN 3 in 98.7% of cases and between koilocytosis and CIN 1 in 76.5% of cases, but only 62.3% of the CIN cases were classified into the correct group, with the CIN 2 group showing the highest rate of misclassification. Graphical plots of triangulation data demonstrated the continuum of morphological change from normal squamous epithelium to the highest grade of CIN, with overlapping of the groups originally defined by the pathologists. This study shows that automated location of nuclei in cervical biopsies using computerized image analysis is possible. Analysis of positional information enables quantitative evaluation of architectural features in CIN using Delaunay triangulation meshes, which is effective in the objective classification of CIN. This demonstrates the future potential of automated machine vision systems in diagnostic histopathology. Copyright 2000 John Wiley & Sons, Ltd.

Utility of cytopathological specimens and an automated image analysis for the evaluation of HER2 status and intratumor heterogeneity in breast carcinoma.

PubMed

Arihiro, Koji; Oda, Miyo; Ogawa, Katsunari; Kaneko, Yoshie; Shimizu, Tomomi; Tanaka, Yuna; Marubashi, Yukari; Ishida, Katsunari; Takai, Chikako; Taoka, Chie; Kimura, Shuji; Shiroma, Noriyuki

2016-12-01

Although updated HER2 testing guidelines have been improved by a collaboration between the American Society of Clinical Oncology (ASCO) and the College of American Pathologists (CAP) in 2013, HER2 evaluation is still problematic because of issues involving CEP17 polysomy, heterogeneity, and HER2 score 2+ cases. The aim of this retrospective study was to evaluate the relationship between HER2 gene heterogeneity, or so called CEP17 polysomy, using breast carcinoma cells sampled by scraping and the IHC score graded by automated image analysis using whole slide image. We randomly selected 23 breast carcinoma cases with a HER2 score 0, 24 cases with a HER2 score 1+, 24 cases with HER2 score 2+, and 23 cases with HER2 score 3+ from the records of patients with breast cancer at Hiroshima University Hospital. We compared the results of fluorescent in situ hybridization (FISH) using formalin-fixed, paraffin-embedded (FFPE) tissues and cytological samples and compared the HER2 score calculated using an automated image analysis using wholly scanned slide images and visual counting. We successfully performed the FISH assay in 78 of 94 cases (83%) using FFPE tissues and in all 94 (100%) cases using cytological samples. Frequency of both HER2 amplification and CEP17 polysomy was higher when cytological samples were used than when FFPE tissue was used. Frequency of HER2 heterogeneity using cytological samples was higher that than using FFPE tissue, except for the IHC score 3+ cases. When assessment of HER2 status based on FISH using FFPE tissue cannot be accomplished, FISH using cytological samples should be considered. When intensity of HER2 is heterogeneous in the tumor tissue, particularly in cases regarded as score 2+, they should be evaluated by automated image analysis using the whole slide image. Copyright © 2016 Elsevier GmbH. All rights reserved.

A low-cost machine vision system for the recognition and sorting of small parts

NASA Astrophysics Data System (ADS)

Barea, Gustavo; Surgenor, Brian W.; Chauhan, Vedang; Joshi, Keyur D.

2018-04-01

An automated machine vision-based system for the recognition and sorting of small parts was designed, assembled and tested. The system was developed to address a need to expose engineering students to the issues of machine vision and assembly automation technology, with readily available and relatively low-cost hardware and software. This paper outlines the design of the system and presents experimental performance results. Three different styles of plastic gears, together with three different styles of defective gears, were used to test the system. A pattern matching tool was used for part classification. Nine experiments were conducted to demonstrate the effects of changing various hardware and software parameters, including: conveyor speed, gear feed rate, classification, and identification score thresholds. It was found that the system could achieve a maximum system accuracy of 95% at a feed rate of 60 parts/min, for a given set of parameter settings. Future work will be looking at the effect of lighting.

Intra- and interoperator variability of lobar pulmonary volumes and emphysema scores in patients with chronic obstructive pulmonary disease and emphysema: comparison of manual and semi-automated segmentation techniques.

PubMed

Molinari, Francesco; Pirronti, Tommaso; Sverzellati, Nicola; Diciotti, Stefano; Amato, Michele; Paolantonio, Guglielmo; Gentile, Luigia; Parapatt, George K; D'Argento, Francesco; Kuhnigk, Jan-Martin

2013-01-01

We aimed to compare the intra- and interoperator variability of lobar volumetry and emphysema scores obtained by semi-automated and manual segmentation techniques in lung emphysema patients. In two sessions held three months apart, two operators performed lobar volumetry of unenhanced chest computed tomography examinations of 47 consecutive patients with chronic obstructive pulmonary disease and lung emphysema. Both operators used the manual and semi-automated segmentation techniques. The intra- and interoperator variability of the volumes and emphysema scores obtained by semi-automated segmentation was compared with the variability obtained by manual segmentation of the five pulmonary lobes. The intra- and interoperator variability of the lobar volumes decreased when using semi-automated lobe segmentation (coefficients of repeatability for the first operator: right upper lobe, 147 vs. 96.3; right middle lobe, 137.7 vs. 73.4; right lower lobe, 89.2 vs. 42.4; left upper lobe, 262.2 vs. 54.8; and left lower lobe, 260.5 vs. 56.5; coefficients of repeatability for the second operator: right upper lobe, 61.4 vs. 48.1; right middle lobe, 56 vs. 46.4; right lower lobe, 26.9 vs. 16.7; left upper lobe, 61.4 vs. 27; and left lower lobe, 63.6 vs. 27.5; coefficients of reproducibility in the interoperator analysis: right upper lobe, 191.3 vs. 102.9; right middle lobe, 219.8 vs. 126.5; right lower lobe, 122.6 vs. 90.1; left upper lobe, 166.9 vs. 68.7; and left lower lobe, 168.7 vs. 71.6). The coefficients of repeatability and reproducibility of emphysema scores also decreased when using semi-automated segmentation and had ranges that varied depending on the target lobe and selected threshold of emphysema. Semi-automated segmentation reduces the intra- and interoperator variability of lobar volumetry and provides a more objective tool than manual technique for quantifying lung volumes and severity of emphysema.

Toward automated assessment of health Web page quality using the DISCERN instrument.

PubMed

Allam, Ahmed; Schulz, Peter J; Krauthammer, Michael

2017-05-01

As the Internet becomes the number one destination for obtaining health-related information, there is an increasing need to identify health Web pages that convey an accurate and current view of medical knowledge. In response, the research community has created multicriteria instruments for reliably assessing online medical information quality. One such instrument is DISCERN, which measures health Web page quality by assessing an array of features. In order to scale up use of the instrument, there is interest in automating the quality evaluation process by building machine learning (ML)-based DISCERN Web page classifiers. The paper addresses 2 key issues that are essential before constructing automated DISCERN classifiers: (1) generation of a robust DISCERN training corpus useful for training classification algorithms, and (2) assessment of the usefulness of the current DISCERN scoring schema as a metric for evaluating the performance of these algorithms. Using DISCERN, 272 Web pages discussing treatment options in breast cancer, arthritis, and depression were evaluated and rated by trained coders. First, different consensus models were compared to obtain a robust aggregated rating among the coders, suitable for a DISCERN ML training corpus. Second, a new DISCERN scoring criterion was proposed (features-based score) as an ML performance metric that is more reflective of the score distribution across different DISCERN quality criteria. First, we found that a probabilistic consensus model applied to the DISCERN instrument was robust against noise (random ratings) and superior to other approaches for building a training corpus. Second, we found that the established DISCERN scoring schema (overall score) is ill-suited to measure ML performance for automated classifiers. Use of a probabilistic consensus model is advantageous for building a training corpus for the DISCERN instrument, and use of a features-based score is an appropriate ML metric for automated DISCERN classifiers. The code for the probabilistic consensus model is available at https://bitbucket.org/A_2/em_dawid/ . © The Author 2016. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com

Predictive models of lameness in dairy cows achieve high sensitivity and specificity with force measurements in three dimensions.

PubMed

Dunthorn, Jason; Dyer, Robert M; Neerchal, Nagaraj K; McHenry, Jonathan S; Rajkondawar, Parimal G; Steingraber, Gary; Tasch, Uri

2015-11-01

Lameness remains a significant cause of production losses, a growing welfare concern and may be a greater economic burden than clinical mastitis . A growing need for accurate, continuous automated detection systems continues because US prevalence of lameness is 12.5% while individual herds may experience prevalence's of 27.8-50.8%. To that end the first force-plate system restricted to the vertical dimension identified lame cows with 85% specificity and 52% sensitivity. These results lead to the hypothesis that addition of transverse and longitudinal dimensions could improve sensitivity of lameness detection. To address the hypothesis we upgraded the original force plate system to measure ground reaction forces (GRFs) across three directions. GRFs and locomotion scores were generated from randomly selected cows and logistic regression was used to develop a model that characterised relationships of locomotion scores to the GRFs. This preliminary study showed 76 variables across 3 dimensions produced a model with greater than 90% sensitivity, specificity, and area under the receiver operating curve (AUC). The result was a marked improvement on the 52% sensitivity, and 85% specificity previously observed with the 1 dimensional model or the 45% sensitivities reported with visual observations. Validation of model accuracy continues with the goal to finalise accurate automated methods of lameness detection.

Inferring Meal Eating Activities in Real World Settings from Ambient Sounds: A Feasibility Study

PubMed Central

Thomaz, Edison; Zhang, Cheng; Essa, Irfan; Abowd, Gregory D.

2015-01-01

Dietary self-monitoring has been shown to be an effective method for weight-loss, but it remains an onerous task despite recent advances in food journaling systems. Semi-automated food journaling can reduce the effort of logging, but often requires that eating activities be detected automatically. In this work we describe results from a feasibility study conducted in-the-wild where eating activities were inferred from ambient sounds captured with a wrist-mounted device; twenty participants wore the device during one day for an average of 5 hours while performing normal everyday activities. Our system was able to identify meal eating with an F-score of 79.8% in a person-dependent evaluation, and with 86.6% accuracy in a person-independent evaluation. Our approach is intended to be practical, leveraging off-the-shelf devices with audio sensing capabilities in contrast to systems for automated dietary assessment based on specialized sensors. PMID:25859566

Automated Assessment of Child Vocalization Development Using LENA.

PubMed

Richards, Jeffrey A; Xu, Dongxin; Gilkerson, Jill; Yapanel, Umit; Gray, Sharmistha; Paul, Terrance

2017-07-12

To produce a novel, efficient measure of children's expressive vocal development on the basis of automatic vocalization assessment (AVA), child vocalizations were automatically identified and extracted from audio recordings using Language Environment Analysis (LENA) System technology. Assessment was based on full-day audio recordings collected in a child's unrestricted, natural language environment. AVA estimates were derived using automatic speech recognition modeling techniques to categorize and quantify the sounds in child vocalizations (e.g., protophones and phonemes). These were expressed as phone and biphone frequencies, reduced to principal components, and inputted to age-based multiple linear regression models to predict independently collected criterion-expressive language scores. From these models, we generated vocal development AVA estimates as age-standardized scores and development age estimates. AVA estimates demonstrated strong statistical reliability and validity when compared with standard criterion expressive language assessments. Automated analysis of child vocalizations extracted from full-day recordings in natural settings offers a novel and efficient means to assess children's expressive vocal development. More research remains to identify specific mechanisms of operation.

Automated CT Scan Scores of Bronchiectasis and Air Trapping in Cystic Fibrosis

PubMed Central

Swiercz, Waldemar; Heltshe, Sonya L.; Anthony, Margaret M.; Szefler, Paul; Klein, Rebecca; Strain, John; Brody, Alan S.; Sagel, Scott D.

2014-01-01

Background: Computer analysis of high-resolution CT (HRCT) scans may improve the assessment of structural lung injury in children with cystic fibrosis (CF). The goal of this cross-sectional pilot study was to validate automated, observer-independent image analysis software to establish objective, simple criteria for bronchiectasis and air trapping. Methods: HRCT scans of the chest were performed in 35 children with CF and compared with scans from 12 disease control subjects. Automated image analysis software was developed to count visible airways on inspiratory images and to measure a low attenuation density (LAD) index on expiratory images. Among the children with CF, relationships among automated measures, Brody HRCT scanning scores, lung function, and sputum markers of inflammation were assessed. Results: The number of total, central, and peripheral airways on inspiratory images and LAD (%) on expiratory images were significantly higher in children with CF compared with control subjects. Among subjects with CF, peripheral airway counts correlated strongly with Brody bronchiectasis scores by two raters (r = 0.86, P < .0001; r = 0.91, P < .0001), correlated negatively with lung function, and were positively associated with sputum free neutrophil elastase activity. LAD (%) correlated with Brody air trapping scores (r = 0.83, P < .0001; r = 0.69, P < .0001) but did not correlate with lung function or sputum inflammatory markers. Conclusions: Quantitative airway counts and LAD (%) on HRCT scans appear to be useful surrogates for bronchiectasis and air trapping in children with CF. Our automated methodology provides objective quantitative measures of bronchiectasis and air trapping that may serve as end points in CF clinical trials. PMID:24114359

Topical Trends in a Corpus of Persuasive Writing. Research Report. ETS RR-12-19

ERIC Educational Resources Information Center

Heilman, Michael; Madnani, Nitin

2012-01-01

Many writing assessments use generic prompts about social issues. However, we currently lack an understanding of how test takers respond to such prompts. In the absence of such an understanding, automated scoring systems may not be as reliable as they could be and may worsen over time. To move toward a deeper understanding of responses to generic…

Reading the leaves: A comparison of leaf rank and automated areole measurement for quantifying aspects of leaf venation1

PubMed Central

Green, Walton A.; Little, Stefan A.; Price, Charles A.; Wing, Scott L.; Smith, Selena Y.; Kotrc, Benjamin; Doria, Gabriela

2014-01-01

The reticulate venation that is characteristic of a dicot leaf has excited interest from systematists for more than a century, and from physiological and developmental botanists for decades. The tools of digital image acquisition and computer image analysis, however, are only now approaching the sophistication needed to quantify aspects of the venation network found in real leaves quickly, easily, accurately, and reliably enough to produce biologically meaningful data. In this paper, we examine 120 leaves distributed across vascular plants (representing 118 genera and 80 families) using two approaches: a semiquantitative scoring system called “leaf ranking,” devised by the late Leo Hickey, and an automated image-analysis protocol. In the process of comparing these approaches, we review some methodological issues that arise in trying to quantify a vein network, and discuss the strengths and weaknesses of automatic data collection and human pattern recognition. We conclude that subjective leaf rank provides a relatively consistent, semiquantitative measure of areole size among other variables; that modal areole size is generally consistent across large sections of a leaf lamina; and that both approaches—semiquantitative, subjective scoring; and fully quantitative, automated measurement—have appropriate places in the study of leaf venation. PMID:25202646

Automated Pressure Injury Risk Assessment System Incorporated Into an Electronic Health Record System.

PubMed

Jin, Yinji; Jin, Taixian; Lee, Sun-Mi

Pressure injury risk assessment is the first step toward preventing pressure injuries, but traditional assessment tools are time-consuming, resulting in work overload and fatigue for nurses. The objectives of the study were to build an automated pressure injury risk assessment system (Auto-PIRAS) that can assess pressure injury risk using data, without requiring nurses to collect or input additional data, and to evaluate the validity of this assessment tool. A retrospective case-control study and a system development study were conducted in a 1,355-bed university hospital in Seoul, South Korea. A total of 1,305 pressure injury patients and 5,220 nonpressure injury patients participated for the development of a risk scoring algorithm: 687 and 2,748 for the validation of the algorithm and 237 and 994 for validation after clinical implementation, respectively. A total of 4,211 pressure injury-related clinical variables were extracted from the electronic health record (EHR) systems to develop a risk scoring algorithm, which was validated and incorporated into the EHR. That program was further evaluated for predictive and concurrent validity. Auto-PIRAS, incorporated into the EHR system, assigned a risk assessment score of high, moderate, or low and displayed this on the Kardex nursing record screen. Risk scores were updated nightly according to 10 predetermined risk factors. The predictive validity measures of the algorithm validation stage were as follows: sensitivity = .87, specificity = .90, positive predictive value = .68, negative predictive value = .97, Youden index = .77, and the area under the receiver operating characteristic curve = .95. The predictive validity measures of the Braden Scale were as follows: sensitivity = .77, specificity = .93, positive predictive value = .72, negative predictive value = .95, Youden index = .70, and the area under the receiver operating characteristic curve = .85. The kappa of the Auto-PIRAS and Braden Scale risk classification result was .73. The predictive performance of the Auto-PIRAS was similar to Braden Scale assessments conducted by nurses. Auto-PIRAS is expected to be used as a system that assesses pressure injury risk automatically without additional data collection by nurses.

The corneal transplant score: a simple corneal graft candidate calculator.

PubMed

Rosenfeld, Eldar; Varssano, David

2013-07-01

Shortage of corneas for transplantation has created long waiting lists in most countries. Transplant calculators are available for many organs. The purpose of this study is to describe a simple automatic scoring system for keratoplasty recipient candidates, based on several parameters that we consider most relevant for tissue allocation, and to compare the system's accuracy in predicting decisions made by a cornea specialist. Twenty pairs of candidate data were randomly created on an electronic spreadsheet. A single priority score was computed from the data of each candidate. A cornea surgeon and the automated system then decided independently which candidate in each pair should have surgery if only a single cornea was available. The scoring system can calculate values between 0 (lowest priority) and 18 (highest priority) for each candidate. Average score value in our randomly created cohort was 6.35 ± 2.38 (mean ± SD), range 1.28 to 10.76. Average score difference between the candidates in each pair was 3.12 ± 2.10, range 0.08 to 8.45. The manual scoring process, although theoretical, was mentally and emotionally demanding for the surgeon. Agreement was achieved between the human decision and the calculated value in 19 of 20 pairs. Disagreement was reached in the pair with the lowest score difference (0.08). With worldwide donor cornea shortage, waiting for transplantation can be long. Manual sorting of priority for transplantation in a long waiting list is difficult, time-consuming and prone to error. The suggested system may help achieve a justified distribution of available tissue.

Developing and evaluating an automated appendicitis risk stratification algorithm for pediatric patients in the emergency department.

PubMed

Deleger, Louise; Brodzinski, Holly; Zhai, Haijun; Li, Qi; Lingren, Todd; Kirkendall, Eric S; Alessandrini, Evaline; Solti, Imre

2013-12-01

To evaluate a proposed natural language processing (NLP) and machine-learning based automated method to risk stratify abdominal pain patients by analyzing the content of the electronic health record (EHR). We analyzed the EHRs of a random sample of 2100 pediatric emergency department (ED) patients with abdominal pain, including all with a final diagnosis of appendicitis. We developed an automated system to extract relevant elements from ED physician notes and lab values and to automatically assign a risk category for acute appendicitis (high, equivocal, or low), based on the Pediatric Appendicitis Score. We evaluated the performance of the system against a manually created gold standard (chart reviews by ED physicians) for recall, specificity, and precision. The system achieved an average F-measure of 0.867 (0.869 recall and 0.863 precision) for risk classification, which was comparable to physician experts. Recall/precision were 0.897/0.952 in the low-risk category, 0.855/0.886 in the high-risk category, and 0.854/0.766 in the equivocal-risk category. The information that the system required as input to achieve high F-measure was available within the first 4 h of the ED visit. Automated appendicitis risk categorization based on EHR content, including information from clinical notes, shows comparable performance to physician chart reviewers as measured by their inter-annotator agreement and represents a promising new approach for computerized decision support to promote application of evidence-based medicine at the point of care.

Empirical Analysis and Automated Classification of Security Bug Reports

NASA Technical Reports Server (NTRS)

Tyo, Jacob P.

2016-01-01

With the ever expanding amount of sensitive data being placed into computer systems, the need for effective cybersecurity is of utmost importance. However, there is a shortage of detailed empirical studies of security vulnerabilities from which cybersecurity metrics and best practices could be determined. This thesis has two main research goals: (1) to explore the distribution and characteristics of security vulnerabilities based on the information provided in bug tracking systems and (2) to develop data analytics approaches for automatic classification of bug reports as security or non-security related. This work is based on using three NASA datasets as case studies. The empirical analysis showed that the majority of software vulnerabilities belong only to a small number of types. Addressing these types of vulnerabilities will consequently lead to cost efficient improvement of software security. Since this analysis requires labeling of each bug report in the bug tracking system, we explored using machine learning to automate the classification of each bug report as a security or non-security related (two-class classification), as well as each security related bug report as specific security type (multiclass classification). In addition to using supervised machine learning algorithms, a novel unsupervised machine learning approach is proposed. An ac- curacy of 92%, recall of 96%, precision of 92%, probability of false alarm of 4%, F-Score of 81% and G-Score of 90% were the best results achieved during two-class classification. Furthermore, an accuracy of 80%, recall of 80%, precision of 94%, and F-score of 85% were the best results achieved during multiclass classification.

Automated Cognitive Health Assessment Using Smart Home Monitoring of Complex Tasks

PubMed Central

Dawadi, Prafulla N.; Cook, Diane J.; Schmitter-Edgecombe, Maureen

2014-01-01

One of the many services that intelligent systems can provide is the automated assessment of resident well-being. We hypothesize that the functional health of individuals, or ability of individuals to perform activities independently without assistance, can be estimated by tracking their activities using smart home technologies. In this paper, we introduce a machine learning-based method for assessing activity quality in smart homes. To validate our approach we quantify activity quality for 179 volunteer participants who performed a complex, interweaved set of activities in our smart home apartment. We observed a statistically significant correlation (r=0.79) between automated assessment of task quality and direct observation scores. Using machine learning techniques to predict the cognitive health of the participants based on task quality is accomplished with an AUC value of 0.64. We believe that this capability is an important step in understanding everyday functional health of individuals in their home environments. PMID:25530925

Automated Cognitive Health Assessment Using Smart Home Monitoring of Complex Tasks.

PubMed

Dawadi, Prafulla N; Cook, Diane J; Schmitter-Edgecombe, Maureen

2013-11-01

One of the many services that intelligent systems can provide is the automated assessment of resident well-being. We hypothesize that the functional health of individuals, or ability of individuals to perform activities independently without assistance, can be estimated by tracking their activities using smart home technologies. In this paper, we introduce a machine learning-based method for assessing activity quality in smart homes. To validate our approach we quantify activity quality for 179 volunteer participants who performed a complex, interweaved set of activities in our smart home apartment. We observed a statistically significant correlation (r=0.79) between automated assessment of task quality and direct observation scores. Using machine learning techniques to predict the cognitive health of the participants based on task quality is accomplished with an AUC value of 0.64. We believe that this capability is an important step in understanding everyday functional health of individuals in their home environments.

Machine learning of network metrics in ATLAS Distributed Data Management

NASA Astrophysics Data System (ADS)

Lassnig, Mario; Toler, Wesley; Vamosi, Ralf; Bogado, Joaquin; ATLAS Collaboration

2017-10-01

The increasing volume of physics data poses a critical challenge to the ATLAS experiment. In anticipation of high luminosity physics, automation of everyday data management tasks has become necessary. Previously many of these tasks required human decision-making and operation. Recent advances in hardware and software have made it possible to entrust more complicated duties to automated systems using models trained by machine learning algorithms. In this contribution we show results from one of our ongoing automation efforts that focuses on network metrics. First, we describe our machine learning framework built atop the ATLAS Analytics Platform. This framework can automatically extract and aggregate data, train models with various machine learning algorithms, and eventually score the resulting models and parameters. Second, we use these models to forecast metrics relevant for networkaware job scheduling and data brokering. We show the characteristics of the data and evaluate the forecasting accuracy of our models.

Quantitative traits for the tail suspension test: automation, optimization, and BXD RI mapping.

PubMed

Lad, Heena V; Liu, Lin; Payá-Cano, José L; Fernandes, Cathy; Schalkwyk, Leonard C

2007-07-01

Immobility in the tail suspension test (TST) is considered a model of despair in a stressful situation, and acute treatment with antidepressants reduces immobility. Inbred strains of mouse exhibit widely differing baseline levels of immobility in the TST and several quantitative trait loci (QTLs) have been nominated. The labor of manual scoring and various scoring criteria make obtaining robust data and comparisons across different laboratories problematic. Several studies have validated strain gauge and video analysis methods by comparison with manual scoring. We set out to find objective criteria for automated scoring parameters that maximize the biological information obtained, using a video tracking system on tapes of tail suspension tests of 24 lines of the BXD recombinant inbred panel and the progenitor strains C57BL/6J and DBA/2J. The maximum genetic effect size is captured using the highest time resolution and a low mobility threshold. Dissecting the trait further by comparing genetic association of multiple measures reveals good evidence for loci involved in immobility on chromosomes 4 and 15. These are best seen when using a high threshold for immobility, despite the overall better heritability at the lower threshold. A second trial of the test has greater duration of immobility and a completely different genetic profile. Frequency of mobility is also an independent phenotype, with a distal chromosome 1 locus.

An automated quasi-continuous capillary refill timing device

PubMed Central

Blaxter, L L; Morris, D E; Crowe, J A; Henry, C; Hill, S; Sharkey, D; Vyas, H; Hayes-Gill, B R

2016-01-01

Capillary refill time (CRT) is a simple means of cardiovascular assessment which is widely used in clinical care. Currently, CRT is measured through manual assessment of the time taken for skin tone to return to normal colour following blanching of the skin surface. There is evidence to suggest that manually assessed CRT is subject to bias from ambient light conditions, a lack of standardisation of both blanching time and manually applied pressure, subjectiveness of return to normal colour, and variability in the manual assessment of time. We present a novel automated system for CRT measurement, incorporating three components: a non-invasive adhesive sensor incorporating a pneumatic actuator, a diffuse multi-wavelength reflectance measurement device, and a temperature sensor; a battery operated datalogger unit containing a self contained pneumatic supply; and PC based data analysis software for the extraction of refill time, patient skin surface temperature, and sensor signal quality. Through standardisation of the test, it is hoped that some of the shortcomings of manual CRT can be overcome. In addition, an automated system will facilitate easier integration of CRT into electronic record keeping and clinical monitoring or scoring systems, as well as reducing demands on clinicians. Summary analysis of volunteer (n = 30) automated CRT datasets are presented, from 15 healthy adults and 15 healthy children (aged from 5 to 15 years), as their arms were cooled from ambient temperature to 5°C. A more detailed analysis of two typical datasets is also presented, demonstrating that the response of automated CRT to cooling matches that of previously published studies. PMID:26642080

Automated sleep scoring and sleep apnea detection in children

NASA Astrophysics Data System (ADS)

Baraglia, David P.; Berryman, Matthew J.; Coussens, Scott W.; Pamula, Yvonne; Kennedy, Declan; Martin, A. James; Abbott, Derek

2005-12-01

This paper investigates the automated detection of a patient's breathing rate and heart rate from their skin conductivity as well as sleep stage scoring and breathing event detection from their EEG. The software developed for these tasks is tested on data sets obtained from the sleep disorders unit at the Adelaide Women's and Children's Hospital. The sleep scoring and breathing event detection tasks used neural networks to achieve signal classification. The Fourier transform and the Higuchi fractal dimension were used to extract features for input to the neural network. The filtered skin conductivity appeared visually to bear a similarity to the breathing and heart rate signal, but a more detailed evaluation showed the relation was not consistent. Sleep stage classification was achieved with and accuracy of around 65% with some stages being accurately scored and others poorly scored. The two breathing events hypopnea and apnea were scored with varying degrees of accuracy with the highest scores being around 75% and 30%.

Automatic, semi-automatic and manual validation of urban drainage data.

PubMed

Branisavljević, N; Prodanović, D; Pavlović, D

2010-01-01

Advances in sensor technology and the possibility of automated long distance data transmission have made continuous measurements the preferable way of monitoring urban drainage processes. Usually, the collected data have to be processed by an expert in order to detect and mark the wrong data, remove them and replace them with interpolated data. In general, the first step in detecting the wrong, anomaly data is called the data quality assessment or data validation. Data validation consists of three parts: data preparation, validation scores generation and scores interpretation. This paper will present the overall framework for the data quality improvement system, suitable for automatic, semi-automatic or manual operation. The first two steps of the validation process are explained in more detail, using several validation methods on the same set of real-case data from the Belgrade sewer system. The final part of the validation process, which is the scores interpretation, needs to be further investigated on the developed system.

Automation and robotics for the Space Exploration Initiative: Results from Project Outreach

NASA Technical Reports Server (NTRS)

Gonzales, D.; Criswell, D.; Heer, E.

1991-01-01

A total of 52 submissions were received in the Automation and Robotics (A&R) area during Project Outreach. About half of the submissions (24) contained concepts that were judged to have high utility for the Space Exploration Initiative (SEI) and were analyzed further by the robotics panel. These 24 submissions are analyzed here. Three types of robots were proposed in the high scoring submissions: structured task robots (STRs), teleoperated robots (TORs), and surface exploration robots. Several advanced TOR control interface technologies were proposed in the submissions. Many A&R concepts or potential standards were presented or alluded to by the submitters, but few specific technologies or systems were suggested.

A Comparison of Human Narrative Coding of Redemption and Automated Linguistic Analysis for Understanding Life Stories.

PubMed

Weston, Sara J; Cox, Keith S; Condon, David M; Jackson, Joshua J

2016-10-01

The majority of life narrative research is performed using trained human coders. In contrast, automated linguistic analysis is oft employed in the study of verbal behaviors. These two methodological approaches are directly compared to determine the utility of automated linguistic analysis for the study of life narratives. In a study of in-person interviews (N = 158) and a second study of life stories collected online (N = 242), redemption scores are compared to the output of the Linguistic Inquiry and Word Count (Pennebaker, Francis & Booth, 2001). Additionally, patterns of language are found using exploratory principal components analysis. In both studies, redemption scores are modestly correlated with some LIWC categories and unassociated with the components. Patterns of language do not replicate across samples, indicating that the structure of language does not extend to a broader population. Redemption scores and linguistic components are independent predictors of life satisfaction up to 3 years later. These studies converge on the finding that human-coded redemption and automated linguistic analysis are complementary and nonredundant methods of analyzing life narratives, and considerations for the study of life narratives are discussed. © 2015 Wiley Periodicals, Inc.

Automated assessment of joint synovitis activity from medical ultrasound and power doppler examinations using image processing and machine learning methods.

PubMed

Cupek, Rafal; Ziębiński, Adam

2016-01-01

Rheumatoid arthritis is the most common rheumatic disease with arthritis, and causes substantial functional disability in approximately 50% patients after 10 years. Accurate measurement of the disease activity is crucial to provide an adequate treatment and care to the patients. The aim of this study is focused on a computer aided diagnostic system that supports an assessment of synovitis severity. This paper focus on a computer aided diagnostic system that was developed within joint Polish-Norwegian research project related to the automated assessment of the severity of synovitis. Semiquantitative ultrasound with power Doppler is a reliable and widely used method of assessing synovitis. Synovitis is estimated by ultrasound examiner using the scoring system graded from 0 to 3. Activity score is estimated on the basis of the examiner's experience or standardized ultrasound atlases. The method needs trained medical personnel and the result can be affected by a human error. The porotype of a computer-aided diagnostic system and algorithms essential for an analysis of ultrasonic images of finger joints are main scientific output of the MEDUSA project. Medusa Evaluation System prototype uses bone, skin, joint and synovitis area detectors for mutual structural model based evaluation of synovitis. Finally, several algorithms that support the semi-automatic or automatic detection of the bone region were prepared as well as a system that uses the statistical data processing approach in order to automatically localize the regions of interest. Semiquantitative ultrasound with power Doppler is a reliable and widely used method of assessing synovitis. Activity score is estimated on the basis of the examiner's experience and the result can be affected by a human error. In this paper we presented the MEDUSA project which is focused on a computer aided diagnostic system that supports an assessment of synovitis severity.

Personality type of the glaucoma patient.

PubMed

Lim, Michele C; Shiba, Diana R; Clark, Ingrid J; Kim, Daniel Y; Styles, Douglas E; Brandt, James D; Watnik, Mitchell R; Barthelow, Isaac J

2007-12-01

To characterize the personality profile of glaucoma subjects. One hundred eight subjects including 56 open-angle glaucoma (OAG) and 52 controls were given the Minnesota Multiphasic Personality Inventory-2 (MMPI-2) test and all performed automated perimetry. Clinical and demographic information which could relate to personality type was collected. OAG subjects had significantly higher Hypochondriasis (Hs; P=0.0082), Hysteria (Hy; P=0.0056), and Health Concerns (HEA; P=0.0025) mean scores than the control group. OAG subjects also had a significantly greater frequency of clinically abnormal score for hysteria (P=0.0262), and health concerns (P=0.0018). Multivariate analysis of variance revealed that Hypochondriasis, Hysteria, and Health Concerns scores were related to number of systemic medications used and to diagnostic group. Other potential explanatory variables such as sex, ethnicity, number of medical problems, length of glaucoma diagnosis, occurrence of glaucoma surgery, intraocular pressure, and visual status (logMAR, visual field indices) were not related to these personality scores. Patients with a diagnosis of OAG had more abnormal MMPI-2 scores in areas that focus upon concerns of somatic complaints and poor health. The use of systemic medications, which may be a constant reminder of illness, is a factor that may contribute to higher MMPI-2 scores.

FISH and tips: a large scale analysis of automated versus manual scoring for sperm aneuploidy detection.

PubMed

Martinez, Guillaume; Gillois, Pierre; Le Mitouard, Marine; Borye, Rémy; Esquerré-Lamare, Camille; Satre, Véronique; Bujan, Louis; Hennebicq, Sylviane

2013-01-01

Approximately 1% of the spermatozoa found in ejaculate of healthy men are aneuploid and this rate increases in the population of subfertile and infertile men. Moreover, fertilization with these aneuploid sperm can lead to impaired embryo development. Fluorescent In Situ Hybridization (FISH) is the common cytogenetic tool used for aneuploidy screening on sperm. However, it is a time-consuming technique and cytogenetic or in vitro fertilization laboratories cannot routinely use it and face the increasing demand of such analyses before Assisted Reproductive Techniques (ART). As automation can be a clue for routine practice, this study compares manual and automated scoring of sperm aneuploidy rates using a Metafer Metasystems® device. The results obtained also contribute to global data about FISH on sperm cells. We recruited 100 men addressed for sperm cryopreservation. They all signed an informed consent to participate in the study. 29 men were donors or consulted before vasectomy (control group) and 71 were suffering of Hodgkin's disease or non Hodgkin lymphoma (patient group). One semen sample was collected for each patient, analyzed according to WHO criteria and prepared for a triple-color FISH using centromeric probes for chromosomes 18, X and Y. Automated scoring was performed using a Metafer Metasystems® device. 507,019 cells were scored. We found a strong concordance between the automated and the manual reading (d < 0.01 in Bland-Altman test). We also did not find a statistically significant difference between the automated and the manual reading using Wilcoxon test for total aneuploidy rate (p = 0.06), sex chromosomes disomy (p = 0.33), chromosome 18 disomy (p = 0.39) and diploidy (p = 0.21). Cumulative rate of total aneuploidy was 0.78% ± 0.212% for patient group and 0.54% ± 0.15 for control group and among this, sex chromosome XY disomy rate was of 0.54% for patient group and 0.27% for control group. This study validates the automated reading for FISH on sperm with a Metafer Metasystems® device and allows its use in a laboratory routine.

New methods for analyzing semantic graph based assessments in science education

NASA Astrophysics Data System (ADS)

Vikaros, Lance Steven

This research investigated how the scoring of semantic graphs (known by many as concept maps) could be improved and automated in order to address issues of inter-rater reliability and scalability. As part of the NSF funded SENSE-IT project to introduce secondary school science students to sensor networks (NSF Grant No. 0833440), semantic graphs illustrating how temperature change affects water ecology were collected from 221 students across 16 schools. The graphing task did not constrain students' use of terms, as is often done with semantic graph based assessment due to coding and scoring concerns. The graphing software used provided real-time feedback to help students learn how to construct graphs, stay on topic and effectively communicate ideas. The collected graphs were scored by human raters using assessment methods expected to boost reliability, which included adaptations of traditional holistic and propositional scoring methods, use of expert raters, topical rubrics, and criterion graphs. High levels of inter-rater reliability were achieved, demonstrating that vocabulary constraints may not be necessary after all. To investigate a new approach to automating the scoring of graphs, thirty-two different graph features characterizing graphs' structure, semantics, configuration and process of construction were then used to predict human raters' scoring of graphs in order to identify feature patterns correlated to raters' evaluations of graphs' topical accuracy and complexity. Results led to the development of a regression model able to predict raters' scoring with 77% accuracy, with 46% accuracy expected when used to score new sets of graphs, as estimated via cross-validation tests. Although such performance is comparable to other graph and essay based scoring systems, cross-context testing of the model and methods used to develop it would be needed before it could be recommended for widespread use. Still, the findings suggest techniques for improving the reliability and scalability of semantic graph based assessments without requiring constraint of how ideas are expressed.

Validation of Automated Scores of TOEFL iBT® Tasks against Nontest Indicators of Writing Ability. TOEFL iBT® Research Report. TOEFL iBT-15. ETS Research Report RR-11-24

ERIC Educational Resources Information Center

Weigle, Sara Cushing

2011-01-01

Automated scoring has the potential to dramatically reduce the time and costs associated with the assessment of complex skills such as writing, but its use must be validated against a variety of criteria for it to be accepted by test users and stakeholders. This study addresses two validity-related issues regarding the use of e-rater® with the…

Crowdsourcing scoring of immunohistochemistry images: Evaluating Performance of the Crowd and an Automated Computational Method

NASA Astrophysics Data System (ADS)

Irshad, Humayun; Oh, Eun-Yeong; Schmolze, Daniel; Quintana, Liza M.; Collins, Laura; Tamimi, Rulla M.; Beck, Andrew H.

2017-02-01

The assessment of protein expression in immunohistochemistry (IHC) images provides important diagnostic, prognostic and predictive information for guiding cancer diagnosis and therapy. Manual scoring of IHC images represents a logistical challenge, as the process is labor intensive and time consuming. Since the last decade, computational methods have been developed to enable the application of quantitative methods for the analysis and interpretation of protein expression in IHC images. These methods have not yet replaced manual scoring for the assessment of IHC in the majority of diagnostic laboratories and in many large-scale research studies. An alternative approach is crowdsourcing the quantification of IHC images to an undefined crowd. The aim of this study is to quantify IHC images for labeling of ER status with two different crowdsourcing approaches, image-labeling and nuclei-labeling, and compare their performance with automated methods. Crowdsourcing- derived scores obtained greater concordance with the pathologist interpretations for both image-labeling and nuclei-labeling tasks (83% and 87%), as compared to the pathologist concordance achieved by the automated method (81%) on 5,338 TMA images from 1,853 breast cancer patients. This analysis shows that crowdsourcing the scoring of protein expression in IHC images is a promising new approach for large scale cancer molecular pathology studies.

Building "e-rater"® Scoring Models Using Machine Learning Methods. Research Report. ETS RR-16-04

ERIC Educational Resources Information Center

Chen, Jing; Fife, James H.; Bejar, Isaac I.; Rupp, André A.

2016-01-01

The "e-rater"® automated scoring engine used at Educational Testing Service (ETS) scores the writing quality of essays. In the current practice, e-rater scores are generated via a multiple linear regression (MLR) model as a linear combination of various features evaluated for each essay and human scores as the outcome variable. This…

Automated Classification of Usual Interstitial Pneumonia using Regional Volumetric Texture Analysis in High-Resolution CT

PubMed Central

Depeursinge, Adrien; Chin, Anne S.; Leung, Ann N.; Terrone, Donato; Bristow, Michael; Rosen, Glenn; Rubin, Daniel L.

2014-01-01

Objectives We propose a novel computational approach for the automated classification of classic versus atypical usual interstitial pneumonia (UIP). Materials and Methods 33 patients with UIP were enrolled in this study. They were classified as classic versus atypical UIP by a consensus of two thoracic radiologists with more than 15 years of experience using the American Thoracic Society evidence–based guidelines for CT diagnosis of UIP. Two cardiothoracic fellows with one year of subspecialty training provided independent readings. The system is based on regional characterization of the morphological tissue properties of lung using volumetric texture analysis of multiple detector CT images. A simple digital atlas with 36 lung subregions is used to locate texture properties, from which the responses of multi-directional Riesz wavelets are obtained. Machine learning is used to aggregate and to map the regional texture attributes to a simple score that can be used to stratify patients with UIP into classic and atypical subtypes. Results We compared the predictions based on regional volumetric texture analysis with the ground truth established by expert consensus. The area under the receiver operating characteristic curve of the proposed score was estimated to be 0.81 using a leave-one-patient-out cross-validation, with high specificity for classic UIP. The performance of our automated method was found to be similar to that of the two fellows and to the agreement between experienced chest radiologists reported in the literature. However, the errors of our method and the fellows occurred on different cases, which suggests that combining human and computerized evaluations may be synergistic. Conclusions Our results are encouraging and suggest that an automated system may be useful in routine clinical practice as a diagnostic aid for identifying patients with complex lung disease such as classic UIP, obviating the need for invasive surgical lung biopsy and its associated risks. PMID:25551822

Computer-Generated Feedback on Student Writing

ERIC Educational Resources Information Center

Ware, Paige

2011-01-01

A distinction must be made between "computer-generated scoring" and "computer-generated feedback". Computer-generated scoring refers to the provision of automated scores derived from mathematical models built on organizational, syntactic, and mechanical aspects of writing. In contrast, computer-generated feedback, the focus of this article, refers…

Automated Cognitive Health Assessment From Smart Home-Based Behavior Data.

PubMed

Dawadi, Prafulla Nath; Cook, Diane Joyce; Schmitter-Edgecombe, Maureen

2016-07-01

Smart home technologies offer potential benefits for assisting clinicians by automating health monitoring and well-being assessment. In this paper, we examine the actual benefits of smart home-based analysis by monitoring daily behavior in the home and predicting clinical scores of the residents. To accomplish this goal, we propose a clinical assessment using activity behavior (CAAB) approach to model a smart home resident's daily behavior and predict the corresponding clinical scores. CAAB uses statistical features that describe characteristics of a resident's daily activity performance to train machine learning algorithms that predict the clinical scores. We evaluate the performance of CAAB utilizing smart home sensor data collected from 18 smart homes over two years. We obtain a statistically significant correlation ( r=0.72) between CAAB-predicted and clinician-provided cognitive scores and a statistically significant correlation ( r=0.45) between CAAB-predicted and clinician-provided mobility scores. These prediction results suggest that it is feasible to predict clinical scores using smart home sensor data and learning-based data analysis.

Automated detection of discourse segment and experimental types from the text of cancer pathway results sections.

PubMed

Burns, Gully A P C; Dasigi, Pradeep; de Waard, Anita; Hovy, Eduard H

2016-01-01

Automated machine-reading biocuration systems typically use sentence-by-sentence information extraction to construct meaning representations for use by curators. This does not directly reflect the typical discourse structure used by scientists to construct an argument from the experimental data available within a article, and is therefore less likely to correspond to representations typically used in biomedical informatics systems (let alone to the mental models that scientists have). In this study, we develop Natural Language Processing methods to locate, extract, and classify the individual passages of text from articles' Results sections that refer to experimental data. In our domain of interest (molecular biology studies of cancer signal transduction pathways), individual articles may contain as many as 30 small-scale individual experiments describing a variety of findings, upon which authors base their overall research conclusions. Our system automatically classifies discourse segments in these texts into seven categories (fact, hypothesis, problem, goal, method, result, implication) with an F-score of 0.68. These segments describe the essential building blocks of scientific discourse to (i) provide context for each experiment, (ii) report experimental details and (iii) explain the data's meaning in context. We evaluate our system on text passages from articles that were curated in molecular biology databases (the Pathway Logic Datum repository, the Molecular Interaction MINT and INTACT databases) linking individual experiments in articles to the type of assay used (coprecipitation, phosphorylation, translocation etc.). We use supervised machine learning techniques on text passages containing unambiguous references to experiments to obtain baseline F1 scores of 0.59 for MINT, 0.71 for INTACT and 0.63 for Pathway Logic. Although preliminary, these results support the notion that targeting information extraction methods to experimental results could provide accurate, automated methods for biocuration. We also suggest the need for finer-grained curation of experimental methods used when constructing molecular biology databases. © The Author(s) 2016. Published by Oxford University Press.

Fully automated gynecomastia quantification from low-dose chest CT

NASA Astrophysics Data System (ADS)

Liu, Shuang; Sonnenblick, Emily B.; Azour, Lea; Yankelevitz, David F.; Henschke, Claudia I.; Reeves, Anthony P.

2018-02-01

Gynecomastia is characterized by the enlargement of male breasts, which is a common and sometimes distressing condition found in over half of adult men over the age of 44. Although the majority of gynecomastia is physiologic or idiopathic, its occurrence may also associate with an extensive variety of underlying systemic disease or drug toxicity. With the recent large-scale implementation of annual lung cancer screening using low-dose chest CT (LDCT), gynecomastia is believed to be a frequent incidental finding on LDCT. A fully automated system for gynecomastia quantification from LDCT is presented in this paper. The whole breast region is first segmented using an anatomyorientated approach based on the propagation of pectoral muscle fronts in the vertical direction. The subareolar region is then localized, and the fibroglandular tissue within it is measured for the assessment of gynecomastia. The presented system was validated using 454 breast regions from non-contrast LDCT scans of 227 adult men. The ground truth was established by an experienced radiologist by classifying each breast into one of the five categorical scores. The automated measurements have been demonstrated to achieve promising performance for the gynecomastia diagnosis with the AUC of 0.86 for the ROC curve and have statistically significant Spearman correlation r=0.70 (p < 0.001) with the reference categorical grades. The encouraging results demonstrate the feasibility of fully automated gynecomastia quantification from LDCT, which may aid the early detection as well as the treatment of both gynecomastia and the underlying medical problems, if any, that cause gynecomastia.

Initial Correction versus Negative Marking in Multiple Choice Examinations

ERIC Educational Resources Information Center

Van Hecke, Tanja

2015-01-01

Optimal assessment tools should measure in a limited time the knowledge of students in a correct and unbiased way. A method for automating the scoring is multiple choice scoring. This article compares scoring methods from a probabilistic point of view by modelling the probability to pass: the number right scoring, the initial correction (IC) and…

Automated touch sensing in the mouse tapered beam test using Raspberry Pi.

PubMed

Ardesch, Dirk Jan; Balbi, Matilde; Murphy, Timothy H

2017-11-01

Rodent models of neurological disease such as stroke are often characterized by motor deficits. One of the tests that are used to assess these motor deficits is the tapered beam test, which provides a sensitive measure of bilateral motor function based on foot faults (slips) made by a rodent traversing a gradually narrowing beam. However, manual frame-by-frame scoring of video recordings is necessary to obtain test results, which is time-consuming and prone to human rater bias. We present a cost-effective method for automated touch sensing in the tapered beam test. Capacitive touch sensors detect foot faults onto the beam through a layer of conductive paint, and results are processed and stored on a Raspberry Pi computer. Automated touch sensing using this method achieved high sensitivity (96.2%) as compared to 'gold standard' manual video scoring. Furthermore, it provided a reliable measure of lateralized motor deficits in mice with unilateral photothrombotic stroke: results indicated an increased number of contralesional foot faults for up to 6days after ischemia. The automated adaptation of the tapered beam test produces results immediately after each trial, without the need for labor-intensive post-hoc video scoring. It also increases objectivity of the data as it requires less experimenter involvement during analysis. Automated touch sensing may provide a useful adaptation to the existing tapered beam test in mice, while the simplicity of the hardware lends itself to potential further adaptations to related behavioral tests. Copyright © 2017 Elsevier B.V. All rights reserved.

Foreign object detection and removal to improve automated analysis of chest radiographs

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hogeweg, Laurens; Sanchez, Clara I.; Melendez, Jaime

2013-07-15

Purpose: Chest radiographs commonly contain projections of foreign objects, such as buttons, brassier clips, jewellery, or pacemakers and wires. The presence of these structures can substantially affect the output of computer analysis of these images. An automated method is presented to detect, segment, and remove foreign objects from chest radiographs.Methods: Detection is performed using supervised pixel classification with a kNN classifier, resulting in a probability estimate per pixel to belong to a projected foreign object. Segmentation is performed by grouping and post-processing pixels with a probability above a certain threshold. Next, the objects are replaced by texture inpainting.Results: The methodmore » is evaluated in experiments on 257 chest radiographs. The detection at pixel level is evaluated with receiver operating characteristic analysis on pixels within the unobscured lung fields and an A{sub z} value of 0.949 is achieved. Free response operator characteristic analysis is performed at the object level, and 95.6% of objects are detected with on average 0.25 false positive detections per image. To investigate the effect of removing the detected objects through inpainting, a texture analysis system for tuberculosis detection is applied to images with and without pathology and with and without foreign object removal. Unprocessed, the texture analysis abnormality score of normal images with foreign objects is comparable to those with pathology. After removing foreign objects, the texture score of normal images with and without foreign objects is similar, while abnormal images, whether they contain foreign objects or not, achieve on average higher scores.Conclusions: The authors conclude that removal of foreign objects from chest radiographs is feasible and beneficial for automated image analysis.« less

Drug side effect extraction from clinical narratives of psychiatry and psychology patients

PubMed Central

Kocher, Jean-Pierre A; Chute, Christopher G; Savova, Guergana K

2011-01-01

Objective To extract physician-asserted drug side effects from electronic medical record clinical narratives. Materials and methods Pattern matching rules were manually developed through examining keywords and expression patterns of side effects to discover an individual side effect and causative drug relationship. A combination of machine learning (C4.5) using side effect keyword features and pattern matching rules was used to extract sentences that contain side effect and causative drug pairs, enabling the system to discover most side effect occurrences. Our system was implemented as a module within the clinical Text Analysis and Knowledge Extraction System. Results The system was tested in the domain of psychiatry and psychology. The rule-based system extracting side effects and causative drugs produced an F score of 0.80 (0.55 excluding allergy section). The hybrid system identifying side effect sentences had an F score of 0.75 (0.56 excluding allergy section) but covered more side effect and causative drug pairs than individual side effect extraction. Discussion The rule-based system was able to identify most side effects expressed by clear indication words. More sophisticated semantic processing is required to handle complex side effect descriptions in the narrative. We demonstrated that our system can be trained to identify sentences with complex side effect descriptions that can be submitted to a human expert for further abstraction. Conclusion Our system was able to extract most physician-asserted drug side effects. It can be used in either an automated mode for side effect extraction or semi-automated mode to identify side effect sentences that can significantly simplify abstraction by a human expert. PMID:21946242

Personal authentication using hand vein triangulation and knuckle shape.

PubMed

Kumar, Ajay; Prathyusha, K Venkata

2009-09-01

This paper presents a new approach to authenticate individuals using triangulation of hand vein images and simultaneous extraction of knuckle shape information. The proposed method is fully automated and employs palm dorsal hand vein images acquired from the low-cost, near infrared, contactless imaging. The knuckle tips are used as key points for the image normalization and extraction of region of interest. The matching scores are generated in two parallel stages: (i) hierarchical matching score from the four topologies of triangulation in the binarized vein structures and (ii) from the geometrical features consisting of knuckle point perimeter distances in the acquired images. The weighted score level combination from these two matching scores are used to authenticate the individuals. The achieved experimental results from the proposed system using contactless palm dorsal-hand vein images are promising (equal error rate of 1.14%) and suggest more user friendly alternative for user identification.

"First generation" automated DNA sequencing technology.

PubMed

Slatko, Barton E; Kieleczawa, Jan; Ju, Jingyue; Gardner, Andrew F; Hendrickson, Cynthia L; Ausubel, Frederick M

2011-10-01

Beginning in the 1980s, automation of DNA sequencing has greatly increased throughput, reduced costs, and enabled large projects to be completed more easily. The development of automation technology paralleled the development of other aspects of DNA sequencing: better enzymes and chemistry, separation and imaging technology, sequencing protocols, robotics, and computational advancements (including base-calling algorithms with quality scores, database developments, and sequence analysis programs). Despite the emergence of high-throughput sequencing platforms, automated Sanger sequencing technology remains useful for many applications. This unit provides background and a description of the "First-Generation" automated DNA sequencing technology. It also includes protocols for using the current Applied Biosystems (ABI) automated DNA sequencing machines. © 2011 by John Wiley & Sons, Inc.

Visual Display Principles for C3I System Tasks

DTIC Science & Technology

1993-06-01

early in the design process is now explicitly recognized in military R & D policy as evidenced by the Navy’s HARDMAN and the Army’s MANPRINT programs...information): required sampling rate for each battlefield area, target type, and sensor type, etc.? - Change detections aids - Where is the enemy...increasing load and sophistication for - Automated measurement and operators and decisionmakers scoring (%hits, miss distances, attrition rates , etc

Pepitome: evaluating improved spectral library search for identification complementarity and quality assessment

PubMed Central

Dasari, Surendra; Chambers, Matthew C.; Martinez, Misti A.; Carpenter, Kristin L.; Ham, Amy-Joan L.; Vega-Montoto, Lorenzo J.; Tabb, David L.

2012-01-01

Spectral libraries have emerged as a viable alternative to protein sequence databases for peptide identification. These libraries contain previously detected peptide sequences and their corresponding tandem mass spectra (MS/MS). Search engines can then identify peptides by comparing experimental MS/MS scans to those in the library. Many of these algorithms employ the dot product score for measuring the quality of a spectrum-spectrum match (SSM). This scoring system does not offer a clear statistical interpretation and ignores fragment ion m/z discrepancies in the scoring. We developed a new spectral library search engine, Pepitome, which employs statistical systems for scoring SSMs. Pepitome outperformed the leading library search tool, SpectraST, when analyzing data sets acquired on three different mass spectrometry platforms. We characterized the reliability of spectral library searches by confirming shotgun proteomics identifications through RNA-Seq data. Applying spectral library and database searches on the same sample revealed their complementary nature. Pepitome identifications enabled the automation of quality analysis and quality control (QA/QC) for shotgun proteomics data acquisition pipelines. PMID:22217208

Automated extraction of family history information from clinical notes.

PubMed

Bill, Robert; Pakhomov, Serguei; Chen, Elizabeth S; Winden, Tamara J; Carter, Elizabeth W; Melton, Genevieve B

2014-01-01

Despite increased functionality for obtaining family history in a structured format within electronic health record systems, clinical notes often still contain this information. We developed and evaluated an Unstructured Information Management Application (UIMA)-based natural language processing (NLP) module for automated extraction of family history information with functionality for identifying statements, observations (e.g., disease or procedure), relative or side of family with attributes (i.e., vital status, age of diagnosis, certainty, and negation), and predication ("indicator phrases"), the latter of which was used to establish relationships between observations and family member. The family history NLP system demonstrated F-scores of 66.9, 92.4, 82.9, 57.3, 97.7, and 61.9 for detection of family history statements, family member identification, observation identification, negation identification, vital status, and overall extraction of the predications between family members and observations, respectively. While the system performed well for detection of family history statements and predication constituents, further work is needed to improve extraction of certainty and temporal modifications.

Automated Extraction of Family History Information from Clinical Notes

PubMed Central

Bill, Robert; Pakhomov, Serguei; Chen, Elizabeth S.; Winden, Tamara J.; Carter, Elizabeth W.; Melton, Genevieve B.

2014-01-01

Despite increased functionality for obtaining family history in a structured format within electronic health record systems, clinical notes often still contain this information. We developed and evaluated an Unstructured Information Management Application (UIMA)-based natural language processing (NLP) module for automated extraction of family history information with functionality for identifying statements, observations (e.g., disease or procedure), relative or side of family with attributes (i.e., vital status, age of diagnosis, certainty, and negation), and predication (“indicator phrases”), the latter of which was used to establish relationships between observations and family member. The family history NLP system demonstrated F-scores of 66.9, 92.4, 82.9, 57.3, 97.7, and 61.9 for detection of family history statements, family member identification, observation identification, negation identification, vital status, and overall extraction of the predications between family members and observations, respectively. While the system performed well for detection of family history statements and predication constituents, further work is needed to improve extraction of certainty and temporal modifications. PMID:25954443

Methodological Approaches to Online Scoring of Essays.

ERIC Educational Resources Information Center

Chung, Gregory K. W. K.; O'Neil, Harold F., Jr.

This report examines the feasibility of scoring essays using computer-based techniques. Essays have been incorporated into many of the standardized testing programs. Issues of validity and reliability must be addressed to deploy automated approaches to scoring fully. Two approaches that have been used to classify documents, surface- and word-based…

Evaluation of the "e-rater"® Scoring Engine for the "GRE"® Issue and Argument Prompts. Research Report. ETS RR-12-02

ERIC Educational Resources Information Center

Ramineni, Chaitanya; Trapani, Catherine S.; Williamson, David M.; Davey, Tim; Bridgeman, Brent

2012-01-01

Automated scoring models for the "e-rater"® scoring engine were built and evaluated for the "GRE"® argument and issue-writing tasks. Prompt-specific, generic, and generic with prompt-specific intercept scoring models were built and evaluation statistics such as weighted kappas, Pearson correlations, standardized difference in…

Automated detection of breast cancer in false-negative screening MRI studies from women at increased risk.

PubMed

Gubern-Mérida, Albert; Vreemann, Suzan; Martí, Robert; Melendez, Jaime; Lardenoije, Susanne; Mann, Ritse M; Karssemeijer, Nico; Platel, Bram

2016-02-01

To evaluate the performance of an automated computer-aided detection (CAD) system to detect breast cancers that were overlooked or misinterpreted in a breast MRI screening program for women at increased risk. We identified 40 patients that were diagnosed with breast cancer in MRI and had a prior MRI examination reported as negative available. In these prior examinations, 24 lesions could retrospectively be identified by two breast radiologists in consensus: 11 were scored as visible and 13 as minimally visible. Additionally, 120 normal scans were collected from 120 women without history of breast cancer or breast surgery participating in the same MRI screening program. A fully automated CAD system was applied to this dataset to detect malignant lesions. At 4 false-positives per normal case, the sensitivity for the detection of cancer lesions that were visible or minimally visible in retrospect in prior-negative examinations was 0.71 (95% CI=0.38-1.00) and 0.31 (0.07-0.59), respectively. A substantial proportion of cancers that were misinterpreted or overlooked in an MRI screening program was detected by a CAD system in prior-negative examinations. It has to be clarified with further studies if such a CAD system has an influence on the number of misinterpreted and overlooked cancers in clinical practice when results are given to a radiologist. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Image segmentation and dynamic lineage analysis in single-cell fluorescence microscopy.

PubMed

Wang, Quanli; Niemi, Jarad; Tan, Chee-Meng; You, Lingchong; West, Mike

2010-01-01

An increasingly common component of studies in synthetic and systems biology is analysis of dynamics of gene expression at the single-cell level, a context that is heavily dependent on the use of time-lapse movies. Extracting quantitative data on the single-cell temporal dynamics from such movies remains a major challenge. Here, we describe novel methods for automating key steps in the analysis of single-cell, fluorescent images-segmentation and lineage reconstruction-to recognize and track individual cells over time. The automated analysis iteratively combines a set of extended morphological methods for segmentation, and uses a neighborhood-based scoring method for frame-to-frame lineage linking. Our studies with bacteria, budding yeast and human cells, demonstrate the portability and usability of these methods, whether using phase, bright field or fluorescent images. These examples also demonstrate the utility of our integrated approach in facilitating analyses of engineered and natural cellular networks in diverse settings. The automated methods are implemented in freely available, open-source software.

Structured reporting platform improves CAD-RADS assessment.

PubMed

Szilveszter, Bálint; Kolossváry, Márton; Karády, Júlia; Jermendy, Ádám L; Károlyi, Mihály; Panajotu, Alexisz; Bagyura, Zsolt; Vecsey-Nagy, Milán; Cury, Ricardo C; Leipsic, Jonathon A; Merkely, Béla; Maurovich-Horvat, Pál

2017-11-01

Structured reporting in cardiac imaging is strongly encouraged to improve quality through consistency. The Coronary Artery Disease - Reporting and Data System (CAD-RADS) was recently introduced to facilitate interdisciplinary communication of coronary CT angiography (CTA) results. We aimed to assess the agreement between manual and automated CAD-RADS classification using a structured reporting platform. Five readers prospectively interpreted 500 coronary CT angiographies using a structured reporting platform that automatically calculates the CAD-RADS score based on stenosis and plaque parameters manually entered by the reader. In addition, all readers manually assessed CAD-RADS blinded to the automatically derived results, which was used as the reference standard. We evaluated factors influencing reader performance including CAD-RADS training, clinical load, time of the day and level of expertise. Total agreement between manual and automated classification was 80.2%. Agreement in stenosis categories was 86.7%, whereas the agreement in modifiers was 95.8% for "N", 96.8% for "S", 95.6% for "V" and 99.4% for "G". Agreement for V improved after CAD-RADS training (p = 0.047). Time of the day and clinical load did not influence reader performance (p > 0.05 both). Less experienced readers had a higher total agreement as compared to more experienced readers (87.0% vs 78.0%, respectively; p = 0.011). Even though automated CAD-RADS classification uses data filled in by the readers, it outperforms manual classification by preventing human errors. Structured reporting platforms with automated calculation of the CAD-RADS score might improve data quality and support standardization of clinical decision making. Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.

Automated Writing Evaluation Program's Effect on Student Writing Achievement

ERIC Educational Resources Information Center

Holman, Lester Donnie

2011-01-01

In an ex post facto causal-comparative research design, this study investigated the effectiveness of Automated Writing Evaluation (AWE) programs on raising the student writing achievement. Tennessee Comprehensive Assessment Program (TCAP) writing achievement scores from the 2010 administration were utilized for this study. The independent variable…

Automated scoring of regional lung perfusion in children from contrast enhanced 3D MRI

NASA Astrophysics Data System (ADS)

Heimann, Tobias; Eichinger, Monika; Bauman, Grzegorz; Bischoff, Arved; Puderbach, Michael; Meinzer, Hans-Peter

2012-03-01

MRI perfusion images give information about regional lung function and can be used to detect pulmonary pathologies in cystic fibrosis (CF) children. However, manual assessment of the percentage of pathologic tissue in defined lung subvolumes features large inter- and intra-observer variation, making it difficult to determine disease progression consistently. We present an automated method to calculate a regional score for this purpose. First, lungs are located based on thresholding and morphological operations. Second, statistical shape models of left and right children's lungs are initialized at the determined locations and used to precisely segment morphological images. Segmentation results are transferred to perfusion maps and employed as masks to calculate perfusion statistics. An automated threshold to determine pathologic tissue is calculated and used to determine accurate regional scores. We evaluated the method on 10 MRI images and achieved an average surface distance of less than 1.5 mm compared to manual reference segmentations. Pathologic tissue was detected correctly in 9 cases. The approach seems suitable for detecting early signs of CF and monitoring response to therapy.

Detection and Automated Scoring of Dicentric Chromosomes in Nonstimulated Lymphocyte Prematurely Condensed Chromosomes After Telomere and Centromere Staining

DOE Office of Scientific and Technical Information (OSTI.GOV)

M'kacher, Radhia; El Maalouf, Elie; Laboratoire Modélisation Intelligence Processus Systèmes

Purpose: To combine telomere and centromere (TC) staining of premature chromosome condensation (PCC) fusions to identify dicentrics, centric rings, and acentric chromosomes, making possible the realization of a dose–response curve and automation of the process. Methods and Materials: Blood samples from healthy donors were exposed to {sup 60}Co irradiation at varying doses up to 8 Gy, followed by a repair period of 8 hours. Premature chromosome condensation fusions were carried out, and TC staining using peptide nucleic acid probes was performed. Chromosomal aberration (CA) scoring was carried out manually and automatically using PCC-TCScore software, developed in our laboratory. Results: Wemore » successfully optimized the hybridization conditions and image capture parameters, to increase the sensitivity and effectiveness of CA scoring. Dicentrics, centric rings, and acentric chromosomes were rapidly and accurately detected, leading to a linear-quadratic dose–response curve by manual scoring at up to 8 Gy. Using PCC-TCScore software for automatic scoring, we were able to detect 95% of dicentrics and centric rings. Conclusion: The introduction of TC staining to the PCC fusion technique has made possible the rapid scoring of unstable CAs, including dicentrics, with a level of accuracy and ease not previously possible. This new approach can be used for biological dosimetry in radiation emergency medicine, where the rapid and accurate detection of dicentrics is a high priority using automated scoring. Because there is no culture time, this new approach can also be used for the follow-up of patients treated by genotoxic therapy, creating the possibility to perform the estimation of induced chromosomal aberrations immediately after the blood draw.« less

Automated Guidance for Thermodynamics Essays: Critiquing versus Revisiting

ERIC Educational Resources Information Center

Donnelly, Dermot F.; Vitale, Jonathan M.; Linn, Marcia C.

2015-01-01

Middle school students struggle to explain thermodynamics concepts. In this study, to help students succeed, we use a natural language processing program to analyze their essays explaining the aspects of thermodynamics and provide guidance based on the automated score. The 346 sixth-grade students were assigned to either the critique condition…

Automated Assessment of Speech Fluency for L2 English Learners

ERIC Educational Resources Information Center

Yoon, Su-Youn

2009-01-01

This dissertation provides an automated scoring method of speech fluency for second language learners of English (L2 learners) based that uses speech recognition technology. Non-standard pronunciation, frequent disfluencies, faulty grammar, and inappropriate lexical choices are crucial characteristics of L2 learners' speech. Due to the ease of…

Automated coronary artery calcification detection on low-dose chest CT images

NASA Astrophysics Data System (ADS)

Xie, Yiting; Cham, Matthew D.; Henschke, Claudia; Yankelevitz, David; Reeves, Anthony P.

2014-03-01

Coronary artery calcification (CAC) measurement from low-dose CT images can be used to assess the risk of coronary artery disease. A fully automatic algorithm to detect and measure CAC from low-dose non-contrast, non-ECG-gated chest CT scans is presented. Based on the automatically detected CAC, the Agatston score (AS), mass score and volume score were computed. These were compared with scores obtained manually from standard-dose ECG-gated scans and low-dose un-gated scans of the same patient. The automatic algorithm segments the heart region based on other pre-segmented organs to provide a coronary region mask. The mitral valve and aortic valve calcification is identified and excluded. All remaining voxels greater than 180HU within the mask region are considered as CAC candidates. The heart segmentation algorithm was evaluated on 400 non-contrast cases with both low-dose and regular dose CT scans. By visual inspection, 371 (92.8%) of the segmentations were acceptable. The automated CAC detection algorithm was evaluated on 41 low-dose non-contrast CT scans. Manual markings were performed on both low-dose and standard-dose scans for these cases. Using linear regression, the correlation of the automatic AS with the standard-dose manual scores was 0.86; with the low-dose manual scores the correlation was 0.91. Standard risk categories were also computed. The automated method risk category agreed with manual markings of gated scans for 24 cases while 15 cases were 1 category off. For low-dose scans, the automatic method agreed with 33 cases while 7 cases were 1 category off.

Construct Validity of "e-rater"® in Scoring TOEFL® Essays. Research Report. ETS RR-07-21

ERIC Educational Resources Information Center

Attali, Yigal

2007-01-01

This study examined the construct validity of the "e-rater"® automated essay scoring engine as an alternative to human scoring in the context of TOEFL® essay writing. Analyses were based on a sample of students who repeated the TOEFL within a short time period. Two "e-rater" scores were investigated in this study, the first…

A fully automated multi-modal computer aided diagnosis approach to coronary calcium scoring of MSCT images

NASA Astrophysics Data System (ADS)

Wu, Jing; Ferns, Gordon; Giles, John; Lewis, Emma

2012-03-01

Inter- and intra- observer variability is a problem often faced when an expert or observer is tasked with assessing the severity of a disease. This issue is keenly felt in coronary calcium scoring of patients suffering from atherosclerosis where in clinical practice, the observer must identify firstly the presence, followed by the location of candidate calcified plaques found within the coronary arteries that may prevent oxygenated blood flow to the heart muscle. However, it can be difficult for a human observer to differentiate calcified plaques that are located in the coronary arteries from those found in surrounding anatomy such as the mitral valve or pericardium. In addition to the benefits to scoring accuracy, the use of fast, low dose multi-slice CT imaging to perform the cardiac scan is capable of acquiring the entire heart within a single breath hold. Thus exposing the patient to lower radiation dose, which for a progressive disease such as atherosclerosis where multiple scans may be required, is beneficial to their health. Presented here is a fully automated method for calcium scoring using both the traditional Agatston method, as well as the volume scoring method. Elimination of the unwanted regions of the cardiac image slices such as lungs, ribs, and vertebrae is carried out using adaptive heart isolation. Such regions cannot contain calcified plaques but can be of a similar intensity and their removal will aid detection. Removal of both the ascending and descending aortas, as they contain clinical insignificant plaques, is necessary before the final calcium scores are calculated and examined against ground truth scores of three averaged expert observer results. The results presented here are intended to show the feasibility and requirement for an automated scoring method to reduce the subjectivity and reproducibility error inherent with manual clinical calcium scoring.

Dual-Energy Computed Tomography Angiography of the Head and Neck With Single-Source Computed Tomography: A New Technical (Split Filter) Approach for Bone Removal.

PubMed

Kaemmerer, Nadine; Brand, Michael; Hammon, Matthias; May, Matthias; Wuest, Wolfgang; Krauss, Bernhard; Uder, Michael; Lell, Michael M

2016-10-01

Dual-energy computed tomographic angiography (DE-CTA) has been demonstrated to improve the visualization of the head and neck vessels. The aim of this study was to test the potential of split-filter single-source dual-energy CT to automatically remove bone from the final CTA data set. Dual-energy CTA was performed in 50 consecutive patients to evaluate the supra-aortic arteries, either to grade carotid artery stenosis or to rule out traumatic dissections. Dual-energy CTA was performed on a 128-slice single-source CT system equipped with a special filter array to separate the 120-kV spectrum into a high- and a low-energy spectrum for DE-based automated bone removal. Image quality of fully automated bone suppression and subsequent manual optimization was evaluated by 2 radiologists on maximum intensity projections using a 4-grade scoring system. The effect of image reconstruction with an iterative metal artifact reduction algorithm on DE postprocessing was tested using a 3-grade scoring system, and the time demand for each postprocessing step was measured. Two patients were excluded due to insufficient arterial contrast enhancement; in the remaining 48 patients, automated bone removal could be performed successfully. The addition of iterative metal artifact reduction algorithm improved image quality in 58.3% of the cases. After manual optimization, DE-CTA image quality was rated excellent in 7, good in 29, and moderate in 10 patients. Interobserver agreement was high (κ = 0.85). Stenosis grading was not influenced using DE-CTA with bone removal as compared with the original CTA. The time demand for DE image reconstruction was significantly higher than for single-energy reconstruction (42.1 vs 20.9 seconds). Our results suggest that bone removal in DE-CTA of the head and neck vessels with a single-source CT is feasible and can be performed within acceptable time and moderate user interaction.

Higher heritabilities for gait components than for overall gait scores may improve mobility in ducks.

PubMed

Duggan, Brendan M; Rae, Anne M; Clements, Dylan N; Hocking, Paul M

2017-05-02

Genetic progress in selection for greater body mass and meat yield in poultry has been associated with an increase in gait problems which are detrimental to productivity and welfare. The incidence of suboptimal gait in breeding flocks is controlled through the use of a visual gait score, which is a subjective assessment of walking ability of each bird. The subjective nature of the visual gait score has led to concerns over its effectiveness in reducing the incidence of suboptimal gait in poultry through breeding. The aims of this study were to assess the reliability of the current visual gait scoring system in ducks and to develop a more objective method to select for better gait. Experienced gait scorers assessed short video clips of walking ducks to estimate the reliability of the current visual gait scoring system. Kendall's coefficients of concordance between and within observers were estimated at 0.49 and 0.75, respectively. In order to develop a more objective scoring system, gait components were visually scored on more than 4000 pedigreed Pekin ducks and genetic parameters were estimated for these components. Gait components, which are a more objective measure, had heritabilities that were as good as, or better than, those of the overall visual gait score. Measurement of gait components is simpler and therefore more objective than the standard visual gait score. The recording of gait components can potentially be automated, which may increase accuracy further and may improve heritability estimates. Genetic correlations were generally low, which suggests that it is possible to use gait components to select for an overall improvement in both economic traits and gait as part of a balanced breeding programme.

The creation, management, and use of data quality information for life cycle assessment.

PubMed

Edelen, Ashley; Ingwersen, Wesley W

2018-04-01

Despite growing access to data, questions of "best fit" data and the appropriate use of results in supporting decision making still plague the life cycle assessment (LCA) community. This discussion paper addresses revisions to assessing data quality captured in a new US Environmental Protection Agency guidance document as well as additional recommendations on data quality creation, management, and use in LCA databases and studies. Existing data quality systems and approaches in LCA were reviewed and tested. The evaluations resulted in a revision to a commonly used pedigree matrix, for which flow and process level data quality indicators are described, more clarity for scoring criteria, and further guidance on interpretation are given. Increased training for practitioners on data quality application and its limits are recommended. A multi-faceted approach to data quality assessment utilizing the pedigree method alongside uncertainty analysis in result interpretation is recommended. A method of data quality score aggregation is proposed and recommendations for usage of data quality scores in existing data are made to enable improved use of data quality scores in LCA results interpretation. Roles for data generators, data repositories, and data users are described in LCA data quality management. Guidance is provided on using data with data quality scores from other systems alongside data with scores from the new system. The new pedigree matrix and recommended data quality aggregation procedure can now be implemented in openLCA software. Additional ways in which data quality assessment might be improved and expanded are described. Interoperability efforts in LCA data should focus on descriptors to enable user scoring of data quality rather than translation of existing scores. Developing and using data quality indicators for additional dimensions of LCA data, and automation of data quality scoring through metadata extraction and comparison to goal and scope are needed.

A data-driven algorithm integrating clinical and laboratory features for the diagnosis and prognosis of necrotizing enterocolitis.

PubMed

Ji, Jun; Ling, Xuefeng B; Zhao, Yingzhen; Hu, Zhongkai; Zheng, Xiaolin; Xu, Zhening; Wen, Qiaojun; Kastenberg, Zachary J; Li, Ping; Abdullah, Fizan; Brandt, Mary L; Ehrenkranz, Richard A; Harris, Mary Catherine; Lee, Timothy C; Simpson, B Joyce; Bowers, Corinna; Moss, R Lawrence; Sylvester, Karl G

2014-01-01

Necrotizing enterocolitis (NEC) is a major source of neonatal morbidity and mortality. Since there is no specific diagnostic test or risk of progression model available for NEC, the diagnosis and outcome prediction of NEC is made on clinical grounds. The objective in this study was to develop and validate new NEC scoring systems for automated staging and prognostic forecasting. A six-center consortium of university based pediatric teaching hospitals prospectively collected data on infants under suspicion of having NEC over a 7-year period. A database comprised of 520 infants was utilized to develop the NEC diagnostic and prognostic models by dividing the entire dataset into training and testing cohorts of demographically matched subjects. Developed on the training cohort and validated on the blind testing cohort, our multivariate analyses led to NEC scoring metrics integrating clinical data. Machine learning using clinical and laboratory results at the time of clinical presentation led to two nec models: (1) an automated diagnostic classification scheme; (2) a dynamic prognostic method for risk-stratifying patients into low, intermediate and high NEC scores to determine the risk for disease progression. We submit that dynamic risk stratification of infants with NEC will assist clinicians in determining the need for additional diagnostic testing and guide potential therapies in a dynamic manner. http://translationalmedicine.stanford.edu/cgi-bin/NEC/index.pl and smartphone application upon request.

Validation of a new classifier for the automated analysis of the human epidermal growth factor receptor 2 (HER2) gene amplification in breast cancer specimens

PubMed Central

2013-01-01

Amplification of the human epidermal growth factor receptor 2 (HER2) is a prognostic marker for poor clinical outcome and a predictive marker for therapeutic response to targeted therapies in breast cancer patients. With the introduction of anti-HER2 therapies, accurate assessment of HER2 status has become essential. Fluorescence in situ hybridization (FISH) is a widely used technique for the determination of HER2 status in breast cancer. However, the manual signal enumeration is time-consuming. Therefore, several companies like MetaSystem have developed automated image analysis software. Some of these signal enumeration software employ the so called “tile-sampling classifier”, a programming algorithm through which the software quantifies fluorescent signals in images on the basis of square tiles of fixed dimensions. Considering that the size of tile does not always correspond to the size of a single tumor cell nucleus, some users argue that this analysis method might not completely reflect the biology of cells. For that reason, MetaSystems has developed a new classifier which is able to recognize nuclei within tissue sections in order to determine the HER2 amplification status on nuclei basis. We call this new programming algorithm “nuclei-sampling classifier”. In this study, we evaluated the accuracy of the “nuclei-sampling classifier” in determining HER2 gene amplification by FISH in nuclei of breast cancer cells. To this aim, we randomly selected from our cohort 64 breast cancer specimens (32 nonamplified and 32 amplified) and we compared results obtained through manual scoring and through this new classifier. The new classifier automatically recognized individual nuclei. The automated analysis was followed by an optional human correction, during which the user interacted with the software in order to improve the selection of cell nuclei automatically selected. Overall concordance between manual scoring and automated nuclei-sampling analysis was 98.4% (100% for nonamplified cases and 96.9% for amplified cases). However, after human correction, concordance between the two methods was 100%. We conclude that the nuclei-based classifier is a new available tool for automated quantitative HER2 FISH signals analysis in nuclei in breast cancer specimen and it can be used for clinical purposes. PMID:23379971

Automated identification of sleep states from EEG signals by means of ensemble empirical mode decomposition and random under sampling boosting.

PubMed

Hassan, Ahnaf Rashik; Bhuiyan, Mohammed Imamul Hassan

2017-03-01

Automatic sleep staging is essential for alleviating the burden of the physicians of analyzing a large volume of data by visual inspection. It is also a precondition for making an automated sleep monitoring system feasible. Further, computerized sleep scoring will expedite large-scale data analysis in sleep research. Nevertheless, most of the existing works on sleep staging are either multichannel or multiple physiological signal based which are uncomfortable for the user and hinder the feasibility of an in-home sleep monitoring device. So, a successful and reliable computer-assisted sleep staging scheme is yet to emerge. In this work, we propose a single channel EEG based algorithm for computerized sleep scoring. In the proposed algorithm, we decompose EEG signal segments using Ensemble Empirical Mode Decomposition (EEMD) and extract various statistical moment based features. The effectiveness of EEMD and statistical features are investigated. Statistical analysis is performed for feature selection. A newly proposed classification technique, namely - Random under sampling boosting (RUSBoost) is introduced for sleep stage classification. This is the first implementation of EEMD in conjunction with RUSBoost to the best of the authors' knowledge. The proposed feature extraction scheme's performance is investigated for various choices of classification models. The algorithmic performance of our scheme is evaluated against contemporary works in the literature. The performance of the proposed method is comparable or better than that of the state-of-the-art ones. The proposed algorithm gives 88.07%, 83.49%, 92.66%, 94.23%, and 98.15% for 6-state to 2-state classification of sleep stages on Sleep-EDF database. Our experimental outcomes reveal that RUSBoost outperforms other classification models for the feature extraction framework presented in this work. Besides, the algorithm proposed in this work demonstrates high detection accuracy for the sleep states S1 and REM. Statistical moment based features in the EEMD domain distinguish the sleep states successfully and efficaciously. The automated sleep scoring scheme propounded herein can eradicate the onus of the clinicians, contribute to the device implementation of a sleep monitoring system, and benefit sleep research. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Using multiclass classification to automate the identification of patient safety incident reports by type and severity.

PubMed

Wang, Ying; Coiera, Enrico; Runciman, William; Magrabi, Farah

2017-06-12

Approximately 10% of admissions to acute-care hospitals are associated with an adverse event. Analysis of incident reports helps to understand how and why incidents occur and can inform policy and practice for safer care. Unfortunately our capacity to monitor and respond to incident reports in a timely manner is limited by the sheer volumes of data collected. In this study, we aim to evaluate the feasibility of using multiclass classification to automate the identification of patient safety incidents in hospitals. Text based classifiers were applied to identify 10 incident types and 4 severity levels. Using the one-versus-one (OvsO) and one-versus-all (OvsA) ensemble strategies, we evaluated regularized logistic regression, linear support vector machine (SVM) and SVM with a radial-basis function (RBF) kernel. Classifiers were trained and tested with "balanced" datasets (n_ Type  = 2860, n_ SeverityLevel  = 1160) from a state-wide incident reporting system. Testing was also undertaken with imbalanced "stratified" datasets (n_ Type  = 6000, n_ SeverityLevel =5950) from the state-wide system and an independent hospital reporting system. Classifier performance was evaluated using a confusion matrix, as well as F-score, precision and recall. The most effective combination was a OvsO ensemble of binary SVM RBF classifiers with binary count feature extraction. For incident type, classifiers performed well on balanced and stratified datasets (F-score: 78.3, 73.9%), but were worse on independent datasets (68.5%). Reports about falls, medications, pressure injury, aggression and blood products were identified with high recall and precision. "Documentation" was the hardest type to identify. For severity level, F-score for severity assessment code (SAC) 1 (extreme risk) was 87.3 and 64% for SAC4 (low risk) on balanced data. With stratified data, high recall was achieved for SAC1 (82.8-84%) but precision was poor (6.8-11.2%). High risk incidents (SAC2) were confused with medium risk incidents (SAC3). Binary classifier ensembles appear to be a feasible method for identifying incidents by type and severity level. Automated identification should enable safety problems to be detected and addressed in a more timely manner. Multi-label classifiers may be necessary for reports that relate to more than one incident type.

Stress-free automatic sleep deprivation using air puffs

PubMed Central

Gross, Brooks A.; Vanderheyden, William M.; Urpa, Lea M.; Davis, Devon E.; Fitzpatrick, Christopher J.; Prabhu, Kaustubh; Poe, Gina R.

2015-01-01

Background Sleep deprivation via gentle handling is time-consuming and personnel-intensive. New Method We present here an automated sleep deprivation system via air puffs. Implanted EMG and EEG electrodes were used to assess sleep/waking states in six male Sprague-Dawley rats. Blood samples were collected from an implanted intravenous catheter every 4 hours during the 12-hour light cycle on baseline, 8 hours of sleep deprivation via air puffs, and 8 hours of sleep deprivation by gentle handling days. Results The automated system was capable of scoring sleep and waking states as accurately as our offline version (~90% for sleep) and with sufficient speed to trigger a feedback response within an acceptable amount of time (1.76 s). Manual state scoring confirmed normal sleep on the baseline day and sleep deprivation on the two manipulation days (68% decrease in non-REM, 63% decrease in REM, and 74% increase in waking). No significant differences in levels of ACTH and corticosterone (stress hormones indicative of HPA axis activity) were found at any time point between baseline sleep and sleep deprivation via air puffs. Comparison with Existing Method There were no significant differences in ACTH or corticosterone concentrations between sleep deprivation by air puffs and gentle handling over the 8-hour period. Conclusions Our system accurately detects sleep and delivers air puffs to acutely deprive rats of sleep with sufficient temporal resolution during the critical 4-5 h post learning sleep-dependent memory consolidation period. The system is stress-free and a viable alternative to existing sleep deprivation techniques. PMID:26014662

Stress-free automatic sleep deprivation using air puffs.

PubMed

Gross, Brooks A; Vanderheyden, William M; Urpa, Lea M; Davis, Devon E; Fitzpatrick, Christopher J; Prabhu, Kaustubh; Poe, Gina R

2015-08-15

Sleep deprivation via gentle handling is time-consuming and personnel-intensive. We present here an automated sleep deprivation system via air puffs. Implanted EMG and EEG electrodes were used to assess sleep/waking states in six male Sprague-Dawley rats. Blood samples were collected from an implanted intravenous catheter every 4h during the 12-h light cycle on baseline, 8h of sleep deprivation via air puffs, and 8h of sleep deprivation by gentle handling days. The automated system was capable of scoring sleep and waking states as accurately as our offline version (∼90% for sleep) and with sufficient speed to trigger a feedback response within an acceptable amount of time (1.76s). Manual state scoring confirmed normal sleep on the baseline day and sleep deprivation on the two manipulation days (68% decrease in non-REM, 63% decrease in REM, and 74% increase in waking). No significant differences in levels of ACTH and corticosterone (stress hormones indicative of HPA axis activity) were found at any time point between baseline sleep and sleep deprivation via air puffs. There were no significant differences in ACTH or corticosterone concentrations between sleep deprivation by air puffs and gentle handling over the 8-h period. Our system accurately detects sleep and delivers air puffs to acutely deprive rats of sleep with sufficient temporal resolution during the critical 4-5h post learning sleep-dependent memory consolidation period. The system is stress-free and a viable alternative to existing sleep deprivation techniques. Copyright © 2015 Elsevier B.V. All rights reserved.

Students' Experiences with an Automated Essay Scorer

ERIC Educational Resources Information Center

Scharber, Cassandra; Dexter, Sara; Riedel, Eric

2008-01-01

The purpose of this research is to analyze preservice teachers' use of and reactions to an automated essay scorer used within an online, case-based learning environment called ETIPS. Data analyzed include post-assignment surveys, a user log of students' actions within the cases, instructor-assigned scores on final essays, and interviews with four…

Automated Clinical Assessment from Smart home-based Behavior Data

PubMed Central

Dawadi, Prafulla Nath; Cook, Diane Joyce; Schmitter-Edgecombe, Maureen

2016-01-01

Smart home technologies offer potential benefits for assisting clinicians by automating health monitoring and well-being assessment. In this paper, we examine the actual benefits of smart home-based analysis by monitoring daily behaviour in the home and predicting standard clinical assessment scores of the residents. To accomplish this goal, we propose a Clinical Assessment using Activity Behavior (CAAB) approach to model a smart home resident’s daily behavior and predict the corresponding standard clinical assessment scores. CAAB uses statistical features that describe characteristics of a resident’s daily activity performance to train machine learning algorithms that predict the clinical assessment scores. We evaluate the performance of CAAB utilizing smart home sensor data collected from 18 smart homes over two years using prediction and classification-based experiments. In the prediction-based experiments, we obtain a statistically significant correlation (r = 0.72) between CAAB-predicted and clinician-provided cognitive assessment scores and a statistically significant correlation (r = 0.45) between CAAB-predicted and clinician-provided mobility scores. Similarly, for the classification-based experiments, we find CAAB has a classification accuracy of 72% while classifying cognitive assessment scores and 76% while classifying mobility scores. These prediction and classification results suggest that it is feasible to predict standard clinical scores using smart home sensor data and learning-based data analysis. PMID:26292348

Manual versus automated γ-H2AX foci analysis across five European laboratories: can this assay be used for rapid biodosimetry in a large scale radiation accident?

PubMed

Rothkamm, Kai; Barnard, Stephen; Ainsbury, Elizabeth A; Al-Hafidh, Jenna; Barquinero, Joan-Francesc; Lindholm, Carita; Moquet, Jayne; Perälä, Marjo; Roch-Lefèvre, Sandrine; Scherthan, Harry; Thierens, Hubert; Vral, Anne; Vandersickel, Veerle

2013-08-30

The identification of severely exposed individuals and reassurance of the 'worried well' are of prime importance for initial triage following a large scale radiation accident. We aim to develop the γ-H2AX foci assay into a rapid biomarker tool for use in accidents. Here, five laboratories established a standard operating procedure and analysed 100 ex vivo γ-irradiated, 4 or 24h incubated and overnight-shipped lymphocyte samples from four donors to generate γ-H2AX reference data, using manual and/or automated foci scoring strategies. In addition to acute, homogeneous exposures to 0, 1, 2 and 4Gy, acute simulated partial body (4Gy to 50% of cells) and protracted exposures (4Gy over 24h) were analysed. Data from all laboratories could be satisfactorily fitted with linear dose response functions. Average yields observed at 4h post exposure were 2-4 times higher than at 24h and varied considerably between laboratories. Automated scoring caused larger uncertainties than manual scoring and was unable to identify partial exposures, which were detectable in manually scored samples due to their overdispersed foci distributions. Protracted exposures were detectable but doses could not be accurately estimated with the γ-H2AX assay. We conclude that the γ-H2AX assay may be useful for rapid triage following a recent acute radiation exposure. The potentially higher speed and convenience of automated relative to manual foci scoring needs to be balanced against its compromised accuracy and inability to detect partial body exposures. Regular re-calibration or inclusion of reference samples may be necessary to ensure consistent results between laboratories or over long time periods. Crown Copyright © 2013. Published by Elsevier B.V. All rights reserved.

Delivery of Patient-Reported Outcome Instruments by Automated Mobile Phone Text Messaging.

PubMed

Anthony, Christopher A; Lawler, Ericka A; Glass, Natalie A; McDonald, Katelyn; Shah, Apurva S

2017-11-01

Patient-reported outcome (PRO) instruments allow patients to interpret their health and are integral in evaluating orthopedic treatments and outcomes. The purpose of this study was to define: (1) correlation between PROs collected by automated delivery of text messages on mobile phones compared with paper delivery; and (2) patient use characteristics of a technology platform utilizing automated delivery of text messages on mobile phones. Paper versions of the 12-Item Short Form Health Survey (SF-12) and the short form of the Disabilities of the Arm, Shoulder and Hand (QuickDASH) were completed by patients in orthopedic hand and upper extremity clinics. Over the next 48 hours, the same patients also completed the mobile phone portion of the study outside of the clinic which included text message delivery of the SF-12 and QuickDASH, assigned in a random order. Correlations between paper and text message delivery of the 2 PROs were assessed. Among 72 patients, the intraclass correlation coefficient (ICC) between the written and mobile phone delivery of QuickDASH was 0.91 (95% confidence interval [CI], 0.85-0.95). The ICC between the paper and mobile phone delivery of the SF-12 physical health composite score was 0.88 (95% CI, 0.79-0.93) and 0.86 (95% CI, 0.75-0.92) for the SF-12 mental health composite score. We find that text message delivery using mobile phones permits valid assessment of SF-12 and QuickDASH scores. The findings suggest that software-driven automated delivery of text communication to patients via mobile phones may be a valid method to obtain other PRO scores in orthopedic patients.

Somatostatin receptor immunohistochemistry in neuroendocrine tumors: comparison between manual and automated evaluation

PubMed Central

Daniel, Kaemmerer; Maria, Athelogou; Amelie, Lupp; Isabell, Lenhardt; Stefan, Schulz; Luisa, Peter; Merten, Hommann; Vikas, Prasad; Gerd, Binnig; Paul, Baum Richard

2014-01-01

Background: Manual evaluation of somatostatin receptor (SSTR) immunohistochemistry (IHC) is a time-consuming and cost-intensive procedure. Aim of the study was to compare manual evaluation of SSTR subtype IHC to an automated software-based analysis, and to in-vivo imaging by SSTR-based PET/CT. Methods: We examined 25 gastroenteropancreatic neuroendocrine tumor (GEP-NET) patients and correlated their in-vivo SSTR-PET/CT data (determined by the standardized uptake values SUVmax,-mean) with the corresponding ex-vivo IHC data of SSTR subtype (1, 2A, 4, 5) expression. Exactly the same lesions were imaged by PET/CT, resected and analyzed by IHC in each patient. After manual evaluation, the IHC slides were digitized and automatically evaluated for SSTR expression by Definiens XD software. A virtual IHC score “BB1” was created for comparing the manual and automated analysis of SSTR expression. Results: BB1 showed a significant correlation with the corresponding conventionally determined Her2/neu score of the SSTR-subtypes 2A (rs: 0.57), 4 (rs: 0.44) and 5 (rs: 0.43). BB1 of SSTR2A also significantly correlated with the SUVmax (rs: 0.41) and the SUVmean (rs: 0.50). Likewise, a significant correlation was seen between the conventionally evaluated SSTR2A status and the SUVmax (rs: 0.42) and SUVmean (rs: 0.62).Conclusion: Our data demonstrate that the evaluation of the SSTR status by automated analysis (BB1 score), using digitized histopathology slides (“virtual microscopy”), corresponds well with the SSTR2A, 4 and 5 expression as determined by conventional manual histopathology. The BB1 score also exhibited a significant association to the SSTR-PET/CT data in accordance with the high affinity profile of the SSTR analogues used for imaging. PMID:25197368

Gene/protein name recognition based on support vector machine using dictionary as features.

PubMed

Mitsumori, Tomohiro; Fation, Sevrani; Murata, Masaki; Doi, Kouichi; Doi, Hirohumi

2005-01-01

Automated information extraction from biomedical literature is important because a vast amount of biomedical literature has been published. Recognition of the biomedical named entities is the first step in information extraction. We developed an automated recognition system based on the SVM algorithm and evaluated it in Task 1.A of BioCreAtIvE, a competition for automated gene/protein name recognition. In the work presented here, our recognition system uses the feature set of the word, the part-of-speech (POS), the orthography, the prefix, the suffix, and the preceding class. We call these features "internal resource features", i.e., features that can be found in the training data. Additionally, we consider the features of matching against dictionaries to be external resource features. We investigated and evaluated the effect of these features as well as the effect of tuning the parameters of the SVM algorithm. We found that the dictionary matching features contributed slightly to the improvement in the performance of the f-score. We attribute this to the possibility that the dictionary matching features might overlap with other features in the current multiple feature setting. During SVM learning, each feature alone had a marginally positive effect on system performance. This supports the fact that the SVM algorithm is robust on the high dimensionality of the feature vector space and means that feature selection is not required.

Automated design of degenerate codon libraries.

PubMed

Mena, Marco A; Daugherty, Patrick S

2005-12-01

Degenerate codon libraries are frequently used in protein engineering and evolution studies but are often limited to targeting a small number of positions to adequately limit the search space. To mitigate this, codon degeneracy can be limited using heuristics or previous knowledge of the targeted positions. To automate design of libraries given a set of amino acid sequences, an algorithm (LibDesign) was developed that generates a set of possible degenerate codon libraries, their resulting size, and their score relative to a user-defined scoring function. A gene library of a specified size can then be constructed that is representative of the given amino acid distribution or that includes specific sequences or combinations thereof. LibDesign provides a new tool for automated design of high-quality protein libraries that more effectively harness existing sequence-structure information derived from multiple sequence alignment or computational protein design data.

The feasibility of automated eye tracking with the Early Childhood Vigilance Test of attention in younger HIV-exposed Ugandan children.

PubMed

Boivin, Michael J; Weiss, Jonathan; Chhaya, Ronak; Seffren, Victoria; Awadu, Jorem; Sikorskii, Alla; Giordani, Bruno

2017-07-01

Tobii eye tracking was compared with webcam-based observer scoring on an animation viewing measure of attention (Early Childhood Vigilance Test; ECVT) to evaluate the feasibility of automating measurement and scoring. Outcomes from both scoring approaches were compared with the Mullen Scales of Early Learning (MSEL), Color-Object Association Test (COAT), and Behavior Rating Inventory of Executive Function for preschool children (BRIEF-P). A total of 44 children 44 to 65 months of age were evaluated with the ECVT, COAT, MSEL, and BRIEF-P. Tobii ×2-30 portable infrared cameras were programmed to monitor pupil direction during the ECVT 6-min animation and compared with observer-based PROCODER webcam scoring. Children watched 78% of the cartoon (Tobii) compared with 67% (webcam scoring), although the 2 measures were highly correlated (r = .90, p = .001). It is possible for 2 such measures to be highly correlated even if one is consistently higher than the other (Bergemann et al., 2012). Both ECVT Tobii and webcam ECVT measures significantly correlated with COAT immediate recall (r = .37, p = .02 vs. r = .38, p = .01, respectively) and total recall (r = .33, p = .06 vs. r = .42, p = .005) measures. However, neither the Tobii eye tracking nor PROCODER webcam ECVT measures of attention correlated with MSEL composite cognitive performance or BRIEF-P global executive composite. ECVT scoring using Tobii eye tracking is feasible with at-risk very young African children and consistent with webcam-based scoring approaches in their correspondence to one another and other neurocognitive performance-based measures. By automating measurement and scoring, eye tracking technologies can improve the efficiency and help better standardize ECVT testing of attention in younger children. This holds promise for other neurodevelopmental tests where eye movements, tracking, and gaze length can provide important behavioral markers of neuropsychological and neurodevelopmental processes associated with such tests. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

A comparison of oxygen saturation data in inpatients with low oxygen saturation using automated continuous monitoring and intermittent manual data charting.

PubMed

Taenzer, Andreas H; Pyke, Joshua; Herrick, Michael D; Dodds, Thomas M; McGrath, Susan P

2014-02-01

The manual collection and charting of traditional vital signs data in inpatient populations have been shown to be inaccurate when compared with true physiologic values. This issue has not been examined with respect to oxygen saturation data despite the increased use of this measurement in systems designed to assess the risk of patient deterioration. Of particular note are the lack of available data examining the accuracy of oxygen saturation charting in a particularly vulnerable group of patients who have prolonged oxygen desaturations (mean SpO2 <90% over at least 15 minutes). In addition, no data are currently available that investigate the often suspected "wake up" effect, resulting from a nurse entering a patient's room to obtain vital signs. In this study, we compared oxygen saturation data recorded manually with data collected by an automated continuous monitoring system in 16 inpatients considered to be at high risk for deterioration (average SpO2 values <90% collected by the automated system in a 15-minute interval before a manual charting event). Data were sampled from the automatic collection system from 2 periods: over a 15-minute period that ended 5 minutes before the time of the manual data collection and charting, and over a 5-minute range before and after the time of the manual data collection and charting. Average saturations from prolonged baseline desaturations (15-minute period) were compared with both the manual and automated data sampled at the time of the nurse's visit to analyze for systematic change and to investigate the presence of an arousal effect. The manually charted data were higher than those recorded by the automated system. Manually recorded data were on average 6.5% (confidence interval, 4.0%-9.0%) higher in oxygen saturation. No significant arousal effect resulting from the nurse's visit to the patient's room was detected. In a cohort of patients with prolonged desaturations, manual recordings of SpO2 did not reflect physiologic patient state when compared with continuous automated sampling. Currently, early warning scores depend on manual vital sign recordings in many settings; the study data suggest that SpO2 ought to be added to the list of vital sign values that have been shown to be recorded inaccurately.

Automated processing of fluorescence in-situ hybridization slides for HER2 testing in breast and gastro-esophageal carcinomas.

PubMed

Tafe, Laura J; Allen, Samantha F; Steinmetz, Heather B; Dokus, Betty A; Cook, Leanne J; Marotti, Jonathan D; Tsongalis, Gregory J

2014-08-01

HER2 fluorescence in-situ hybridization (FISH) is used in breast and gastro-esophageal carcinoma for determining HER2 gene amplification and patients' eligibility for HER2 targeted therapeutics. Traditional manual processing of the FISH slides is labor intensive because of multiple steps that require hands on manipulation of the slides and specifically timed intervals between steps. This highly manual processing also introduces inter-run and inter-operator variability that may affect the quality of the FISH result. Therefore, we sought to incorporate an automated processing instrument into our FISH workflow. Twenty-six cases including breast (20) and gastro-esophageal (6) cancer comprising 23 biopsies and three excision specimens were tested for HER2 FISH (Pathvysion, Abbott) using the Thermobrite Elite (TBE) system (Leica). Up to 12 slides can be run simultaneously. All cases were previously tested by the Pathvysion HER2 FISH assay with manual preparation. Twenty cells were counted by two observers for each case; five cases were tested on three separate runs by different operators to evaluate the precision and inter-operator variability. There was 100% concordance in the scoring between the manual and TBE methods as well as among the five cases that were tested on three runs. Only one case failed due to poor probe hybridization. In total, seven cases were positive for HER2 amplification (HER2:CEP17 ratio >2.2) and the remaining 19 were negative (HER2:CEP17 ratio <1.8) utilizing the 2007 ASCO/CAP scoring criteria. Due to the automated denaturation and hybridization, for each run, there was a reduction in labor of 3.5h which could then be dedicated to other lab functions. The TBE is a walk away pre- and post-hybridization system that automates FISH slide processing, improves work flow and consistency and saves approximately 3.5h of technologist time. The instrument has a small footprint thus occupying minimal counter space. TBE processed slides performed exceptionally well in comparison to the manual technique with no disagreement in HER2 amplification status. Copyright © 2014 Elsevier Inc. All rights reserved.

Statistical machine translation for biomedical text: are we there yet?

PubMed

Wu, Cuijun; Xia, Fei; Deleger, Louise; Solti, Imre

2011-01-01

In our paper we addressed the research question: "Has machine translation achieved sufficiently high quality to translate PubMed titles for patients?". We analyzed statistical machine translation output for six foreign language - English translation pairs (bi-directionally). We built a high performing in-house system and evaluated its output for each translation pair on large scale both with automated BLEU scores and human judgment. In addition to the in-house system, we also evaluated Google Translate's performance specifically within the biomedical domain. We report high performance for German, French and Spanish -- English bi-directional translation pairs for both Google Translate and our system.

Method of multi-dimensional moment analysis for the characterization of signal peaks

DOEpatents

Pfeifer, Kent B; Yelton, William G; Kerr, Dayle R; Bouchier, Francis A

2012-10-23

A method of multi-dimensional moment analysis for the characterization of signal peaks can be used to optimize the operation of an analytical system. With a two-dimensional Peclet analysis, the quality and signal fidelity of peaks in a two-dimensional experimental space can be analyzed and scored. This method is particularly useful in determining optimum operational parameters for an analytical system which requires the automated analysis of large numbers of analyte data peaks. For example, the method can be used to optimize analytical systems including an ion mobility spectrometer that uses a temperature stepped desorption technique for the detection of explosive mixtures.

Automated process control for plasma etching

NASA Astrophysics Data System (ADS)

McGeown, Margaret; Arshak, Khalil I.; Murphy, Eamonn

1992-06-01

This paper discusses the development and implementation of a rule-based system which assists in providing automated process control for plasma etching. The heart of the system is to establish a correspondence between a particular data pattern -- sensor or data signals -- and one or more modes of failure, i.e., a data-driven monitoring approach. The objective of this rule based system, PLETCHSY, is to create a program combining statistical process control (SPC) and fault diagnosis to help control a manufacturing process which varies over time. This can be achieved by building a process control system (PCS) with the following characteristics. A facility to monitor the performance of the process by obtaining and analyzing the data relating to the appropriate process variables. Process sensor/status signals are input into an SPC module. If trends are present, the SPC module outputs the last seven control points, a pattern which is represented by either regression or scoring. The pattern is passed to the rule-based module. When the rule-based system recognizes a pattern, it starts the diagnostic process using the pattern. If the process is considered to be going out of control, advice is provided about actions which should be taken to bring the process back into control.

Automating PACS quality control with the Vanderbilt image processing enterprise resource

NASA Astrophysics Data System (ADS)

Esparza, Michael L.; Welch, E. Brian; Landman, Bennett A.

2012-02-01

Precise image acquisition is an integral part of modern patient care and medical imaging research. Periodic quality control using standardized protocols and phantoms ensures that scanners are operating according to specifications, yet such procedures do not ensure that individual datasets are free from corruption; for example due to patient motion, transient interference, or physiological variability. If unacceptable artifacts are noticed during scanning, a technologist can repeat a procedure. Yet, substantial delays may be incurred if a problematic scan is not noticed until a radiologist reads the scans or an automated algorithm fails. Given scores of slices in typical three-dimensional scans and widevariety of potential use cases, a technologist cannot practically be expected inspect all images. In large-scale research, automated pipeline systems have had great success in achieving high throughput. However, clinical and institutional workflows are largely based on DICOM and PACS technologies; these systems are not readily compatible with research systems due to security and privacy restrictions. Hence, quantitative quality control has been relegated to individual investigators and too often neglected. Herein, we propose a scalable system, the Vanderbilt Image Processing Enterprise Resource (VIPER) to integrate modular quality control and image analysis routines with a standard PACS configuration. This server unifies image processing routines across an institutional level and provides a simple interface so that investigators can collaborate to deploy new analysis technologies. VIPER integrates with high performance computing environments has successfully analyzed all standard scans from our institutional research center over the course of the last 18 months.

Development and Evaluation of Semiautomated Quantification of Lissamine Green Staining of the Bulbar Conjunctiva From Digital Images.

PubMed

Bunya, Vatinee Y; Chen, Min; Zheng, Yuanjie; Massaro-Giordano, Mina; Gee, James; Daniel, Ebenezer; O'Sullivan, Ryan; Smith, Eli; Stone, Richard A; Maguire, Maureen G

2017-10-01

Lissamine green (LG) staining of the conjunctiva is a key biomarker in evaluating ocular surface disease. The disease currently is assessed using relatively coarse subjective scales. Objective assessment would standardize comparisons over time and between clinicians. To develop a semiautomated, quantitative system to assess lissamine green staining of the bulbar conjunctiva on digital images. Using a standard photography protocol, 35 digital images of the conjunctiva of 11 patients with a diagnosis of dry eye disease based on characteristic signs and symptoms were obtained after topical administration of preservative-free LG, 1%, solution. Images were scored independently by 2 masked ophthalmologists in an academic medical center using the van Bijsterveld and National Eye Institute (NEI) scales. The region of interest was identified by manually marking 7 anatomic landmarks on the images. An objective measure was developed by segmenting the images, forming a vector of key attributes, and then performing a random forest regression. Subjective scores were correlated with the output from a computer algorithm using a cross-validation technique. The ranking of images from least to most staining was compared between the algorithm and the ophthalmologists. The study was conducted from April 26, 2012, through June 2, 2016. Correlation and level of agreement among computerized algorithm scores, van Bijsterveld scale clinical scores, and NEI scale clinical scores. The scores from the automated algorithm correlated well with the mean scores obtained from the gradings of 2 ophthalmologists for the 35 images using the van Bijsterveld scale (Spearman correlation coefficient, rs = 0.79), and moderately with the NEI scale (rs = 0.61) scores. For qualitative ranking of staining, the correlation between the automated algorithm and the 2 ophthalmologists was rs = 0.78 and rs = 0.83. The algorithm performed well when evaluating LG staining of the conjunctiva, as evidenced by good correlation with subjective gradings using 2 different grading scales. Future longitudinal studies are needed to assess the responsiveness of the algorithm to change of conjunctival staining over time.

A Practical Approach for Recognizing Eating Moments with Wrist-Mounted Inertial Sensing

PubMed Central

Thomaz, Edison; Essa, Irfan; Abowd, Gregory D.

2018-01-01

Recognizing when eating activities take place is one of the key challenges in automated food intake monitoring. Despite progress over the years, most proposed approaches have been largely impractical for everyday usage, requiring multiple on-body sensors or specialized devices such as neck collars for swallow detection. In this paper, we describe the implementation and evaluation of an approach for inferring eating moments based on 3-axis accelerometry collected with a popular off-the-shelf smartwatch. Trained with data collected in a semi-controlled laboratory setting with 20 subjects, our system recognized eating moments in two free-living condition studies (7 participants, 1 day; 1 participant, 31 days), with F-scores of 76.1% (66.7% Precision, 88.8% Recall), and 71.3% (65.2% Precision, 78.6% Recall). This work represents a contribution towards the implementation of a practical, automated system for everyday food intake monitoring, with applicability in areas ranging from health research and food journaling. PMID:29520397

Automated Scoring of Mathematics Tasks in the Common Core Era: Enhancements to M-Rater in Support of "CBAL"™ Mathematics and the Common Core Assessments. Research Reports. ETS RR-13-26

ERIC Educational Resources Information Center

Fife, James H.

2013-01-01

The m-rater scoring engine has been used successfully for the past several years to score "CBAL"™ mathematics tasks, for the most part without the need for human scoring. During this time, various improvements to m-rater and its scoring keys have been implemented in response to specific CBAL needs. In 2012, with the general move toward…

An automated multi-modal object analysis approach to coronary calcium scoring of adaptive heart isolated MSCT images

NASA Astrophysics Data System (ADS)

Wu, Jing; Ferns, Gordon; Giles, John; Lewis, Emma

2012-02-01

Inter- and intra- observer variability is a problem often faced when an expert or observer is tasked with assessing the severity of a disease. This issue is keenly felt in coronary calcium scoring of patients suffering from atherosclerosis where in clinical practice, the observer must identify firstly the presence, followed by the location of candidate calcified plaques found within the coronary arteries that may prevent oxygenated blood flow to the heart muscle. This can be challenging for a human observer as it is difficult to differentiate calcified plaques that are located in the coronary arteries from those found in surrounding anatomy such as the mitral valve or pericardium. The inclusion or exclusion of false positive or true positive calcified plaques respectively will alter the patient calcium score incorrectly, thus leading to the possibility of incorrect treatment prescription. In addition to the benefits to scoring accuracy, the use of fast, low dose multi-slice CT imaging to perform the cardiac scan is capable of acquiring the entire heart within a single breath hold. Thus exposing the patient to lower radiation dose, which for a progressive disease such as atherosclerosis where multiple scans may be required, is beneficial to their health. Presented here is a fully automated method for calcium scoring using both the traditional Agatston method, as well as the Volume scoring method. Elimination of the unwanted regions of the cardiac image slices such as lungs, ribs, and vertebrae is carried out using adaptive heart isolation. Such regions cannot contain calcified plaques but can be of a similar intensity and their removal will aid detection. Removal of both the ascending and descending aortas, as they contain clinical insignificant plaques, is necessary before the final calcium scores are calculated and examined against ground truth scores of three averaged expert observer results. The results presented here are intended to show the requirement and feasibility for an automated scoring method that reduces the subjectivity and reproducibility error inherent with manual clinical calcium scoring.

Fold assessment for comparative protein structure modeling.

PubMed

Melo, Francisco; Sali, Andrej

2007-11-01

Accurate and automated assessment of both geometrical errors and incompleteness of comparative protein structure models is necessary for an adequate use of the models. Here, we describe a composite score for discriminating between models with the correct and incorrect fold. To find an accurate composite score, we designed and applied a genetic algorithm method that searched for a most informative subset of 21 input model features as well as their optimized nonlinear transformation into the composite score. The 21 input features included various statistical potential scores, stereochemistry quality descriptors, sequence alignment scores, geometrical descriptors, and measures of protein packing. The optimized composite score was found to depend on (1) a statistical potential z-score for residue accessibilities and distances, (2) model compactness, and (3) percentage sequence identity of the alignment used to build the model. The accuracy of the composite score was compared with the accuracy of assessment by single and combined features as well as by other commonly used assessment methods. The testing set was representative of models produced by automated comparative modeling on a genomic scale. The composite score performed better than any other tested score in terms of the maximum correct classification rate (i.e., 3.3% false positives and 2.5% false negatives) as well as the sensitivity and specificity across the whole range of thresholds. The composite score was implemented in our program MODELLER-8 and was used to assess models in the MODBASE database that contains comparative models for domains in approximately 1.3 million protein sequences.

Users manual for the Automated Performance Test System (APTS)

NASA Technical Reports Server (NTRS)

Lane, N. E.; Kennedy, R. S.

1990-01-01

The characteristics of and the user information for the Essex Automated Performance Test System (APTS) computer-based portable performance assessment battery are given. The battery was developed to provide a menu of performance test tapping the widest possible variety of human cognitive and motor functions, implemented on a portable computer system suitable for use in both laboratory and field settings for studying the effects of toxic agents and other stressors. The manual gives guidance in selecting, administering and scoring tests from the battery, and reviews the data and studies underlying the development of the battery. Its main emphasis is on the users of the battery - the scientists, researchers and technicians who wish to examine changes in human performance across time or as a function of changes in the conditions under which test data are obtained. First the how to information needed to make decisions about where and how to use the battery is given, followed by the research background supporting the battery development. Further, the development history of the battery focuses largely on the logical framework within which tests were evaluated.

HPV-QUEST: A highly customized system for automated HPV sequence analysis capable of processing Next Generation sequencing data set.

PubMed

Yin, Li; Yao, Jiqiang; Gardner, Brent P; Chang, Kaifen; Yu, Fahong; Goodenow, Maureen M

2012-01-01

Next Generation sequencing (NGS) applied to human papilloma viruses (HPV) can provide sensitive methods to investigate the molecular epidemiology of multiple type HPV infection. Currently a genotyping system with a comprehensive collection of updated HPV reference sequences and a capacity to handle NGS data sets is lacking. HPV-QUEST was developed as an automated and rapid HPV genotyping system. The web-based HPV-QUEST subtyping algorithm was developed using HTML, PHP, Perl scripting language, and MYSQL as the database backend. HPV-QUEST includes a database of annotated HPV reference sequences with updated nomenclature covering 5 genuses, 14 species and 150 mucosal and cutaneous types to genotype blasted query sequences. HPV-QUEST processes up to 10 megabases of sequences within 1 to 2 minutes. Results are reported in html, text and excel formats and display e-value, blast score, and local and coverage identities; provide genus, species, type, infection site and risk for the best matched reference HPV sequence; and produce results ready for additional analyses.

Automated Scoring of Teachers' Open-Ended Responses to Video Prompts: Bringing the Classroom-Video-Analysis Assessment to Scale

ERIC Educational Resources Information Center

Kersting, Nicole B.; Sherin, Bruce L.; Stigler, James W.

2014-01-01

In this study, we explored the potential for machine scoring of short written responses to the Classroom-Video-Analysis (CVA) assessment, which is designed to measure teachers' usable mathematics teaching knowledge. We created naïve Bayes classifiers for CVA scales assessing three different topic areas and compared computer-generated scores to…

Comparison of "E-Rater"[R] Automated Essay Scoring Model Calibration Methods Based on Distributional Targets

ERIC Educational Resources Information Center

Zhang, Mo; Williamson, David M.; Breyer, F. Jay; Trapani, Catherine

2012-01-01

This article describes two separate, related studies that provide insight into the effectiveness of "e-rater" score calibration methods based on different distributional targets. In the first study, we developed and evaluated a new type of "e-rater" scoring model that was cost-effective and applicable under conditions of absent human rating and…

Automated Scoring of Speaking Tasks in the Test of English-for-Teaching ("TEFT"™). Research Report. ETS RR-15-31

ERIC Educational Resources Information Center

Zechner, Klaus; Chen, Lei; Davis, Larry; Evanini, Keelan; Lee, Chong Min; Leong, Chee Wee; Wang, Xinhao; Yoon, Su-Youn

2015-01-01

This research report presents a summary of research and development efforts devoted to creating scoring models for automatically scoring spoken item responses of a pilot administration of the Test of English-for-Teaching ("TEFT"™) within the "ELTeach"™ framework.The test consists of items for all four language modalities:…

Evaluation of "e-rater"® for the "Praxis I"®Writing Test. Research Report. ETS RR-15-03

ERIC Educational Resources Information Center

Ramineni, Chaitanya; Trapani, Catherine S.; Williamson, David M.

2015-01-01

Automated scoring models were trained and evaluated for the essay task in the "Praxis I"® writing test. Prompt-specific and generic "e-rater"® scoring models were built, and evaluation statistics, such as quadratic weighted kappa, Pearson correlation, and standardized differences in mean scores, were examined to evaluate the…

Applying machine learning to pattern analysis for automated in-design layout optimization

NASA Astrophysics Data System (ADS)

Cain, Jason P.; Fakhry, Moutaz; Pathak, Piyush; Sweis, Jason; Gennari, Frank; Lai, Ya-Chieh

2018-04-01

Building on previous work for cataloging unique topological patterns in an integrated circuit physical design, a new process is defined in which a risk scoring methodology is used to rank patterns based on manufacturing risk. Patterns with high risk are then mapped to functionally equivalent patterns with lower risk. The higher risk patterns are then replaced in the design with their lower risk equivalents. The pattern selection and replacement is fully automated and suitable for use for full-chip designs. Results from 14nm product designs show that the approach can identify and replace risk patterns with quantifiable positive impact on the risk score distribution after replacement.

An automated tool for an analysis of compliance to evidence-based clinical guidelines.

PubMed

Metfessel, B A

2001-01-01

Evidence-based clinical guidelines have been developed in an attempt to decrease practice variation and improve patient outcomes. Although a number of studies and a few commercial products have attempted to measure guideline compliance, there still exists a strong need for an automated product that can take as input large amounts of data and create systematic and detailed profiles of compliance to evidence-based guidelines. The Guideline Compliance Assessment Tool is a product presently under development in our group that will accept as input medical and pharmacy claims data and create a guideline compliance profile that assesses provider practice patterns as compared to evidence-based standards. The system components include an episode of care grouper to standardize classifications of illnesses, an evidence-based guideline knowledge base that potentially contains information on several hundred distinct conditions, a guideline compliance scoring system that emphasizes systematic guideline variance rather than random variances, and an advanced data warehouse that would allow drilling into specific areas of interest. As provider profiling begins to shift away from a primary emphasis on cost to an emphasis on quality, automated methods for measuring guideline compliance will become important in measuring provider performance and increasing guideline usage, consequently improving the standard of care and the potential for better patient outcomes.

MARC: A Thought Experiment in the Morality of Automated Marking of English

ERIC Educational Resources Information Center

Elliott, Victoria

2014-01-01

Automated essay scoring programs are becoming more common and more technically advanced. They provoke strong reactions from both their advocates and their detractors. Arguments tend to fall into two categories: technical and principled. This paper argues that since technical difficulties will be overcome with time, the debate ought to be held in…

Experimental Evidence on the Effectiveness of Automated Essay Scoring in Teacher Education Cases

ERIC Educational Resources Information Center

Riedel, Eric; Dexter, Sara L.; Scharber, Cassandra; Doering, Aaron

2006-01-01

Research on computer-based writing evaluation has only recently focused on the potential for providing formative feedback rather than summative assessment. This study tests the impact of an automated essay scorer (AES) that provides formative feedback on essay drafts written as part of a series of online teacher education case studies. Seventy…

The Complete Automation of the Minnesota Multiphasic Personality Inventory and a Study of its Response Latency.

ERIC Educational Resources Information Center

Dunn, Thomas G.; And Others

The feasibility of completely automating the Minnesota Multiphasic Personality Inventory (MMPI) was tested, and item response latencies were compared with other MMPI item characteristics. A total of 26 scales were successfully scored automatically for 165 subjects. The program also typed a Mayo Clinic interpretive report on a computer terminal,…

Task Analysis and Descriptions of Required Job Competencies of Robotics/Automated Systems Technicians. Outlines for New Courses and Modules.

ERIC Educational Resources Information Center

Hull, Daniel M.; Lovett, James E.

The six new robotics and automated systems specialty courses developed by the Robotics/Automated Systems Technician (RAST) project are described in this publication. Course titles are Fundamentals of Robotics and Automated Systems, Automated Systems and Support Components, Controllers for Robots and Automated Systems, Robotics and Automated…

Coronary artery calcification identification and labeling in low-dose chest CT images

NASA Astrophysics Data System (ADS)

Xie, Yiting; Liu, Shuang; Miller, Albert; Miller, Jeffrey A.; Markowitz, Steven; Akhund, Ali; Reeves, Anthony P.

2017-03-01

A fully automated computer algorithm has been developed to evaluate coronary artery calcification (CAC) from lowdose CT scans. CAC is identified and evaluated in three main coronary artery groups: Left Main and Left Anterior Descending Artery (LM + LAD) CAC, Left Circumflex Artery (LCX) CAC, and Right Coronary Artery (RCA) CAC. The artery labeling is achieved by segmenting all CAC candidates in the heart region and applying geometric constraints on the candidates using locally pre-identified anatomy regions. This algorithm was evaluated on 1,359 low-dose ungated CT scans, in which each artery CAC content was categorically visually scored by a radiologist into none, mild, moderate and extensive. The Spearman correlation coefficient R was used to assess the agreement between three automated CAC scores (Agatston-weighted, volume, and mass) and categorical visual scores. For Agatston-weighted automated scores, R was 0.87 for total CAC, 0.82 for LM + LAD CAC, 0.66 for LCX CAC and 0.72 for RCA CAC; results using volume and mass scores were similar. CAC detection sensitivities were: 0.87 for total, 0.82 for LM + LAD, 0.65 for LCX and 0.74 for RCA. To assess the impact of image noise, the dataset was further partitioned into three subsets based on heart region noise level (low<=80HU, medium=(80HU, 110HU], high>110HU). The low and medium noise subsets had higher sensitivities and correlations than the high noise subset. These results indicate that location specific heart risk assessment is possible from low-dose chest CT images.

WE-H-BRC-09: Simulated Errors in Mock Radiotherapy Plans to Quantify the Effectiveness of the Physics Plan Review

DOE Office of Scientific and Technical Information (OSTI.GOV)

Gopan, O; Kalet, A; Smith, W

2016-06-15

Purpose: A standard tool for ensuring the quality of radiation therapy treatments is the initial physics plan review. However, little is known about its performance in practice. The goal of this study is to measure the effectiveness of physics plan review by introducing simulated errors into “mock” treatment plans and measuring the performance of plan review by physicists. Methods: We generated six mock treatment plans containing multiple errors. These errors were based on incident learning system data both within the department and internationally (SAFRON). These errors were scored for severity and frequency. Those with the highest scores were included inmore » the simulations (13 errors total). Observer bias was minimized using a multiple co-correlated distractor approach. Eight physicists reviewed these plans for errors, with each physicist reviewing, on average, 3/6 plans. The confidence interval for the proportion of errors detected was computed using the Wilson score interval. Results: Simulated errors were detected in 65% of reviews [51–75%] (95% confidence interval [CI] in brackets). The following error scenarios had the highest detection rates: incorrect isocenter in DRRs/CBCT (91% [73–98%]) and a planned dose different from the prescribed dose (100% [61–100%]). Errors with low detection rates involved incorrect field parameters in record and verify system (38%, [18–61%]) and incorrect isocenter localization in planning system (29% [8–64%]). Though pre-treatment QA failure was reliably identified (100%), less than 20% of participants reported the error that caused the failure. Conclusion: This is one of the first quantitative studies of error detection. Although physics plan review is a key safety measure and can identify some errors with high fidelity, others errors are more challenging to detect. This data will guide future work on standardization and automation. Creating new checks or improving existing ones (i.e., via automation) will help in detecting those errors with low detection rates.« less

Automated Guidance for Student Inquiry

ERIC Educational Resources Information Center

Gerard, Libby F.; Ryoo, Kihyun; McElhaney, Kevin W.; Liu, Ou Lydia; Rafferty, Anna N.; Linn, Marcia C.

2016-01-01

In 4 classroom experiments we investigated uses for technologies that automatically score student generated essays, concept diagrams, and drawings in inquiry curricula. We used the automatic scores to assign typical and research-based guidance and studied the impact of the guidance on student progress. Seven teachers and their 897 students…

An immunohistochemical and fluorescence in situ hybridization-based comparison between the Oracle HER2 Bond Immunohistochemical System, Dako HercepTest, and Vysis PathVysion HER2 FISH using both commercially validated and modified ASCO/CAP and United Kingdom HER2 IHC scoring guidelines.

PubMed

O'Grady, Anthony; Allen, David; Happerfield, Lisa; Johnson, Nicola; Provenzano, Elena; Pinder, Sarah E; Tee, Lilian; Gu, Mai; Kay, Elaine W

2010-12-01

Immunohistochemistry (IHC) is used as the frontline assay to determine HER2 status in invasive breast cancer patients. The aim of the study was to compare the performance of the Leica Oracle HER2 Bond IHC System (Oracle) with the current most readily accepted Dako HercepTest (HercepTest), using both commercially validated and modified ASCO/CAP and UK HER2 IHC scoring guidelines. A total of 445 breast cancer samples from 3 international clinical HER2 referral centers were stained with the 2 test systems and scored in a blinded fashion by experienced pathologists. The overall agreement between the 2 tests in a 3×3 (negative, equivocal and positive) analysis shows a concordance of 86.7% and 86.3%, respectively when analyzed using commercially validated and modified ASCO/CAP and UK HER2 IHC scoring guidelines. There is a good concordance between the Oracle and the HercepTest. The advantages of a complete fully automated test such as the Oracle include standardization of key analytical factors and improved turn around time. The implementation of the modified ASCO/CAP and UK HER2 IHC scoring guidelines has minimal effect on either assay interpretation, showing that Oracle can be used as a methodology for accurately determining HER2 IHC status in formalin fixed, paraffin-embedded breast cancer tissue.

Delaying investments in sensor technology: The rationality of dairy farmers' investment decisions illustrated within the framework of real options theory.

PubMed

Rutten, C J; Steeneveld, W; Oude Lansink, A G J M; Hogeveen, H

2018-05-02

The adoption rate of sensors on dairy farms varies widely. Whereas some sensors are hardly adopted, others are adopted by many farmers. A potential rational explanation for the difference in adoption may be the expected future technological progress in the sensor technology and expected future improved decision support possibilities. For some sensors not much progress can be expected because the technology has already made enormous progress in recent years, whereas for sensors that have only recently been introduced on the market, much progress can be expected. The adoption of sensors may thus be partly explained by uncertainty about the investment decision, in which uncertainty lays in the future performance of the sensors and uncertainty about whether improved informed decision support will become available. The overall aim was to offer a plausible example of why a sensor may not be adopted now. To explain this, the role of uncertainty about technological progress in the investment decision was illustrated for highly adopted sensors (automated estrus detection) and hardly adopted sensors (automated body condition score). This theoretical illustration uses the real options theory, which accounts for the role of uncertainty in the timing of investment decisions. A discrete event model, simulating a farm of 100 dairy cows, was developed to estimate the net present value (NPV) of investing now and investing in 5 yr in both sensor systems. The results show that investing now in automated estrus detection resulted in a higher NPV than investing 5 yr from now, whereas for the automated body condition score postponing the investment resulted in a higher NPV compared with investing now. These results are in line with the observation that farmers postpone investments in sensors. Also, the current high adoption of automated estrus detection sensors can be explained because the NPV of investing now is higher than the NPV of investing in 5 yr. The results confirm that uncertainty about future sensor performance and uncertainty about whether improved decision support will become available play a role in investment decisions. Copyright © 2018 American Dairy Science Association. Published by Elsevier Inc. All rights reserved.

The Harvard Automated Phone Task: new performance-based activities of daily living tests for early Alzheimer's disease.

PubMed

Marshall, Gad A; Dekhtyar, Maria; Bruno, Jonathan M; Jethwani, Kamal; Amariglio, Rebecca E; Johnson, Keith A; Sperling, Reisa A; Rentz, Dorene M

2015-12-01

Impairment in activities of daily living is a major burden for Alzheimer's disease dementia patients and caregivers. Multiple subjective scales and a few performance-based instruments have been validated and proven to be reliable in measuring instrumental activities of daily living in Alzheimer's disease dementia but less so in amnestic mild cognitive impairment and preclinical Alzheimer's disease. To validate the Harvard Automated Phone Task, a new performance-based activities of daily living test for early Alzheimer's disease, which assesses high level tasks that challenge seniors in daily life. In a cross-sectional study, the Harvard Automated Phone Task was associated with demographics and cognitive measures through univariate and multivariate analyses; ability to discriminate across diagnostic groups was assessed; test-retest reliability with the same and alternate versions was assessed in a subset of participants; and the relationship with regional cortical thickness was assessed in a subset of participants. Academic clinical research center. One hundred and eighty two participants were recruited from the community (127 clinically normal elderly and 45 young normal participants) and memory disorders clinics at Brigham and Women's Hospital and Massachusetts General Hospital (10 participants with mild cognitive impairment). As part of the Harvard Automated Phone Task, participants navigated an interactive voice response system to refill a prescription (APT-Script), select a new primary care physician (APT-PCP), and make a bank account transfer and payment (APT-Bank). The 3 tasks were scored based on time, errors, and repetitions from which composite z-scores were derived, as well as a separate report of correct completion of the task. We found that the Harvard Automated Phone Task discriminated well between diagnostic groups (APT-Script: p=0.002; APT-PCP: p<0.001; APT-Bank: p=0.02), had an incremental level of difficulty, and had excellent test-retest reliability (Cronbach's α values of 0.81 to 0.87). Within the clinically normal elderly, there were significant associations in multivariate models between performance on the Harvard Automated Phone Task and executive function (APT-PCP: p<0.001), processing speed (APT-Script: p=0.005), and regional cortical atrophy (APT-PCP: p=0.001; no significant association with APT-Script) independent of hearing acuity, motor speed, age, race, education, and premorbid intelligence. Our initial experience with the Harvard Automated Phone Task, which consists of ecologically valid, easily-administered measures of daily activities, suggests that these tasks could be useful for screening and tracking the earliest functional alterations in preclinical and early prodromal AD.

Automated assessment of cognitive health using smart home technologies.

PubMed

Dawadi, Prafulla N; Cook, Diane J; Schmitter-Edgecombe, Maureen; Parsey, Carolyn

2013-01-01

The goal of this work is to develop intelligent systems to monitor the wellbeing of individuals in their home environments. This paper introduces a machine learning-based method to automatically predict activity quality in smart homes and automatically assess cognitive health based on activity quality. This paper describes an automated framework to extract set of features from smart home sensors data that reflects the activity performance or ability of an individual to complete an activity which can be input to machine learning algorithms. Output from learning algorithms including principal component analysis, support vector machine, and logistic regression algorithms are used to quantify activity quality for a complex set of smart home activities and predict cognitive health of participants. Smart home activity data was gathered from volunteer participants (n=263) who performed a complex set of activities in our smart home testbed. We compare our automated activity quality prediction and cognitive health prediction with direct observation scores and health assessment obtained from neuropsychologists. With all samples included, we obtained statistically significant correlation (r=0.54) between direct observation scores and predicted activity quality. Similarly, using a support vector machine classifier, we obtained reasonable classification accuracy (area under the ROC curve=0.80, g-mean=0.73) in classifying participants into two different cognitive classes, dementia and cognitive healthy. The results suggest that it is possible to automatically quantify the task quality of smart home activities and perform limited assessment of the cognitive health of individual if smart home activities are properly chosen and learning algorithms are appropriately trained.

Automated Assessment of Cognitive Health Using Smart Home Technologies

PubMed Central

Dawadi, Prafulla N.; Cook, Diane J.; Schmitter-Edgecombe, Maureen; Parsey, Carolyn

2014-01-01

BACKGROUND The goal of this work is to develop intelligent systems to monitor the well being of individuals in their home environments. OBJECTIVE This paper introduces a machine learning-based method to automatically predict activity quality in smart homes and automatically assess cognitive health based on activity quality. METHODS This paper describes an automated framework to extract set of features from smart home sensors data that reflects the activity performance or ability of an individual to complete an activity which can be input to machine learning algorithms. Output from learning algorithms including principal component analysis, support vector machine, and logistic regression algorithms are used to quantify activity quality for a complex set of smart home activities and predict cognitive health of participants. RESULTS Smart home activity data was gathered from volunteer participants (n=263) who performed a complex set of activities in our smart home testbed. We compare our automated activity quality prediction and cognitive health prediction with direct observation scores and health assessment obtained from neuropsychologists. With all samples included, we obtained statistically significant correlation (r=0.54) between direct observation scores and predicted activity quality. Similarly, using a support vector machine classifier, we obtained reasonable classification accuracy (area under the ROC curve = 0.80, g-mean = 0.73) in classifying participants into two different cognitive classes, dementia and cognitive healthy. CONCLUSIONS The results suggest that it is possible to automatically quantify the task quality of smart home activities and perform limited assessment of the cognitive health of individual if smart home activities are properly chosen and learning algorithms are appropriately trained. PMID:23949177

Humans: still vital after all these years of automation.

PubMed

Parasuraman, Raja; Wickens, Christopher D

2008-06-01

The authors discuss empirical studies of human-automation interaction and their implications for automation design. Automation is prevalent in safety-critical systems and increasingly in everyday life. Many studies of human performance in automated systems have been conducted over the past 30 years. Developments in three areas are examined: levels and stages of automation, reliance on and compliance with automation, and adaptive automation. Automation applied to information analysis or decision-making functions leads to differential system performance benefits and costs that must be considered in choosing appropriate levels and stages of automation. Human user dependence on automated alerts and advisories reflects two components of operator trust, reliance and compliance, which are in turn determined by the threshold designers use to balance automation misses and false alarms. Finally, adaptive automation can provide additional benefits in balancing workload and maintaining the user's situation awareness, although more research is required to identify when adaptation should be user controlled or system driven. The past three decades of empirical research on humans and automation has provided a strong science base that can be used to guide the design of automated systems. This research can be applied to most current and future automated systems.

An Effectiveness Evaluation Between Manual and Automated Readability Counting Techniques. CNETS Report 5-75.

ERIC Educational Resources Information Center

Bunde, Gary R.

A statistical comparison was made between two automated devices which were used to count data points (words, sentences, and syllables) needed in the Flesch Reading Ease Score to determine the reading grade level of written material. Determination of grade level of all Rate Training Manuals and Non-Resident Career Courses had been requested by the…

Automated Scoring of Chinese Engineering Students' English Essays

ERIC Educational Resources Information Center

Liu, Ming; Wang, Yuqi; Xu, Weiwei; Liu, Li

2017-01-01

The number of Chinese engineering students has increased greatly since 1999. Rating the quality of these students' English essays has thus become time-consuming and challenging. This paper presents a novel automatic essay scoring algorithm called PSOSVR, based on a machine learning algorithm, Support Vector Machine for Regression (SVR), and a…

Automated Sentence Completion Scoring.

ERIC Educational Resources Information Center

Veldman, Donald J.

A 62-item form of the sentence-completion technique requiring one-word responses was administered to 1718 undergraduates in teacher education. The data were punched on cards and lists of different responses were compiled. Responses indicating evasion, hostility, anxiety and depression were identified for each stem to form a scoring "dictionary." A…

Automated detection of insect-damaged sunflower seeds by X-ray imaging

USDA-ARS?s Scientific Manuscript database

The development of insect-resistant sunflowers is hindered by the lack of a quick and effective method for scoring samples in terms of insect damage. The current method for scoring insect damage, which involves manual inspection of seeds for holes bored into the shell, is tedious, requiring approxi...

Transforming Biology Assessment with Machine Learning: Automated Scoring of Written Evolutionary Explanations

ERIC Educational Resources Information Center

Nehm, Ross H.; Ha, Minsu; Mayfield, Elijah

2012-01-01

This study explored the use of machine learning to automatically evaluate the accuracy of students' written explanations of evolutionary change. Performance of the Summarization Integrated Development Environment (SIDE) program was compared to human expert scoring using a corpus of 2,260 evolutionary explanations written by 565 undergraduate…

Automatic information extraction from unstructured mammography reports using distributed semantics.

PubMed

Gupta, Anupama; Banerjee, Imon; Rubin, Daniel L

2018-02-01

To date, the methods developed for automated extraction of information from radiology reports are mainly rule-based or dictionary-based, and, therefore, require substantial manual effort to build these systems. Recent efforts to develop automated systems for entity detection have been undertaken, but little work has been done to automatically extract relations and their associated named entities in narrative radiology reports that have comparable accuracy to rule-based methods. Our goal is to extract relations in a unsupervised way from radiology reports without specifying prior domain knowledge. We propose a hybrid approach for information extraction that combines dependency-based parse tree with distributed semantics for generating structured information frames about particular findings/abnormalities from the free-text mammography reports. The proposed IE system obtains a F 1 -score of 0.94 in terms of completeness of the content in the information frames, which outperforms a state-of-the-art rule-based system in this domain by a significant margin. The proposed system can be leveraged in a variety of applications, such as decision support and information retrieval, and may also easily scale to other radiology domains, since there is no need to tune the system with hand-crafted information extraction rules. Copyright © 2018 Elsevier Inc. All rights reserved.

Automated image analysis method for detecting and quantifying macrovesicular steatosis in hematoxylin and eosin-stained histology images of human livers.

PubMed

Nativ, Nir I; Chen, Alvin I; Yarmush, Gabriel; Henry, Scot D; Lefkowitch, Jay H; Klein, Kenneth M; Maguire, Timothy J; Schloss, Rene; Guarrera, James V; Berthiaume, Francois; Yarmush, Martin L

2014-02-01

Large-droplet macrovesicular steatosis (ld-MaS) in more than 30% of liver graft hepatocytes is a major risk factor for liver transplantation. An accurate assessment of the ld-MaS percentage is crucial for determining liver graft transplantability, which is currently based on pathologists' evaluations of hematoxylin and eosin (H&E)-stained liver histology specimens, with the predominant criteria being the relative size of the lipid droplets (LDs) and their propensity to displace a hepatocyte's nucleus to the cell periphery. Automated image analysis systems aimed at objectively and reproducibly quantifying ld-MaS do not accurately differentiate large LDs from small-droplet macrovesicular steatosis and do not take into account LD-mediated nuclear displacement; this leads to a poor correlation with pathologists' assessments. Here we present an improved image analysis method that incorporates nuclear displacement as a key image feature for segmenting and classifying ld-MaS from H&E-stained liver histology slides. 52,000 LDs in 54 digital images from 9 patients were analyzed, and the performance of the proposed method was compared against the performance of current image analysis methods and the ld-MaS percentage evaluations of 2 trained pathologists from different centers. We show that combining nuclear displacement and LD size information significantly improves the separation between large and small macrovesicular LDs (specificity = 93.7%, sensitivity = 99.3%) and the correlation with pathologists' ld-MaS percentage assessments (linear regression coefficient of determination = 0.97). This performance vastly exceeds that of other automated image analyzers, which typically underestimate or overestimate pathologists' ld-MaS scores. This work demonstrates the potential of automated ld-MaS analysis in monitoring the steatotic state of livers. The image analysis principles demonstrated here may help to standardize ld-MaS scores among centers and ultimately help in the process of determining liver graft transplantability. © 2013 American Association for the Study of Liver Diseases.

Algorithm improvement program nuclide identification algorithm scoring criteria and scoring application.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Enghauser, Michael

2016-02-01

The goal of the Domestic Nuclear Detection Office (DNDO) Algorithm Improvement Program (AIP) is to facilitate gamma-radiation detector nuclide identification algorithm development, improvement, and validation. Accordingly, scoring criteria have been developed to objectively assess the performance of nuclide identification algorithms. In addition, a Microsoft Excel spreadsheet application for automated nuclide identification scoring has been developed. This report provides an overview of the equations, nuclide weighting factors, nuclide equivalencies, and configuration weighting factors used by the application for scoring nuclide identification algorithm performance. Furthermore, this report presents a general overview of the nuclide identification algorithm scoring application including illustrative examples.

HT-COMET: a novel automated approach for high throughput assessment of human sperm chromatin quality.

PubMed

Albert, Océane; Reintsch, Wolfgang E; Chan, Peter; Robaire, Bernard

2016-05-01

Can we make the comet assay (single-cell gel electrophoresis) for human sperm a more accurate and informative high throughput assay? We developed a standardized automated high throughput comet (HT-COMET) assay for human sperm that improves its accuracy and efficiency, and could be of prognostic value to patients in the fertility clinic. The comet assay involves the collection of data on sperm DNA damage at the level of the single cell, allowing the use of samples from severe oligozoospermic patients. However, this makes comet scoring a low throughput procedure that renders large cohort analyses tedious. Furthermore, the comet assay comes with an inherent vulnerability to variability. Our objective is to develop an automated high throughput comet assay for human sperm that will increase both its accuracy and efficiency. The study comprised two distinct components: a HT-COMET technical optimization section based on control versus DNAse treatment analyses ( ITALIC! n = 3-5), and a cross-sectional study on 123 men presenting to a reproductive center with sperm concentrations categorized as severe oligozoospermia, oligozoospermia or normozoospermia. Sperm chromatin quality was measured using the comet assay: on classic 2-well slides for software comparison; on 96-well slides for HT-COMET optimization; after exposure to various concentrations of a damage-inducing agent, DNAse, using HT-COMET; on 123 subjects with different sperm concentrations using HT-COMET. Data from the 123 subjects were correlated to classic semen quality parameters and plotted as single-cell data in individual DNA damage profiles. We have developed a standard automated HT-COMET procedure for human sperm. It includes automated scoring of comets by a fully integrated high content screening setup that compares well with the most commonly used semi-manual analysis software. Using this method, a cross-sectional study on 123 men showed no significant correlation between sperm concentration and sperm DNA damage, confirming the existence of hidden chromatin damage in men with apparently normal semen characteristics, and a significant correlation between percentage DNA in the tail and percentage of progressively motile spermatozoa. Finally, the use of DNA damage profiles helped to distinguish subjects between and within sperm concentration categories, and allowed a determination of the proportion of highly damaged cells. The main limitations of the HT-COMET are the high, yet indispensable, investment in an automated liquid handling system and heating block to ensure accuracy, and the availability of an automated plate reading microscope and analysis software. This standardized HT-COMET assay offers many advantages, including higher accuracy and evenness due to automation of sensitive steps, a 14.4-fold increase in sample analysis capacity, and an imaging and scoring time of 1 min/well. Overall, HT-COMET offers a decrease in total experimental time of more than 90%. Hence, this assay constitutes a more efficient option to assess sperm chromatin quality, paves the way to using this assay to screen large cohorts, and holds prognostic value for infertile patients. Funded by the CIHR Institute of Human Development, Child and Youth Health (IHDCYH; RHF 100625). O.A. is a fellow supported by the Fonds de la Recherche du Québec - Santé (FRQS) and the CIHR Training Program in Reproduction, Early Development, and the Impact on Health (REDIH). B.R. is a James McGill Professor. The authors declare no conflicts of interest. © The Author 2016. Published by Oxford University Press on behalf of the European Society of Human Reproduction and Embryology. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

The Automation-by-Expertise-by-Training Interaction.

PubMed

Strauch, Barry

2017-03-01

I introduce the automation-by-expertise-by-training interaction in automated systems and discuss its influence on operator performance. Transportation accidents that, across a 30-year interval demonstrated identical automation-related operator errors, suggest a need to reexamine traditional views of automation. I review accident investigation reports, regulator studies, and literature on human computer interaction, expertise, and training and discuss how failing to attend to the interaction of automation, expertise level, and training has enabled operators to commit identical automation-related errors. Automated systems continue to provide capabilities exceeding operators' need for effective system operation and provide interfaces that can hinder, rather than enhance, operator automation-related situation awareness. Because of limitations in time and resources, training programs do not provide operators the expertise needed to effectively operate these automated systems, requiring them to obtain the expertise ad hoc during system operations. As a result, many do not acquire necessary automation-related system expertise. Integrating automation with expected operator expertise levels, and within training programs that provide operators the necessary automation expertise, can reduce opportunities for automation-related operator errors. Research to address the automation-by-expertise-by-training interaction is needed. However, such research must meet challenges inherent to examining realistic sociotechnical system automation features with representative samples of operators, perhaps by using observational and ethnographic research. Research in this domain should improve the integration of design and training and, it is hoped, enhance operator performance.

A study into the automation of cognitive assessment tasks for delivery via the telephone: lessons for developing remote monitoring applications for the elderly.

PubMed

D'Arcy, Shona; Rapcan, Viliam; Gali, Alessandra; Burke, Nicola; O'Connell, Gloria Crispino; Robertson, Ian H; Reilly, Richard B

2013-01-01

Cognitive assessments are valuable tools in assessing neurological conditions. They are critical in measuring deficits in cognitive function in an array of neurological disorders and during the ageing process. Automation of cognitive assessments is one way to address the increasing burden on medical resources for an ever increasing ageing population. This study investigated the suitability of using automated Interactive Voice Response (IVR) technology to deliver a suite of cognitive assessments to older adults using speech as the input modality. Several clinically valid and gold-standard cognitive assessments were selected for implementation in the IVR application. The IVR application was designed using human centred design principles to ensure the experience was as user friendly as possible. Sixty one participants completed two IVR assessments and one face to face (FF) assessment with a neuropsychologist. Completion rates for individual tests were inspected to identify those tests that are most suitable for administration via IVR technology. Interclass correlations were calculated to assess the reliability of the automated administration of the cognitive assessments across delivery modes. While all participants successfully completed all automated assessments, variability in the completion rates for different cognitive tests was observed. Statistical analysis found significant interclass correlations for certain cognitive tests between the different modes of administration. Analysis also suggests that an initial FF assessment reduces the variability in cognitive test scores when introducing automation into such an assessment. [corrected] This study has demonstrated the functional and cognitive reliability of administering specific cognitive tests using an automated, speech driven application. This study has defined the characteristics of existing cognitive tests that are suitable for such an automated delivery system and also informs on the limitations of other cognitive tests for this modality. This study presents recommendations for developing future large scale cognitive assessments.

Accurate Identification of ALK Positive Lung Carcinoma Patients: Novel FDA-Cleared Automated Fluorescence In Situ Hybridization Scanning System and Ultrasensitive Immunohistochemistry

PubMed Central

Conde, Esther; Suárez-Gauthier, Ana; Benito, Amparo; Garrido, Pilar; García-Campelo, Rosario; Biscuola, Michele; Paz-Ares, Luis; Hardisson, David; de Castro, Javier; Camacho, M. Carmen; Rodriguez-Abreu, Delvys; Abdulkader, Ihab; Ramirez, Josep; Reguart, Noemí; Salido, Marta; Pijuán, Lara; Arriola, Edurne; Sanz, Julián; Folgueras, Victoria; Villanueva, Noemí; Gómez-Román, Javier; Hidalgo, Manuel; López-Ríos, Fernando

2014-01-01

Background Based on the excellent results of the clinical trials with ALK-inhibitors, the importance of accurately identifying ALK positive lung cancer has never been greater. However, there are increasing number of recent publications addressing discordances between FISH and IHC. The controversy is further fuelled by the different regulatory approvals. This situation prompted us to investigate two ALK IHC antibodies (using a novel ultrasensitive detection-amplification kit) and an automated ALK FISH scanning system (FDA-cleared) in a series of non-small cell lung cancer tumor samples. Methods Forty-seven ALK FISH-positive and 56 ALK FISH-negative NSCLC samples were studied. All specimens were screened for ALK expression by two IHC antibodies (clone 5A4 from Novocastra and clone D5F3 from Ventana) and for ALK rearrangement by FISH (Vysis ALK FISH break-apart kit), which was automatically captured and scored by using Bioview's automated scanning system. Results All positive cases with the IHC antibodies were FISH-positive. There was only one IHC-negative case with both antibodies which showed a FISH-positive result. The overall sensitivity and specificity of the IHC in comparison with FISH were 98% and 100%, respectively. Conclusions The specificity of these ultrasensitive IHC assays may obviate the need for FISH confirmation in positive IHC cases. However, the likelihood of false negative IHC results strengthens the case for FISH testing, at least in some situations. PMID:25248157

Interprofessional education and social interaction: The use of automated external defibrillators in team-based basic life support.

PubMed

Onan, Arif; Simsek, Nurettin

2017-04-01

Automated external defibrillators are pervasive computing devices designed for the treatment and management of acute sudden cardiac arrest. This study aims to explain users' actual use behavior in teams formed by different professions taken after a short time span of interaction with automated external defibrillator. Before the intervention, all the participants were certified with the American Heart Association Basic Life Support for healthcare providers. A statistically significant difference was revealed in mean individual automated external defibrillator technical skills between uniprofessional and interprofessional groups. The technical automated external defibrillator team scores were greater for groups with interprofessional than for those with uniprofessional education. The nontechnical automated external defibrillator skills of interprofessional and uniprofessional teams revealed differences in advantage of interprofessional teams. Students positively accept automated external defibrillators if well-defined and validated training opportunities to use them expertly are available. Uniprofessional teams were successfully supported by their members and, thereby, used automated external defibrillator effectively. Furthermore, the interprofessional approach resulted in as much effective teamwork as the uniprofessional approach.

Cognitive Performance Scores for the Pediatric Automated Neuropsychological Assessment Metrics in Childhood-Onset Systemic Lupus Erythematosus.

PubMed

Vega-Fernandez, Patricia; Vanderburgh White, Shana; Zelko, Frank; Ruth, Natasha M; Levy, Deborah M; Muscal, Eyal; Klein-Gitelman, Marisa S; Huber, Adam M; Tucker, Lori B; Roebuck-Spencer, Tresa; Ying, Jun; Brunner, Hermine I

2015-08-01

To develop and initially validate a global cognitive performance score (CPS) for the Pediatric Automated Neuropsychological Assessment Metrics (PedANAM) to serve as a screening tool of cognition in childhood lupus. Patients (n = 166) completed the 9 subtests of the PedANAM battery, each of which provides 3 principal performance parameters (accuracy, mean reaction time for correct responses, and throughput). Cognitive ability was measured by formal neurocognitive testing or estimated by the Pediatric Perceived Cognitive Function Questionnaire-43 to determine the presence or absence of neurocognitive dysfunction (NCD). A subset of the data was used to develop 4 candidate PedANAM-CPS indices with supervised or unsupervised statistical approaches: PedANAM-CPSUWA , i.e., unweighted averages of the accuracy scores of all PedANAM subtests; PedANAM-CPSPCA , i.e., accuracy scores of all PedANAM subtests weighted through principal components analysis; PedANAM-CPSlogit , i.e., algorithm derived from logistic models to estimate NCD status based on the accuracy scores of all of the PedANAM subtests; and PedANAM-CPSmultiscore , i.e., algorithm derived from logistic models to estimate NCD status based on select PedANAM performance parameters. PedANAM-CPS candidates were validated using the remaining data. PedANAM-CPS indices were moderately correlated with each other (|r| > 0.65). All of the PedANAM-CPS indices discriminated children by NCD status across data sets (P < 0.036). The PedANAM-CPSmultiscore had the highest area under the receiver operating characteristic curve (AUC) across all data sets for identifying NCD status (AUC >0.74), followed by the PedANAM-CPSlogit , the PedANAM-CPSPCA , and the PedANAM-CPSUWA , respectively. Based on preliminary validation and considering ease of use, the PedANAM-CPSmultiscore and the PedANAM-CPSPCA appear to be best suited as global measures of PedANAM performance. © 2015, American College of Rheumatology.

Knowledge maps: a tool for online assessment with automated feedback.

PubMed

Ho, Veronica W; Harris, Peter G; Kumar, Rakesh K; Velan, Gary M

2018-12-01

In higher education, most assessments or examinations comprise either multiple-choice items or open-ended questions such as modified essay questions (MEQs). Online concept and knowledge maps are potential tools for assessment, which might emphasize meaningful, integrated understanding of phenomena. We developed an online knowledge-mapping assessment tool, which provides automated feedback on student-submitted maps. We conducted a pilot study to investigate the potential utility of online knowledge mapping as a tool for automated assessment by comparing the scores generated by the software with manual grading of a MEQ on the same topic for a cohort of first-year medical students. In addition, an online questionnaire was used to gather students' perceptions of the tool. Map items were highly discriminating between students of differing knowledge of the topic overall. Regression analysis showed a significant correlation between map scores and MEQ scores, and responses to the questionnaire regarding use of knowledge maps for assessment were overwhelmingly positive. These results suggest that knowledge maps provide a similar indication of students' understanding of a topic as a MEQ, with the advantage of instant, consistent computer grading and time savings for educators. Online concept and knowledge maps could be a useful addition to the assessment repertoire in higher education.

Automated biphasic morphological assessment of hepatitis B-related liver fibrosis using second harmonic generation microscopy

NASA Astrophysics Data System (ADS)

Wang, Tong-Hong; Chen, Tse-Ching; Teng, Xiao; Liang, Kung-Hao; Yeh, Chau-Ting

2015-08-01

Liver fibrosis assessment by biopsy and conventional staining scores is based on histopathological criteria. Variations in sample preparation and the use of semi-quantitative histopathological methods commonly result in discrepancies between medical centers. Thus, minor changes in liver fibrosis might be overlooked in multi-center clinical trials, leading to statistically non-significant data. Here, we developed a computer-assisted, fully automated, staining-free method for hepatitis B-related liver fibrosis assessment. In total, 175 liver biopsies were divided into training (n = 105) and verification (n = 70) cohorts. Collagen was observed using second harmonic generation (SHG) microscopy without prior staining, and hepatocyte morphology was recorded using two-photon excitation fluorescence (TPEF) microscopy. The training cohort was utilized to establish a quantification algorithm. Eleven of 19 computer-recognizable SHG/TPEF microscopic morphological features were significantly correlated with the ISHAK fibrosis stages (P < 0.001). A biphasic scoring method was applied, combining support vector machine and multivariate generalized linear models to assess the early and late stages of fibrosis, respectively, based on these parameters. The verification cohort was used to verify the scoring method, and the area under the receiver operating characteristic curve was >0.82 for liver cirrhosis detection. Since no subjective gradings are needed, interobserver discrepancies could be avoided using this fully automated method.

Automated biphasic morphological assessment of hepatitis B-related liver fibrosis using second harmonic generation microscopy.

PubMed

Wang, Tong-Hong; Chen, Tse-Ching; Teng, Xiao; Liang, Kung-Hao; Yeh, Chau-Ting

2015-08-11

Liver fibrosis assessment by biopsy and conventional staining scores is based on histopathological criteria. Variations in sample preparation and the use of semi-quantitative histopathological methods commonly result in discrepancies between medical centers. Thus, minor changes in liver fibrosis might be overlooked in multi-center clinical trials, leading to statistically non-significant data. Here, we developed a computer-assisted, fully automated, staining-free method for hepatitis B-related liver fibrosis assessment. In total, 175 liver biopsies were divided into training (n = 105) and verification (n = 70) cohorts. Collagen was observed using second harmonic generation (SHG) microscopy without prior staining, and hepatocyte morphology was recorded using two-photon excitation fluorescence (TPEF) microscopy. The training cohort was utilized to establish a quantification algorithm. Eleven of 19 computer-recognizable SHG/TPEF microscopic morphological features were significantly correlated with the ISHAK fibrosis stages (P < 0.001). A biphasic scoring method was applied, combining support vector machine and multivariate generalized linear models to assess the early and late stages of fibrosis, respectively, based on these parameters. The verification cohort was used to verify the scoring method, and the area under the receiver operating characteristic curve was >0.82 for liver cirrhosis detection. Since no subjective gradings are needed, interobserver discrepancies could be avoided using this fully automated method.

Prototype space station automation system delivered and demonstrated at NASA

NASA Technical Reports Server (NTRS)

Block, Roger F.

1987-01-01

The Automated Subsystem Control for Life Support System (ASCLSS) program has successfully developed and demonstrated a generic approach to the automation and control of Space Station subsystems. The hierarchical and distributed real time controls system places the required controls authority at every level of the automation system architecture. As a demonstration of the automation technique, the ASCLSS system automated the Air Revitalization Group (ARG) of the Space Station regenerative Environmental Control and Life Support System (ECLSS) using real-time, high fidelity simulators of the ARG processess. This automation system represents an early flight prototype and an important test bed for evaluating Space Station controls technology including future application of ADA software in real-time control and the development and demonstration of embedded artificial intelligence and expert systems (AI/ES) in distributed automation and controls systems.

Evaluation of computer-based computer tomography stratification against outcome models in connective tissue disease-related interstitial lung disease: a patient outcome study.

PubMed

Jacob, Joseph; Bartholmai, Brian J; Rajagopalan, Srinivasan; Brun, Anne Laure; Egashira, Ryoko; Karwoski, Ronald; Kokosi, Maria; Wells, Athol U; Hansell, David M

2016-11-23

To evaluate computer-based computer tomography (CT) analysis (CALIPER) against visual CT scoring and pulmonary function tests (PFTs) when predicting mortality in patients with connective tissue disease-related interstitial lung disease (CTD-ILD). To identify outcome differences between distinct CTD-ILD groups derived following automated stratification of CALIPER variables. A total of 203 consecutive patients with assorted CTD-ILDs had CT parenchymal patterns evaluated by CALIPER and visual CT scoring: honeycombing, reticular pattern, ground glass opacities, pulmonary vessel volume, emphysema, and traction bronchiectasis. CT scores were evaluated against pulmonary function tests: forced vital capacity, diffusing capacity for carbon monoxide, carbon monoxide transfer coefficient, and composite physiologic index for mortality analysis. Automated stratification of CALIPER-CT variables was evaluated in place of and alongside forced vital capacity and diffusing capacity for carbon monoxide in the ILD gender, age physiology (ILD-GAP) model using receiver operating characteristic curve analysis. Cox regression analyses identified four independent predictors of mortality: patient age (P < 0.0001), smoking history (P = 0.0003), carbon monoxide transfer coefficient (P = 0.003), and pulmonary vessel volume (P < 0.0001). Automated stratification of CALIPER variables identified three morphologically distinct groups which were stronger predictors of mortality than all CT and functional indices. The Stratified-CT model substituted automated stratified groups for functional indices in the ILD-GAP model and maintained model strength (area under curve (AUC) = 0.74, P < 0.0001), ILD-GAP (AUC = 0.72, P < 0.0001). Combining automated stratified groups with the ILD-GAP model (stratified CT-GAP model) strengthened predictions of 1- and 2-year mortality: ILD-GAP (AUC = 0.87 and 0.86, respectively); stratified CT-GAP (AUC = 0.89 and 0.88, respectively). CALIPER-derived pulmonary vessel volume is an independent predictor of mortality across all CTD-ILD patients. Furthermore, automated stratification of CALIPER CT variables represents a novel method of prognostication at least as robust as PFTs in CTD-ILD patients.

Automation of Space Station module power management and distribution system

NASA Technical Reports Server (NTRS)

Bechtel, Robert; Weeks, Dave; Walls, Bryan

1990-01-01

Viewgraphs on automation of space station module (SSM) power management and distribution (PMAD) system are presented. Topics covered include: reasons for power system automation; SSM/PMAD approach to automation; SSM/PMAD test bed; SSM/PMAD topology; functional partitioning; SSM/PMAD control; rack level autonomy; FRAMES AI system; and future technology needs for power system automation.

A Ranking Method for Evaluating Constructed Responses

ERIC Educational Resources Information Center

Attali, Yigal

2014-01-01

This article presents a comparative judgment approach for holistically scored constructed response tasks. In this approach, the grader rank orders (rather than rate) the quality of a small set of responses. A prior automated evaluation of responses guides both set formation and scaling of rankings. Sets are formed to have similar prior scores and…

45 CFR 310.5 - What options are available for Computerized Tribal IV-D Systems and office automation?

Code of Federal Regulations, 2010 CFR

2010-10-01

... to conduct automated data processing and recordkeeping activities through Office Automation... IV-D Systems and office automation? 310.5 Section 310.5 Public Welfare Regulations Relating to Public... AUTOMATION Requirements for Computerized Tribal IV-D Systems and Office Automation § 310.5 What options are...

Physiological Self-Regulation and Adaptive Automation

NASA Technical Reports Server (NTRS)

Prinzell, Lawrence J.; Pope, Alan T.; Freeman, Frederick G.

2007-01-01

Adaptive automation has been proposed as a solution to current problems of human-automation interaction. Past research has shown the potential of this advanced form of automation to enhance pilot engagement and lower cognitive workload. However, there have been concerns voiced regarding issues, such as automation surprises, associated with the use of adaptive automation. This study examined the use of psychophysiological self-regulation training with adaptive automation that may help pilots deal with these problems through the enhancement of cognitive resource management skills. Eighteen participants were assigned to 3 groups (self-regulation training, false feedback, and control) and performed resource management, monitoring, and tracking tasks from the Multiple Attribute Task Battery. The tracking task was cycled between 3 levels of task difficulty (automatic, adaptive aiding, manual) on the basis of the electroencephalogram-derived engagement index. The other two tasks remained in automatic mode that had a single automation failure. Those participants who had received self-regulation training performed significantly better and reported lower National Aeronautics and Space Administration Task Load Index scores than participants in the false feedback and control groups. The theoretical and practical implications of these results for adaptive automation are discussed.

Automated Measurement of Tear Film Dynamics and Lipid Layer Thickness for Assessment of Non-Sjögren Dry Eye Syndrome With Meibomian Gland Dysfunction.

PubMed

Ji, Yong Woo; Lee, Jeihoon; Lee, Hun; Seo, Kyoung Yul; Kim, Eung Kweon; Kim, Tae-Im

2017-02-01

To investigate automated values from an advanced corneal topographer with a built-in real keratometer, color camera, and ocular surface interferometer for the evaluation of non-Sjögren dry eye syndrome (NSDES) with meibomian gland dysfunction (MGD). Sixty-four patients (64 eyes) diagnosed with NSDES with MGD were enrolled. All eyes were evaluated using the Ocular Surface Disease Index (OSDI), fluorescence staining score, tear film breakup time (TBUT), Schirmer test, and MGD grade. Noninvasive Keratograph average tear film breakup time (NIKBUTav), tear meniscus height (TMHk), meibomian gland (MG) dropout grade, and lipid layer thickness (LLT) using interferometry were measured. Among automated indexes, NIKBUTav (mean 7.68 ± 4.07 s) and the MG dropout grade (mean 1.0 ± 0.5) significantly correlated with the OSDI (mean 40.6 ± 22.9) (r = -0.337, P = 0.006; and r = 0.201, P = 0.023, respectively), as did all conventional indicators, except the Schirmer score (mean 9.1 ± 5.9 mm). TMHk (mean 0.21 ± 0.18 mm) had significant correlation with the Schirmer score, the staining score (mean 1.2 ± 0.7), TBUT (mean 3.8 ± 1.8 s), and NIKBUTav (r = 0.298, P = 0.007; r = -0.268, P = 0.016; r = 0.459, P < 0.001; and r = 0.439, P < 0.001, respectively), but not any MGD indicator, even the MG dropout grade. NIKBUTav showed significant correlations with all clinical parameters and other automated values, except the Schirmer score and LLT (mean 83.94 ± 20.82 nm) (all (Equation is included in full-text article.)≥ 0.25 and P < 0.01). The MG dropout grade highly correlated with all indexes except TMHk (all (Equation is included in full-text article.)≥ 0.25 and P < 0.05). LLT was significantly associated with TBUT, MGD grade (mean 2.0 ± 0.7), and MG dropout grade (r = 0.219, P = 0.047; r = -0.221, P = 0.039; and r = 0.433, P < 0.001, respectively), although it was not related to patient symptoms. Automated noninvasive measurements using an advanced corneal topographer and LLT measured with an ocular surface interferometer can be alternatives to conventional methods to evaluate tear conditions on the ocular surface; the former device can provide information about conformational MG changes in NSDES with MGD.

Laboratory automation in clinical bacteriology: what system to choose?

PubMed

Croxatto, A; Prod'hom, G; Faverjon, F; Rochais, Y; Greub, G

2016-03-01

Automation was introduced many years ago in several diagnostic disciplines such as chemistry, haematology and molecular biology. The first laboratory automation system for clinical bacteriology was released in 2006, and it rapidly proved its value by increasing productivity, allowing a continuous increase in sample volumes despite limited budgets and personnel shortages. Today, two major manufacturers, BD Kiestra and Copan, are commercializing partial or complete laboratory automation systems for bacteriology. The laboratory automation systems are rapidly evolving to provide improved hardware and software solutions to optimize laboratory efficiency. However, the complex parameters of the laboratory and automation systems must be considered to determine the best system for each given laboratory. We address several topics on laboratory automation that may help clinical bacteriologists to understand the particularities and operative modalities of the different systems. We present (a) a comparison of the engineering and technical features of the various elements composing the two different automated systems currently available, (b) the system workflows of partial and complete laboratory automation, which define the basis for laboratory reorganization required to optimize system efficiency, (c) the concept of digital imaging and telebacteriology, (d) the connectivity of laboratory automation to the laboratory information system, (e) the general advantages and disadvantages as well as the expected impacts provided by laboratory automation and (f) the laboratory data required to conduct a workflow assessment to determine the best configuration of an automated system for the laboratory activities and specificities. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

Automated Tracking of Motion and Body Weight for Objective Monitoring of Rats in Colony Housing

PubMed Central

Brenneis, Christian; Westhof, Andreas; Holschbach, Jeannine; Michaelis, Martin; Guehring, Hans; Kleinschmidt-Doerr, Kerstin

2017-01-01

Living together in large social communities within an enriched environment stimulates self-motivated activity in rats. We developed a modular housing system in which a single unit can accommodate as many as 48 rats and contains multiple functional areas. This rat colony cage further allowed us to remotely measure body weight and to continuously measure movement, including jumping and stair walking between areas. Compared with pair-housed, age-, strain-, and weight-matched rats in conventional cages, the colony-housed rats exhibited higher body mass indices, had more exploratory behavior, and were more cooperative during handling. Continuous activity tracking revealed that the amount of spontaneous locomotion, such as jumping between levels and running through the staircase, fell after surgery, blood sampling, injections, and behavioral tests to a similar extent regardless of the specific intervention. Data from the automated system allowed us to identify individual rats with significant differences (>2 SD) from other cohoused rats; these rats showed potential health problems, as verified using conventional health scoring. Thus, our rat colony cage permits social interaction and provides a variety of functional areas, thereby perhaps improving animal wellbeing. Furthermore, automated online tracking enabled continuous quantification of spontaneous motion, potentially providing objective measures of animal behavior in various disease models and reducing the need for experimental manipulation. Finally, health monitoring of individual rats was facilitated in an objective manner. PMID:28905711

Contribution for new genetic markers of rheumatoid arthritis activity and severity: sequencing of the tumor necrosis factor-alpha gene promoter.

PubMed

Fonseca, João Eurico; Cavaleiro, João; Teles, José; Sousa, Elsa; Andreozzi, Valeska L; Antunes, Marília; Amaral-Turkman, Maria A; Canhão, Helena; Mourão, Ana F; Lopes, Joana; Caetano-Lopes, Joana; Weinmann, Pamela; Sobral, Marta; Nero, Patrícia; Saavedra, Maria J; Malcata, Armando; Cruz, Margarida; Melo, Rui; Braña, Araceli; Miranda, Luis; Patto, José V; Barcelos, Anabela; da Silva, José Canas; Santos, Luís M; Figueiredo, Guilherme; Rodrigues, Mário; Jesus, Herberto; Quintal, Alberto; Carvalho, Teresa; da Silva, José A Pereira; Branco, Jaime; Queiroz, Mário Viana

2007-01-01

The objective of this study was to assess whether clinical measures of rheumatoid arthritis activity and severity were influenced by tumor necrosis factor-alpha (TNF-alpha) promoter genotype/haplotype markers. Each patient's disease activity was assessed by the disease activity score using 28 joint counts (DAS28) and functional capacity by the Health Assessment Questionnaire (HAQ) score. Systemic manifestations, radiological damage evaluated by the Sharp/van der Heijde (SvdH) score, disease-modifying anti-rheumatic drug use, joint surgeries, and work disability were also assessed. The promoter region of the TNF-alpha gene, between nucleotides -1,318 and +49, was sequenced using an automated platform. Five hundred fifty-four patients were evaluated and genotyped for 10 single-nucleotide polymorphism (SNP) markers, but 5 of these markers were excluded due to failure to fall within Hardy-Weinberg equilibrium or to monomorphism. Patients with more than 10 years of disease duration (DD) presented significant associations between the -857 SNP and systemic manifestations, as well as joint surgeries. Associations were also found between the -308 SNP and work disability in patients with more than 2 years of DD and radiological damage in patients with less than 10 years of DD. A borderline effect was found between the -238 SNP and HAQ score and radiological damage in patients with 2 to 10 years of DD. An association was also found between haplotypes and the SvdH score for those with more than 10 years of DD. An association was found between some TNF-alpha promoter SNPs and systemic manifestations, radiological progression, HAQ score, work disability, and joint surgeries, particularly in some classes of DD and between haplotypes and radiological progression for those with more than 10 years of DD.

Contribution for new genetic markers of rheumatoid arthritis activity and severity: sequencing of the tumor necrosis factor-alpha gene promoter

PubMed Central

Fonseca, João Eurico; Cavaleiro, João; Teles, José; Sousa, Elsa; Andreozzi, Valeska L; Antunes, Marília; Amaral-Turkman, Maria A; Canhão, Helena; Mourão, Ana F; Lopes, Joana; Caetano-Lopes, Joana; Weinmann, Pamela; Sobral, Marta; Nero, Patrícia; Saavedra, Maria J; Malcata, Armando; Cruz, Margarida; Melo, Rui; Braña, Araceli; Miranda, Luis; Patto, José V; Barcelos, Anabela; da Silva, José Canas; Santos, Luís M; Figueiredo, Guilherme; Rodrigues, Mário; Jesus, Herberto; Quintal, Alberto; Carvalho, Teresa; da Silva, José A Pereira; Branco, Jaime; Queiroz, Mário Viana

2007-01-01

The objective of this study was to assess whether clinical measures of rheumatoid arthritis activity and severity were influenced by tumor necrosis factor-alpha (TNF-α) promoter genotype/haplotype markers. Each patient's disease activity was assessed by the disease activity score using 28 joint counts (DAS28) and functional capacity by the Health Assessment Questionnaire (HAQ) score. Systemic manifestations, radiological damage evaluated by the Sharp/van der Heijde (SvdH) score, disease-modifying anti-rheumatic drug use, joint surgeries, and work disability were also assessed. The promoter region of the TNF-α gene, between nucleotides -1,318 and +49, was sequenced using an automated platform. Five hundred fifty-four patients were evaluated and genotyped for 10 single-nucleotide polymorphism (SNP) markers, but 5 of these markers were excluded due to failure to fall within Hardy-Weinberg equilibrium or to monomorphism. Patients with more than 10 years of disease duration (DD) presented significant associations between the -857 SNP and systemic manifestations, as well as joint surgeries. Associations were also found between the -308 SNP and work disability in patients with more than 2 years of DD and radiological damage in patients with less than 10 years of DD. A borderline effect was found between the -238 SNP and HAQ score and radiological damage in patients with 2 to 10 years of DD. An association was also found between haplotypes and the SvdH score for those with more than 10 years of DD. An association was found between some TNF-α promoter SNPs and systemic manifestations, radiological progression, HAQ score, work disability, and joint surgeries, particularly in some classes of DD and between haplotypes and radiological progression for those with more than 10 years of DD. PMID:17408492

Human-system Interfaces to Automatic Systems: Review Guidance and Technical Basis

DOE Office of Scientific and Technical Information (OSTI.GOV)

OHara, J.M.; Higgins, J.C.

Automation has become ubiquitous in modern complex systems and commercial nuclear power plants are no exception. Beyond the control of plant functions and systems, automation is applied to a wide range of additional functions including monitoring and detection, situation assessment, response planning, response implementation, and interface management. Automation has become a 'team player' supporting plant personnel in nearly all aspects of plant operation. In light of the increasing use and importance of automation in new and future plants, guidance is needed to enable the NRC staff to conduct safety reviews of the human factors engineering (HFE) aspects of modern automation.more » The objective of the research described in this report was to develop guidance for reviewing the operator's interface with automation. We first developed a characterization of the important HFE aspects of automation based on how it is implemented in current systems. The characterization included five dimensions: Level of automation, function of automation, modes of automation, flexibility of allocation, and reliability of automation. Next, we reviewed literature pertaining to the effects of these aspects of automation on human performance and the design of human-system interfaces (HSIs) for automation. Then, we used the technical basis established by the literature to develop design review guidance. The guidance is divided into the following seven topics: Automation displays, interaction and control, automation modes, automation levels, adaptive automation, error tolerance and failure management, and HSI integration. In addition, we identified insights into the automaton design process, operator training, and operations.« less

Canadian macromolecular crystallography facility: a suite of fully automated beamlines.

PubMed

Grochulski, Pawel; Fodje, Michel; Labiuk, Shaunivan; Gorin, James; Janzen, Kathryn; Berg, Russ

2012-06-01

The Canadian light source is a 2.9 GeV national synchrotron radiation facility located on the University of Saskatchewan campus in Saskatoon. The small-gap in-vacuum undulator illuminated beamline, 08ID-1, together with the bending magnet beamline, 08B1-1, constitute the Canadian Macromolecular Crystallography Facility (CMCF). The CMCF provides service to more than 50 Principal Investigators in Canada and the United States. Up to 25% of the beam time is devoted to commercial users and the general user program is guaranteed up to 55% of the useful beam time through a peer-review process. CMCF staff provides "Mail-In" crystallography service to users with the highest scored proposals. Both beamlines are equipped with very robust end-stations including on-axis visualization systems, Rayonix 300 CCD series detectors and Stanford-type robotic sample auto-mounters. MxDC, an in-house developed beamline control system, is integrated with a data processing module, AutoProcess, allowing full automation of data collection and data processing with minimal human intervention. Sample management and remote monitoring of experiments is enabled through interaction with a Laboratory Information Management System developed at the facility.

Analysis of HIV using a high resolution melting (HRM) diversity assay: automation of HRM data analysis enhances the utility of the assay for analysis of HIV incidence.

PubMed

Cousins, Matthew M; Swan, David; Magaret, Craig A; Hoover, Donald R; Eshleman, Susan H

2012-01-01

HIV diversity may be a useful biomarker for discriminating between recent and non-recent HIV infection. The high resolution melting (HRM) diversity assay was developed to quantify HIV diversity in viral populations without sequencing. In this assay, HIV diversity is expressed as a single numeric HRM score that represents the width of a melting peak. HRM scores are highly associated with diversity measures obtained with next generation sequencing. In this report, a software package, the HRM Diversity Assay Analysis Tool (DivMelt), was developed to automate calculation of HRM scores from melting curve data. DivMelt uses computational algorithms to calculate HRM scores by identifying the start (T1) and end (T2) melting temperatures for a DNA sample and subtracting them (T2 - T1 =  HRM score). DivMelt contains many user-supplied analysis parameters to allow analyses to be tailored to different contexts. DivMelt analysis options were optimized to discriminate between recent and non-recent HIV infection and to maximize HRM score reproducibility. HRM scores calculated using DivMelt were compared to HRM scores obtained using a manual method that is based on visual inspection of DNA melting curves. HRM scores generated with DivMelt agreed with manually generated HRM scores obtained from the same DNA melting data. Optimal parameters for discriminating between recent and non-recent HIV infection were identified. DivMelt provided greater discrimination between recent and non-recent HIV infection than the manual method. DivMelt provides a rapid, accurate method of determining HRM scores from melting curve data, facilitating use of the HRM diversity assay for large-scale studies.

Analysis of HIV Using a High Resolution Melting (HRM) Diversity Assay: Automation of HRM Data Analysis Enhances the Utility of the Assay for Analysis of HIV Incidence

PubMed Central

Cousins, Matthew M.; Swan, David; Magaret, Craig A.; Hoover, Donald R.; Eshleman, Susan H.

2012-01-01

Background HIV diversity may be a useful biomarker for discriminating between recent and non-recent HIV infection. The high resolution melting (HRM) diversity assay was developed to quantify HIV diversity in viral populations without sequencing. In this assay, HIV diversity is expressed as a single numeric HRM score that represents the width of a melting peak. HRM scores are highly associated with diversity measures obtained with next generation sequencing. In this report, a software package, the HRM Diversity Assay Analysis Tool (DivMelt), was developed to automate calculation of HRM scores from melting curve data. Methods DivMelt uses computational algorithms to calculate HRM scores by identifying the start (T1) and end (T2) melting temperatures for a DNA sample and subtracting them (T2–T1 = HRM score). DivMelt contains many user-supplied analysis parameters to allow analyses to be tailored to different contexts. DivMelt analysis options were optimized to discriminate between recent and non-recent HIV infection and to maximize HRM score reproducibility. HRM scores calculated using DivMelt were compared to HRM scores obtained using a manual method that is based on visual inspection of DNA melting curves. Results HRM scores generated with DivMelt agreed with manually generated HRM scores obtained from the same DNA melting data. Optimal parameters for discriminating between recent and non-recent HIV infection were identified. DivMelt provided greater discrimination between recent and non-recent HIV infection than the manual method. Conclusion DivMelt provides a rapid, accurate method of determining HRM scores from melting curve data, facilitating use of the HRM diversity assay for large-scale studies. PMID:23240016

The effects of lossy compression on diagnostically relevant seizure information in EEG signals.

PubMed

Higgins, G; McGinley, B; Faul, S; McEvoy, R P; Glavin, M; Marnane, W P; Jones, E

2013-01-01

This paper examines the effects of compression on EEG signals, in the context of automated detection of epileptic seizures. Specifically, it examines the use of lossy compression on EEG signals in order to reduce the amount of data which has to be transmitted or stored, while having as little impact as possible on the information in the signal relevant to diagnosing epileptic seizures. Two popular compression methods, JPEG2000 and SPIHT, were used. A range of compression levels was selected for both algorithms in order to compress the signals with varying degrees of loss. This compression was applied to the database of epileptiform data provided by the University of Freiburg, Germany. The real-time EEG analysis for event detection automated seizure detection system was used in place of a trained clinician for scoring the reconstructed data. Results demonstrate that compression by a factor of up to 120:1 can be achieved, with minimal loss in seizure detection performance as measured by the area under the receiver operating characteristic curve of the seizure detection system.

Algorithm Improvement Program Nuclide Identification Algorithm Scoring Criteria And Scoring Application - DNDO.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Enghauser, Michael

2015-02-01

The goal of the Domestic Nuclear Detection Office (DNDO) Algorithm Improvement Program (AIP) is to facilitate gamma-radiation detector nuclide identification algorithm development, improvement, and validation. Accordingly, scoring criteria have been developed to objectively assess the performance of nuclide identification algorithms. In addition, a Microsoft Excel spreadsheet application for automated nuclide identification scoring has been developed. This report provides an overview of the equations, nuclide weighting factors, nuclide equivalencies, and configuration weighting factors used by the application for scoring nuclide identification algorithm performance. Furthermore, this report presents a general overview of the nuclide identification algorithm scoring application including illustrative examples.

Automated classification of MMPI profiles into psychotic, neurotic or personality disorder types.

PubMed

Hatcher, W E

1978-03-01

A Fortran program has been developed which can objectively classify Minnesota Multiphasic Inventory (MMPI) profiles as being psychotic, neurotic, personality disorder, or indeterminate types. The method used is a set of configural rules, 'Henrichs' rules for males'. The only input data required are K-corrected T scores, which are the end product of standard scoring techniques. To automate these rules it was necessary to rewrite them so that all decisions were the result of arithmetic comparisons or logical tests using only and, or and not. In particular, examination of the Welsh code, which many rules required, had to be stimulated by the use of several sorted arrays. The program has been carefully tested and is in the use in our computer lab.

Automated power distribution system hardware. [for space station power supplies

NASA Technical Reports Server (NTRS)

Anderson, Paul M.; Martin, James A.; Thomason, Cindy

1989-01-01

An automated power distribution system testbed for the space station common modules has been developed. It incorporates automated control and monitoring of a utility-type power system. Automated power system switchgear, control and sensor hardware requirements, hardware design, test results, and potential applications are discussed. The system is designed so that the automated control and monitoring of the power system is compatible with both a 208-V, 20-kHz single-phase AC system and a high-voltage (120 to 150 V) DC system.

Semiautomatic regional segmentation to measure orbital fat volumes in thyroid-associated ophthalmopathy. A validation study.

PubMed

Comerci, M; Elefante, A; Strianese, D; Senese, R; Bonavolontà, P; Alfano, B; Bonavolontà, B; Brunetti, A

2013-08-01

This study was designed to validate a novel semi-automated segmentation method to measure regional intra-orbital fat tissue volume in Graves' ophthalmopathy. Twenty-four orbits from 12 patients with Graves' ophthalmopathy, 24 orbits from 12 controls, ten orbits from five MRI study simulations and two orbits from a digital model were used. Following manual region of interest definition of the orbital volumes performed by two operators with different levels of expertise, an automated procedure calculated intra-orbital fat tissue volumes (global and regional, with automated definition of four quadrants). In patients with Graves' disease, clinical activity score and degree of exophthalmos were measured and correlated with intra-orbital fat volumes. Operator performance was evaluated and statistical analysis of the measurements was performed. Accurate intra-orbital fat volume measurements were obtained with coefficients of variation below 5%. The mean operator difference in total fat volume measurements was 0.56%. Patients had significantly higher intra-orbital fat volumes than controls (p<0.001 using Student's t test). Fat volumes and clinical score were significantly correlated (p<0.001). The semi-automated method described here can provide accurate, reproducible intra-orbital fat measurements with low inter-operator variation and good correlation with clinical data.

Automated and objective action coding of facial expressions in patients with acute facial palsy.

PubMed

Haase, Daniel; Minnigerode, Laura; Volk, Gerd Fabian; Denzler, Joachim; Guntinas-Lichius, Orlando

2015-05-01

Aim of the present observational single center study was to objectively assess facial function in patients with idiopathic facial palsy with a new computer-based system that automatically recognizes action units (AUs) defined by the Facial Action Coding System (FACS). Still photographs using posed facial expressions of 28 healthy subjects and of 299 patients with acute facial palsy were automatically analyzed for bilateral AU expression profiles. All palsies were graded with the House-Brackmann (HB) grading system and with the Stennert Index (SI). Changes of the AU profiles during follow-up were analyzed for 77 patients. The initial HB grading of all patients was 3.3 ± 1.2. SI at rest was 1.86 ± 1.3 and during motion 3.79 ± 4.3. Healthy subjects showed a significant AU asymmetry score of 21 ± 11 % and there was no significant difference to patients (p = 0.128). At initial examination of patients, the number of activated AUs was significantly lower on the paralyzed side than on the healthy side (p < 0.0001). The final examination for patients took place 4 ± 6 months post baseline. The number of activated AUs and the ratio between affected and healthy side increased significantly between baseline and final examination (both p < 0.0001). The asymmetry score decreased between baseline and final examination (p < 0.0001). The number of activated AUs on the healthy side did not change significantly (p = 0.779). Radical rethinking in facial grading is worthwhile: automated FACS delivers fast and objective global and regional data on facial motor function for use in clinical routine and clinical trials.

Comparison of automated and manual vital sign collection at hospital wards.

PubMed

Wood, Jeffrey; Finkelstein, Joseph

2013-01-01

Using a cross-over study design, vital signs were collected from 60 patients by 6 nurses. Each nurse was randomly assigned for manual vital sign collection in 5 patients and for automated data collection in other 5 patients. The mean time taken for vital signs information to be available in EMR was significantly (p <0.004) lower after automated data collection (158.7±67.0) than after the manual collection (4079.8±7091.8 s). The nursing satisfaction score of collecting vital signs was significantly lower (p<0.007) for the manual way (10.3±3.9) than for the automated way (16.5±3.4). We found that 30% of vital sign records were transmitted to EMR with at least one error after manual data collection whereas there wasno transmission error with automated data collection. Allparticipating nurses stated that the automated vital sign collection can improve their efficiency and save their time for direct patient care.

Glaucoma risk index: automated glaucoma detection from color fundus images.

PubMed

Bock, Rüdiger; Meier, Jörg; Nyúl, László G; Hornegger, Joachim; Michelson, Georg

2010-06-01

Glaucoma as a neurodegeneration of the optic nerve is one of the most common causes of blindness. Because revitalization of the degenerated nerve fibers of the optic nerve is impossible early detection of the disease is essential. This can be supported by a robust and automated mass-screening. We propose a novel automated glaucoma detection system that operates on inexpensive to acquire and widely used digital color fundus images. After a glaucoma specific preprocessing, different generic feature types are compressed by an appearance-based dimension reduction technique. Subsequently, a probabilistic two-stage classification scheme combines these features types to extract the novel Glaucoma Risk Index (GRI) that shows a reasonable glaucoma detection performance. On a sample set of 575 fundus images a classification accuracy of 80% has been achieved in a 5-fold cross-validation setup. The GRI gains a competitive area under ROC (AUC) of 88% compared to the established topography-based glaucoma probability score of scanning laser tomography with AUC of 87%. The proposed color fundus image-based GRI achieves a competitive and reliable detection performance on a low-priced modality by the statistical analysis of entire images of the optic nerve head. Copyright (c) 2010 Elsevier B.V. All rights reserved.

Automated genomic DNA purification options in agricultural applications using MagneSil paramagnetic particles

NASA Astrophysics Data System (ADS)

Bitner, Rex M.; Koller, Susan C.

2002-06-01

The automated high throughput purification of genomic DNA form plant materials can be performed using MagneSil paramagnetic particles on the Beckman-Coulter FX, BioMek 2000, and the Tecan Genesis robot. Similar automated methods are available for DNA purifications from animal blood. These methods eliminate organic extractions, lengthy incubations and cumbersome filter plates. The DNA is suitable for applications such as PCR and RAPD analysis. Methods are described for processing traditionally difficult samples such as those containing large amounts of polyphenolics or oils, while still maintaining a high level of DNA purity. The robotic protocols have ben optimized for agricultural applications such as marker assisted breeding, seed-quality testing, and SNP discovery and scoring. In addition to high yield purification of DNA from plant samples or animal blood, the use of Promega's DNA-IQ purification system is also described. This method allows for the purification of a narrow range of DNA regardless of the amount of additional DNA that is present in the initial sample. This simultaneous Isolation and Quantification of DNA allows the DNA to be used directly in applications such as PCR, SNP analysis, and RAPD, without the need for separate quantitation of the DNA.

Reduction of false-positives in a CAD scheme for automated detection of architectural distortion in digital mammography

NASA Astrophysics Data System (ADS)

de Oliveira, Helder C. R.; Mencattini, Arianna; Casti, Paola; Martinelli, Eugenio; di Natale, Corrado; Catani, Juliana H.; de Barros, Nestor; Melo, Carlos F. E.; Gonzaga, Adilson; Vieira, Marcelo A. C.

2018-02-01

This paper proposes a method to reduce the number of false-positives (FP) in a computer-aided detection (CAD) scheme for automated detection of architectural distortion (AD) in digital mammography. AD is a subtle contraction of breast parenchyma that may represent an early sign of breast cancer. Due to its subtlety and variability, AD is more difficult to detect compared to microcalcifications and masses, and is commonly found in retrospective evaluations of false-negative mammograms. Several computer-based systems have been proposed for automated detection of AD in breast images. The usual approach is automatically detect possible sites of AD in a mammographic image (segmentation step) and then use a classifier to eliminate the false-positives and identify the suspicious regions (classification step). This paper focus on the optimization of the segmentation step to reduce the number of FPs that is used as input to the classifier. The proposal is to use statistical measurements to score the segmented regions and then apply a threshold to select a small quantity of regions that should be submitted to the classification step, improving the detection performance of a CAD scheme. We evaluated 12 image features to score and select suspicious regions of 74 clinical Full-Field Digital Mammography (FFDM). All images in this dataset contained at least one region with AD previously marked by an expert radiologist. The results showed that the proposed method can reduce the false positives of the segmentation step of the CAD scheme from 43.4 false positives (FP) per image to 34.5 FP per image, without increasing the number of false negatives.

Automated discovery of safety and efficacy concerns for joint & muscle pain relief treatments from online reviews.

PubMed

Adams, David Z; Gruss, Richard; Abrahams, Alan S

2017-04-01

Product issues can cost companies millions in lawsuits and have devastating effects on a firm's sales, image and goodwill, especially in the era of social media. The ability for a system to detect the presence of safety and efficacy (S&E) concerns early on could not only protect consumers from injuries due to safety hazards, but could also mitigate financial damage to the manufacturer. Prior studies in the field of automated defect discovery have found industry-specific techniques appropriate to the automotive, consumer electronics, home appliance, and toy industries, but have not investigated pain relief medicines and medical devices. In this study, we focus specifically on automated discovery of S&E concerns in over-the-counter (OTC) joint and muscle pain relief remedies and devices. We select a dataset of over 32,000 records for three categories of Joint & Muscle Pain Relief treatments from Amazon's online product reviews, and train "smoke word" dictionaries which we use to score holdout reviews, for the presence of safety and efficacy issues. We also score using conventional sentiment analysis techniques. Compared to traditional sentiment analysis techniques, we found that smoke term dictionaries were better suited to detect product concerns from online consumer reviews, and significantly outperformed the sentiment analysis techniques in uncovering both efficacy and safety concerns, across all product subcategories. Our research can be applied to the healthcare and pharmaceutical industry in order to detect safety and efficacy concerns, reducing risks that consumers face using these products. These findings can be highly beneficial to improving quality assurance and management in joint and muscle pain relief. Copyright © 2017 Elsevier B.V. All rights reserved.

Crowdsourcing the creation of image segmentation algorithms for connectomics.

PubMed

Arganda-Carreras, Ignacio; Turaga, Srinivas C; Berger, Daniel R; Cireşan, Dan; Giusti, Alessandro; Gambardella, Luca M; Schmidhuber, Jürgen; Laptev, Dmitry; Dwivedi, Sarvesh; Buhmann, Joachim M; Liu, Ting; Seyedhosseini, Mojtaba; Tasdizen, Tolga; Kamentsky, Lee; Burget, Radim; Uher, Vaclav; Tan, Xiao; Sun, Changming; Pham, Tuan D; Bas, Erhan; Uzunbas, Mustafa G; Cardona, Albert; Schindelin, Johannes; Seung, H Sebastian

2015-01-01

To stimulate progress in automating the reconstruction of neural circuits, we organized the first international challenge on 2D segmentation of electron microscopic (EM) images of the brain. Participants submitted boundary maps predicted for a test set of images, and were scored based on their agreement with a consensus of human expert annotations. The winning team had no prior experience with EM images, and employed a convolutional network. This "deep learning" approach has since become accepted as a standard for segmentation of EM images. The challenge has continued to accept submissions, and the best so far has resulted from cooperation between two teams. The challenge has probably saturated, as algorithms cannot progress beyond limits set by ambiguities inherent in 2D scoring and the size of the test dataset. Retrospective evaluation of the challenge scoring system reveals that it was not sufficiently robust to variations in the widths of neurite borders. We propose a solution to this problem, which should be useful for a future 3D segmentation challenge.

Evaluation of different heating methods for the detection of boar taint by means of the human nose.

PubMed

Bekaert, K M; Aluwé, M; Vanhaecke, L; Heres, L; Duchateau, L; Vandendriessche, F; Tuyttens, F A M

2013-05-01

No automated detection system for boar taint detection is currently available, thus boar taint at the slaughterline can currently only be assessed using the singeing method (olfactory scoring). This study compares several heating methods (microwave, soldering iron and pyropen) and evaluates the effect of habituation, cleaning the soldering iron, singeing the fat twice in the same place, and variations in the technical procedures. All methods seem to be suitable for detecting boar taint but the choice of heating method for sensory scoring of boar taint depends on habituation of the trained assessor and specific conditions applied. The pyropen seems to be most suitable because it does not contact the fat and is easy to handle (wireless). Finally, the intensity score may also be influenced by: contamination from not cleaning the soldering iron, singeing the fat twice in the same place, and the effect of habituation. Copyright © 2013 Elsevier Ltd. All rights reserved.

Instrumentation Automation for Concrete Structures: Report 2, Automation Hardware and Retrofitting Techniques, and Report 3, Available Data Collection and Reduction Software

DTIC Science & Technology

1987-06-01

commercial products. · OP -- Typical cutout at a plumbiinc location where an automated monitoring system has bv :• installed. The sensor used with the...This report provides a description of commercially available sensors , instruments, and ADP equipment that may be selected to fully automate...automated. The automated plumbline monitoring system includes up to twelve sensors , repeaters, a system controller, and a printer. The system may

Flight control system design factors for applying automated testing techniques

NASA Technical Reports Server (NTRS)

Sitz, Joel R.; Vernon, Todd H.

1990-01-01

Automated validation of flight-critical embedded systems is being done at ARC Dryden Flight Research Facility. The automated testing techniques are being used to perform closed-loop validation of man-rated flight control systems. The principal design features and operational experiences of the X-29 forward-swept-wing aircraft and F-18 High Alpha Research Vehicle (HARV) automated test systems are discussed. Operationally applying automated testing techniques has accentuated flight control system features that either help or hinder the application of these techniques. The paper also discusses flight control system features which foster the use of automated testing techniques.

High-fidelity, low-cost, automated method to assess laparoscopic skills objectively.

PubMed

Gray, Richard J; Kahol, Kanav; Islam, Gazi; Smith, Marshall; Chapital, Alyssa; Ferrara, John

2012-01-01

We sought to define the extent to which a motion analysis-based assessment system constructed with simple equipment could measure technical skill objectively and quantitatively. An "off-the-shelf" digital video system was used to capture the hand and instrument movement of surgical trainees (beginner level = PGY-1, intermediate level = PGY-3, and advanced level = PGY-5/fellows) while they performed a peg transfer exercise. The video data were passed through a custom computer vision algorithm that analyzed incoming pixels to measure movement smoothness objectively. The beginner-level group had the poorest performance, whereas those in the advanced group generated the highest scores. Intermediate-level trainees scored significantly (p < 0.04) better than beginner trainees. Advanced-level trainees scored significantly better than intermediate-level trainees and beginner-level trainees (p < 0.04 and p < 0.03, respectively). A computer vision-based analysis of surgical movements provides an objective basis for technical expertise-level analysis with construct validity. The technology to capture the data is simple, low cost, and readily available, and it obviates the need for expert human assessment in this setting. Copyright © 2012 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

How Important Is Content in the Ratings of Essay Assessments?

ERIC Educational Resources Information Center

Shermis, Mark D.; Shneyderman, Aleksandr; Attali, Yigal

2008-01-01

This study was designed to examine the extent to which "content" accounts for variance in scores assigned in automated essay scoring protocols. Specifically it was hypothesised that certain writing genre would emphasise content more than others. Data were drawn from 1668 essays calibrated at two grade levels (6 and 8) using "e-rater[TM]", an…

Improving the driver-automation interaction: an approach using automation uncertainty.

PubMed

Beller, Johannes; Heesen, Matthias; Vollrath, Mark

2013-12-01

The aim of this study was to evaluate whether communicating automation uncertainty improves the driver-automation interaction. A false system understanding of infallibility may provoke automation misuse and can lead to severe consequences in case of automation failure. The presentation of automation uncertainty may prevent this false system understanding and, as was shown by previous studies, may have numerous benefits. Few studies, however, have clearly shown the potential of communicating uncertainty information in driving. The current study fills this gap. We conducted a driving simulator experiment, varying the presented uncertainty information between participants (no uncertainty information vs. uncertainty information) and the automation reliability (high vs.low) within participants. Participants interacted with a highly automated driving system while engaging in secondary tasks and were required to cooperate with the automation to drive safely. Quantile regressions and multilevel modeling showed that the presentation of uncertainty information increases the time to collision in the case of automation failure. Furthermore, the data indicated improved situation awareness and better knowledge of fallibility for the experimental group. Consequently, the automation with the uncertainty symbol received higher trust ratings and increased acceptance. The presentation of automation uncertaintythrough a symbol improves overall driver-automation cooperation. Most automated systems in driving could benefit from displaying reliability information. This display might improve the acceptance of fallible systems and further enhances driver-automation cooperation.

Automated planning of tangential breast intensity-modulated radiotherapy using heuristic optimization.

PubMed

Purdie, Thomas G; Dinniwell, Robert E; Letourneau, Daniel; Hill, Christine; Sharpe, Michael B

2011-10-01

To present an automated technique for two-field tangential breast intensity-modulated radiotherapy (IMRT) treatment planning. A total of 158 planned patients with Stage 0, I, and II breast cancer treated using whole-breast IMRT were retrospectively replanned using automated treatment planning tools. The tools developed are integrated into the existing clinical treatment planning system (Pinnacle(3)) and are designed to perform the manual volume delineation, beam placement, and IMRT treatment planning steps carried out by the treatment planning radiation therapist. The automated algorithm, using only the radio-opaque markers placed at CT simulation as inputs, optimizes the tangential beam parameters to geometrically minimize the amount of lung and heart treated while covering the whole-breast volume. The IMRT parameters are optimized according to the automatically delineated whole-breast volume. The mean time to generate a complete treatment plan was 6 min, 50 s ± 1 min 12 s. For the automated plans, 157 of 158 plans (99%) were deemed clinically acceptable, and 138 of 158 plans (87%) were deemed clinically improved or equal to the corresponding clinical plan when reviewed in a randomized, double-blinded study by one experienced breast radiation oncologist. In addition, overall the automated plans were dosimetrically equivalent to the clinical plans when scored for target coverage and lung and heart doses. We have developed robust and efficient automated tools for fully inversed planned tangential breast IMRT planning that can be readily integrated into clinical practice. The tools produce clinically acceptable plans using only the common anatomic landmarks from the CT simulation process as an input. We anticipate the tools will improve patient access to high-quality IMRT treatment by simplifying the planning process and will reduce the effort and cost of incorporating more advanced planning into clinical practice. Crown Copyright © 2011. Published by Elsevier Inc. All rights reserved.

Pilot study of an automated method to determine Melasma Area and Severity Index.

PubMed

Tay, E Y; Gan, E Y; Tan, V W D; Lin, Z; Liang, Y; Lin, F; Wee, S; Thng, T G

2015-06-01

Objective outcome measures for melasma severity are essential for the evaluation of severity as well as results of treatment. The modified Melasma Area and Severity Index (mMASI) score is a validated tool for assessing melasma severity but is often subject to inter-observer variability. To develop and validate a novel image analysis software designed to automatically calculate the area and degree of hyperpigmentation in melasma from computer image analysis of whole-face digital photographs, thereby deriving an automated mMASI score (aMASI). The algorithm was developed in collaboration between dermatologists and image analysis experts. Firstly, using an adaptive threshold method, the algorithm identifies, segments and calculates the areas involved. It then calculates the darkness. Finally, the derived area and darkness are then used to calculate mMASI. The scores derived from the algorithm are validated prospectively. Twenty-nine patients with melasma using depigmenting agents were recruited for validation. Three dermatologists scored mMASI at baseline and post-treatment using standardized photographs. These scores were compared with aMASI scores derived from computer analysis. aMASI scores correlated well with clinical mMASI pre-treatment (r = 0·735, P < 0·001) and post-treatment (r = 0·608, P < 0·001). aMASI was reliable in detecting changes with treatment. These changes in aMASI scores correlated well with changes in clinician-assessed mMASI (r = 0·622, P < 0·001). This study proposes a novel approach in melasma scoring using digital image analysis. It holds promise as a tool that would enable clinicians worldwide to standardize melasma severity scoring and outcome measures in an easy and reproducible manner, enabling different treatment options to be compared accurately. © 2015 British Association of Dermatologists.

Comparison of CT perfusion summary maps to early diffusion-weighted images in suspected acute middle cerebral artery stroke.

PubMed

Benson, John; Payabvash, Seyedmehdi; Salazar, Pascal; Jagadeesan, Bharathi; Palmer, Christopher S; Truwit, Charles L; McKinney, Alexander M

2015-04-01

To assess the accuracy and reliability of one vendor's (Vital Images, Toshiba Medical, Minnetonka, MN) automated CT perfusion (CTP) summary maps in identification and volume estimation of infarcted tissue in patients with acute middle cerebral artery (MCA) distribution infarcts. From 1085 CTP examinations over 5.5 years, 43 diffusion-weighted imaging (DWI)-positive patients were included who underwent both CTP and DWI <12 h after symptom onset, with another 43 age-matched patients as controls (DWI-negative). Automated delay-corrected postprocessing software (DC-SVD) generated both infarct "core only" and "core+penumbra" CTP summary maps. Three reviewers independently tabulated Alberta Stroke Program Early CT scores (ASPECTS) of both CTP summary maps and coregistered DWI. Of 86 included patients, 36 had DWI infarct volumes ≤70 ml, 7 had volumes >70 ml, and 43 were negative; the automated CTP "core only" map correctly classified each as >70 ml or ≤70 ml, while the "core+penumbra" map misclassified 4 as >70 ml. There were strong correlations between DWI volume with both summary map-based volumes: "core only" (r=0.93), and "core+penumbra" (r=0.77) (both p<0.0001). Agreement between ASPECTS scores of infarct core on DWI with summary maps was 0.65-0.74 for "core only" map, and 0.61-0.65 for "core+penumbra" (both p<0.0001). Using DWI-based ASPECTS scores as the standard, the accuracy of the CTP-based maps were 79.1-86.0% for the "core only" map, and 83.7-88.4% for "core+penumbra." Automated CTP summary maps appear to be relatively accurate in both the detection of acute MCA distribution infarcts, and the discrimination of volumes using a 70 ml threshold. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Using the Language Environment Analysis (LENA) system in preschool classrooms with children with autism spectrum disorders.

PubMed

Dykstra, Jessica R; Sabatos-Devito, Maura G; Irvin, Dwight W; Boyd, Brian A; Hume, Kara A; Odom, Sam L

2013-09-01

This study describes the language environment of preschool programs serving children with autism spectrum disorders (ASDs) and examines relationships between child characteristics and an automated measure of adult and child language in the classroom. The Language Environment Analysis (LENA) system was used with 40 children with ASD to collect data on adult and child language. Standardized assessments were administered to obtain language, cognitive, and autism severity scores for participants. With a mean of over 5 hours of recording across two days several months apart, there was a mean of 3.6 child vocalizations per minute, 1.0 conversational turns (in which either the adult or child respond to the other within 5 seconds) per minute, and 29.2 adult words per minute. Two of the three LENA variables were significantly correlated with language age-equivalents. Cognitive age-equivalents were also significantly correlated with two LENA variables. Autism Diagnostic Observation Schedule severity scores and LENA variables were not significantly correlated. Implications for using the LENA system with children with ASD in the school environment are discussed.

Daily mood ratings via text message as a proxy for clinic based depression assessment.

PubMed

Aguilera, Adrian; Schueller, Stephen M; Leykin, Yan

2015-04-01

Mobile and automated technologies are increasingly becoming integrated into mental health care and assessment. The purpose of this study was to determine how automated daily mood ratings are related to the Patient Health Questionnaire-9 (PHQ-9), a standard measure in the screening and tracking of depressive symptoms. There was a significant relationship between daily mood scores and PHQ-9 scores, and between one-week average mood scores and PHQ-9 scores, controlling for linear change in depression scores. PHQ-9 scores were not related to the average of two week mood ratings. This study also constructed models using variance, maximum, and minimum values of mood ratings in the preceding week and two-week periods as predictors of PHQ-9. None of these variables significantly predicted PHQ-9 scores when controlling for daily mood ratings and the corresponding averages for each period. This study only assessed patients who were in treatment for depression, therefore findings might not generalize to the relationship between text message mood ratings for those who are not depressed. The sample was also predominantly Spanish speaking and low-income making generalizability to other populations uncertain. Our results show that automatic text message based mood ratings can be a clinically useful proxy for the PHQ-9. Importantly, this approach avoids the limitations of the PHQ-9 administration, which include length and a higher requirement for literacy. Copyright © 2015 Elsevier B.V. All rights reserved.

The Harvard Automated Phone Task: new performance-based activities of daily living tests for early Alzheimer’s disease

PubMed Central

Marshall, Gad A.; Dekhtyar, Maria; Bruno, Jonathan M.; Jethwani, Kamal; Amariglio, Rebecca E.; Johnson, Keith A.; Sperling, Reisa A.; Rentz, Dorene M.

2015-01-01

Background Impairment in activities of daily living is a major burden for Alzheimer’s disease dementia patients and caregivers. Multiple subjective scales and a few performance-based instruments have been validated and proven to be reliable in measuring instrumental activities of daily living in Alzheimer’s disease dementia but less so in amnestic mild cognitive impairment and preclinical Alzheimer’s disease. Objective To validate the Harvard Automated Phone Task, a new performance-based activities of daily living test for early Alzheimer’s disease, which assesses high level tasks that challenge seniors in daily life. Design In a cross-sectional study, the Harvard Automated Phone Task was associated with demographics and cognitive measures through univariate and multivariate analyses; ability to discriminate across diagnostic groups was assessed; test-retest reliability with the same and alternate versions was assessed in a subset of participants; and the relationship with regional cortical thickness was assessed in a subset of participants. Setting Academic clinical research center. Participants One hundred and eighty two participants were recruited from the community (127 clinically normal elderly and 45 young normal participants) and memory disorders clinics at Brigham and Women’s Hospital and Massachusetts General Hospital (10 participants with mild cognitive impairment). Measurements As part of the Harvard Automated Phone Task, participants navigated an interactive voice response system to refill a prescription (APT-Script), select a new primary care physician (APT-PCP), and make a bank account transfer and payment (APT-Bank). The 3 tasks were scored based on time, errors, and repetitions from which composite z-scores were derived, as well as a separate report of correct completion of the task. Results We found that the Harvard Automated Phone Task discriminated well between diagnostic groups (APT-Script: p=0.002; APT-PCP: p<0.001; APT-Bank: p=0.02), had an incremental level of difficulty, and had excellent test-retest reliability (Cronbach’s α values of 0.81 to 0.87). Within the clinically normal elderly, there were significant associations in multivariate models between performance on the Harvard Automated Phone Task and executive function (APT-PCP: p<0.001), processing speed (APT-Script: p=0.005), and regional cortical atrophy (APT-PCP: p=0.001; no significant association with APT-Script) independent of hearing acuity, motor speed, age, race, education, and premorbid intelligence. Conclusions Our initial experience with the Harvard Automated Phone Task, which consists of ecologically valid, easily-administered measures of daily activities, suggests that these tasks could be useful for screening and tracking the earliest functional alterations in preclinical and early prodromal AD. PMID:26665121

Lameness detection challenges in automated milking systems addressed with partial least squares discriminant analysis.

PubMed

Garcia, E; Klaas, I; Amigo, J M; Bro, R; Enevoldsen, C

2014-12-01

Lameness causes decreased animal welfare and leads to higher production costs. This study explored data from an automatic milking system (AMS) to model on-farm gait scoring from a commercial farm. A total of 88 cows were gait scored once per week, for 2 5-wk periods. Eighty variables retrieved from AMS were summarized week-wise and used to predict 2 defined classes: nonlame and clinically lame cows. Variables were represented with 2 transformations of the week summarized variables, using 2-wk data blocks before gait scoring, totaling 320 variables (2 × 2 × 80). The reference gait scoring error was estimated in the first week of the study and was, on average, 15%. Two partial least squares discriminant analysis models were fitted to parity 1 and parity 2 groups, respectively, to assign the lameness class according to the predicted probability of being lame (score 3 or 4/4) or not lame (score 1/4). Both models achieved sensitivity and specificity values around 80%, both in calibration and cross-validation. At the optimum values in the receiver operating characteristic curve, the false-positive rate was 28% in the parity 1 model, whereas in the parity 2 model it was about half (16%), which makes it more suitable for practical application; the model error rates were, 23 and 19%, respectively. Based on data registered automatically from one AMS farm, we were able to discriminate nonlame and lame cows, where partial least squares discriminant analysis achieved similar performance to the reference method. Copyright © 2014 American Dairy Science Association. Published by Elsevier Inc. All rights reserved.

Effect of Automated Online Counseling on Clinical Outcomes and Quality of Life Among Adolescents With Acne Vulgaris

PubMed Central

Tuong, William; Wang, Audrey S.; Armstrong, April W.

2016-01-01

IMPORTANCE Effective patient education is necessary for treating patients with acne vulgaris. Automated online counseling simulates face-to-face encounters and may be a useful tool to deliver education. OBJECTIVE To compare the effectiveness of a standard educational website with that of an automated-counseling website in improving clinical outcomes and quality of life among adolescents with acne. DESIGN, SETTING, AND PARTICIPANTS Randomized clinical trial conducted between March 27, 2014, and June 27, 2014, including a 12-week follow-up in a local inner-city high school. Ninety-eight students aged at least 13 years with mild to moderate acne were eligible for participation. A per-protocol analysis of the evaluable population was conducted on clinical outcome data. INTERVENTIONS Participants viewed either a standard educational website or an automated-counseling website. MAIN OUTCOMES AND MEASURES The primary outcome was the total acne lesion count. Secondary measures included the Children’s Dermatology Life Quality Index (CDLQI) scores and general skin care behavior. RESULTS Forty-nine participants were randomized to each group. At baseline, the mean (SD) total acne lesion count was not significantly different between the standard-website group and the automated-counseling–website group (21.33 [10.81] vs 25.33 [12.45]; P = .10). Improvement in the mean (SD) acne lesion count was not significantly different between the standard-website group and the automated-counseling–website group (0.20 [9.26] vs 3.90 [12.19]; P = .10). The mean (SD) improvement in CDLQI score for the standard-website group was not significantly different from that of the automated-counseling–website group (0.17 [2.64] vs 0.39 [2.94]; P = .71). After 12 weeks, a greater proportion of participants in the automated-counseling–website group maintained or adopted a recommended anti-acne skin care routine compared with the standard-website group (43% vs 22%; P = .03). CONCLUSIONS AND RELEVANCE Internet-based acne education using automated counseling was not superior to standard-website education in improving acne severity and quality of life. However, a greater proportion of participants who viewed the automated-counseling website reported having maintained or adopted a recommended anti-acne skin care regimen. TRIAL REGISTRATION clinicaltrials.gov Identifier: NCT02031718 PMID:26017816

Automated biphasic morphological assessment of hepatitis B-related liver fibrosis using second harmonic generation microscopy

PubMed Central

Wang, Tong-Hong; Chen, Tse-Ching; Teng, Xiao; Liang, Kung-Hao; Yeh, Chau-Ting

2015-01-01

Liver fibrosis assessment by biopsy and conventional staining scores is based on histopathological criteria. Variations in sample preparation and the use of semi-quantitative histopathological methods commonly result in discrepancies between medical centers. Thus, minor changes in liver fibrosis might be overlooked in multi-center clinical trials, leading to statistically non-significant data. Here, we developed a computer-assisted, fully automated, staining-free method for hepatitis B-related liver fibrosis assessment. In total, 175 liver biopsies were divided into training (n = 105) and verification (n = 70) cohorts. Collagen was observed using second harmonic generation (SHG) microscopy without prior staining, and hepatocyte morphology was recorded using two-photon excitation fluorescence (TPEF) microscopy. The training cohort was utilized to establish a quantification algorithm. Eleven of 19 computer-recognizable SHG/TPEF microscopic morphological features were significantly correlated with the ISHAK fibrosis stages (P < 0.001). A biphasic scoring method was applied, combining support vector machine and multivariate generalized linear models to assess the early and late stages of fibrosis, respectively, based on these parameters. The verification cohort was used to verify the scoring method, and the area under the receiver operating characteristic curve was >0.82 for liver cirrhosis detection. Since no subjective gradings are needed, interobserver discrepancies could be avoided using this fully automated method. PMID:26260921

Proteomics Quality Control: Quality Control Software for MaxQuant Results.

PubMed

Bielow, Chris; Mastrobuoni, Guido; Kempa, Stefan

2016-03-04

Mass spectrometry-based proteomics coupled to liquid chromatography has matured into an automatized, high-throughput technology, producing data on the scale of multiple gigabytes per instrument per day. Consequently, an automated quality control (QC) and quality analysis (QA) capable of detecting measurement bias, verifying consistency, and avoiding propagation of error is paramount for instrument operators and scientists in charge of downstream analysis. We have developed an R-based QC pipeline called Proteomics Quality Control (PTXQC) for bottom-up LC-MS data generated by the MaxQuant software pipeline. PTXQC creates a QC report containing a comprehensive and powerful set of QC metrics, augmented with automated scoring functions. The automated scores are collated to create an overview heatmap at the beginning of the report, giving valuable guidance also to nonspecialists. Our software supports a wide range of experimental designs, including stable isotope labeling by amino acids in cell culture (SILAC), tandem mass tags (TMT), and label-free data. Furthermore, we introduce new metrics to score MaxQuant's Match-between-runs (MBR) functionality by which peptide identifications can be transferred across Raw files based on accurate retention time and m/z. Last but not least, PTXQC is easy to install and use and represents the first QC software capable of processing MaxQuant result tables. PTXQC is freely available at https://github.com/cbielow/PTXQC .

Single pellet grasping following cervical spinal cord injury in adult rat using an automated full-time training robot

PubMed Central

Fenrich, Keith K.; May, Zacincte; Torres-Espín, Abel; Forero, Juan; Bennett, David J.; Fouad, Karim

2016-01-01

Task specific motor training is a common form of rehabilitation therapy in individuals with spinal cord injury (SCI). The single pellet grasping (SPG) task is a skilled forelimb motor task used to evaluate recovery of forelimb function in rodent models of SCI. The task requires animals to obtain food pellets located on a shelf beyond a slit at the front of an enclosure. Manually training and testing rats in the SPG task requires extensive time and often yields results with high outcome variability and small therapeutic windows (i.e., the difference between pre- and post-SCI success rates). Recent advances in automated SPG training using automated pellet presentation (APP) systems allow rats to train ad libitum 24 h a day, 7 days a week. APP trained rats have improved success rates, require less researcher time, and have lower outcome variability compared to manually trained rats. However, it is unclear whether APP trained rats can perform the SPG task using the APP system after SCI. Here we show that rats with cervical SCI can successfully perform the SPG task using the APP system. We found that SCI rats with APP training performed significantly more attempts, had slightly lower and less variable final score success rates, and larger therapeutic windows than SCI rats with manual training. These results demonstrate that APP training has clear advantages over manual training for evaluating reaching performance of SCI rats and represents a new tool for investigating rehabilitative motor training following CNS injury. PMID:26611563

Single pellet grasping following cervical spinal cord injury in adult rat using an automated full-time training robot.

PubMed

Fenrich, Keith K; May, Zacincte; Torres-Espín, Abel; Forero, Juan; Bennett, David J; Fouad, Karim

2016-02-15

Task specific motor training is a common form of rehabilitation therapy in individuals with spinal cord injury (SCI). The single pellet grasping (SPG) task is a skilled forelimb motor task used to evaluate recovery of forelimb function in rodent models of SCI. The task requires animals to obtain food pellets located on a shelf beyond a slit at the front of an enclosure. Manually training and testing rats in the SPG task requires extensive time and often yields results with high outcome variability and small therapeutic windows (i.e., the difference between pre- and post-SCI success rates). Recent advances in automated SPG training using automated pellet presentation (APP) systems allow rats to train ad libitum 24h a day, 7 days a week. APP trained rats have improved success rates, require less researcher time, and have lower outcome variability compared to manually trained rats. However, it is unclear whether APP trained rats can perform the SPG task using the APP system after SCI. Here we show that rats with cervical SCI can successfully perform the SPG task using the APP system. We found that SCI rats with APP training performed significantly more attempts, had slightly lower and less variable final score success rates, and larger therapeutic windows than SCI rats with manual training. These results demonstrate that APP training has clear advantages over manual training for evaluating reaching performance of SCI rats and represents a new tool for investigating rehabilitative motor training following CNS injury. Copyright © 2015 Elsevier B.V. All rights reserved.

Development Status: Automation Advanced Development Space Station Freedom Electric Power System

NASA Technical Reports Server (NTRS)

Dolce, James L.; Kish, James A.; Mellor, Pamela A.

1990-01-01

Electric power system automation for Space Station Freedom is intended to operate in a loop. Data from the power system is used for diagnosis and security analysis to generate Operations Management System (OMS) requests, which are sent to an arbiter, which sends a plan to a commander generator connected to the electric power system. This viewgraph presentation profiles automation software for diagnosis, scheduling, and constraint interfaces, and simulation to support automation development. The automation development process is diagrammed, and the process of creating Ada and ART versions of the automation software is described.

21 CFR 864.5620 - Automated hemoglobin system.

Code of Federal Regulations, 2010 CFR

2010-04-01

... 21 Food and Drugs 8 2010-04-01 2010-04-01 false Automated hemoglobin system. 864.5620 Section 864....5620 Automated hemoglobin system. (a) Identification. An automated hemoglobin system is a fully... hemoglobin content of human blood. (b) Classification. Class II (performance standards). [45 FR 60601, Sept...

21 CFR 864.5620 - Automated hemoglobin system.

Code of Federal Regulations, 2011 CFR

2011-04-01

... 21 Food and Drugs 8 2011-04-01 2011-04-01 false Automated hemoglobin system. 864.5620 Section 864....5620 Automated hemoglobin system. (a) Identification. An automated hemoglobin system is a fully... hemoglobin content of human blood. (b) Classification. Class II (performance standards). [45 FR 60601, Sept...

49 CFR 38.173 - Automated guideway transit vehicles and systems.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 49 Transportation 1 2010-10-01 2010-10-01 false Automated guideway transit vehicles and systems... DISABILITIES ACT (ADA) ACCESSIBILITY SPECIFICATIONS FOR TRANSPORTATION VEHICLES Other Vehicles and Systems § 38.173 Automated guideway transit vehicles and systems. (a) Automated Guideway Transit (AGT) vehicles and...

49 CFR 38.173 - Automated guideway transit vehicles and systems.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 49 Transportation 1 2012-10-01 2012-10-01 false Automated guideway transit vehicles and systems... DISABILITIES ACT (ADA) ACCESSIBILITY SPECIFICATIONS FOR TRANSPORTATION VEHICLES Other Vehicles and Systems § 38.173 Automated guideway transit vehicles and systems. (a) Automated Guideway Transit (AGT) vehicles and...

49 CFR 38.173 - Automated guideway transit vehicles and systems.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 49 Transportation 1 2013-10-01 2013-10-01 false Automated guideway transit vehicles and systems... DISABILITIES ACT (ADA) ACCESSIBILITY SPECIFICATIONS FOR TRANSPORTATION VEHICLES Other Vehicles and Systems § 38.173 Automated guideway transit vehicles and systems. (a) Automated Guideway Transit (AGT) vehicles and...

49 CFR 38.173 - Automated guideway transit vehicles and systems.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 49 Transportation 1 2014-10-01 2014-10-01 false Automated guideway transit vehicles and systems... DISABILITIES ACT (ADA) ACCESSIBILITY SPECIFICATIONS FOR TRANSPORTATION VEHICLES Other Vehicles and Systems § 38.173 Automated guideway transit vehicles and systems. (a) Automated Guideway Transit (AGT) vehicles and...

49 CFR 38.173 - Automated guideway transit vehicles and systems.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 49 Transportation 1 2011-10-01 2011-10-01 false Automated guideway transit vehicles and systems... DISABILITIES ACT (ADA) ACCESSIBILITY SPECIFICATIONS FOR TRANSPORTATION VEHICLES Other Vehicles and Systems § 38.173 Automated guideway transit vehicles and systems. (a) Automated Guideway Transit (AGT) vehicles and...

Application of Novel Software Algorithms to Spectral-Domain Optical Coherence Tomography for Automated Detection of Diabetic Retinopathy.

PubMed

Adhi, Mehreen; Semy, Salim K; Stein, David W; Potter, Daniel M; Kuklinski, Walter S; Sleeper, Harry A; Duker, Jay S; Waheed, Nadia K

2016-05-01

To present novel software algorithms applied to spectral-domain optical coherence tomography (SD-OCT) for automated detection of diabetic retinopathy (DR). Thirty-one diabetic patients (44 eyes) and 18 healthy, nondiabetic controls (20 eyes) who underwent volumetric SD-OCT imaging and fundus photography were retrospectively identified. A retina specialist independently graded DR stage. Trained automated software generated a retinal thickness score signifying macular edema and a cluster score signifying microaneurysms and/or hard exudates for each volumetric SD-OCT. Of 44 diabetic eyes, 38 had DR and six eyes did not have DR. Leave-one-out cross-validation using a linear discriminant at missed detection/false alarm ratio of 3.00 computed software sensitivity and specificity of 92% and 69%, respectively, for DR detection when compared to clinical assessment. Novel software algorithms applied to commercially available SD-OCT can successfully detect DR and may have potential as a viable screening tool for DR in future. [Ophthalmic Surg Lasers Imaging Retina. 2016;47:410-417.]. Copyright 2016, SLACK Incorporated.

Evaluation of a pictograph enhancement system for patient instruction: a recall study

PubMed Central

Zeng-Treitler, Qing; Perri, Seneca; Nakamura, Carlos; Kuang, Jinqiu; Hill, Brent; Bui, Duy Duc An; Stoddard, Gregory J; Bray, Bruce E

2014-01-01

Objective We developed a novel computer application called Glyph that automatically converts text to sets of illustrations using natural language processing and computer graphics techniques to provide high quality pictographs for health communication. In this study, we evaluated the ability of the Glyph system to illustrate a set of actual patient instructions, and tested patient recall of the original and Glyph illustrated instructions. Methods We used Glyph to illustrate 49 patient instructions representing 10 different discharge templates from the University of Utah Cardiology Service. 84 participants were recruited through convenience sampling. To test the recall of illustrated versus non-illustrated instructions, participants were asked to review and then recall a set questionnaires that contained five pictograph-enhanced and five non-pictograph-enhanced items. Results The mean score without pictographs was 0.47 (SD 0.23), or 47% recall. With pictographs, this mean score increased to 0.52 (SD 0.22), or 52% recall. In a multivariable mixed effects linear regression model, this 0.05 mean increase was statistically significant (95% CI 0.03 to 0.06, p<0.001). Discussion In our study, the presence of Glyph pictographs improved discharge instruction recall (p<0.001). Education, age, and English as first language were associated with better instruction recall and transcription. Conclusions Automated illustration is a novel approach to improve the comprehension and recall of discharge instructions. Our results showed a statistically significant in recall with automated illustrations. Subjects with no-colleague education and younger subjects appeared to benefit more from the illustrations than others. PMID:25301809

Space station automation of common module power management and distribution

NASA Technical Reports Server (NTRS)

Miller, W.; Jones, E.; Ashworth, B.; Riedesel, J.; Myers, C.; Freeman, K.; Steele, D.; Palmer, R.; Walsh, R.; Gohring, J.

1989-01-01

The purpose is to automate a breadboard level Power Management and Distribution (PMAD) system which possesses many functional characteristics of a specified Space Station power system. The automation system was built upon 20 kHz ac source with redundancy of the power buses. There are two power distribution control units which furnish power to six load centers which in turn enable load circuits based upon a system generated schedule. The progress in building this specified autonomous system is described. Automation of Space Station Module PMAD was accomplished by segmenting the complete task in the following four independent tasks: (1) develop a detailed approach for PMAD automation; (2) define the software and hardware elements of automation; (3) develop the automation system for the PMAD breadboard; and (4) select an appropriate host processing environment.

Development and Testing of an Automated 4-Day Text Messaging Guidance as an Aid for Improving Colonoscopy Preparation.

PubMed

Walter, Benjamin Michael; Klare, Peter; Neu, Bruno; Schmid, Roland M; von Delius, Stefan

2016-06-21

In gastroenterology a sufficient colon cleansing improves adenoma detection rate and prevents the need for preterm repeat colonoscopies due to invalid preparation. It has been shown that patient education is of major importance for improvement of colon cleansing. Objective of this study was to assess the function of an automated text messaging (short message service, SMS)-supported colonoscopy preparation starting 4 days before colonoscopy appointment. After preevaluation to assess mobile phone usage in the patient population for relevance of this approach, a Web-based, automated SMS text messaging system was developed, following which a single-center feasibility study at a tertiary care center was performed. Patients scheduled for outpatient colonoscopy were invited to participate. Patients enrolled in the study group received automated information about dietary recommendations and bowel cleansing during colonoscopy preparation. Data of outpatient colonoscopies with regular preparation procedure were used for pair matching and served as control. Primary end point was feasibility of SMS text messaging support in colonoscopy preparation assessed as stable and satisfactory function of the system. Secondary end points were quality of bowel preparation according to the Boston Bowel Preparation Scale (BBPS) and patient satisfaction with SMS text messaging-provided information assessed by a questionnaire. Web-based SMS text messaging-supported colonoscopy preparation was successful and feasible in 19 of 20 patients. Mean (standard error of the mean, SEM) total BBPS score was slightly higher in the SMS group than in the control group (7.3, SEM 0.3 vs 6.4, SEM 0.2) and for each colonic region (left, transverse, and right colon). Patient satisfaction regarding SMS text messaging-based information was high. Using SMS for colonoscopy preparation with 4 days' guidance including dietary recommendation is a new approach to improve colonoscopy preparation. Quality of colonoscopy preparation was sufficient and patients were highly satisfied with the system during colonoscopy preparation.

Development and Testing of an Automated 4-Day Text Messaging Guidance as an Aid for Improving Colonoscopy Preparation

PubMed Central

Klare, Peter; Neu, Bruno; Schmid, Roland M; von Delius, Stefan

2016-01-01

Background In gastroenterology a sufficient colon cleansing improves adenoma detection rate and prevents the need for preterm repeat colonoscopies due to invalid preparation. It has been shown that patient education is of major importance for improvement of colon cleansing. Objective Objective of this study was to assess the function of an automated text messaging (short message service, SMS)–supported colonoscopy preparation starting 4 days before colonoscopy appointment. Methods After preevaluation to assess mobile phone usage in the patient population for relevance of this approach, a Web-based, automated SMS text messaging system was developed, following which a single-center feasibility study at a tertiary care center was performed. Patients scheduled for outpatient colonoscopy were invited to participate. Patients enrolled in the study group received automated information about dietary recommendations and bowel cleansing during colonoscopy preparation. Data of outpatient colonoscopies with regular preparation procedure were used for pair matching and served as control. Primary end point was feasibility of SMS text messaging support in colonoscopy preparation assessed as stable and satisfactory function of the system. Secondary end points were quality of bowel preparation according to the Boston Bowel Preparation Scale (BBPS) and patient satisfaction with SMS text messaging–provided information assessed by a questionnaire. Results Web-based SMS text messaging–supported colonoscopy preparation was successful and feasible in 19 of 20 patients. Mean (standard error of the mean, SEM) total BBPS score was slightly higher in the SMS group than in the control group (7.3, SEM 0.3 vs 6.4, SEM 0.2) and for each colonic region (left, transverse, and right colon). Patient satisfaction regarding SMS text messaging–based information was high. Conclusions Using SMS for colonoscopy preparation with 4 days’ guidance including dietary recommendation is a new approach to improve colonoscopy preparation. Quality of colonoscopy preparation was sufficient and patients were highly satisfied with the system during colonoscopy preparation. PMID:27329204

Closed-loop double-vasopressor automated system vs manual bolus vasopressor to treat hypotension during spinal anaesthesia for caesarean section: a randomised controlled trial.

PubMed

Sng, B L; Tan, H S; Sia, A T H

2014-01-01

Hypotension necessitating vasopressor administration occurs commonly during caesarean section under spinal anaesthesia. We developed a novel vasopressor delivery system that automatically administers phenylephrine or ephedrine based on continuous non-invasive arterial pressure monitoring. A phenylephrine bolus of 50 μg was given at 30-s intervals when systolic blood pressure fell < 90% of baseline; an ephedrine bolus of 4 mg was given instead if systolic pressure fell < 90% of baseline together with a heart rate < 60 beats.min(-1). The control group used manual boluses of either phenylephrine 100 μg or ephedrine 8 mg, administered at 1-min intervals based on the same thresholds for systolic pressure and heart rate. This randomised, controlled, double-blinded trial involved 213 healthy women who underwent elective caesarean delivery under spinal anaesthesia using 11 mg hyperbaric bupivacaine with 15 μg fentanyl and 100 μg morphine. The automated vasopressor group had better systolic pressure control, with 37/106 (34.9%) having any beat-to-beat systolic pressure reading < 80% of baseline compared with 63/107 (58.9%) in the control group (p < 0.001). There was no difference in the incidence of reactive hypertension, defined as systolic pressure > 120% of baseline, with 8/106 (7.5%) in the automated vasopressor group vs 14/107 (13.1%) in the control group, or total dose of vasopressors. The automated vasopressor group had lower median absolute performance error of 8.5% vs control of 9.8% (p = 0.013), and reduced incidence of nausea (1/106 (0.9%) vs 11/107 (10.3%), p = 0.005). Neonatal umbilical cord pH, umbilical lactate and Apgar scores were similar. Hence, our system afforded better control of maternal blood pressure and reduced nausea with no increase in reactive hypertension when compared with manual boluses. © 2013 The Association of Anaesthetists of Great Britain and Ireland.

47 CFR 80.475 - Scope of service of the Automated Maritime Telecommunications System (AMTS).

Code of Federal Regulations, 2010 CFR

2010-10-01

... 47 Telecommunication 5 2010-10-01 2010-10-01 false Scope of service of the Automated Maritime Telecommunications System (AMTS). 80.475 Section 80.475 Telecommunication FEDERAL COMMUNICATIONS COMMISSION... Automated Systems § 80.475 Scope of service of the Automated Maritime Telecommunications System (AMTS). (a...

47 CFR 80.475 - Scope of service of the Automated Maritime Telecommunications System (AMTS).

Code of Federal Regulations, 2011 CFR

2011-10-01

... 47 Telecommunication 5 2011-10-01 2011-10-01 false Scope of service of the Automated Maritime Telecommunications System (AMTS). 80.475 Section 80.475 Telecommunication FEDERAL COMMUNICATIONS COMMISSION... Automated Systems § 80.475 Scope of service of the Automated Maritime Telecommunications System (AMTS). (a...

47 CFR 80.475 - Scope of service of the Automated Maritime Telecommunications System (AMTS).

Code of Federal Regulations, 2012 CFR

2012-10-01

... 47 Telecommunication 5 2012-10-01 2012-10-01 false Scope of service of the Automated Maritime Telecommunications System (AMTS). 80.475 Section 80.475 Telecommunication FEDERAL COMMUNICATIONS COMMISSION... Automated Systems § 80.475 Scope of service of the Automated Maritime Telecommunications System (AMTS). (a...

47 CFR 80.475 - Scope of service of the Automated Maritime Telecommunications System (AMTS).

Code of Federal Regulations, 2014 CFR

2014-10-01

... 47 Telecommunication 5 2014-10-01 2014-10-01 false Scope of service of the Automated Maritime Telecommunications System (AMTS). 80.475 Section 80.475 Telecommunication FEDERAL COMMUNICATIONS COMMISSION... Automated Systems § 80.475 Scope of service of the Automated Maritime Telecommunications System (AMTS). (a...

47 CFR 80.475 - Scope of service of the Automated Maritime Telecommunications System (AMTS).

Code of Federal Regulations, 2013 CFR

2013-10-01

... 47 Telecommunication 5 2013-10-01 2013-10-01 false Scope of service of the Automated Maritime Telecommunications System (AMTS). 80.475 Section 80.475 Telecommunication FEDERAL COMMUNICATIONS COMMISSION... Automated Systems § 80.475 Scope of service of the Automated Maritime Telecommunications System (AMTS). (a...

36 CFR 1192.173 - Automated guideway transit vehicles and systems.

Code of Federal Regulations, 2010 CFR

2010-07-01

... TRANSPORTATION VEHICLES Other Vehicles and Systems § 1192.173 Automated guideway transit vehicles and systems. (a) Automated Guideway Transit (AGT) vehicles and systems, sometimes called “people movers”, operated in... 36 Parks, Forests, and Public Property 3 2010-07-01 2010-07-01 false Automated guideway transit...

36 CFR 1192.173 - Automated guideway transit vehicles and systems.

Code of Federal Regulations, 2012 CFR

2012-07-01

... TRANSPORTATION VEHICLES Other Vehicles and Systems § 1192.173 Automated guideway transit vehicles and systems. (a) Automated Guideway Transit (AGT) vehicles and systems, sometimes called “people movers”, operated in... 36 Parks, Forests, and Public Property 3 2012-07-01 2012-07-01 false Automated guideway transit...

36 CFR § 1192.173 - Automated guideway transit vehicles and systems.

Code of Federal Regulations, 2013 CFR

2013-07-01

... TRANSPORTATION VEHICLES Other Vehicles and Systems § 1192.173 Automated guideway transit vehicles and systems. (a) Automated Guideway Transit (AGT) vehicles and systems, sometimes called “people movers”, operated in... 36 Parks, Forests, and Public Property 3 2013-07-01 2012-07-01 true Automated guideway transit...

36 CFR 1192.173 - Automated guideway transit vehicles and systems.

Code of Federal Regulations, 2011 CFR

2011-07-01

... TRANSPORTATION VEHICLES Other Vehicles and Systems § 1192.173 Automated guideway transit vehicles and systems. (a) Automated Guideway Transit (AGT) vehicles and systems, sometimes called “people movers”, operated in... 36 Parks, Forests, and Public Property 3 2011-07-01 2011-07-01 false Automated guideway transit...

36 CFR 1192.173 - Automated guideway transit vehicles and systems.

Code of Federal Regulations, 2014 CFR

2014-07-01

... TRANSPORTATION VEHICLES Other Vehicles and Systems § 1192.173 Automated guideway transit vehicles and systems. (a) Automated Guideway Transit (AGT) vehicles and systems, sometimes called “people movers”, operated in... 36 Parks, Forests, and Public Property 3 2014-07-01 2014-07-01 false Automated guideway transit...

Flight-deck automation - Promises and problems

NASA Technical Reports Server (NTRS)

Wiener, E. L.; Curry, R. E.

1980-01-01

The paper analyzes the role of human factors in flight-deck automation, identifies problem areas, and suggests design guidelines. Flight-deck automation using microprocessor technology and display systems improves performance and safety while leading to a decrease in size, cost, and power consumption. On the other hand negative factors such as failure of automatic equipment, automation-induced error compounded by crew error, crew error in equipment set-up, failure to heed automatic alarms, and loss of proficiency must also be taken into account. Among the problem areas discussed are automation of control tasks, monitoring of complex systems, psychosocial aspects of automation, and alerting and warning systems. Guidelines are suggested for designing, utilising, and improving control and monitoring systems. Investigation into flight-deck automation systems is important as the knowledge gained can be applied to other systems such as air traffic control and nuclear power generation, but the many problems encountered with automated systems need to be analyzed and overcome in future research.

Automation Applications in an Advanced Air Traffic Management System : Volume 4A. Automation Requirements.

DOT National Transportation Integrated Search

1974-08-01

Volume 4 describes the automation requirements. A presentation of automation requirements is made for an advanced air traffic management system in terms of controller work force, computer resources, controller productivity, system manning, failure ef...

Development and Evaluation of an Automated Machine Learning Algorithm for In-Hospital Mortality Risk Adjustment Among Critical Care Patients.

PubMed

Delahanty, Ryan J; Kaufman, David; Jones, Spencer S

2018-06-01

Risk adjustment algorithms for ICU mortality are necessary for measuring and improving ICU performance. Existing risk adjustment algorithms are not widely adopted. Key barriers to adoption include licensing and implementation costs as well as labor costs associated with human-intensive data collection. Widespread adoption of electronic health records makes automated risk adjustment feasible. Using modern machine learning methods and open source tools, we developed and evaluated a retrospective risk adjustment algorithm for in-hospital mortality among ICU patients. The Risk of Inpatient Death score can be fully automated and is reliant upon data elements that are generated in the course of usual hospital processes. One hundred thirty-one ICUs in 53 hospitals operated by Tenet Healthcare. A cohort of 237,173 ICU patients discharged between January 2014 and December 2016. The data were randomly split into training (36 hospitals), and validation (17 hospitals) data sets. Feature selection and model training were carried out using the training set while the discrimination, calibration, and accuracy of the model were assessed in the validation data set. Model discrimination was evaluated based on the area under receiver operating characteristic curve; accuracy and calibration were assessed via adjusted Brier scores and visual analysis of calibration curves. Seventeen features, including a mix of clinical and administrative data elements, were retained in the final model. The Risk of Inpatient Death score demonstrated excellent discrimination (area under receiver operating characteristic curve = 0.94) and calibration (adjusted Brier score = 52.8%) in the validation dataset; these results compare favorably to the published performance statistics for the most commonly used mortality risk adjustment algorithms. Low adoption of ICU mortality risk adjustment algorithms impedes progress toward increasing the value of the healthcare delivered in ICUs. The Risk of Inpatient Death score has many attractive attributes that address the key barriers to adoption of ICU risk adjustment algorithms and performs comparably to existing human-intensive algorithms. Automated risk adjustment algorithms have the potential to obviate known barriers to adoption such as cost-prohibitive licensing fees and significant direct labor costs. Further evaluation is needed to ensure that the level of performance observed in this study could be achieved at independent sites.

AutoIHC-scoring: a machine learning framework for automated Allred scoring of molecular expression in ER- and PR-stained breast cancer tissue.

PubMed

Tewary, S; Arun, I; Ahmed, R; Chatterjee, S; Chakraborty, C

2017-11-01

In prognostic evaluation of breast cancer Immunohistochemical (IHC) markers namely, oestrogen receptor (ER) and progesterone receptor (PR) are widely used. The expert pathologist investigates qualitatively the stained tissue slide under microscope to provide the Allred score; which is clinically used for therapeutic decision making. Such qualitative judgment is time-consuming, tedious and more often suffers from interobserver variability. As a result, it leads to imprecise IHC score for ER and PR. To overcome this, there is an urgent need of developing a reliable and efficient IHC quantifier for high throughput decision making. In view of this, our study aims at developing an automated IHC profiler for quantitative assessment of ER and PR molecular expression from stained tissue images. We propose here to use CMYK colour space for positively and negatively stained cell extraction for proportion score. Also colour features are used for quantitative assessment of intensity scoring among the positively stained cells. Five different machine learning models namely artificial neural network, Naïve Bayes, K-nearest neighbours, decision tree and random forest are considered for learning the colour features using average red, green and blue pixel values of positively stained cell patches. Fifty cases of ER- and PR-stained tissues have been evaluated for validation with the expert pathologist's score. All five models perform adequately where random forest shows the best correlation with the expert's score (Pearson's correlation coefficient = 0.9192). In the proposed approach the average variation of diaminobenzidine (DAB) to nuclear area from the expert's score is found to be 7.58%, as compared to 27.83% for state-of-the-art ImmunoRatio software. © 2017 The Authors Journal of Microscopy © 2017 Royal Microscopical Society.

Development of design principles for automated systems in transport control.

PubMed

Balfe, Nora; Wilson, John R; Sharples, Sarah; Clarke, Theresa

2012-01-01

This article reports the results of a qualitative study investigating attitudes towards and opinions of an advanced automation system currently used in UK rail signalling. In-depth interviews were held with 10 users, key issues associated with automation were identified and the automation's impact on the signalling task investigated. The interview data highlighted the importance of the signallers' understanding of the automation and their (in)ability to predict its outputs. The interviews also covered the methods used by signallers to interact with and control the automation, and the perceived effects on their workload. The results indicate that despite a generally low level of understanding and ability to predict the actions of the automation system, signallers have developed largely successful coping mechanisms that enable them to use the technology effectively. These findings, along with parallel work identifying desirable attributes of automation from the literature in the area, were used to develop 12 principles of automation which can be used to help design new systems which better facilitate cooperative working. The work reported in this article was completed with the active involvement of operational rail staff who regularly use automated systems in rail signalling. The outcomes are currently being used to inform decisions on the extent and type of automation and user interfaces in future generations of rail control systems.

Automated Subsystem Control for Life Support System (ASCLSS)

NASA Technical Reports Server (NTRS)

Block, Roger F.

1987-01-01

The Automated Subsystem Control for Life Support Systems (ASCLSS) program has successfully developed and demonstrated a generic approach to the automation and control of space station subsystems. The automation system features a hierarchical and distributed real-time control architecture which places maximum controls authority at the lowest or process control level which enhances system autonomy. The ASCLSS demonstration system pioneered many automation and control concepts currently being considered in the space station data management system (DMS). Heavy emphasis is placed on controls hardware and software commonality implemented in accepted standards. The approach demonstrates successfully the application of real-time process and accountability with the subsystem or process developer. The ASCLSS system completely automates a space station subsystem (air revitalization group of the ASCLSS) which moves the crew/operator into a role of supervisory control authority. The ASCLSS program developed over 50 lessons learned which will aide future space station developers in the area of automation and controls..

Embodied conversational agents for multimodal automated social skills training in people with autism spectrum disorders.

PubMed

Tanaka, Hiroki; Negoro, Hideki; Iwasaka, Hidemi; Nakamura, Satoshi

2017-01-01

Social skills training, performed by human trainers, is a well-established method for obtaining appropriate skills in social interaction. Previous work automated the process of social skills training by developing a dialogue system that teaches social communication skills through interaction with a computer avatar. Even though previous work that simulated social skills training only considered acoustic and linguistic information, human social skills trainers take into account visual and other non-verbal features. In this paper, we create and evaluate a social skills training system that closes this gap by considering the audiovisual features of the smiling ratio and the head pose (yaw and pitch). In addition, the previous system was only tested with graduate students; in this paper, we applied our system to children or young adults with autism spectrum disorders. For our experimental evaluation, we recruited 18 members from the general population and 10 people with autism spectrum disorders and gave them our proposed multimodal system to use. An experienced human social skills trainer rated the social skills of the users. We evaluated the system's effectiveness by comparing pre- and post-training scores and identified significant improvement in their social skills using our proposed multimodal system. Computer-based social skills training is useful for people who experience social difficulties. Such a system can be used by teachers, therapists, and social skills trainers for rehabilitation and the supplemental use of human-based training anywhere and anytime.

Automation Applications in an Advanced Air Traffic Management System : Volume 4B. Automation Requirements (Concluded)

DOT National Transportation Integrated Search

1974-08-01

Volume 4 describes the automation requirements. A presentation of automation requirements is made for an advanced air traffic management system in terms of controller work for-e, computer resources, controller productivity, system manning, failure ef...

46 CFR 62.20-3 - Plans for information.

Code of Federal Regulations, 2010 CFR

2010-10-01

...-based system hardware. (3) Safety controls. (4) Automated electric power management. (5) Automation... COAST GUARD, DEPARTMENT OF HOMELAND SECURITY (CONTINUED) MARINE ENGINEERING VITAL SYSTEM AUTOMATION Plan... Officer in Charge, Marine Inspection, for use in the evaluation of automated systems provided to replace...

Library Automation in the Netherlands and Pica.

ERIC Educational Resources Information Center

Bossers, Anton; Van Muyen, Martin

1984-01-01

Describes the Pica Library Automation Network (originally the Project for Integrated Catalogue Automation), which is based on a centralized bibliographic database. Highlights include the Pica conception of library automation, online shared cataloging system, circulation control system, acquisition system, and online Dutch union catalog with…

15 CFR 758.2 - Automated Export System (AES).

Code of Federal Regulations, 2014 CFR

2014-01-01

... 15 Commerce and Foreign Trade 2 2014-01-01 2014-01-01 false Automated Export System (AES). 758.2... CLEARANCE REQUIREMENTS § 758.2 Automated Export System (AES). The Census Bureau's Foreign Trade Statistics...) electronically using the Automated Export System (AES). In order to use AES, you must apply directly to the...

15 CFR 758.2 - Automated Export System (AES).

Code of Federal Regulations, 2013 CFR

2013-01-01

... 15 Commerce and Foreign Trade 2 2013-01-01 2013-01-01 false Automated Export System (AES). 758.2... CLEARANCE REQUIREMENTS § 758.2 Automated Export System (AES). The Census Bureau's Foreign Trade Statistics...) electronically using the Automated Export System (AES). In order to use AES, you must apply directly to the...

15 CFR 758.2 - Automated Export System (AES).

Code of Federal Regulations, 2012 CFR

2012-01-01

... 15 Commerce and Foreign Trade 2 2012-01-01 2012-01-01 false Automated Export System (AES). 758.2... CLEARANCE REQUIREMENTS § 758.2 Automated Export System (AES). The Census Bureau's Foreign Trade Statistics...) electronically using the Automated Export System (AES). In order to use AES, you must apply directly to the...

21 CFR 864.9175 - Automated blood grouping and antibody test system.

Code of Federal Regulations, 2012 CFR

2012-04-01

... Manufacture Blood and Blood Products § 864.9175 Automated blood grouping and antibody test system. (a) Identification. An automated blood grouping and antibody test system is a device used to group erythrocytes (red... 21 Food and Drugs 8 2012-04-01 2012-04-01 false Automated blood grouping and antibody test system...

21 CFR 864.9175 - Automated blood grouping and antibody test system.

Code of Federal Regulations, 2010 CFR

2010-04-01

... Manufacture Blood and Blood Products § 864.9175 Automated blood grouping and antibody test system. (a) Identification. An automated blood grouping and antibody test system is a device used to group erythrocytes (red... 21 Food and Drugs 8 2010-04-01 2010-04-01 false Automated blood grouping and antibody test system...

21 CFR 864.9175 - Automated blood grouping and antibody test system.

Code of Federal Regulations, 2011 CFR

2011-04-01

... Manufacture Blood and Blood Products § 864.9175 Automated blood grouping and antibody test system. (a) Identification. An automated blood grouping and antibody test system is a device used to group erythrocytes (red... 21 Food and Drugs 8 2011-04-01 2011-04-01 false Automated blood grouping and antibody test system...

21 CFR 864.9175 - Automated blood grouping and antibody test system.

Code of Federal Regulations, 2014 CFR

2014-04-01

... Manufacture Blood and Blood Products § 864.9175 Automated blood grouping and antibody test system. (a) Identification. An automated blood grouping and antibody test system is a device used to group erythrocytes (red... 21 Food and Drugs 8 2014-04-01 2014-04-01 false Automated blood grouping and antibody test system...

21 CFR 864.9175 - Automated blood grouping and antibody test system.

Code of Federal Regulations, 2013 CFR

2013-04-01

... Manufacture Blood and Blood Products § 864.9175 Automated blood grouping and antibody test system. (a) Identification. An automated blood grouping and antibody test system is a device used to group erythrocytes (red... 21 Food and Drugs 8 2013-04-01 2013-04-01 false Automated blood grouping and antibody test system...

22 CFR 120.30 - The Automated Export System (AES).

Code of Federal Regulations, 2012 CFR

2012-04-01

... 22 Foreign Relations 1 2012-04-01 2012-04-01 false The Automated Export System (AES). 120.30 Section 120.30 Foreign Relations DEPARTMENT OF STATE INTERNATIONAL TRAFFIC IN ARMS REGULATIONS PURPOSE AND DEFINITIONS § 120.30 The Automated Export System (AES). The Automated Export System (AES) is the Department of...

22 CFR 120.30 - The Automated Export System (AES).

Code of Federal Regulations, 2014 CFR

2014-04-01

... 22 Foreign Relations 1 2014-04-01 2014-04-01 false The Automated Export System (AES). 120.30 Section 120.30 Foreign Relations DEPARTMENT OF STATE INTERNATIONAL TRAFFIC IN ARMS REGULATIONS PURPOSE AND DEFINITIONS § 120.30 The Automated Export System (AES). The Automated Export System (AES) is the Department of...

22 CFR 120.30 - The Automated Export System (AES).

Code of Federal Regulations, 2011 CFR

2011-04-01

... 22 Foreign Relations 1 2011-04-01 2011-04-01 false The Automated Export System (AES). 120.30 Section 120.30 Foreign Relations DEPARTMENT OF STATE INTERNATIONAL TRAFFIC IN ARMS REGULATIONS PURPOSE AND DEFINITIONS § 120.30 The Automated Export System (AES). The Automated Export System (AES) is the Department of...

22 CFR 120.30 - The Automated Export System (AES).

Code of Federal Regulations, 2013 CFR

2013-04-01

... 22 Foreign Relations 1 2013-04-01 2013-04-01 false The Automated Export System (AES). 120.30 Section 120.30 Foreign Relations DEPARTMENT OF STATE INTERNATIONAL TRAFFIC IN ARMS REGULATIONS PURPOSE AND DEFINITIONS § 120.30 The Automated Export System (AES). The Automated Export System (AES) is the Department of...

Autonomy and Automation

NASA Technical Reports Server (NTRS)

Shively, Jay

2017-01-01

A significant level of debate and confusion has surrounded the meaning of the terms autonomy and automation. Automation is a multi-dimensional concept, and we propose that Remotely Piloted Aircraft Systems (RPAS) automation should be described with reference to the specific system and task that has been automated, the context in which the automation functions, and other relevant dimensions. In this paper, we present definitions of automation, pilot in the loop, pilot on the loop and pilot out of the loop. We further propose that in future, the International Civil Aviation Organization (ICAO) RPAS Panel avoids the use of the terms autonomy and autonomous when referring to automated systems on board RPA. Work Group 7 proposes to develop, in consultation with other workgroups, a taxonomy of Levels of Automation for RPAS.

Automated extraction of Biomarker information from pathology reports.

PubMed

Lee, Jeongeun; Song, Hyun-Je; Yoon, Eunsil; Park, Seong-Bae; Park, Sung-Hye; Seo, Jeong-Wook; Park, Peom; Choi, Jinwook

2018-05-21

Pathology reports are written in free-text form, which precludes efficient data gathering. We aimed to overcome this limitation and design an automated system for extracting biomarker profiles from accumulated pathology reports. We designed a new data model for representing biomarker knowledge. The automated system parses immunohistochemistry reports based on a "slide paragraph" unit defined as a set of immunohistochemistry findings obtained for the same tissue slide. Pathology reports are parsed using context-free grammar for immunohistochemistry, and using a tree-like structure for surgical pathology. The performance of the approach was validated on manually annotated pathology reports of 100 randomly selected patients managed at Seoul National University Hospital. High F-scores were obtained for parsing biomarker name and corresponding test results (0.999 and 0.998, respectively) from the immunohistochemistry reports, compared to relatively poor performance for parsing surgical pathology findings. However, applying the proposed approach to our single-center dataset revealed information on 221 unique biomarkers, which represents a richer result than biomarker profiles obtained based on the published literature. Owing to the data representation model, the proposed approach can associate biomarker profiles extracted from an immunohistochemistry report with corresponding pathology findings listed in one or more surgical pathology reports. Term variations are resolved by normalization to corresponding preferred terms determined by expanded dictionary look-up and text similarity-based search. Our proposed approach for biomarker data extraction addresses key limitations regarding data representation and can handle reports prepared in the clinical setting, which often contain incomplete sentences, typographical errors, and inconsistent formatting.

System reliability, performance and trust in adaptable automation.

PubMed

Chavaillaz, Alain; Wastell, David; Sauer, Jürgen

2016-01-01

The present study examined the effects of reduced system reliability on operator performance and automation management in an adaptable automation environment. 39 operators were randomly assigned to one of three experimental groups: low (60%), medium (80%), and high (100%) reliability of automation support. The support system provided five incremental levels of automation which operators could freely select according to their needs. After 3 h of training on a simulated process control task (AutoCAMS) in which the automation worked infallibly, operator performance and automation management were measured during a 2.5-h testing session. Trust and workload were also assessed through questionnaires. Results showed that although reduced system reliability resulted in lower levels of trust towards automation, there were no corresponding differences in the operators' reliance on automation. While operators showed overall a noteworthy ability to cope with automation failure, there were, however, decrements in diagnostic speed and prospective memory with lower reliability. Copyright © 2015. Published by Elsevier Ltd.

Automated Planning and Scheduling for Planetary Rover Distributed Operations

NASA Technical Reports Server (NTRS)

Backes, Paul G.; Rabideau, Gregg; Tso, Kam S.; Chien, Steve

1999-01-01

Automated planning and Scheduling, including automated path planning, has been integrated with an Internet-based distributed operations system for planetary rover operations. The resulting prototype system enables faster generation of valid rover command sequences by a distributed planetary rover operations team. The Web Interface for Telescience (WITS) provides Internet-based distributed collaboration, the Automated Scheduling and Planning Environment (ASPEN) provides automated planning and scheduling, and an automated path planner provided path planning. The system was demonstrated on the Rocky 7 research rover at JPL.

Automated lobar quantification of emphysema in patients with severe COPD.

PubMed

Revel, Marie-Pierre; Faivre, Jean-Baptiste; Remy-Jardin, Martine; Deken, Valérie; Duhamel, Alain; Marquette, Charles-Hugo; Tacelli, Nunzia; Bakai, Anne-Marie; Remy, Jacques

2008-12-01

Automated lobar quantification of emphysema has not yet been evaluated. Unenhanced 64-slice MDCT was performed in 47 patients evaluated before bronchoscopic lung-volume reduction. CT images reconstructed with a standard (B20) and high-frequency (B50) kernel were analyzed using a dedicated prototype software (MevisPULMO) allowing lobar quantification of emphysema extent. Lobar quantification was obtained following (a) a fully automatic delineation of the lobar limits by the software and (b) a semiautomatic delineation with manual correction of the lobar limits when necessary and was compared with the visual scoring of emphysema severity per lobe. No statistically significant difference existed between automated and semiautomated lobar quantification (p > 0.05 in the five lobes), with differences ranging from 0.4 to 3.9%. The agreement between the two methods (intraclass correlation coefficient, ICC) was excellent for left upper lobe (ICC = 0.94), left lower lobe (ICC = 0.98), and right lower lobe (ICC = 0.80). The agreement was good for right upper lobe (ICC = 0.68) and moderate for middle lobe (IC = 0.53). The Bland and Altman plots confirmed these results. A good agreement was observed between the software and visually assessed lobar predominance of emphysema (kappa 0.78; 95% CI 0.64-0.92). Automated and semiautomated lobar quantifications of emphysema are concordant and show good agreement with visual scoring.

Automated morphometry provides accurate and reproducible virtual staging of liver fibrosis in chronic hepatitis C

PubMed Central

Calès, Paul; Chaigneau, Julien; Hunault, Gilles; Michalak, Sophie; Cavaro-Menard, Christine; Fasquel, Jean-Baptiste; Bertrais, Sandrine; Rousselet, Marie-Christine

2015-01-01

Background: Liver fibrosis staging provides prognostic value, although hampered by observer variability. We used digital analysis to develop diagnostic morphometric scores for significant fibrosis, cirrhosis and fibrosis staging in chronic hepatitis C. Materials and Methods: We automated the measurement of 44 classical and new morphometric descriptors. The reference was histological METAVIR fibrosis (F) staging (F0 to F4) on liver biopsies. The derivation population included 416 patients and liver biopsies ≥20 mm-length. Two validation population included 438 patients. Results: In the derivation population, the area under the receiver operating characteristic (AUROC) for clinically significant fibrosis (F stage ≥2) of a logistic score combining 5 new descriptors (stellar fibrosis area, edge linearity, bridge thickness, bridge number, nodularity) was 0.957. The AUROC for cirrhosis of 6 new descriptors (edge linearity, nodularity, portal stellar fibrosis area, portal distance, granularity, fragmentation) was 0.994. Predicted METAVIR F staging combining 8 morphometric descriptors agreed well with METAVIR F staging by pathologists: κ = 0.868. Morphometric score of clinically significant fibrosis had a higher correlation with porto-septal fibrosis area (rs = 0.835) than METAVIR F staging (rs = 0.756, P < 0.001) and the same correlations with fibrosis biomarkers, e.g., serum hyaluronate: rs = 0.484 versus rs = 0.476 for METAVIR F (P = 0.862). In the validation population, the AUROCs of clinically significant fibrosis and cirrhosis scores were, respectively: 0.893 and 0.993 in 153 patients (biopsy < 20 mm); 0.955 and 0.994 in 285 patients (biopsy ≥ 20 mm). The three morphometric diagnoses agreed with consensus expert reference as well as or better than diagnoses by first-line pathologists in 285 patients, respectively: significant fibrosis: 0.733 versus 0.733 (κ), cirrhosis: 0.900 versus 0.827, METAVIR F: 0.881 versus 0.865. Conclusion: The new automated morphometric scores provide reproducible and accurate diagnoses of fibrosis stages via “virtual expert pathologist.” PMID:26110088

DREAMTools: a Python package for scoring collaborative challenges

PubMed Central

Cokelaer, Thomas; Bansal, Mukesh; Bare, Christopher; Bilal, Erhan; Bot, Brian M.; Chaibub Neto, Elias; Eduati, Federica; de la Fuente, Alberto; Gönen, Mehmet; Hill, Steven M.; Hoff, Bruce; Karr, Jonathan R.; Küffner, Robert; Menden, Michael P.; Meyer, Pablo; Norel, Raquel; Pratap, Abhishek; Prill, Robert J.; Weirauch, Matthew T.; Costello, James C.; Stolovitzky, Gustavo; Saez-Rodriguez, Julio

2016-01-01

DREAM challenges are community competitions designed to advance computational methods and address fundamental questions in system biology and translational medicine. Each challenge asks participants to develop and apply computational methods to either predict unobserved outcomes or to identify unknown model parameters given a set of training data. Computational methods are evaluated using an automated scoring metric, scores are posted to a public leaderboard, and methods are published to facilitate community discussions on how to build improved methods. By engaging participants from a wide range of science and engineering backgrounds, DREAM challenges can comparatively evaluate a wide range of statistical, machine learning, and biophysical methods. Here, we describe DREAMTools, a Python package for evaluating DREAM challenge scoring metrics. DREAMTools provides a command line interface that enables researchers to test new methods on past challenges, as well as a framework for scoring new challenges. As of March 2016, DREAMTools includes more than 80% of completed DREAM challenges. DREAMTools complements the data, metadata, and software tools available at the DREAM website http://dreamchallenges.org and on the Synapse platform at https://www.synapse.org. Availability:  DREAMTools is a Python package. Releases and documentation are available at http://pypi.python.org/pypi/dreamtools. The source code is available at http://github.com/dreamtools/dreamtools. PMID:27134723

Fully automated joint space width measurement and digital X-ray radiogrammetry in early RA.

PubMed

Platten, Michael; Kisten, Yogan; Kälvesten, Johan; Arnaud, Laurent; Forslind, Kristina; van Vollenhoven, Ronald

2017-01-01

To study fully automated digital joint space width (JSW) and bone mineral density (BMD) in relation to a conventional radiographic scoring method in early rheumatoid arthritis (eRA). Radiographs scored by the modified Sharp van der Heijde score (SHS) in patients with eRA were acquired from the SWEdish FarmacOTherapy study. Fully automated JSW measurements of bilateral metacarpals 2, 3 and 4 were compared with the joint space narrowing (JSN) score in SHS. Multilevel mixed model statistics were applied to calculate the significance of the association between ΔJSW and ΔBMD over 1 year, and the JSW differences between damaged and undamaged joints as evaluated by the JSN. Based on 576 joints of 96 patients with eRA, a significant reduction from baseline to 1 year was observed in the JSW from 1.69 (±0.19) mm to 1.66 (±0.19) mm (p<0.01), and BMD from 0.583 (±0.068) g/cm 2 to 0.566 (±0.074) g/cm 2 (p<0.01). A significant positive association was observed between ΔJSW and ΔBMD over 1 year (p<0.0001). On an individual joint level, JSWs of undamaged (JSN=0) joints were wider than damaged (JSN>0) joints: 1.68 mm (95% CI 1.70 to 1.67) vs 1.54 mm (95% CI 1.63 to 1.46). Similarly the unadjusted multilevel model showed significant differences in JSW between undamaged (1.68 mm (95% CI 1.72 to 1.64)) and damaged joints (1.63 mm (95% CI 1.68 to 1.58)) (p=0.0048). This difference remained significant in the adjusted model: 1.66 mm (95% CI 1.70 to 1.61) vs 1.62 mm (95% CI 1.68 to 1.56) (p=0.042). To measure the JSW with this fully automated digital tool may be useful as a quick and observer-independent application for evaluating cartilage damage in eRA. NCT00764725.

Evaluation of an Automated Keywording System.

ERIC Educational Resources Information Center

Malone, Linda C.; And Others

1990-01-01

Discussion of automated indexing techniques focuses on ways to statistically document improvements in the development of an automated keywording system over time. The system developed by the Joint Chiefs of Staff to automate the storage, categorization, and retrieval of information from military exercises is explained, and performance measures are…

21 CFR 864.5700 - Automated platelet aggregation system.

Code of Federal Regulations, 2011 CFR

2011-04-01

... addition of an aggregating reagent to a platelet-rich plasma. (b) Classification. Class II (performance... 21 Food and Drugs 8 2011-04-01 2011-04-01 false Automated platelet aggregation system. 864.5700... § 864.5700 Automated platelet aggregation system. (a) Identification. An automated platelet aggregation...

21 CFR 864.5700 - Automated platelet aggregation system.

Code of Federal Regulations, 2014 CFR

2014-04-01

... addition of an aggregating reagent to a platelet-rich plasma. (b) Classification. Class II (performance... 21 Food and Drugs 8 2014-04-01 2014-04-01 false Automated platelet aggregation system. 864.5700... § 864.5700 Automated platelet aggregation system. (a) Identification. An automated platelet aggregation...

21 CFR 864.5700 - Automated platelet aggregation system.

Code of Federal Regulations, 2013 CFR

2013-04-01

... addition of an aggregating reagent to a platelet-rich plasma. (b) Classification. Class II (performance... 21 Food and Drugs 8 2013-04-01 2013-04-01 false Automated platelet aggregation system. 864.5700... § 864.5700 Automated platelet aggregation system. (a) Identification. An automated platelet aggregation...

21 CFR 864.5700 - Automated platelet aggregation system.

Code of Federal Regulations, 2010 CFR

2010-04-01

... addition of an aggregating reagent to a platelet-rich plasma. (b) Classification. Class II (performance... 21 Food and Drugs 8 2010-04-01 2010-04-01 false Automated platelet aggregation system. 864.5700... § 864.5700 Automated platelet aggregation system. (a) Identification. An automated platelet aggregation...

21 CFR 864.5700 - Automated platelet aggregation system.

Code of Federal Regulations, 2012 CFR

2012-04-01

... addition of an aggregating reagent to a platelet-rich plasma. (b) Classification. Class II (performance... 21 Food and Drugs 8 2012-04-01 2012-04-01 false Automated platelet aggregation system. 864.5700... § 864.5700 Automated platelet aggregation system. (a) Identification. An automated platelet aggregation...

Costs to Automate Demand Response - Taxonomy and Results from Field Studies and Programs

DOE Office of Scientific and Technical Information (OSTI.GOV)

Piette, Mary A.; Schetrit, Oren; Kiliccote, Sila

During the past decade, the technology to automate demand response (DR) in buildings and industrial facilities has advanced significantly. Automation allows rapid, repeatable, reliable operation. This study focuses on costs for DR automation in commercial buildings with some discussion on residential buildings and industrial facilities. DR automation technology relies on numerous components, including communication systems, hardware and software gateways, standards-based messaging protocols, controls and integration platforms, and measurement and telemetry systems. This report compares cost data from several DR automation programs and pilot projects, evaluates trends in the cost per unit of DR and kilowatts (kW) available from automated systems,more » and applies a standard naming convention and classification or taxonomy for system elements. Median costs for the 56 installed automated DR systems studied here are about $200/kW. The deviation around this median is large with costs in some cases being an order of magnitude great or less than the median. This wide range is a result of variations in system age, size of load reduction, sophistication, and type of equipment included in cost analysis. The costs to automate fast DR systems for ancillary services are not fully analyzed in this report because additional research is needed to determine the total cost to install, operate, and maintain these systems. However, recent research suggests that they could be developed at costs similar to those of existing hot-summer DR automation systems. This report considers installation and configuration costs and does include the costs of owning and operating DR automation systems. Future analysis of the latter costs should include the costs to the building or facility manager costs as well as utility or third party program manager cost.« less

Comparison of Actual Costs to Integrate Commercial Buildings with the Grid

DOE Office of Scientific and Technical Information (OSTI.GOV)

Piette, Mary Ann; Black, Doug; Yin, Rongxin

During the past decade, the technology to automate demand response (DR) in buildings and industrial facilities has advanced significantly. Automation allows rapid, repeatable, reliable operation. This study focuses on costs for DR automation in commercial buildings with some discussion on residential buildings and industrial facilities. DR automation technology relies on numerous components, including communication systems, hardware and software gateways, standards-based messaging protocols, controls and integration platforms, and measurement and telemetry systems. This paper discusses the impact factors that contribute to the costs of automated DR systems, with a focus on OpenADR 1.0 and 2.0 systems. In addition, this report comparesmore » cost data from several DR automation programs and pilot projects, evaluates trends in the cost per unit of DR and kilowatts (kW) available from automated systems, and applies a standard naming convention and classification or taxonomy for system elements. In summary, median costs for the 56 installed automated DR systems studied here are about $200/kW. The deviation around this median is large with costs in some cases being an order of magnitude greater or less than median. Costs to automate fast DR systems for ancillary services are not fully analyzed in this report because additional research is needed to determine the total such costs.« less

A system-level approach to automation research

NASA Technical Reports Server (NTRS)

Harrison, F. W.; Orlando, N. E.

1984-01-01

Automation is the application of self-regulating mechanical and electronic devices to processes that can be accomplished with the human organs of perception, decision, and actuation. The successful application of automation to a system process should reduce man/system interaction and the perceived complexity of the system, or should increase affordability, productivity, quality control, and safety. The expense, time constraints, and risk factors associated with extravehicular activities have led the Automation Technology Branch (ATB), as part of the NASA Automation Research and Technology Program, to investigate the use of robots and teleoperators as automation aids in the context of space operations. The ATB program addresses three major areas: (1) basic research in autonomous operations, (2) human factors research on man-machine interfaces with remote systems, and (3) the integration and analysis of automated systems. This paper reviews the current ATB research in the area of robotics and teleoperators.

[Standardization of operation monitoring and control of the clinical laboratory automation system].

PubMed

Tao, R

2000-10-01

Laboratory automation systems showed up in the 1980s and have been introduced to many clinical laboratories since early 1990s. Meanwhile, it was found that the difference in the specimen tube dimensions, specimen identification formats, specimen carrier transportation equipment architecture, electromechanical interfaces between the analyzers and the automation systems was preventing the systems from being introduced to a wider extent. To standardize the different interfaces and reduce the cost of laboratory automation, NCCLS and JCCLS started establishing standards for laboratory automation in 1996 and 1997 respectively. Operation monitoring and control of the laboratory automation system have been included in their activities, resulting in the publication of an NCCLS proposed standard in 1999.

Embodied conversational agents for multimodal automated social skills training in people with autism spectrum disorders

PubMed Central

Negoro, Hideki; Iwasaka, Hidemi; Nakamura, Satoshi

2017-01-01

Social skills training, performed by human trainers, is a well-established method for obtaining appropriate skills in social interaction. Previous work automated the process of social skills training by developing a dialogue system that teaches social communication skills through interaction with a computer avatar. Even though previous work that simulated social skills training only considered acoustic and linguistic information, human social skills trainers take into account visual and other non-verbal features. In this paper, we create and evaluate a social skills training system that closes this gap by considering the audiovisual features of the smiling ratio and the head pose (yaw and pitch). In addition, the previous system was only tested with graduate students; in this paper, we applied our system to children or young adults with autism spectrum disorders. For our experimental evaluation, we recruited 18 members from the general population and 10 people with autism spectrum disorders and gave them our proposed multimodal system to use. An experienced human social skills trainer rated the social skills of the users. We evaluated the system’s effectiveness by comparing pre- and post-training scores and identified significant improvement in their social skills using our proposed multimodal system. Computer-based social skills training is useful for people who experience social difficulties. Such a system can be used by teachers, therapists, and social skills trainers for rehabilitation and the supplemental use of human-based training anywhere and anytime. PMID:28796781

Automation of immunohistochemical evaluation in breast cancer using image analysis

PubMed Central

Prasad, Keerthana; Tiwari, Avani; Ilanthodi, Sandhya; Prabhu, Gopalakrishna; Pai, Muktha

2011-01-01

AIM: To automate breast cancer diagnosis and to study the inter-observer and intra-observer variations in the manual evaluations. METHODS: Breast tissue specimens from sixty cases were stained separately for estrogen receptor (ER), progesterone receptor (PR) and human epidermal growth factor receptor-2 (HER-2/neu). All cases were assessed by manual grading as well as image analysis. The manual grading was performed by an experienced expert pathologist. To study inter-observer and intra-observer variations, we obtained readings from another pathologist as the second observer from a different laboratory who has a little less experience than the first observer. We also took a second reading from the second observer to study intra-observer variations. Image analysis was carried out using in-house developed software (TissueQuant). A comparison of the results from image analysis and manual scoring of ER, PR and HER-2/neu was also carried out. RESULTS: The performance of the automated analysis in the case of ER, PR and HER-2/neu expressions was compared with the manual evaluations. The performance of the automated system was found to correlate well with the manual evaluations. The inter-observer variations were measured using Spearman correlation coefficient r and 95% confidence interval. In the case of ER expression, Spearman correlation r = 0.53, in the case of PR expression, r = 0.63, and in the case of HER-2/neu expression, r = 0.68. Similarly, intra-observer variations were also measured. In the case of ER, PR and HER-2/neu expressions, r = 0.46, 0.66 and 0.70, respectively. CONCLUSION: The automation of breast cancer diagnosis from immunohistochemically stained specimens is very useful for providing objective and repeatable evaluations. PMID:21611095

A manic-depressive symptom self-report in optical scanable format.

PubMed

Glick, Henry A; McBride, Linda; Bauer, Mark S

2003-10-01

The Internal State Scale (ISS) is a self-report instrument that allows the simultaneous assessment of both manic and depressive symptoms in individuals with manic-depressive disorder. Prior work indicates that subscales are highly correlated with clinician ratings of mania and depression and provide a discriminant function that identifies individuals in manic/hypomanic, mixed, depressed, and euthymic mood states. A drawback to the ISS is that its items were developed in the visual analogue scale (VAS) format which is labor-intensive to score, particularly with repeat (e.g. daily) administration. A Likert-based format would allow quick and easy optical scanning for which scoring could be automated. To compare discriminating properties in Likert versus VAS format we re-analyzed previously collected data and collected new data: (a) VAS-based ISS scores from 86 subjects from a prior four-site study were re-analyzed by collapsing scores into 20 and then 10 Likert-based bins to assess loss of precision from collapsing scores, and (b) 24 additional subjects were administered the ISS in VAS and Likert formats to assess loss of precision due to instrument completion factors. Discriminant ability, including kappas and receiver operator characteristic curves, were unchanged across the two formats. Within-subjects reliability was uniformally high across formats. Likert-based scoring of the ISS can be used without loss of precision, thus making automated scoring of the ISS feasible. This format will be particularly useful for studies that require processing of large numbers of ISSs, such as those that collect frequent ratings over long periods of time and/or those that utilize large samples.

21 CFR 866.1645 - Fully automated short-term incubation cycle antimicrobial susceptibility system.

Code of Federal Regulations, 2010 CFR

2010-04-01

... 21 Food and Drugs 8 2010-04-01 2010-04-01 false Fully automated short-term incubation cycle... Diagnostic Devices § 866.1645 Fully automated short-term incubation cycle antimicrobial susceptibility system. (a) Identification. A fully automated short-term incubation cycle antimicrobial susceptibility system...

Pilot interaction with automated airborne decision making systems

NASA Technical Reports Server (NTRS)

Rouse, W. B.; Chu, Y. Y.; Greenstein, J. S.; Walden, R. S.

1976-01-01

An investigation was made of interaction between a human pilot and automated on-board decision making systems. Research was initiated on the topic of pilot problem solving in automated and semi-automated flight management systems and attempts were made to develop a model of human decision making in a multi-task situation. A study was made of allocation of responsibility between human and computer, and discussed were various pilot performance parameters with varying degrees of automation. Optimal allocation of responsibility between human and computer was considered and some theoretical results found in the literature were presented. The pilot as a problem solver was discussed. Finally the design of displays, controls, procedures, and computer aids for problem solving tasks in automated and semi-automated systems was considered.

Imitating manual curation of text-mined facts in biomedicine.

PubMed

Rodriguez-Esteban, Raul; Iossifov, Ivan; Rzhetsky, Andrey

2006-09-08

Text-mining algorithms make mistakes in extracting facts from natural-language texts. In biomedical applications, which rely on use of text-mined data, it is critical to assess the quality (the probability that the message is correctly extracted) of individual facts--to resolve data conflicts and inconsistencies. Using a large set of almost 100,000 manually produced evaluations (most facts were independently reviewed more than once, producing independent evaluations), we implemented and tested a collection of algorithms that mimic human evaluation of facts provided by an automated information-extraction system. The performance of our best automated classifiers closely approached that of our human evaluators (ROC score close to 0.95). Our hypothesis is that, were we to use a larger number of human experts to evaluate any given sentence, we could implement an artificial-intelligence curator that would perform the classification job at least as accurately as an average individual human evaluator. We illustrated our analysis by visualizing the predicted accuracy of the text-mined relations involving the term cocaine.

Image-Based Quantification of Plant Immunity and Disease.

PubMed

Laflamme, Bradley; Middleton, Maggie; Lo, Timothy; Desveaux, Darrell; Guttman, David S

2016-12-01

Measuring the extent and severity of disease is a critical component of plant pathology research and crop breeding. Unfortunately, existing visual scoring systems are qualitative, subjective, and the results are difficult to transfer between research groups, while existing quantitative methods can be quite laborious. Here, we present plant immunity and disease image-based quantification (PIDIQ), a quantitative, semi-automated system to rapidly and objectively measure disease symptoms in a biologically relevant context. PIDIQ applies an ImageJ-based macro to plant photos in order to distinguish healthy tissue from tissue that has yellowed due to disease. It can process a directory of images in an automated manner and report the relative ratios of healthy to diseased leaf area, thereby providing a quantitative measure of plant health that can be statistically compared with appropriate controls. We used the Arabidopsis thaliana-Pseudomonas syringae model system to show that PIDIQ is able to identify both enhanced plant health associated with effector-triggered immunity as well as elevated disease symptoms associated with effector-triggered susceptibility. Finally, we show that the quantitative results provided by PIDIQ correspond to those obtained via traditional in planta pathogen growth assays. PIDIQ provides a simple and effective means to nondestructively quantify disease from whole plants and we believe it will be equally effective for monitoring disease on excised leaves and stems.

Automated Scoring of Short-Answer Open-Ended GRE® Subject Test Items. ETS GRE® Board Research Report No. 04-02. ETS RR-08-20

ERIC Educational Resources Information Center

Attali, Yigal; Powers, Don; Freedman, Marshall; Harrison, Marissa; Obetz, Susan

2008-01-01

This report describes the development, administration, and scoring of open-ended variants of GRE® Subject Test items in biology and psychology. These questions were administered in a Web-based experiment to registered examinees of the respective Subject Tests. The questions required a short answer of 1-3 sentences, and responses were automatically…

Validity of Scores for a Developmental Writing Scale Based on Automated Scoring

ERIC Educational Resources Information Center

Attali, Yigal; Powers, Donald

2009-01-01

A developmental writing scale for timed essay-writing performance was created on the basis of automatically computed indicators of writing fluency, word choice, and conventions of standard written English. In a large-scale data collection effort that involved a national sample of more than 12,000 students from 4th, 6th, 8th, 10th, and 12th grade,…

Improving the Army’s Assessment of Interactive Multimedia Instruction Courseware

DTIC Science & Technology

2009-01-01

pretests and posttests , along with automated procedures to analyze and report test scores across courses or schools. Learning (knowledge retention...determine whether the training program (versus other factors) accounts for differences in pretest and posttest scores (although some study designs allow...based efforts have also been made. Learning Many courses have posttests , but there are no reports of pretest / posttest comparisons across courses or

Automated structure solution, density modification and model building.

PubMed

Terwilliger, Thomas C

2002-11-01

The approaches that form the basis of automated structure solution in SOLVE and RESOLVE are described. The use of a scoring scheme to convert decision making in macromolecular structure solution to an optimization problem has proven very useful and in many cases a single clear heavy-atom solution can be obtained and used for phasing. Statistical density modification is well suited to an automated approach to structure solution because the method is relatively insensitive to choices of numbers of cycles and solvent content. The detection of non-crystallographic symmetry (NCS) in heavy-atom sites and checking of potential NCS operations against the electron-density map has proven to be a reliable method for identification of NCS in most cases. Automated model building beginning with an FFT-based search for helices and sheets has been successful in automated model building for maps with resolutions as low as 3 A. The entire process can be carried out in a fully automatic fashion in many cases.

Assessment in health care education - modelling and implementation of a computer supported scoring process.

PubMed

Alfredsson, Jayne; Plichart, Patrick; Zary, Nabil

2012-01-01

Research on computer supported scoring of assessments in health care education has mainly focused on automated scoring. Little attention has been given to how informatics can support the currently predominant human-based grading approach. This paper reports steps taken to develop a model for a computer supported scoring process that focuses on optimizing a task that was previously undertaken without computer support. The model was also implemented in the open source assessment platform TAO in order to study its benefits. Ability to score test takers anonymously, analytics on the graders reliability and a more time efficient process are example of observed benefits. A computer supported scoring will increase the quality of the assessment results.

Advanced paratransit system : an application of digital map, automated vehicle scheduling and vehicle location systems

DOT National Transportation Integrated Search

1997-05-01

This report documents and evaluates an advanced Paratransit system demonstration project. The Santa Clara Valley Transportation Agency (SCVTA), via OUTREACH, implemented such a system, comprised of an automated trip scheduling system (ATSS) and autom...

47 CFR 80.54 - Automated Maritime Telecommunications System (AMTS)-System Licensing.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 47 Telecommunication 5 2010-10-01 2010-10-01 false Automated Maritime Telecommunications System (AMTS)-System Licensing. 80.54 Section 80.54 Telecommunication FEDERAL COMMUNICATIONS COMMISSION... § 80.54 Automated Maritime Telecommunications System (AMTS)—System Licensing. AMTS licensees will be...

47 CFR 80.54 - Automated Maritime Telecommunications System (AMTS)-System Licensing.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 47 Telecommunication 5 2011-10-01 2011-10-01 false Automated Maritime Telecommunications System (AMTS)-System Licensing. 80.54 Section 80.54 Telecommunication FEDERAL COMMUNICATIONS COMMISSION... § 80.54 Automated Maritime Telecommunications System (AMTS)—System Licensing. AMTS licensees will be...

47 CFR 80.54 - Automated Maritime Telecommunications System (AMTS)-System Licensing.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 47 Telecommunication 5 2014-10-01 2014-10-01 false Automated Maritime Telecommunications System (AMTS)-System Licensing. 80.54 Section 80.54 Telecommunication FEDERAL COMMUNICATIONS COMMISSION... § 80.54 Automated Maritime Telecommunications System (AMTS)—System Licensing. AMTS licensees will be...

47 CFR 80.54 - Automated Maritime Telecommunications System (AMTS)-System Licensing.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 47 Telecommunication 5 2012-10-01 2012-10-01 false Automated Maritime Telecommunications System (AMTS)-System Licensing. 80.54 Section 80.54 Telecommunication FEDERAL COMMUNICATIONS COMMISSION... § 80.54 Automated Maritime Telecommunications System (AMTS)—System Licensing. AMTS licensees will be...

47 CFR 80.54 - Automated Maritime Telecommunications System (AMTS)-System Licensing.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 47 Telecommunication 5 2013-10-01 2013-10-01 false Automated Maritime Telecommunications System (AMTS)-System Licensing. 80.54 Section 80.54 Telecommunication FEDERAL COMMUNICATIONS COMMISSION... § 80.54 Automated Maritime Telecommunications System (AMTS)—System Licensing. AMTS licensees will be...

Laboratory automation: total and subtotal.

PubMed

Hawker, Charles D

2007-12-01

Worldwide, perhaps 2000 or more clinical laboratories have implemented some form of laboratory automation, either a modular automation system, such as for front-end processing, or a total laboratory automation system. This article provides descriptions and examples of these various types of automation. It also presents an outline of how a clinical laboratory that is contemplating automation should approach its decision and the steps it should follow to ensure a successful implementation. Finally, the role of standards in automation is reviewed.

Selecting automation for the clinical chemistry laboratory.

PubMed

Melanson, Stacy E F; Lindeman, Neal I; Jarolim, Petr

2007-07-01

Laboratory automation proposes to improve the quality and efficiency of laboratory operations, and may provide a solution to the quality demands and staff shortages faced by today's clinical laboratories. Several vendors offer automation systems in the United States, with both subtle and obvious differences. Arriving at a decision to automate, and the ensuing evaluation of available products, can be time-consuming and challenging. Although considerable discussion concerning the decision to automate has been published, relatively little attention has been paid to the process of evaluating and selecting automation systems. To outline a process for evaluating and selecting automation systems as a reference for laboratories contemplating laboratory automation. Our Clinical Chemistry Laboratory staff recently evaluated all major laboratory automation systems in the United States, with their respective chemistry and immunochemistry analyzers. Our experience is described and organized according to the selection process, the important considerations in clinical chemistry automation, decisions and implementation, and we give conclusions pertaining to this experience. Including the formation of a committee, workflow analysis, submitting a request for proposal, site visits, and making a final decision, the process of selecting chemistry automation took approximately 14 months. We outline important considerations in automation design, preanalytical processing, analyzer selection, postanalytical storage, and data management. Selecting clinical chemistry laboratory automation is a complex, time-consuming process. Laboratories considering laboratory automation may benefit from the concise overview and narrative and tabular suggestions provided.

Brief episodes of intracranial hypertension and cerebral hypoperfusion are associated with poor functional outcome after severe traumatic brain injury.

PubMed

Stein, Deborah M; Hu, Peter F; Brenner, Megan; Sheth, Kevin N; Liu, Keng-Hao; Xiong, Wei; Aarabi, Bizhan; Scalea, Thomas M

2011-08-01

Management strategies after severe traumatic brain injury (TBI) target prevention and treatment of intracranial hypertension (ICH) and cerebral hypoperfusion (CH). We have previously established that continuous automated recordings of vital signs (VS) are more highly correlated with outcome than manual end-hour recordings. One potential benefit of automated vital sign data capture is the ability to detect brief episodes of ICH and CH. The purpose of this study was to establish whether a relationship exists between brief episodes of ICH and CH and outcome after severe TBI. Patients at the R Adams Cowley Shock Trauma Center were prospectively enrolled over a 2-year period. Inclusion criteria were as follows: age >14 years, admission within the first 6 hours after injury, Glasgow Coma Scale score <9 on admission, and placement of a clinically indicated ICP monitor. From high-resolution automated VS data recording system, we calculated the 5-minute means of intracranial pressure (ICP), cerebral perfusion pressure (CPP), and Brain Trauma Index (BTI = CPP/ICP). Patients were stratified by mortality and 6-month Extended Glasgow Outcome Score (GOSE). Sixty subjects were enrolled with a mean admission Glasgow Coma Scale score of 6.4 ± 3.1, a mean Head Abbreviated Injury Severity Scale score of 4.2 ± 0.7, and a mean Marshall CT score of 2.5 ± 0.9. Significant differences in the mean number of brief episodes of CPP <50 and BTI <2 in patients with a GOSE 1-4 versus GOSE 5-8 (9.4 vs. 4.7, p = 0.02 and 9.3 vs. 4.9, p = 0.03) were found. There were significantly more mean brief episodes per day of ICP >30 (0.52 vs. 0.29, p = 0.02), CPP <50 (0.65 vs. 0.28, p < 0.001), CPP <60 (1.09 vs. 0.7, p = 0.03), BTI <2 (0.66 vs. 0.31, p = 0.002), and BTI <3 (1.1 vs. 0.64, p = 0.01) in those patients with GOSE 1-4. Number of brief episodes of CPP <50, CPP <60, BTI <2, and BTI <3 all demonstrated high predictive power for unfavorable functional outcome (area under the curve = 0.65-0.75, p < 0.05). This study demonstrates that the number of brief 5-minute episodes of ICH and CH is predictive of poor outcome after severe TBI. This finding has important implications for management paradigms which are currently targeted to treatment rather than prevention of ICH and CH. This study demonstrates that these brief episodes may play a significant role in outcome after severe TBI.

Automated evaluation of liver fibrosis in thioacetamide, carbon tetrachloride, and bile duct ligation rodent models using second-harmonic generation/two-photon excited fluorescence microscopy.

PubMed

Liu, Feng; Chen, Long; Rao, Hui-Ying; Teng, Xiao; Ren, Ya-Yun; Lu, Yan-Qiang; Zhang, Wei; Wu, Nan; Liu, Fang-Fang; Wei, Lai

2017-01-01

Animal models provide a useful platform for developing and testing new drugs to treat liver fibrosis. Accordingly, we developed a novel automated system to evaluate liver fibrosis in rodent models. This system uses second-harmonic generation (SHG)/two-photon excited fluorescence (TPEF) microscopy to assess a total of four mouse and rat models, using chemical treatment with either thioacetamide (TAA) or carbon tetrachloride (CCl 4 ), and a surgical method, bile duct ligation (BDL). The results obtained by the new technique were compared with that using Ishak fibrosis scores and two currently used quantitative methods for determining liver fibrosis: the collagen proportionate area (CPA) and measurement of hydroxyproline (HYP) content. We show that 11 shared morphological parameters faithfully recapitulate Ishak fibrosis scores in the models, with high area under the receiver operating characteristic (ROC) curve (AUC) performance. The AUC values of 11 shared parameters were greater than that of the CPA (TAA: 0.758-0.922 vs 0.752-0.908; BDL: 0.874-0.989 vs 0.678-0.966) in the TAA mice and BDL rat models and similar to that of the CPA in the TAA rat and CCl 4 mouse models. Similarly, based on the trends in these parameters at different time points, 9, 10, 7, and 2 model-specific parameters were selected for the TAA rats, TAA mice, CCl 4 mice, and BDL rats, respectively. These parameters identified differences among the time points in the four models, with high AUC accuracy, and the corresponding AUC values of these parameters were greater compared with those of the CPA in the TAA rat and mouse models (rats: 0.769-0.894 vs 0.64-0.799; mice: 0.87-0.93 vs 0.739-0.836) and similar to those of the CPA in the CCl 4 mouse and BDL rat models. Similarly, the AUC values of 11 shared parameters and model-specific parameters were greater than those of HYP in the TAA rats, TAA mice, and CCl 4 mouse models and were similar to those of HYP in the BDL rat models. The automated evaluation system, combined with 11 shared parameters and model-specific parameters, could specifically, accurately, and quantitatively stage liver fibrosis in animal models.

Crew system dynamics - Combining humans and automation

NASA Technical Reports Server (NTRS)

Connors, Mary

1989-01-01

Some of the human factor issues involved in effectively combining human and automated systems are examined with particular reference to spaceflights. The concepts of the crew system and crew systems dynamics are defined, and the present status of crew systems is summarized. The possibilities and potential problems aasociated with the use of automated systems are discussed, as are unique capabilities and possible errors introduced by human participants. It is emphasized that the true integration of human and automated systems must allow for the characteristics of both.

Phaser.MRage: automated molecular replacement

PubMed Central

Bunkóczi, Gábor; Echols, Nathaniel; McCoy, Airlie J.; Oeffner, Robert D.; Adams, Paul D.; Read, Randy J.

2013-01-01

Phaser.MRage is a molecular-replacement automation framework that implements a full model-generation workflow and provides several layers of model exploration to the user. It is designed to handle a large number of models and can distribute calculations efficiently onto parallel hardware. In addition, phaser.MRage can identify correct solutions and use this information to accelerate the search. Firstly, it can quickly score all alternative models of a component once a correct solution has been found. Secondly, it can perform extensive analysis of identified solutions to find protein assemblies and can employ assembled models for subsequent searches. Thirdly, it is able to use a priori assembly information (derived from, for example, homologues) to speculatively place and score molecules, thereby customizing the search procedure to a certain class of protein molecule (for example, antibodies) and incorporating additional biological information into molecular replacement. PMID:24189240

Phaser.MRage: automated molecular replacement.

PubMed

Bunkóczi, Gábor; Echols, Nathaniel; McCoy, Airlie J; Oeffner, Robert D; Adams, Paul D; Read, Randy J

2013-11-01

Phaser.MRage is a molecular-replacement automation framework that implements a full model-generation workflow and provides several layers of model exploration to the user. It is designed to handle a large number of models and can distribute calculations efficiently onto parallel hardware. In addition, phaser.MRage can identify correct solutions and use this information to accelerate the search. Firstly, it can quickly score all alternative models of a component once a correct solution has been found. Secondly, it can perform extensive analysis of identified solutions to find protein assemblies and can employ assembled models for subsequent searches. Thirdly, it is able to use a priori assembly information (derived from, for example, homologues) to speculatively place and score molecules, thereby customizing the search procedure to a certain class of protein molecule (for example, antibodies) and incorporating additional biological information into molecular replacement.

Automated Generation and Assessment of Autonomous Systems Test Cases

NASA Technical Reports Server (NTRS)

Barltrop, Kevin J.; Friberg, Kenneth H.; Horvath, Gregory A.

2008-01-01

This slide presentation reviews some of the issues concerning verification and validation testing of autonomous spacecraft routinely culminates in the exploration of anomalous or faulted mission-like scenarios using the work involved during the Dawn mission's tests as examples. Prioritizing which scenarios to develop usually comes down to focusing on the most vulnerable areas and ensuring the best return on investment of test time. Rules-of-thumb strategies often come into play, such as injecting applicable anomalies prior to, during, and after system state changes; or, creating cases that ensure good safety-net algorithm coverage. Although experience and judgment in test selection can lead to high levels of confidence about the majority of a system's autonomy, it's likely that important test cases are overlooked. One method to fill in potential test coverage gaps is to automatically generate and execute test cases using algorithms that ensure desirable properties about the coverage. For example, generate cases for all possible fault monitors, and across all state change boundaries. Of course, the scope of coverage is determined by the test environment capabilities, where a faster-than-real-time, high-fidelity, software-only simulation would allow the broadest coverage. Even real-time systems that can be replicated and run in parallel, and that have reliable set-up and operations features provide an excellent resource for automated testing. Making detailed predictions for the outcome of such tests can be difficult, and when algorithmic means are employed to produce hundreds or even thousands of cases, generating predicts individually is impractical, and generating predicts with tools requires executable models of the design and environment that themselves require a complete test program. Therefore, evaluating the results of large number of mission scenario tests poses special challenges. A good approach to address this problem is to automatically score the results based on a range of metrics. Although the specific means of scoring depends highly on the application, the use of formal scoring - metrics has high value in identifying and prioritizing anomalies, and in presenting an overall picture of the state of the test program. In this paper we present a case study based on automatic generation and assessment of faulted test runs for the Dawn mission, and discuss its role in optimizing the allocation of resources for completing the test program.

Hyperparameterization of soil moisture statistical models for North America with Ensemble Learning Models (Elm)

NASA Astrophysics Data System (ADS)

Steinberg, P. D.; Brener, G.; Duffy, D.; Nearing, G. S.; Pelissier, C.

2017-12-01

Hyperparameterization, of statistical models, i.e. automated model scoring and selection, such as evolutionary algorithms, grid searches, and randomized searches, can improve forecast model skill by reducing errors associated with model parameterization, model structure, and statistical properties of training data. Ensemble Learning Models (Elm), and the related Earthio package, provide a flexible interface for automating the selection of parameters and model structure for machine learning models common in climate science and land cover classification, offering convenient tools for loading NetCDF, HDF, Grib, or GeoTiff files, decomposition methods like PCA and manifold learning, and parallel training and prediction with unsupervised and supervised classification, clustering, and regression estimators. Continuum Analytics is using Elm to experiment with statistical soil moisture forecasting based on meteorological forcing data from NASA's North American Land Data Assimilation System (NLDAS). There Elm is using the NSGA-2 multiobjective optimization algorithm for optimizing statistical preprocessing of forcing data to improve goodness-of-fit for statistical models (i.e. feature engineering). This presentation will discuss Elm and its components, including dask (distributed task scheduling), xarray (data structures for n-dimensional arrays), and scikit-learn (statistical preprocessing, clustering, classification, regression), and it will show how NSGA-2 is being used for automate selection of soil moisture forecast statistical models for North America.

Comparing algorithms for automated vessel segmentation in computed tomography scans of the lung: the VESSEL12 study

PubMed Central

Rudyanto, Rina D.; Kerkstra, Sjoerd; van Rikxoort, Eva M.; Fetita, Catalin; Brillet, Pierre-Yves; Lefevre, Christophe; Xue, Wenzhe; Zhu, Xiangjun; Liang, Jianming; Öksüz, İlkay; Ünay, Devrim; Kadipaşaogandcaron;lu, Kamuran; Estépar, Raúl San José; Ross, James C.; Washko, George R.; Prieto, Juan-Carlos; Hoyos, Marcela Hernández; Orkisz, Maciej; Meine, Hans; Hüllebrand, Markus; Stöcker, Christina; Mir, Fernando Lopez; Naranjo, Valery; Villanueva, Eliseo; Staring, Marius; Xiao, Changyan; Stoel, Berend C.; Fabijanska, Anna; Smistad, Erik; Elster, Anne C.; Lindseth, Frank; Foruzan, Amir Hossein; Kiros, Ryan; Popuri, Karteek; Cobzas, Dana; Jimenez-Carretero, Daniel; Santos, Andres; Ledesma-Carbayo, Maria J.; Helmberger, Michael; Urschler, Martin; Pienn, Michael; Bosboom, Dennis G.H.; Campo, Arantza; Prokop, Mathias; de Jong, Pim A.; Ortiz-de-Solorzano, Carlos; Muñoz-Barrutia, Arrate; van Ginneken, Bram

2016-01-01

The VESSEL12 (VESsel SEgmentation in the Lung) challenge objectively compares the performance of different algorithms to identify vessels in thoracic computed tomography (CT) scans. Vessel segmentation is fundamental in computer aided processing of data generated by 3D imaging modalities. As manual vessel segmentation is prohibitively time consuming, any real world application requires some form of automation. Several approaches exist for automated vessel segmentation, but judging their relative merits is difficult due to a lack of standardized evaluation. We present an annotated reference dataset containing 20 CT scans and propose nine categories to perform a comprehensive evaluation of vessel segmentation algorithms from both academia and industry. Twenty algorithms participated in the VESSEL12 challenge, held at International Symposium on Biomedical Imaging (ISBI) 2012. All results have been published at the VESSEL12 website http://vessel12.grand-challenge.org. The challenge remains ongoing and open to new participants. Our three contributions are: (1) an annotated reference dataset available online for evaluation of new algorithms; (2) a quantitative scoring system for objective comparison of algorithms; and (3) performance analysis of the strengths and weaknesses of the various vessel segmentation methods in the presence of various lung diseases. PMID:25113321

Identifying UMLS concepts from ECG Impressions using KnowledgeMap

PubMed Central

Denny, Joshua C.; Spickard, Anderson; Miller, Randolph A; Schildcrout, Jonathan; Darbar, Dawood; Rosenbloom, S. Trent; Peterson, Josh F.

2005-01-01

Electrocardiogram (ECG) impressions represent a wealth of medical information for potential decision support and drug-effect discovery. Much of this information is inaccessible to automated methods in the free-text portion of the ECG report. We studied the application of the KnowledgeMap concept identifier (KMCI) to map Unified Medical Language System (UMLS) concepts from ECG impressions. ECGs were processed by KMCI and the results scored for accuracy by multiple raters. Reviewers also recorded unidentified concepts through the scoring interface. Overall, KMCI correctly identified 1059 out of 1171 concepts for a recall of 0.90. Precision, indicating the proportion of ECG concepts correctly identified, was 0.94. KMCI was particularly effective at identifying ECG rhythms (330/333), perfusion changes (65/66), and noncardiac medical concepts (11/11). In conclusion, KMCI is an effective method for mapping ECG impressions to UMLS concepts. PMID:16779029

Semantic Analysis of Email Using Domain Ontologies and WordNet

NASA Technical Reports Server (NTRS)

Berrios, Daniel C.; Keller, Richard M.

2005-01-01

The problem of capturing and accessing knowledge in paper form has been supplanted by a problem of providing structure to vast amounts of electronic information. Systems that can construct semantic links for natural language documents like email messages automatically will be a crucial element of semantic email tools. We have designed an information extraction process that can leverage the knowledge already contained in an existing semantic web, recognizing references in email to existing nodes in a network of ontology instances by using linguistic knowledge and knowledge of the structure of the semantic web. We developed a heuristic score that uses several forms of evidence to detect references in email to existing nodes in the Semanticorganizer repository's network. While these scores cannot directly support automated probabilistic inference, they can be used to rank nodes by relevance and link those deemed most relevant to email messages.

HT-COMET: a novel automated approach for high throughput assessment of human sperm chromatin quality

PubMed Central

Albert, Océane; Reintsch, Wolfgang E.; Chan, Peter; Robaire, Bernard

2016-01-01

STUDY QUESTION Can we make the comet assay (single-cell gel electrophoresis) for human sperm a more accurate and informative high throughput assay? SUMMARY ANSWER We developed a standardized automated high throughput comet (HT-COMET) assay for human sperm that improves its accuracy and efficiency, and could be of prognostic value to patients in the fertility clinic. WHAT IS KNOWN ALREADY The comet assay involves the collection of data on sperm DNA damage at the level of the single cell, allowing the use of samples from severe oligozoospermic patients. However, this makes comet scoring a low throughput procedure that renders large cohort analyses tedious. Furthermore, the comet assay comes with an inherent vulnerability to variability. Our objective is to develop an automated high throughput comet assay for human sperm that will increase both its accuracy and efficiency. STUDY DESIGN, SIZE, DURATION The study comprised two distinct components: a HT-COMET technical optimization section based on control versus DNAse treatment analyses (n = 3–5), and a cross-sectional study on 123 men presenting to a reproductive center with sperm concentrations categorized as severe oligozoospermia, oligozoospermia or normozoospermia. PARTICIPANTS/MATERIALS, SETTING, METHODS Sperm chromatin quality was measured using the comet assay: on classic 2-well slides for software comparison; on 96-well slides for HT-COMET optimization; after exposure to various concentrations of a damage-inducing agent, DNAse, using HT-COMET; on 123 subjects with different sperm concentrations using HT-COMET. Data from the 123 subjects were correlated to classic semen quality parameters and plotted as single-cell data in individual DNA damage profiles. MAIN RESULTS AND THE ROLE OF CHANCE We have developed a standard automated HT-COMET procedure for human sperm. It includes automated scoring of comets by a fully integrated high content screening setup that compares well with the most commonly used semi-manual analysis software. Using this method, a cross-sectional study on 123 men showed no significant correlation between sperm concentration and sperm DNA damage, confirming the existence of hidden chromatin damage in men with apparently normal semen characteristics, and a significant correlation between percentage DNA in the tail and percentage of progressively motile spermatozoa. Finally, the use of DNA damage profiles helped to distinguish subjects between and within sperm concentration categories, and allowed a determination of the proportion of highly damaged cells. LIMITATIONS, REASONS FOR CAUTION The main limitations of the HT-COMET are the high, yet indispensable, investment in an automated liquid handling system and heating block to ensure accuracy, and the availability of an automated plate reading microscope and analysis software. WIDER IMPLICATIONS OF THE FINDINGS This standardized HT-COMET assay offers many advantages, including higher accuracy and evenness due to automation of sensitive steps, a 14.4-fold increase in sample analysis capacity, and an imaging and scoring time of 1 min/well. Overall, HT-COMET offers a decrease in total experimental time of more than 90%. Hence, this assay constitutes a more efficient option to assess sperm chromatin quality, paves the way to using this assay to screen large cohorts, and holds prognostic value for infertile patients. STUDY FUNDING/COMPETING INTEREST(S) Funded by the CIHR Institute of Human Development, Child and Youth Health (IHDCYH; RHF 100625). O.A. is a fellow supported by the Fonds de la Recherche du Québec - Santé (FRQS) and the CIHR Training Program in Reproduction, Early Development, and the Impact on Health (REDIH). B.R. is a James McGill Professor. The authors declare no conflicts of interest. PMID:26975326

Understanding the Effect of Workload on Automation Use for Younger and Older Adults

PubMed Central

McBride, Sara E.; Rogers, Wendy A.; Fisk, Arthur D.

2018-01-01

Objective This study examined how individuals, younger and older, interacted with an imperfect automated system. The impact of workload on performance and automation use was also investigated. Background Automation is used in situations characterized by varying levels of workload. As automated systems spread to domains such as transportation and the home, a diverse population of users will interact with automation. Research is needed to understand how different segments of the population use automation. Method Workload was systematically manipulated to create three levels (low, moderate, high) in a dual-task scenario in which participants interacted with a 70% reliable automated aid. Two experiments were conducted to assess automation use for younger and older adults. Results Both younger and older adults relied on the automation more than they complied with it. Among younger adults, high workload led to poorer performance and higher compliance, even when that compliance was detrimental. Older adults’ performance was negatively affected by workload, but their compliance and reliance were unaffected. Conclusion Younger and older adults were both able to use and double-check an imperfect automated system. Workload affected how younger adults complied with automation, particularly with regard to detecting automation false alarms. Older adults tended to comply and rely at fairly high rates overall, and this did not change with increased workload. Application Training programs for imperfect automated systems should vary workload and provide feedback about error types, and strategies for identifying errors. The ability to identify automation errors varies across individuals, thereby necessitating training. PMID:22235529

Understanding the effect of workload on automation use for younger and older adults.

PubMed

McBride, Sara E; Rogers, Wendy A; Fisk, Arthur D

2011-12-01

This study examined how individuals, younger and older, interacted with an imperfect automated system. The impact of workload on performance and automation use was also investigated. Automation is used in situations characterized by varying levels of workload. As automated systems spread to domains such as transportation and the home, a diverse population of users will interact with automation. Research is needed to understand how different segments of the population use automation. Workload was systematically manipulated to create three levels (low, moderate, high) in a dual-task scenario in which participants interacted with a 70% reliable automated aid. Two experiments were conducted to assess automation use for younger and older adults. Both younger and older adults relied on the automation more than they complied with it. Among younger adults, high workload led to poorer performance and higher compliance, even when that compliance was detrimental. Older adults' performance was negatively affected by workload, but their compliance and reliance were unaffected. Younger and older adults were both able to use and double-check an imperfect automated system. Workload affected how younger adults complied with automation, particularly with regard to detecting automation false alarms. Older adults tended to comply and rely at fairly high rates overall, and this did not change with increased workload. Training programs for imperfect automated systems should vary workload and provide feedback about error types, and strategies for identifying errors. The ability to identify automation errors varies across individuals, thereby necessitating training.

The historical development and basis of human factors guidelines for automated systems in aeronautical operations

NASA Technical Reports Server (NTRS)

Ciciora, J. A.; Leonard, S. D.; Johnson, N.; Amell, J.

1984-01-01

In order to derive general design guidelines for automated systems a study was conducted on the utilization and acceptance of existing automated systems as currently employed in several commercial fields. Four principal study area were investigated by means of structured interviews, and in some cases questionnaires. The study areas were aviation, a both scheduled airline and general commercial aviation; process control and factory applications; office automation; and automation in the power industry. The results of over eighty structured interviews were analyzed and responses categoried as various human factors issues for use by both designers and users of automated equipment. These guidelines address such items as general physical features of automated equipment; personnel orientation, acceptance, and training; and both personnel and system reliability.

NICE guidance on sepsis is of limited value in postoperative colorectal patients: the scores that cry 'wolf!'

PubMed

Herrod, Pjj; Cox, M; Keevil, H; Smith, Kje; Lund, J N

2018-04-01

Background and aims Late recognition of sepsis and consequent death remains a problem. To address this, the National Institute for Health and Care Excellence has published updated guidance recommending the use of the Quick Sequential Organ Failure Assessment (Q-SOFA) score when assessing patients at risk of sepsis following the publication of the Third International Consensus Definitions for Sepsis and Septic Shock. The trauma from major surgery produces a systemic inflammatory response syndrome (SIRS) postoperatively as part of its natural history, which may falsely trigger scoring systems. We aimed to assess the accuracy of Q-SOFA and SIRS criteria as recommended scores for early detection of sepsis and septic complications in the first 48hrs after colorectal cancer surgery. Methods We reviewed all elective major colorectal operations in a single centre during a 12-month period from prospectively maintained electronic records. Results One hundred and thirty nine patients were included in this study. In all, 29 patients developed postoperative infective complications in hospital. Nineteen patients triggered on SIRS without developing infective complications, while 42 patients triggered on Q-SOFA with no infective complications. The area under the ROC curve was 0.52 for Q-SOFA and 0.67 for SIRS. Discussion Q-SOFA appears to perform little better than a coin toss at identifying postoperative sepsis after colorectal cancer resection and is inferior to the SIRS criteria. More work is required to assess whether a combination of scoring criteria, biochemical markers and automated tools could increase accurate detection of postoperative infection and trigger early intervention.

Potential of Laboratory Execution Systems (LESs) to Simplify the Application of Business Process Management Systems (BPMSs) in Laboratory Automation.

PubMed

Neubert, Sebastian; Göde, Bernd; Gu, Xiangyu; Stoll, Norbert; Thurow, Kerstin

2017-04-01

Modern business process management (BPM) is increasingly interesting for laboratory automation. End-to-end workflow automation and improved top-level systems integration for information technology (IT) and automation systems are especially prominent objectives. With the ISO Standard Business Process Model and Notation (BPMN) 2.X, a system-independent and interdisciplinary accepted graphical process control notation is provided, allowing process analysis, while also being executable. The transfer of BPM solutions to structured laboratory automation places novel demands, for example, concerning the real-time-critical process and systems integration. The article discusses the potential of laboratory execution systems (LESs) for an easier implementation of the business process management system (BPMS) in hierarchical laboratory automation. In particular, complex application scenarios, including long process chains based on, for example, several distributed automation islands and mobile laboratory robots for a material transport, are difficult to handle in BPMSs. The presented approach deals with the displacement of workflow control tasks into life science specialized LESs, the reduction of numerous different interfaces between BPMSs and subsystems, and the simplification of complex process modelings. Thus, the integration effort for complex laboratory workflows can be significantly reduced for strictly structured automation solutions. An example application, consisting of a mixture of manual and automated subprocesses, is demonstrated by the presented BPMS-LES approach.

Department of Defense (DOD) Automated Biometric Identification System (ABIS) Version 1.2: Initial Operational Test and Evaluation Report

DTIC Science & Technology

2015-05-01

Director, Operational Test and Evaluation Department of Defense (DOD) Automated Biometric Identification System (ABIS) Version 1.2 Initial...Operational Test and Evaluation Report May 2015 This report on the Department of Defense (DOD) Automated Biometric Identification System...COVERED - 4. TITLE AND SUBTITLE Department of Defense (DOD) Automated Biometric Identification System (ABIS) Version 1.2 Initial Operational Test

Effect of Environmental Enrichment on Aggression in BALB/cJ and BALB/cByJ Mice Monitored by Using an Automated System.

PubMed

Giles, Jareca M; Whitaker, Julia W; Moy, Sheryl S; Fletcher, Craig A

2018-04-18

Aggression among mice remains a common undesirable problem in laboratory settings, and animal welfare and scientific outcomes may become compromised depending on the severity of aggression. This study evaluated the effect of cage enrichment comprising a bilevel, mounted 'mezzanine' compared with a cotton square or shelter on intracage male aggression over a 6-wk period. Our first study involved home-cage behavioral challenges to male mice from a high aggression substrain (BALB/cJ) and low-aggression substrain (BALB/cByJ). Aggressive interactions and locomotor activity were scored manually and then compared with measures of activity obtained by using a continuous automated home-cagemonitoring system, the Digital Ventilated Caging (DVC) system. BALB/cJ mice exhibited similar levels of aggression acrosshousing conditions, whereas BALB/cByJ mice had lower aggression when housed with a mezzanine. In the second study,videorecordings and continuous DVC automated measures were collected over 24 h and divided into 12-h light and dark phases. BALB/cByJ mice-but not BALB/cJ-mice had increased aggressive behaviors during the dark phase. However, the DVC detected higher activity levels during the dark phase, compared with the light phase, in both substrains. Elevated activity levels recorded by the DVC correlated with fighting bouts and high levels of locomotion. These results show that a bilevel structural form of enrichment reduces aggression, depending on the BALB/c substrain, and confirms higher aggression levels in the BALB/cJ substrain. In addition, our findings provide evidence that the DVC is effective in identifying mouse cages with patterns of high activity levels, signaling possible aggression incidences, thus potentially allowing for early intervention and consequently improving animal welfare.

Immunohistochemical Expression of Matrix Metalloproteinase-7 in Human Colorectal Adenomas Using Specified Automated Cellular Image Analysis System: A Clinicopathological Study

PubMed Central

Qasim, Ban J.; Ali, Hussam H.; Hussein, Alaa G.

2013-01-01

Background/Aim: To evaluate the immunohistochemical expression of matrix metalloproteinase-7 (MMP-7) in colorectal adenomas, and to correlate this expression with different clinicopathological parameters. Patients and Methods: The study was retrospectively designed. Thirty three paraffin blocks from patients with colorectal adenoma and 20 samples of non-tumerous colonic tissue taken as control group were included in the study. MMP-7 expression was assessed by immunohistochemistry method. The scoring of immunohistochemical staining was conducted utilizing a specified automated cellular image analysis system (Digimizer). Results: The frequency of positive immunohistochemical expression of MMP-7 was significantly higher in adenoma than control group (45.45% versus 10%) (P value < 0.001). Strong MMP-7 staining was mainly seen in adenoma cases (30.30%) in comparison with control (0%) the difference is significant (P < 0.001). The three digital parameters of MMP-7 immunohistochemical expression (Area (A), Number of objects (N), and intensity (I)) were significantly higher in adenoma than control. Mean (A and I) of MMP-7 showed a significant correlation with large sized adenoma (≥ 1cm) (P < 0.05), also a significant positive correlation of the three digital parameters (A, N, and I) of MMP-7 expression with villous configuration and severe dysplasia in colorectal adenoma had been identified (P < 0.05). Conclusion: MMP-7 plays an important role in the growth and malignant conversion of colorectal adenomas as it is more likely to be expressed in advanced colorectal adenomatous polyps with large size, severe dysplasia and villous histology. The use of automated cellular image analysis system (Digmizer) to quantify immunohistochemical staining yields more consistent assay results, converts semi-quantitative assay to a truly quantitative assay, and improves assay objectivity and reproducibility. PMID:23319034

A Comparison of a Brain-Based Adaptive System and a Manual Adaptable System for Invoking Automation

NASA Technical Reports Server (NTRS)

Bailey, Nathan R.; Scerbo, Mark W.; Freeman, Frederick G.; Mikulka, Peter J.; Scott, Lorissa A.

2004-01-01

Two experiments are presented that examine alternative methods for invoking automation. In each experiment, participants were asked to perform simultaneously a monitoring task and a resource management task as well as a tracking task that changed between automatic and manual modes. The monitoring task required participants to detect failures of an automated system to correct aberrant conditions under either high or low system reliability. Performance on each task was assessed as well as situation awareness and subjective workload. In the first experiment, half of the participants worked with a brain-based system that used their EEG signals to switch the tracking task between automatic and manual modes. The remaining participants were yoked to participants from the adaptive condition and received the same schedule of mode switches, but their EEG had no effect on the automation. Within each group, half of the participants were assigned to either the low or high reliability monitoring task. In addition, within each combination of automation invocation and system reliability, participants were separated into high and low complacency potential groups. The results revealed no significant effects of automation invocation on the performance measures; however, the high complacency individuals demonstrated better situation awareness when working with the adaptive automation system. The second experiment was the same as the first with one important exception. Automation was invoked manually. Thus, half of the participants pressed a button to invoke automation for 10 s. The remaining participants were yoked to participants from the adaptable condition and received the same schedule of mode switches, but they had no control over the automation. The results showed that participants who could invoke automation performed more poorly on the resource management task and reported higher levels of subjective workload. Further, those who invoked automation more frequently performed more poorly on the tracking task and reported higher levels of subjective workload. and the adaptable condition in the second experiment revealed only one significant difference: the subjective workload was higher in the adaptable condition. Overall, the results show that a brain-based, adaptive automation system may facilitate situation awareness for those individuals who are more complacent toward automation. By contrast, requiring operators to invoke automation manually may have some detrimental impact on performance but does appear to increases subjective workload relative to an adaptive system.

Impact of the introduction of an automated microbiologic system on the clinical outcomes of bloodstream infections caused by Enterobacteriaceae strains.

PubMed

Callefi, Luciana Azevedo; Medeiros, Eduardo Alexandrino Servolo de; Furtado, Guilherme Henrique Campos

2013-01-01

Enterobacteriaceae strains are a leading cause of bloodstream infections (BSI). The aim of this study is to assess differences in clinical outcomes of patients with BSI caused by Enterobacteriaceae strains before and after introduction of an automated microbiologic system by the microbiology laboratory. We conducted a retrospective cohort study aimed to evaluate the impact of the introduction of an automated microbiologic system (Phoenix(tm) automated microbiology system, Becton, Dickinson and Company (BD) - Diagnostic Systems, Sparks, MD, USA) on the outcomes of BSIs caused by Enterobacteriaceae strains. The study was undertaken at Hospital São Paulo, a 750-bed teaching hospital in São Paulo, Brazil. Patients with BSI caused by Enterobacteriaceae strains before the introduction of the automated system were compared with patients with BSI caused by the same pathogens after the introduction of the automated system with regard to treatment adequacy, clinical cure/improvement and 14- and 28-day mortality rates. We evaluated 90 and 106 patients in the non-automated and automated testing periods, respectively. The most prevalent species in both periods were Klebsiella spp. and Proteus spp. Clinical cure/improvement occurred in 70% and 67.9% in non-automated and automated period, respectively (p = 0.75). 14-day mortality rates were 22.2% and 30% (p = 0.94) and 28-day mortality rates were 24.5% and 40.5% (p = 0.12). There were no significant differences between the two testing periods with regard to treatment adequacy, clinical cure/improvement and 14- and 28-day mortality rates. Introduction of the BD Phoenix(tm) automated microbiology system did not impact the clinical outcomes of BSIs caused by Enterobacteriaceae strains in our setting.

Towards a characterization of information automation systems on the flight deck

NASA Astrophysics Data System (ADS)

Dudley, Rachel Feddersen

This thesis summarizes research to investigate the characteristics that define information automation systems used on aircraft flight decks and the significant impacts that these characteristics have on pilot performance. Major accomplishments of the work include the development of a set of characteristics that describe information automation systems on the flight deck and an experiment designed to study a subset of these characteristics. Information automation systems on the flight deck are responsible for the collection, processing, analysis, and presentation of data to the flightcrew. These systems pose human factors issues and challenges that must be considered by designers of these systems. Based on a previously developed formal definition of information automation for aircraft flight deck systems, an analysis process was developed and conducted to reach a refined set of information automation characteristics. In this work, characteristics are defined as a set of properties or attributes that describe an information automation system's operation or behavior, which can be used to identify and assess potential human factors issues. Hypotheses were formed for a subset of the characteristics: Automation Visibility, Information Quality, and Display Complexity. An experimental investigation was developed to measure performance impacts related to these characteristics, which showed mixed results of expected and surprising findings, with many interactions. A set of recommendations were then developed based on the experimental observations. Ensuring that the right information is presented to pilots at the right time and in the appropriate manner is the job of flight deck system designers. This work provides a foundation for developing recommendations and guidelines specific to information automation on the flight deck with the goal of improving the design and evaluation of information automation systems before they are implemented.

Community pharmacies automation: any impact on counselling duration and job satisfaction?

PubMed

Cavaco, Afonso Miguel; Krookas, Anette Aaland

2014-04-01

One key indicator of the quality of health practitioners-patient interaction is the encounters' duration. Automation have been presented as beneficial to pharmacy staff work with patients and thus with a potential impact on pharmacists' and technicians' job satisfaction. To compare the interaction length between pharmacy staff and patients, as well as their job satisfaction, in community pharmacies with and without automation. Portuguese community pharmacies with and without automation. This cross-sectional study followed a quasi-experimental design, divided in two phases. In the first, paired community pharmacies with and without automation were purposively selected for a non-participant overt observation. The second phase comprised a job satisfaction questionnaire of both pharmacists and technical staff. Practitioners and patients demographic and interactional data, as well as job satisfaction, were statistically compared across automation. Interaction length and job satisfaction. Sixty-eight practitioners from 10 automated and non-automated pharmacies produced 721 registered interaction episodes. Automation had no significant influence in interaction duration, controlling for gender and professional categories, being significantly longer with older patients (p = 0.017). On average, staff working at the pharmacy counter had 45 % of free time from direct patient contact. The mean overall satisfaction in this sample was 5.52 (SD = 0.98) out of a maximum score of seven, with no significant differences with automation as well as between professional categories, only with a significant lower job satisfaction for younger pharmacists. As with previous studies in other settings, duration of the interactions was not influenced by pharmacy automation, as well as practitioners' job satisfaction, while practitioners' time constrains seem to be a subjective perception.

An Automated Method for High-Throughput Screening of Arabidopsis Rosette Growth in Multi-Well Plates and Its Validation in Stress Conditions.

PubMed

De Diego, Nuria; Fürst, Tomáš; Humplík, Jan F; Ugena, Lydia; Podlešáková, Kateřina; Spíchal, Lukáš

2017-01-01

High-throughput plant phenotyping platforms provide new possibilities for automated, fast scoring of several plant growth and development traits, followed over time using non-invasive sensors. Using Arabidops is as a model offers important advantages for high-throughput screening with the opportunity to extrapolate the results obtained to other crops of commercial interest. In this study we describe the development of a highly reproducible high-throughput Arabidopsis in vitro bioassay established using our OloPhen platform, suitable for analysis of rosette growth in multi-well plates. This method was successfully validated on example of multivariate analysis of Arabidopsis rosette growth in different salt concentrations and the interaction with varying nutritional composition of the growth medium. Several traits such as changes in the rosette area, relative growth rate, survival rate and homogeneity of the population are scored using fully automated RGB imaging and subsequent image analysis. The assay can be used for fast screening of the biological activity of chemical libraries, phenotypes of transgenic or recombinant inbred lines, or to search for potential quantitative trait loci. It is especially valuable for selecting genotypes or growth conditions that improve plant stress tolerance.

Quantification of Pulmonary Fibrosis in a Bleomycin Mouse Model Using Automated Histological Image Analysis.

PubMed

Gilhodes, Jean-Claude; Julé, Yvon; Kreuz, Sebastian; Stierstorfer, Birgit; Stiller, Detlef; Wollin, Lutz

2017-01-01

Current literature on pulmonary fibrosis induced in animal models highlights the need of an accurate, reliable and reproducible histological quantitative analysis. One of the major limits of histological scoring concerns the fact that it is observer-dependent and consequently subject to variability, which may preclude comparative studies between different laboratories. To achieve a reliable and observer-independent quantification of lung fibrosis we developed an automated software histological image analysis performed from digital image of entire lung sections. This automated analysis was compared to standard evaluation methods with regard to its validation as an end-point measure of fibrosis. Lung fibrosis was induced in mice by intratracheal administration of bleomycin (BLM) at 0.25, 0.5, 0.75 and 1 mg/kg. A detailed characterization of BLM-induced fibrosis was performed 14 days after BLM administration using lung function testing, micro-computed tomography and Ashcroft scoring analysis. Quantification of fibrosis by automated analysis was assessed based on pulmonary tissue density measured from thousands of micro-tiles processed from digital images of entire lung sections. Prior to analysis, large bronchi and vessels were manually excluded from the original images. Measurement of fibrosis has been expressed by two indexes: the mean pulmonary tissue density and the high pulmonary tissue density frequency. We showed that tissue density indexes gave access to a very accurate and reliable quantification of morphological changes induced by BLM even for the lowest concentration used (0.25 mg/kg). A reconstructed 2D-image of the entire lung section at high resolution (3.6 μm/pixel) has been performed from tissue density values allowing the visualization of their distribution throughout fibrotic and non-fibrotic regions. A significant correlation (p<0.0001) was found between automated analysis and the above standard evaluation methods. This correlation establishes automated analysis as a novel end-point measure of BLM-induced lung fibrosis in mice, which will be very valuable for future preclinical drug explorations.

Quantification of Pulmonary Fibrosis in a Bleomycin Mouse Model Using Automated Histological Image Analysis

PubMed Central

Gilhodes, Jean-Claude; Kreuz, Sebastian; Stierstorfer, Birgit; Stiller, Detlef; Wollin, Lutz

2017-01-01

Current literature on pulmonary fibrosis induced in animal models highlights the need of an accurate, reliable and reproducible histological quantitative analysis. One of the major limits of histological scoring concerns the fact that it is observer-dependent and consequently subject to variability, which may preclude comparative studies between different laboratories. To achieve a reliable and observer-independent quantification of lung fibrosis we developed an automated software histological image analysis performed from digital image of entire lung sections. This automated analysis was compared to standard evaluation methods with regard to its validation as an end-point measure of fibrosis. Lung fibrosis was induced in mice by intratracheal administration of bleomycin (BLM) at 0.25, 0.5, 0.75 and 1 mg/kg. A detailed characterization of BLM-induced fibrosis was performed 14 days after BLM administration using lung function testing, micro-computed tomography and Ashcroft scoring analysis. Quantification of fibrosis by automated analysis was assessed based on pulmonary tissue density measured from thousands of micro-tiles processed from digital images of entire lung sections. Prior to analysis, large bronchi and vessels were manually excluded from the original images. Measurement of fibrosis has been expressed by two indexes: the mean pulmonary tissue density and the high pulmonary tissue density frequency. We showed that tissue density indexes gave access to a very accurate and reliable quantification of morphological changes induced by BLM even for the lowest concentration used (0.25 mg/kg). A reconstructed 2D-image of the entire lung section at high resolution (3.6 μm/pixel) has been performed from tissue density values allowing the visualization of their distribution throughout fibrotic and non-fibrotic regions. A significant correlation (p<0.0001) was found between automated analysis and the above standard evaluation methods. This correlation establishes automated analysis as a novel end-point measure of BLM-induced lung fibrosis in mice, which will be very valuable for future preclinical drug explorations. PMID:28107543

Reliability of Semi-Automated Segmentations in Glioblastoma.

PubMed

Huber, T; Alber, G; Bette, S; Boeckh-Behrens, T; Gempt, J; Ringel, F; Alberts, E; Zimmer, C; Bauer, J S

2017-06-01

In glioblastoma, quantitative volumetric measurements of contrast-enhancing or fluid-attenuated inversion recovery (FLAIR) hyperintense tumor compartments are needed for an objective assessment of therapy response. The aim of this study was to evaluate the reliability of a semi-automated, region-growing segmentation tool for determining tumor volume in patients with glioblastoma among different users of the software. A total of 320 segmentations of tumor-associated FLAIR changes and contrast-enhancing tumor tissue were performed by different raters (neuroradiologists, medical students, and volunteers). All patients underwent high-resolution magnetic resonance imaging including a 3D-FLAIR and a 3D-MPRage sequence. Segmentations were done using a semi-automated, region-growing segmentation tool. Intra- and inter-rater-reliability were addressed by intra-class-correlation (ICC). Root-mean-square error (RMSE) was used to determine the precision error. Dice score was calculated to measure the overlap between segmentations. Semi-automated segmentation showed a high ICC (> 0.985) for all groups indicating an excellent intra- and inter-rater-reliability. Significant smaller precision errors and higher Dice scores were observed for FLAIR segmentations compared with segmentations of contrast-enhancement. Single rater segmentations showed the lowest RMSE for FLAIR of 3.3 % (MPRage: 8.2 %). Both, single raters and neuroradiologists had the lowest precision error for longitudinal evaluation of FLAIR changes. Semi-automated volumetry of glioblastoma was reliably performed by all groups of raters, even without neuroradiologic expertise. Interestingly, segmentations of tumor-associated FLAIR changes were more reliable than segmentations of contrast enhancement. In longitudinal evaluations, an experienced rater can detect progressive FLAIR changes of less than 15 % reliably in a quantitative way which could help to detect progressive disease earlier.

Comparison of subjective and fully automated methods for measuring mammographic density.

PubMed

Moshina, Nataliia; Roman, Marta; Sebuødegård, Sofie; Waade, Gunvor G; Ursin, Giske; Hofvind, Solveig

2018-02-01

Background Breast radiologists of the Norwegian Breast Cancer Screening Program subjectively classified mammographic density using a three-point scale between 1996 and 2012 and changed into the fourth edition of the BI-RADS classification since 2013. In 2015, an automated volumetric breast density assessment software was installed at two screening units. Purpose To compare volumetric breast density measurements from the automated method with two subjective methods: the three-point scale and the BI-RADS density classification. Material and Methods Information on subjective and automated density assessment was obtained from screening examinations of 3635 women recalled for further assessment due to positive screening mammography between 2007 and 2015. The score of the three-point scale (I = fatty; II = medium dense; III = dense) was available for 2310 women. The BI-RADS density score was provided for 1325 women. Mean volumetric breast density was estimated for each category of the subjective classifications. The automated software assigned volumetric breast density to four categories. The agreement between BI-RADS and volumetric breast density categories was assessed using weighted kappa (k w ). Results Mean volumetric breast density was 4.5%, 7.5%, and 13.4% for categories I, II, and III of the three-point scale, respectively, and 4.4%, 7.5%, 9.9%, and 13.9% for the BI-RADS density categories, respectively ( P for trend < 0.001 for both subjective classifications). The agreement between BI-RADS and volumetric breast density categories was k w  = 0.5 (95% CI = 0.47-0.53; P < 0.001). Conclusion Mean values of volumetric breast density increased with increasing density category of the subjective classifications. The agreement between BI-RADS and volumetric breast density categories was moderate.

Advances toward fully automated in vivo assessment of oral epithelial dysplasia by nuclear endomicroscopy-A pilot study.

PubMed

Liese, Jan; Winter, Karsten; Glass, Änne; Bertolini, Julia; Kämmerer, Peer Wolfgang; Frerich, Bernhard; Schiefke, Ingolf; Remmerbach, Torsten W

2017-11-01

Uncertainties in detection of oral epithelial dysplasia (OED) frequently result from sampling error especially in inflammatory oral lesions. Endomicroscopy allows non-invasive, "en face" imaging of upper oral epithelium, but parameters of OED are unknown. Mucosal nuclei were imaged in 34 toluidine blue-stained oral lesions with a commercial endomicroscopy. Histopathological diagnosis showed four biopsies in "dys-/neoplastic," 23 in "inflammatory," and seven in "others" disease groups. Strength of different assessment strategies of nuclear scoring, nuclear count, and automated nuclear analysis were measured by area under ROC curve (AUC) to identify histopathological "dys-/neoplastic" group. Nuclear objects from automated image analysis were visually corrected. Best-performing parameters of nuclear-to-image ratios were the count of large nuclei (AUC=0.986) and 6-nearest neighborhood relation (AUC=0.896), and best parameters of nuclear polymorphism were the count of atypical nuclei (AUC=0.996) and compactness of nuclei (AUC=0.922). Excluding low-grade OED, nuclear scoring and count reached 100% sensitivity and 98% specificity for detection of dys-/neoplastic lesions. In automated analysis, combination of parameters enhanced diagnostic strength. Sensitivity of 100% and specificity of 87% were seen for distances of 6-nearest neighbors and aspect ratios even in uncorrected objects. Correction improved measures of nuclear polymorphism only. The hue of background color was stronger than nuclear density (AUC=0.779 vs 0.687) to detect dys-/neoplastic group indicating that macroscopic aspect is biased. Nuclear-to-image ratios are applicable for automated optical in vivo diagnostics for oral potentially malignant disorders. Nuclear endomicroscopy may promote non-invasive, early detection of dys-/neoplastic lesions by reducing sampling error. © 2017 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Intelligent Automation Approach for Improving Pilot Situational Awareness

NASA Technical Reports Server (NTRS)

Spirkovska, Lilly

2004-01-01

Automation in the aviation domain has been increasing for the past two decades. Pilot reaction to automation varies from highly favorable to highly critical depending on both the pilot's background and how effectively the automation is implemented. We describe a user-centered approach for automation that considers the pilot's tasks and his needs related to accomplishing those tasks. Further, we augment rather than replace how the pilot currently fulfills his goals, relying on redundant displays that offer the pilot an opportunity to build trust in the automation. Our prototype system automates the interpretation of hydraulic system faults of the UH-60 helicopter. We describe the problem with the current system and our methodology for resolving it.

45 CFR 310.15 - What are the safeguards and processes that comprehensive Tribal IV-D agencies must have in place...

Code of Federal Regulations, 2010 CFR

2010-10-01

... IV-D Systems and Office Automation? 310.15 Section 310.15 Public Welfare Regulations Relating to... AND OFFICE AUTOMATION Requirements for Computerized Tribal IV-D Systems and Office Automation § 310.15... ensure the security and privacy of Computerized Tribal IV-D Systems and Office Automation? (a...

Automation of Acquisition Records and Routine in the University Library, Newcastle upon Tyne

ERIC Educational Resources Information Center

Line, Maurice B.

2006-01-01

Purpose: Reports on the trial of an automated order routine for the University Library in Newcastle which began in April 1966. Design/methodology/approach: Presents the author's experiences of the manual order processing system, and the impetus for trialling an automated system. The stages of the automated system are described in detail. Findings:…

ATALARS Operational Requirements: Automated Tactical Aircraft Launch and Recovery System

DOT National Transportation Integrated Search

1988-04-01

The Automated Tactical Aircraft Launch and Recovery System (ATALARS) is a fully automated air traffic management system intended for the military service but is also fully compatible with civil air traffic control systems. This report documents a fir...

Prior Familiarization With Takeover Requests Affects Drivers' Takeover Performance and Automation Trust.

PubMed

Hergeth, Sebastian; Lorenz, Lutz; Krems, Josef F

2017-05-01

The objective for this study was to investigate the effects of prior familiarization with takeover requests (TORs) during conditional automated driving on drivers' initial takeover performance and automation trust. System-initiated TORs are one of the biggest concerns for conditional automated driving and have been studied extensively in the past. Most, but not all, of these studies have included training sessions to familiarize participants with TORs. This makes them hard to compare and might obscure first-failure-like effects on takeover performance and automation trust formation. A driving simulator study compared drivers' takeover performance in two takeover situations across four prior familiarization groups (no familiarization, description, experience, description and experience) and automation trust before and after experiencing the system. As hypothesized, prior familiarization with TORs had a more positive effect on takeover performance in the first than in a subsequent takeover situation. In all groups, automation trust increased after participants experienced the system. Participants who were given no prior familiarization with TORs reported highest automation trust both before and after experiencing the system. The current results extend earlier findings suggesting that prior familiarization with TORs during conditional automated driving will be most relevant for takeover performance in the first takeover situation and that it lowers drivers' automation trust. Potential applications of this research include different approaches to familiarize users with automated driving systems, better integration of earlier findings, and sophistication of experimental designs.

Automation--down to the nuts and bolts.

PubMed

Fix, R J; Rowe, J M; McConnell, B C

2000-01-01

Laboratories that once viewed automation as an expensive luxury are now looking to automation as a solution to increase sample throughput, to help ensure data integrity and to improve laboratory safety. The question is no longer, 'Should we automate?', but 'How should we approach automation?' A laboratory may choose from three approaches when deciding to automate: (1) contract with a third party vendor to produce a turnkey system, (2) develop and fabricate the system in-house or (3) some combination of approaches (1) and (2). The best approach for a given laboratory depends upon its available resources. The first lesson to be learned in automation is that no matter how straightforward an idea appears in the beginning, the solution will not be realized until many complex problems have been resolved. Issues dealing with sample vessel manipulation, liquid handling and system control must be addressed before a final design can be developed. This requires expertise in engineering, electronics, programming and chemistry. Therefore, the team concept of automation should be employed to help ensure success. This presentation discusses the advantages and disadvantages of the three approaches to automation. The development of an automated sample handling and control system for the STAR System focused microwave will be used to illustrate the complexities encountered in a seemingly simple project, and to highlight the importance of the team concept to automation no matter which approach is taken. The STAR System focused microwave from CEM Corporation is an open vessel digestion system with six microwave cells. This system is used to prepare samples for trace metal determination. The automated sample handling was developed around a XYZ motorized gantry system. Grippers were specially designed to perform several different functions and to provide feedback to the control software. Software was written in Visual Basic 5.0 to control the movement of the samples and the operation and monitoring of the STAR microwave. This software also provides a continuous update of the system's status to the computer screen. The system provides unattended preparation of up to 59 samples per run.

Evaluation of a pictograph enhancement system for patient instruction: a recall study.

PubMed

Zeng-Treitler, Qing; Perri, Seneca; Nakamura, Carlos; Kuang, Jinqiu; Hill, Brent; Bui, Duy Duc An; Stoddard, Gregory J; Bray, Bruce E

2014-01-01

We developed a novel computer application called Glyph that automatically converts text to sets of illustrations using natural language processing and computer graphics techniques to provide high quality pictographs for health communication. In this study, we evaluated the ability of the Glyph system to illustrate a set of actual patient instructions, and tested patient recall of the original and Glyph illustrated instructions. We used Glyph to illustrate 49 patient instructions representing 10 different discharge templates from the University of Utah Cardiology Service. 84 participants were recruited through convenience sampling. To test the recall of illustrated versus non-illustrated instructions, participants were asked to review and then recall a set questionnaires that contained five pictograph-enhanced and five non-pictograph-enhanced items. The mean score without pictographs was 0.47 (SD 0.23), or 47% recall. With pictographs, this mean score increased to 0.52 (SD 0.22), or 52% recall. In a multivariable mixed effects linear regression model, this 0.05 mean increase was statistically significant (95% CI 0.03 to 0.06, p<0.001). In our study, the presence of Glyph pictographs improved discharge instruction recall (p<0.001). Education, age, and English as first language were associated with better instruction recall and transcription. Automated illustration is a novel approach to improve the comprehension and recall of discharge instructions. Our results showed a statistically significant in recall with automated illustrations. Subjects with no-colleague education and younger subjects appeared to benefit more from the illustrations than others. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Assessing Students' Use of Evidence and Organization in Response-to-Text Writing: Using Natural Language Processing for Rubric-Based Automated Scoring

ERIC Educational Resources Information Center

Rahimi, Zahra; Litman, Diane; Correnti, Richard; Wang, Elaine; Matsumura, Lindsay Clare

2017-01-01

This paper presents an investigation of score prediction based on natural language processing for two targeted constructs within analytic text-based writing: 1) students' effective use of evidence and, 2) their organization of ideas and evidence in support of their claim. With the long-term goal of producing feedback for students and teachers, we…

Evaluation of 3D-Jury on CASP7 models.

PubMed

Kaján, László; Rychlewski, Leszek

2007-08-21

3D-Jury, the structure prediction consensus method publicly available in the Meta Server http://meta.bioinfo.pl/, was evaluated using models gathered in the 7th round of the Critical Assessment of Techniques for Protein Structure Prediction (CASP7). 3D-Jury is an automated expert process that generates protein structure meta-predictions from sets of models obtained from partner servers. The performance of 3D-Jury was analysed for three aspects. First, we examined the correlation between the 3D-Jury score and a model quality measure: the number of correctly predicted residues. The 3D-Jury score was shown to correlate significantly with the number of correctly predicted residues, the correlation is good enough to be used for prediction. 3D-Jury was also found to improve upon the competing servers' choice of the best structure model in most cases. The value of the 3D-Jury score as a generic reliability measure was also examined. We found that the 3D-Jury score separates bad models from good models better than the reliability score of the original server in 27 cases and falls short of it in only 5 cases out of a total of 38. We report the release of a new Meta Server feature: instant 3D-Jury scoring of uploaded user models. The 3D-Jury score continues to be a good indicator of structural model quality. It also provides a generic reliability score, especially important for models that were not assigned such by the original server. Individual structure modellers can also benefit from the 3D-Jury scoring system by testing their models in the new instant scoring feature http://meta.bioinfo.pl/compare_your_model_example.pl available in the Meta Server.

Evaluation of 3D-Jury on CASP7 models

PubMed Central

Kaján, László; Rychlewski, Leszek

2007-01-01

Background 3D-Jury, the structure prediction consensus method publicly available in the Meta Server , was evaluated using models gathered in the 7th round of the Critical Assessment of Techniques for Protein Structure Prediction (CASP7). 3D-Jury is an automated expert process that generates protein structure meta-predictions from sets of models obtained from partner servers. Results The performance of 3D-Jury was analysed for three aspects. First, we examined the correlation between the 3D-Jury score and a model quality measure: the number of correctly predicted residues. The 3D-Jury score was shown to correlate significantly with the number of correctly predicted residues, the correlation is good enough to be used for prediction. 3D-Jury was also found to improve upon the competing servers' choice of the best structure model in most cases. The value of the 3D-Jury score as a generic reliability measure was also examined. We found that the 3D-Jury score separates bad models from good models better than the reliability score of the original server in 27 cases and falls short of it in only 5 cases out of a total of 38. We report the release of a new Meta Server feature: instant 3D-Jury scoring of uploaded user models. Conclusion The 3D-Jury score continues to be a good indicator of structural model quality. It also provides a generic reliability score, especially important for models that were not assigned such by the original server. Individual structure modellers can also benefit from the 3D-Jury scoring system by testing their models in the new instant scoring feature available in the Meta Server. PMID:17711571

Remotely Piloted Aircraft Systems Panel (RPASP) Working Paper: Autonomy and Automation

NASA Technical Reports Server (NTRS)

Shively, Jay

2017-01-01

A significant level of debate and confusion has surrounded the meaning of the terms "autonomy" and "automation". Automation is a multi-dimensional concept, and we propose that RPAS automation should be described with reference to the specific system and task that has been automated, the context in which the automation functions, and other relevant dimensions. In this paper, we present a definition of "automation". We recommend that autonomy and autonomous operations are out of the scope of the RPAS panel. WG7 proposes to develop, in consultation with other workgroups, a taxonomy of "Levels of Automation" for RPAS.

Robotics for Nuclear Material Handling at LANL:Capabilities and Needs

DOE Office of Scientific and Technical Information (OSTI.GOV)

Harden, Troy A; Lloyd, Jane A; Turner, Cameron J

Nuclear material processing operations present numerous challenges for effective automation. Confined spaces, hazardous materials and processes, particulate contamination, radiation sources, and corrosive chemical operations are but a few of the significant hazards. However, automated systems represent a significant safety advance when deployed in place of manual tasks performed by human workers. The replacement of manual operations with automated systems has been desirable for nearly 40 years, yet only recently are automated systems becoming increasingly common for nuclear materials handling applications. This paper reviews several automation systems which are deployed or about to be deployed at Los Alamos National Laboratory formore » nuclear material handling operations. Highlighted are the current social and technological challenges faced in deploying automated systems into hazardous material handling environments and the opportunities for future innovations.« less

Understanding human management of automation errors

PubMed Central

McBride, Sara E.; Rogers, Wendy A.; Fisk, Arthur D.

2013-01-01

Automation has the potential to aid humans with a diverse set of tasks and support overall system performance. Automated systems are not always reliable, and when automation errs, humans must engage in error management, which is the process of detecting, understanding, and correcting errors. However, this process of error management in the context of human-automation interaction is not well understood. Therefore, we conducted a systematic review of the variables that contribute to error management. We examined relevant research in human-automation interaction and human error to identify critical automation, person, task, and emergent variables. We propose a framework for management of automation errors to incorporate and build upon previous models. Further, our analysis highlights variables that may be addressed through design and training to positively influence error management. Additional efforts to understand the error management process will contribute to automation designed and implemented to support safe and effective system performance. PMID:25383042

Understanding human management of automation errors.

PubMed

McBride, Sara E; Rogers, Wendy A; Fisk, Arthur D

2014-01-01

Automation has the potential to aid humans with a diverse set of tasks and support overall system performance. Automated systems are not always reliable, and when automation errs, humans must engage in error management, which is the process of detecting, understanding, and correcting errors. However, this process of error management in the context of human-automation interaction is not well understood. Therefore, we conducted a systematic review of the variables that contribute to error management. We examined relevant research in human-automation interaction and human error to identify critical automation, person, task, and emergent variables. We propose a framework for management of automation errors to incorporate and build upon previous models. Further, our analysis highlights variables that may be addressed through design and training to positively influence error management. Additional efforts to understand the error management process will contribute to automation designed and implemented to support safe and effective system performance.

Automated CPX support system preliminary design phase

NASA Technical Reports Server (NTRS)

Bordeaux, T. A.; Carson, E. T.; Hepburn, C. D.; Shinnick, F. M.

1984-01-01

The development of the Distributed Command and Control System (DCCS) is discussed. The development of an automated C2 system stimulated the development of an automated command post exercise (CPX) support system to provide a more realistic stimulus to DCCS than could be achieved with the existing manual system. An automated CPX system to support corps-level exercise was designed. The effort comprised four tasks: (1) collecting and documenting user requirements; (2) developing a preliminary system design; (3) defining a program plan; and (4) evaluating the suitability of the TRASANA FOURCE computer model.

System for Computer Automated Typesetting (SCAT) of Computer Authored Texts.

ERIC Educational Resources Information Center

Keeler, F. Laurence

This description of the System for Automated Typesetting (SCAT), an automated system for typesetting text and inserting special graphic symbols in programmed instructional materials created by the computer aided authoring system AUTHOR, provides an outline of the design architecture of the system and an overview including the component…

A technology-enabled adherence enhancement system for people with bipolar disorder: results from a feasibility and patient acceptance analysis

PubMed Central

Sajatovic, Martha; Davis, Michael S; Cassidy, Kristin A; Nestor, Joseph; Sams, Johnny; Fuentes-Casiano, Edna

2015-01-01

Objective As poor medication adherence is common in bipolar disorder (BD), technology-assisted approaches may help to monitor and enhance adherence. This study evaluated preliminary feasibility, patient satisfaction and effects on adherence, BD knowledge, and BD symptoms associated with the use of a multicomponent technology-assisted adherence enhancement system. Methods This prospective study tested the system in five BD patients over a 15-day period. System components included: 1) an automated pill cap with remote monitoring sensor; 2) a multimedia adherence enhancement program; and 3) a treatment incentive program. This study evaluated system usability, patient satisfaction and effects on adherence (Morisky scale), knowledge (treatment knowledge test [TKT]), and symptoms (internal state scale [ISS]). Results Mean age of the sample was 62 years, 4/5 (80%) Caucasian, and 4/5 (80%) single/divorced or widowed. Most participants (4/5, 80%) were on a single BD medication. Participants had BD for an average of 21 years. Challenges included attaching the pill sensor to standard pharmacy bottles for individuals using very large pill containers or those with multiday pill boxes. Three of five (60%) individuals completed the full 15-day period. Usability scores were high overall. Mean Morisky scores improved. Means on all four subscales of the ISS were all in the direction of improvement. On the TKT, there was a 40% increase in mean scores. Conclusion A multicomponent technology-assisted BD adherence enhancement system is feasible. Challenges include accommodating multiple types of pill containers and monitoring multiple drugs simultaneously. The system can also generate adherence information that is potentially useful for treatment planning. PMID:26089652

Semi-automated brain tumor segmentation on multi-parametric MRI using regularized non-negative matrix factorization.

PubMed

Sauwen, Nicolas; Acou, Marjan; Sima, Diana M; Veraart, Jelle; Maes, Frederik; Himmelreich, Uwe; Achten, Eric; Huffel, Sabine Van

2017-05-04

Segmentation of gliomas in multi-parametric (MP-)MR images is challenging due to their heterogeneous nature in terms of size, appearance and location. Manual tumor segmentation is a time-consuming task and clinical practice would benefit from (semi-) automated segmentation of the different tumor compartments. We present a semi-automated framework for brain tumor segmentation based on non-negative matrix factorization (NMF) that does not require prior training of the method. L1-regularization is incorporated into the NMF objective function to promote spatial consistency and sparseness of the tissue abundance maps. The pathological sources are initialized through user-defined voxel selection. Knowledge about the spatial location of the selected voxels is combined with tissue adjacency constraints in a post-processing step to enhance segmentation quality. The method is applied to an MP-MRI dataset of 21 high-grade glioma patients, including conventional, perfusion-weighted and diffusion-weighted MRI. To assess the effect of using MP-MRI data and the L1-regularization term, analyses are also run using only conventional MRI and without L1-regularization. Robustness against user input variability is verified by considering the statistical distribution of the segmentation results when repeatedly analyzing each patient's dataset with a different set of random seeding points. Using L1-regularized semi-automated NMF segmentation, mean Dice-scores of 65%, 74 and 80% are found for active tumor, the tumor core and the whole tumor region. Mean Hausdorff distances of 6.1 mm, 7.4 mm and 8.2 mm are found for active tumor, the tumor core and the whole tumor region. Lower Dice-scores and higher Hausdorff distances are found without L1-regularization and when only considering conventional MRI data. Based on the mean Dice-scores and Hausdorff distances, segmentation results are competitive with state-of-the-art in literature. Robust results were found for most patients, although careful voxel selection is mandatory to avoid sub-optimal segmentation.

Beyond crosswalks: reliability of exposure assessment following automated coding of free-text job descriptions for occupational epidemiology.

PubMed

Burstyn, Igor; Slutsky, Anton; Lee, Derrick G; Singer, Alison B; An, Yuan; Michael, Yvonne L

2014-05-01

Epidemiologists typically collect narrative descriptions of occupational histories because these are less prone than self-reported exposures to recall bias of exposure to a specific hazard. However, the task of coding these narratives can be daunting and prohibitively time-consuming in some settings. The aim of this manuscript is to evaluate the performance of a computer algorithm to translate the narrative description of occupational codes into standard classification of jobs (2010 Standard Occupational Classification) in an epidemiological context. The fundamental question we address is whether exposure assignment resulting from manual (presumed gold standard) coding of the narratives is materially different from that arising from the application of automated coding. We pursued our work through three motivating examples: assessment of physical demands in Women's Health Initiative observational study, evaluation of predictors of exposure to coal tar pitch volatiles in the US Occupational Safety and Health Administration's (OSHA) Integrated Management Information System, and assessment of exposure to agents known to cause occupational asthma in a pregnancy cohort. In these diverse settings, we demonstrate that automated coding of occupations results in assignment of exposures that are in reasonable agreement with results that can be obtained through manual coding. The correlation between physical demand scores based on manual and automated job classification schemes was reasonable (r = 0.5). The agreement between predictive probability of exceeding the OSHA's permissible exposure level for polycyclic aromatic hydrocarbons, using coal tar pitch volatiles as a surrogate, based on manual and automated coding of jobs was modest (Kendall rank correlation = 0.29). In the case of binary assignment of exposure to asthmagens, we observed that fair to excellent agreement in classifications can be reached, depending on presence of ambiguity in assigned job classification (κ = 0.5-0.8). Thus, the success of automated coding appears to depend on the setting and type of exposure that is being assessed. Our overall recommendation is that automated translation of short narrative descriptions of jobs for exposure assessment is feasible in some settings and essential for large cohorts, especially if combined with manual coding to both assess reliability of coding and to further refine the coding algorithm.

Assessing drivers' response during automated driver support system failures with non-driving tasks.

PubMed

Shen, Sijun; Neyens, David M

2017-06-01

With the increase in automated driver support systems, drivers are shifting from operating their vehicles to supervising their automation. As a result, it is important to understand how drivers interact with these automated systems and evaluate their effect on driver responses to safety critical events. This study aimed to identify how drivers responded when experiencing a safety critical event in automated vehicles while also engaged in non-driving tasks. In total 48 participants were included in this driving simulator study with two levels of automated driving: (a) driving with no automation and (b) driving with adaptive cruise control (ACC) and lane keeping (LK) systems engaged; and also two levels of a non-driving task (a) watching a movie or (b) no non-driving task. In addition to driving performance measures, non-driving task performance and the mean glance duration for the non-driving task were compared between the two levels of automated driving. Drivers using the automated systems responded worse than those manually driving in terms of reaction time, lane departure duration, and maximum steering wheel angle to an induced lane departure event. These results also found that non-driving tasks further impaired driver responses to a safety critical event in the automated system condition. In the automated driving condition, driver responses to the safety critical events were slower, especially when engaged in a non-driving task. Traditional driver performance variables may not necessarily effectively and accurately evaluate driver responses to events when supervising autonomous vehicle systems. Thus, it is important to develop and use appropriate variables to quantify drivers' performance under these conditions. Copyright © 2017 Elsevier Ltd and National Safety Council. All rights reserved.

Automated classification of self-grooming in mice using open-source software.

PubMed

van den Boom, Bastijn J G; Pavlidi, Pavlina; Wolf, Casper J H; Mooij, Adriana H; Willuhn, Ingo

2017-09-01

Manual analysis of behavior is labor intensive and subject to inter-rater variability. Although considerable progress in automation of analysis has been made, complex behavior such as grooming still lacks satisfactory automated quantification. We trained a freely available, automated classifier, Janelia Automatic Animal Behavior Annotator (JAABA), to quantify self-grooming duration and number of bouts based on video recordings of SAPAP3 knockout mice (a mouse line that self-grooms excessively) and wild-type animals. We compared the JAABA classifier with human expert observers to test its ability to measure self-grooming in three scenarios: mice in an open field, mice on an elevated plus-maze, and tethered mice in an open field. In each scenario, the classifier identified both grooming and non-grooming with great accuracy and correlated highly with results obtained by human observers. Consistently, the JAABA classifier confirmed previous reports of excessive grooming in SAPAP3 knockout mice. Thus far, manual analysis was regarded as the only valid quantification method for self-grooming. We demonstrate that the JAABA classifier is a valid and reliable scoring tool, more cost-efficient than manual scoring, easy to use, requires minimal effort, provides high throughput, and prevents inter-rater variability. We introduce the JAABA classifier as an efficient analysis tool for the assessment of rodent self-grooming with expert quality. In our "how-to" instructions, we provide all information necessary to implement behavioral classification with JAABA. Copyright © 2017 Elsevier B.V. All rights reserved.

Automation trust and attention allocation in multitasking workspace.

PubMed

Karpinsky, Nicole D; Chancey, Eric T; Palmer, Dakota B; Yamani, Yusuke

2018-07-01

Previous research suggests that operators with high workload can distrust and then poorly monitor automation, which has been generally inferred from automation dependence behaviors. To test automation monitoring more directly, the current study measured operators' visual attention allocation, workload, and trust toward imperfect automation in a dynamic multitasking environment. Participants concurrently performed a manual tracking task with two levels of difficulty and a system monitoring task assisted by an unreliable signaling system. Eye movement data indicate that operators allocate less visual attention to monitor automation when the tracking task is more difficult. Participants reported reduced levels of trust toward the signaling system when the tracking task demanded more focused visual attention. Analyses revealed that trust mediated the relationship between the load of the tracking task and attention allocation in Experiment 1, an effect that was not replicated in Experiment 2. Results imply a complex process underlying task load, visual attention allocation, and automation trust during multitasking. Automation designers should consider operators' task load in multitasking workspaces to avoid reduced automation monitoring and distrust toward imperfect signaling systems. Copyright © 2018. Published by Elsevier Ltd.

Automated electric power management and control for Space Station Freedom

NASA Technical Reports Server (NTRS)

Dolce, James L.; Mellor, Pamela A.; Kish, James A.

1990-01-01

A comprehensive automation design is being developed for Space Station Freedom's electric power system. It strives to increase station productivity by applying expert systems and conventional algorithms to automate power system operation. An integrated approach to the power system command and control problem is defined and used to direct technology development in: diagnosis, security monitoring and analysis, battery management, and cooperative problem-solving for resource allocation. The prototype automated power system is developed using simulations and test-beds.

Automation of the longwall mining system

NASA Technical Reports Server (NTRS)

Zimmerman, W.; Aster, R. W.; Harris, J.; High, J.

1982-01-01

Cost effective, safe, and technologically sound applications of automation technology to underground coal mining were identified. The longwall analysis commenced with a general search for government and industry experience of mining automation technology. A brief industry survey was conducted to identify longwall operational, safety, and design problems. The prime automation candidates resulting from the industry experience and survey were: (1) the shearer operation, (2) shield and conveyor pan line advance, (3) a management information system to allow improved mine logistics support, and (4) component fault isolation and diagnostics to reduce untimely maintenance delays. A system network analysis indicated that a 40% improvement in productivity was feasible if system delays associated with all of the above four areas were removed. A technology assessment and conceptual system design of each of the four automation candidate areas showed that state of the art digital computer, servomechanism, and actuator technologies could be applied to automate the longwall system.

Comparison of a brain-based adaptive system and a manual adaptable system for invoking automation.

PubMed

Bailey, Nathan R; Scerbo, Mark W; Freeman, Frederick G; Mikulka, Peter J; Scott, Lorissa A

2006-01-01

Two experiments are presented examining adaptive and adaptable methods for invoking automation. Empirical investigations of adaptive automation have focused on methods used to invoke automation or on automation-related performance implications. However, no research has addressed whether performance benefits associated with brain-based systems exceed those in which users have control over task allocations. Participants performed monitoring and resource management tasks as well as a tracking task that shifted between automatic and manual modes. In the first experiment, participants worked with an adaptive system that used their electroencephalographic signals to switch the tracking task between automatic and manual modes. Participants were also divided between high- and low-reliability conditions for the system-monitoring task as well as high- and low-complacency potential. For the second experiment, participants operated an adaptable system that gave them manual control over task allocations. Results indicated increased situation awareness (SA) of gauge instrument settings for individuals high in complacency potential using the adaptive system. In addition, participants who had control over automation performed more poorly on the resource management task and reported higher levels of workload. A comparison between systems also revealed enhanced SA of gauge instrument settings and decreased workload in the adaptive condition. The present results suggest that brain-based adaptive automation systems may enhance perceptual level SA while reducing mental workload relative to systems requiring user-initiated control. Potential applications include automated systems for which operator monitoring performance and high-workload conditions are of concern.

Medical ADP Systems: Automated Medical Records Hold Promise to Improve Patient Care

DTIC Science & Technology

1991-01-01

automated medical records. The report discusses the potential benefits that automation could make to the quality of patient care and the factors that impede...information systems, but no organization has fully automated one of the most critical types of information, patient medical records. The patient medical record...its review of automated medical records. GAO’s objectives in this study were to identify the (1) benefits of automating patient records and (2) factors

Elements of EAF automation processes

NASA Astrophysics Data System (ADS)

Ioana, A.; Constantin, N.; Dragna, E. C.

2017-01-01

Our article presents elements of Electric Arc Furnace (EAF) automation. So, we present and analyze detailed two automation schemes: the scheme of electrical EAF automation system; the scheme of thermic EAF automation system. The application results of these scheme of automation consists in: the sensitive reduction of specific consummation of electrical energy of Electric Arc Furnace, increasing the productivity of Electric Arc Furnace, increase the quality of the developed steel, increasing the durability of the building elements of Electric Arc Furnace.

First Annual Workshop on Space Operations Automation and Robotics (SOAR 87)

NASA Technical Reports Server (NTRS)

Griffin, Sandy (Editor)

1987-01-01

Several topics relative to automation and robotics technology are discussed. Automation of checkout, ground support, and logistics; automated software development; man-machine interfaces; neural networks; systems engineering and distributed/parallel processing architectures; and artificial intelligence/expert systems are among the topics covered.

Activities of daily living measured by the Harvard Automated Phone Task track with cognitive decline over time in non-demented elderly.

PubMed

Marshall, Gad A; Aghjayan, Sarah L; Dekhtyar, Maria; Locascio, Joseph J; Jethwani, Kamal; Amariglio, Rebecca E; Johnson, Keith A; Sperling, Reisa A; Rentz, Dorene M

2017-01-01

Impairment in activities of daily living is a major burden to both patients and caregivers. Mild impairment in instrumental activities of daily living is often seen at the stage of mild cognitive impairment. The field of Alzheimer's disease is moving toward earlier diagnosis and intervention and more sensitive and ecologically valid assessments of instrumental or complex activities of daily living are needed. The Harvard Automated Phone Task, a novel performance-based activities of daily living instrument, has the potential to fill this gap. To further validate the Harvard Automated Phone Task by assessing its longitudinal relationship to global cognition and specific cognitive domains in clinically normal elderly and individuals with mild cognitive impairment. In a longitudinal study, the Harvard Automated Phone Task was associated with cognitive measures using mixed effects models. The Harvard Automated Phone Task's ability to discriminate across diagnostic groups at baseline was also assessed. Academic clinical research center. Two hundred and seven participants (45 young normal, 141 clinically normal elderly, and 21 mild cognitive impairment) were recruited from the community and the memory disorders clinics at Brigham and Women's Hospital and Massachusetts General Hospital. Participants performed the three tasks of the Harvard Automated Phone Task, which consist of navigating an interactive voice response system to refill a prescription (APT-Script), select a new primary care physician (APT-PCP), and make a bank account transfer and payment (APT-Bank). The 3 tasks were scored based on time, errors, repetitions, and correct completion of the task. The primary outcome measure used for each of the tasks was total time adjusted for correct completion. The Harvard Automated Phone Task discriminated well between young normal, clinically normal elderly, and mild cognitive impairment participants (APT-Script: p<0.001; APT-PCP: p<0.001; APT-Bank: p=0.04). Worse baseline Harvard Automated Phone Task performance or worsening Harvard Automated Phone Task performance over time tracked with overall worse performance or worsening performance over time in global cognition, processing speed, executive function, and episodic memory. Prior cross-sectional and current longitudinal analyses have demonstrated the utility of the Harvard Automated Phone Task, a new performance-based activities of daily living instrument, in the assessment of early changes in complex activities of daily living in non-demented elderly at risk for Alzheimer's disease. Future studies will focus on cross-validation with other sensitive activities of daily living tests and Alzheimer's disease biomarkers.

Activities of daily living measured by the Harvard Automated Phone Task track with cognitive decline over time in non-demented elderly

PubMed Central

Marshall, Gad A.; Aghjayan, Sarah L.; Dekhtyar, Maria; Locascio, Joseph J.; Jethwani, Kamal; Amariglio, Rebecca E.; Johnson, Keith A.; Sperling, Reisa A.; Rentz, Dorene M.

2017-01-01

Background Impairment in activities of daily living is a major burden to both patients and caregivers. Mild impairment in instrumental activities of daily living is often seen at the stage of mild cognitive impairment. The field of Alzheimer’s disease is moving toward earlier diagnosis and intervention and more sensitive and ecologically valid assessments of instrumental or complex activities of daily living are needed. The Harvard Automated Phone Task, a novel performance-based activities of daily living instrument, has the potential to fill this gap. Objective To further validate the Harvard Automated Phone Task by assessing its longitudinal relationship to global cognition and specific cognitive domains in clinically normal elderly and individuals with mild cognitive impairment. Design In a longitudinal study, the Harvard Automated Phone Task was associated with cognitive measures using mixed effects models. The Harvard Automated Phone Task’s ability to discriminate across diagnostic groups at baseline was also assessed. Setting Academic clinical research center. Participants Two hundred and seven participants (45 young normal, 141 clinically normal elderly, and 21 mild cognitive impairment) were recruited from the community and the memory disorders clinics at Brigham and Women’s Hospital and Massachusetts General Hospital. Measurements Participants performed the three tasks of the Harvard Automated Phone Task, which consist of navigating an interactive voice response system to refill a prescription (APT-Script), select a new primary care physician (APT-PCP), and make a bank account transfer and payment (APT-Bank). The 3 tasks were scored based on time, errors, repetitions, and correct completion of the task. The primary outcome measure used for each of the tasks was total time adjusted for correct completion. Results The Harvard Automated Phone Task discriminated well between young normal, clinically normal elderly, and mild cognitive impairment participants (APT-Script: p<0.001; APT-PCP: p<0.001; APT-Bank: p=0.04). Worse baseline Harvard Automated Phone Task performance or worsening Harvard Automated Phone Task performance over time tracked with overall worse performance or worsening performance over time in global cognition, processing speed, executive function, and episodic memory. Conclusions Prior cross-sectional and current longitudinal analyses have demonstrated the utility of the Harvard Automated Phone Task, a new performance-based activities of daily living instrument, in the assessment of early changes in complex activities of daily living in non-demented elderly at risk for Alzheimer’s disease. Future studies will focus on cross-validation with other sensitive activities of daily living tests and Alzheimer’s disease biomarkers. PMID:29124043

Practical interpretation of CYP2D6 haplotypes: Comparison and integration of automated and expert calling.

PubMed

Ruaño, Gualberto; Kocherla, Mohan; Graydon, James S; Holford, Theodore R; Makowski, Gregory S; Goethe, John W

2016-05-01

We describe a population genetic approach to compare samples interpreted with expert calling (EC) versus automated calling (AC) for CYP2D6 haplotyping. The analysis represents 4812 haplotype calls based on signal data generated by the Luminex xMap analyzers from 2406 patients referred to a high-complexity molecular diagnostics laboratory for CYP450 testing. DNA was extracted from buccal swabs. We compared the results of expert calls (EC) and automated calls (AC) with regard to haplotype number and frequency. The ratio of EC to AC was 1:3. Haplotype frequencies from EC and AC samples were convergent across haplotypes, and their distribution was not statistically different between the groups. Most duplications required EC, as only expansions with homozygous or hemizygous haplotypes could be automatedly called. High-complexity laboratories can offer equivalent interpretation to automated calling for non-expanded CYP2D6 loci, and superior interpretation for duplications. We have validated scientific expert calling specified by scoring rules as standard operating procedure integrated with an automated calling algorithm. The integration of EC with AC is a practical strategy for CYP2D6 clinical haplotyping. Copyright © 2016 Elsevier B.V. All rights reserved.

Stages and levels of automation in support of space teleoperations.

PubMed

Li, Huiyang; Wickens, Christopher D; Sarter, Nadine; Sebok, Angelia

2014-09-01

This study examined the impact of stage of automation on the performance and perceived workload during simulated robotic arm control tasks in routine and off-nominal scenarios. Automation varies with respect to the stage of information processing it supports and its assigned level of automation. Making appropriate choices in terms of stages and levels of automation is critical to ensure robust joint system performance. To date, this issue has been empirically studied in domains such as aviation and medicine but not extensively in the context of space operations. A total of 36 participants played the role of a payload specialist and controlled a simulated robotic arm. Participants performed fly-to tasks with two types of automation (camera recommendation and trajectory control automation) of varying stage. Tasks were performed during routine scenarios and in scenarios in which either the trajectory control automation or a hazard avoidance automation failed. Increasing the stage of automation progressively improved performance and lowered workload when the automation was reliable, but incurred severe performance costs when the system failed. The results from this study support concerns about automation-induced complacency and automation bias when later stages of automation are introduced. The benefits of such automation are offset by the risk of catastrophic outcomes when system failures go unnoticed or become difficult to recover from. A medium stage of automation seems preferable as it provides sufficient support during routine operations and helps avoid potentially catastrophic outcomes in circumstances when the automation fails.

Automated packing systems: review of industrial implementations

NASA Astrophysics Data System (ADS)

Whelan, Paul F.; Batchelor, Bruce G.

1993-08-01

A rich theoretical background to the problems that occur in the automation of material handling can be found in operations research, production engineering, systems engineering and automation, more specifically machine vision, literature. This work has contributed towards the design of intelligent handling systems. This paper will review the application of these automated material handling and packing techniques to industrial problems. The discussion will also highlight the systems integration issues involved in these applications. An outline of one such industrial application, the automated placement of shape templates on to leather hides, is also discussed. The purpose of this system is to arrange shape templates on a leather hide in an efficient manner, so as to minimize the leather waste, before they are automatically cut from the hide. These pieces are used in the furniture and car manufacturing industries for the upholstery of high quality leather chairs and car seats. Currently this type of operation is semi-automated. The paper will outline the problems involved in the full automation of such a procedure.

75 FR 34754 - Privacy Act; Notification of a New Privacy Act System of Records, Title Eight Automated Paperless...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-06-18

... automated case management system, to process complaints, compliance reviews, and to track the activities... comment on the new system of records. The new system report was submitted to the Office of Management and... a New Privacy Act System of Records, Title Eight Automated Paperless Office Tracking System (TEAPOTS...

Understanding reliance on automation: effects of error type, error distribution, age and experience

PubMed Central

Sanchez, Julian; Rogers, Wendy A.; Fisk, Arthur D.; Rovira, Ericka

2015-01-01

An obstacle detection task supported by “imperfect” automation was used with the goal of understanding the effects of automation error types and age on automation reliance. Sixty younger and sixty older adults interacted with a multi-task simulation of an agricultural vehicle (i.e. a virtual harvesting combine). The simulator included an obstacle detection task and a fully manual tracking task. A micro-level analysis provided insight into the way reliance patterns change over time. The results indicated that there are distinct patterns of reliance that develop as a function of error type. A prevalence of automation false alarms led participants to under-rely on the automation during alarm states while over relying on it during non-alarms states. Conversely, a prevalence of automation misses led participants to over-rely on automated alarms and under-rely on the automation during non-alarm states. Older adults adjusted their behavior according to the characteristics of the automation similarly to younger adults, although it took them longer to do so. The results of this study suggest the relationship between automation reliability and reliance depends on the prevalence of specific errors and on the state of the system. Understanding the effects of automation detection criterion settings on human-automation interaction can help designers of automated systems make predictions about human behavior and system performance as a function of the characteristics of the automation. PMID:25642142

Understanding reliance on automation: effects of error type, error distribution, age and experience.

PubMed

Sanchez, Julian; Rogers, Wendy A; Fisk, Arthur D; Rovira, Ericka

2014-03-01

An obstacle detection task supported by "imperfect" automation was used with the goal of understanding the effects of automation error types and age on automation reliance. Sixty younger and sixty older adults interacted with a multi-task simulation of an agricultural vehicle (i.e. a virtual harvesting combine). The simulator included an obstacle detection task and a fully manual tracking task. A micro-level analysis provided insight into the way reliance patterns change over time. The results indicated that there are distinct patterns of reliance that develop as a function of error type. A prevalence of automation false alarms led participants to under-rely on the automation during alarm states while over relying on it during non-alarms states. Conversely, a prevalence of automation misses led participants to over-rely on automated alarms and under-rely on the automation during non-alarm states. Older adults adjusted their behavior according to the characteristics of the automation similarly to younger adults, although it took them longer to do so. The results of this study suggest the relationship between automation reliability and reliance depends on the prevalence of specific errors and on the state of the system. Understanding the effects of automation detection criterion settings on human-automation interaction can help designers of automated systems make predictions about human behavior and system performance as a function of the characteristics of the automation.

Assessment of Operational Automated Guideway Systems - Airtrans (Phase II)

DOT National Transportation Integrated Search

1980-01-01

This study, Phase II, completes the assessment of AIRTRANS, the automated guideway system located at the Dallas-Fort Worth Airport. The Phase I assessment report: "Assessment of Operational Automated Guideway Systems--AIRTRANS (Phase I)" (PB-261 339)...

41 CFR 302-1.100 - What is a comprehensive, automated relocation management system?

Code of Federal Regulations, 2014 CFR

2014-07-01

... system? A comprehensive, automated relocation management system is a system that integrates into a single... 41 Public Contracts and Property Management 4 2014-07-01 2014-07-01 false What is a comprehensive, automated relocation management system? 302-1.100 Section 302-1.100 Public Contracts and Property Management...

41 CFR 302-1.100 - What is a comprehensive, automated relocation management system?

Code of Federal Regulations, 2013 CFR

2013-07-01

... system? A comprehensive, automated relocation management system is a system that integrates into a single... 41 Public Contracts and Property Management 4 2013-07-01 2012-07-01 true What is a comprehensive, automated relocation management system? 302-1.100 Section 302-1.100 Public Contracts and Property Management...

41 CFR 302-1.100 - What is a comprehensive, automated relocation management system?

Code of Federal Regulations, 2011 CFR

2011-07-01

... system? A comprehensive, automated relocation management system is a system that integrates into a single... 41 Public Contracts and Property Management 4 2011-07-01 2011-07-01 false What is a comprehensive, automated relocation management system? 302-1.100 Section 302-1.100 Public Contracts and Property Management...

41 CFR 302-1.100 - What is a comprehensive, automated relocation management system?

Code of Federal Regulations, 2012 CFR

2012-07-01

... system? A comprehensive, automated relocation management system is a system that integrates into a single... 41 Public Contracts and Property Management 4 2012-07-01 2012-07-01 false What is a comprehensive, automated relocation management system? 302-1.100 Section 302-1.100 Public Contracts and Property Management...

Mammographic Breast Density Assessment Using Automated Volumetric Software and Breast Imaging Reporting and Data System (BIRADS) Categorization by Expert Radiologists.

PubMed

Damases, Christine N; Brennan, Patrick C; Mello-Thoms, Claudia; McEntee, Mark F

2016-01-01

To investigate agreement on mammographic breast density (MD) assessment between automated volumetric software and Breast Imaging Reporting and Data System (BIRADS) categorization by expert radiologists. Forty cases of left craniocaudal and mediolateral oblique mammograms from 20 women were used. All images had their volumetric density classified using Volpara density grade (VDG) and average volumetric breast density percentage. The same images were then classified into BIRADS categories (I-IV) by 20 American Board of Radiology examiners. The results demonstrated a moderate agreement (κ = 0.537; 95% CI = 0.234-0.699) between VDG classification and radiologists' BIRADS density assessment. Interreader agreement using BIRADS also demonstrated moderate agreement (κ = 0.565; 95% CI = 0.519-0.610) ranging from 0.328 to 0.669. Radiologists' average BIRADS was lower than average VDG scores by 0.33, with their mean being 2.13, whereas the mean VDG was 2.48 (U = -3.742; P < 0.001). VDG and BIRADS showed a very strong positive correlation (ρ = 0.91; P < 0.001) as did BIRADS and average volumetric breast density percentage (ρ = 0.94; P < 0.001). Automated volumetric breast density assessment shows moderate agreement and very strong correlation with BIRADS; interreader variations still exist within BIRADS. Because of the increasing importance of MD measurement in clinical management of patients, widely accepted, reproducible, and accurate measures of MD are required. Copyright © 2016 The Association of University Radiologists. Published by Elsevier Inc. All rights reserved.

21 CFR 864.5620 - Automated hemoglobin system.

Code of Federal Regulations, 2014 CFR

2014-04-01

... 21 Food and Drugs 8 2014-04-01 2014-04-01 false Automated hemoglobin system. 864.5620 Section 864.5620 Food and Drugs FOOD AND DRUG ADMINISTRATION, DEPARTMENT OF HEALTH AND HUMAN SERVICES (CONTINUED) MEDICAL DEVICES HEMATOLOGY AND PATHOLOGY DEVICES Automated and Semi-Automated Hematology Devices § 864...

21 CFR 864.5620 - Automated hemoglobin system.

Code of Federal Regulations, 2013 CFR

2013-04-01

... 21 Food and Drugs 8 2013-04-01 2013-04-01 false Automated hemoglobin system. 864.5620 Section 864.5620 Food and Drugs FOOD AND DRUG ADMINISTRATION, DEPARTMENT OF HEALTH AND HUMAN SERVICES (CONTINUED) MEDICAL DEVICES HEMATOLOGY AND PATHOLOGY DEVICES Automated and Semi-Automated Hematology Devices § 864...