Segmentized Clear Channel Assessment for IEEE 802.15.4 Networks.

PubMed

Son, Kyou Jung; Hong, Sung Hyeuck; Moon, Seong-Pil; Chang, Tae Gyu; Cho, Hanjin

2016-06-03

This paper proposed segmentized clear channel assessment (CCA) which increases the performance of IEEE 802.15.4 networks by improving carrier sense multiple access with collision avoidance (CSMA/CA). Improving CSMA/CA is important because the low-power consumption feature and throughput performance of IEEE 802.15.4 are greatly affected by CSMA/CA behavior. To improve the performance of CSMA/CA, this paper focused on increasing the chance to transmit a packet by assessing precise channel status. The previous method used in CCA, which is employed by CSMA/CA, assesses the channel by measuring the energy level of the channel. However, this method shows limited channel assessing behavior, which comes from simple threshold dependent channel busy evaluation. The proposed method solves this limited channel decision problem by dividing CCA into two groups. Two groups of CCA compare their energy levels to get precise channel status. To evaluate the performance of the segmentized CCA method, a Markov chain model has been developed. The validation of analytic results is confirmed by comparing them with simulation results. Additionally, simulation results show the proposed method is improving a maximum 8.76% of throughput and decreasing a maximum 3.9% of the average number of CCAs per packet transmission than the IEEE 802.15.4 CCA method.

Segmentized Clear Channel Assessment for IEEE 802.15.4 Networks

PubMed Central

Son, Kyou Jung; Hong, Sung Hyeuck; Moon, Seong-Pil; Chang, Tae Gyu; Cho, Hanjin

2016-01-01

This paper proposed segmentized clear channel assessment (CCA) which increases the performance of IEEE 802.15.4 networks by improving carrier sense multiple access with collision avoidance (CSMA/CA). Improving CSMA/CA is important because the low-power consumption feature and throughput performance of IEEE 802.15.4 are greatly affected by CSMA/CA behavior. To improve the performance of CSMA/CA, this paper focused on increasing the chance to transmit a packet by assessing precise channel status. The previous method used in CCA, which is employed by CSMA/CA, assesses the channel by measuring the energy level of the channel. However, this method shows limited channel assessing behavior, which comes from simple threshold dependent channel busy evaluation. The proposed method solves this limited channel decision problem by dividing CCA into two groups. Two groups of CCA compare their energy levels to get precise channel status. To evaluate the performance of the segmentized CCA method, a Markov chain model has been developed. The validation of analytic results is confirmed by comparing them with simulation results. Additionally, simulation results show the proposed method is improving a maximum 8.76% of throughput and decreasing a maximum 3.9% of the average number of CCAs per packet transmission than the IEEE 802.15.4 CCA method. PMID:27271626

Real-time Continuous Assessment Method for Mental and Physiological Condition using Heart Rate Variability

NASA Astrophysics Data System (ADS)

Yoshida, Yutaka; Yokoyama, Kiyoko; Ishii, Naohiro

It is necessary to monitor the daily health condition for preventing stress syndrome. In this study, it was proposed the method assessing the mental and physiological condition, such as the work stress or the relaxation, using heart rate variability at real time and continuously. The instantanuous heart rate (HR), and the ratio of the number of extreme points (NEP) and the number of heart beats were calculated for assessing mental and physiological condition. In this method, 20 beats heart rate were used to calculate these indexes. These were calculated in one beat interval. Three conditions, which are sitting rest, performing mental arithmetic and watching relaxation movie, were assessed using our proposed algorithm. The assessment accuracies were 71.9% and 55.8%, when performing mental arithmetic and watching relaxation movie respectively. In this method, the mental and physiological condition was assessed using only 20 regressive heart beats, so this method is considered as the real time assessment method.

Assessment of Proficiency and Competency in Laboratory Animal Biomethodologies

PubMed Central

Clifford, Paula; Melfi, Natasha; Bogdanske, John; Johnson, Elizabeth J; Kehler, James; Baran, Szczepan W

2013-01-01

Personnel working with laboratory animals are required by laws and guidelines to be trained and qualified to perform biomethodologic procedures. The assessment of competency and proficiency is a vital component of a laboratory animal training program, because this process confirms that the trainees have met the learning objectives for a particular procedure. The approach toward qualification assessment differs between organizations because laws and guidelines do not outline how the assessment should be performed or which methods and tools should be used. Assessment of clinical and surgical medicine has received considerable attention over the last few decades and has progressed from simple subjective methods to well-defined and objective methods of assessing competency. Although biomethodology competency and proficiency assessment is discussed in the literature, a standard and objective assessment method has not yet been developed. The development and implementation of an objective and standardized biomethodologic assessment program can serve as a tool to improve standards, ensure consistent training, and decrease research variables yet ensure animal welfare. Here we review the definition and goals of training and assessment, review assessment methods, and propose a method to develop a standard and objective assessment program for the laboratory animal science field, particularly training departments and IACUC. PMID:24351758

A new method to assess the sustainability performance of events: Application to the 2014 World Orienteering Championship

DOE Office of Scientific and Technical Information (OSTI.GOV)

Scrucca, Flavio; Severi, Claudio; Galvan, Nicola

Nowadays an increasing attention of public and private agencies to the sustainability performance of events is observed, since it is recognized as a key issue in the context of sustainable development. Assessing the sustainability performance of events involves environmental, social and economic aspects; their impacts are complex and a quantitative assessment is often difficult. This paper presents a new quali-quantitative method developed to measure the sustainability of events, taking into account all its potential impacts. The 2014 World Orienteering Championship, held in Italy, was selected to test the proposed evaluation methodology. The total carbon footprint of the event was 165.34more » tCO{sub 2}eq and the avoided emissions were estimated as being 46 tCO{sub 2}eq. The adopted quali-quantitative method resulted to be efficient in assessing the sustainability impacts and can be applied for the evaluation of similar events. - Highlights: • A quali-quantitative method to assess events' sustainability is presented. • All the methodological issues related to the method are explained. • The method is used to evaluate the sustainability of an international sports event. • The method resulted to be valid to assess the event's sustainability level. • The carbon footprint of the event has been calculated.« less

On the "Exchangeability" of Hands-On and Computer-Simulated Science Performance Assessments. CSE Technical Report.

ERIC Educational Resources Information Center

Rosenquist, Anders; Shavelson, Richard J.; Ruiz-Primo, Maria Araceli

Inconsistencies in scores from computer-simulated and "hands-on" science performance assessments have led to questions about the exchangeability of these two methods in spite of the highly touted potential of computer-simulated performance assessment. This investigation considered possible explanations for students' inconsistent performances: (1)…

Validity of the assessment method of skeletal maturation by cervical vertebrae: a systematic review and meta-analysis.

PubMed

Cericato, G O; Bittencourt, M A V; Paranhos, L R

2015-01-01

To perform a systematic review with meta-analysis to answer the question: is the cervical vertebrae maturation index (CVMI) effective to replace hand-wrist radiograph (gold standard) in determining the pubertal growth spurt in patients undergoing bone growth? A search in three databases was performed, in which studies were selected that compared one of the two main assessment methods for cervical vertebrae (Hassel B, Farman AG. Skeletal maturation evaluation using cervical vertebrae. Am J Orthod Dentofacial Orthop 1995; 107: 58-66, or Baccetti T, Franchi L, McNamara JA Jr. An improved version of the cervical vertebral maturation (CVM) method for the assessment of mandibular growth. Angle Orthod 2002; 72: 316-23) to a carpal assessment method. The main methodological data from each of the texts were collected and tabulated after. Later, the meta-analysis of the correlation coefficients obtained was performed. 19 articles were selected from an initial 206 articles collected. Regardless of the method used, the results of the meta-analysis showed that every article selected presented a positive correlation between skeletal maturation assessment performed by cervical vertebrae and carpal methods, with discrepancy of values between genders indicating higher correlation for the female gender (0.925; 0.878) than for the male (0.879; 0.842). When the assessment was performed without gender separation, correlation was significant (0.592; 0.688) but lower in the cases when genders were separated. With the results of this meta-analysis, it is safe to affirm that both CVMIs used in the present study are reliable to replace the hand-wrist radiograph in predicting the pubertal growth spurt, considering that the highest values were found in female samples, especially in the method by Hassel and Farman.

Establishing pass/fail criteria for bronchoscopy performance.

PubMed

Konge, Lars; Clementsen, Paul; Larsen, Klaus Richter; Arendrup, Henrik; Buchwald, Christian; Ringsted, Charlotte

2012-01-01

Several tools have been created to assess competence in bronchoscopy. However, educational guidelines still use an arbitrary number of performed procedures to decide when basic competency is acquired. The purpose of this study was to define pass/fail scores for two bronchoscopy assessment tools, and investigate how these scores relate to physicians' experience regarding the number of bronchoscopy procedures performed. We studied two assessment tools and used two standard setting methods to create cut scores: the contrasting-groups method and the extended Angoff method. In the first we compared bronchoscopy performance scores of 14 novices with the scores of 14 experienced consultants to find the score that best discriminated between the two groups. In the second we asked an expert group of 7 experienced bronchoscopists to judge how a borderline trainee would perform on each item of the test. Using the contrasting-groups method we found a standard that would fail all novices and pass all consultants. A clear pass related to prior experience of 75 procedures. The consequences of using the extended Angoff method were also acceptable: all trainees who had performed less than 50 bronchoscopies failed the test and all consultants passed. A clear pass related to 80 procedures. Our proposed pass/fail scores for these two methods seem appropriate in terms of consequences. Prior experience with the performance of 75 and 80 bronchoscopies, respectively, seemed to ensure basic competency. In the future objective assessment tools could become an important aid in the certification of physicians performing bronchoscopies. Copyright © 2011 S. Karger AG, Basel.

Utilizing global data to estimate analytical performance on the Sigma scale: A global comparative analysis of methods, instruments, and manufacturers through external quality assurance and proficiency testing programs.

PubMed

Westgard, Sten A

2016-06-01

To assess the analytical performance of instruments and methods through external quality assessment and proficiency testing data on the Sigma scale. A representative report from five different EQA/PT programs around the world (2 US, 1 Canadian, 1 UK, and 1 Australasian) was accessed. The instrument group standard deviations were used as surrogate estimates of instrument imprecision. Performance specifications from the US CLIA proficiency testing criteria were used to establish a common quality goal. Then Sigma-metrics were calculated to grade the analytical performance. Different methods have different Sigma-metrics for each analyte reviewed. Summary Sigma-metrics estimate the percentage of the chemistry analytes that are expected to perform above Five Sigma, which is where optimized QC design can be implemented. The range of performance varies from 37% to 88%, exhibiting significant differentiation between instruments and manufacturers. Median Sigmas for the different manufacturers in three analytes (albumin, glucose, sodium) showed significant differentiation. Chemistry tests are not commodities. Quality varies significantly from manufacturer to manufacturer, instrument to instrument, and method to method. The Sigma-assessments from multiple EQA/PT programs provide more insight into the performance of methods and instruments than any single program by itself. It is possible to produce a ranking of performance by manufacturer, instrument and individual method. Laboratories seeking optimal instrumentation would do well to consult this data as part of their decision-making process. To confirm that these assessments are stable and reliable, a longer term study should be conducted that examines more results over a longer time period. Copyright © 2016 The Canadian Society of Clinical Chemists. Published by Elsevier Inc. All rights reserved.

Faculty's Job Stress and Performance in the Undergraduate Education Assessment in China: A Mixed-Methods Study

ERIC Educational Resources Information Center

Jing, Lizhen

2008-01-01

The Undergraduate Education Assessment (assessment) was launched to upgrade faculty's performance, but it also tends to intensify their job stress. Considering the little empirical research on the influence of stress on performance in the assessment and the confounded findings in literature, the study collected data with a survey and interviews to…

Sensors vs. experts - A performance comparison of sensor-based fall risk assessment vs. conventional assessment in a sample of geriatric patients

PubMed Central

2011-01-01

Background Fall events contribute significantly to mortality, morbidity and costs in our ageing population. In order to identify persons at risk and to target preventive measures, many scores and assessment tools have been developed. These often require expertise and are costly to implement. Recent research investigates the use of wearable inertial sensors to provide objective data on motion features which can be used to assess individual fall risk automatically. So far it is unknown how well this new method performs in comparison with conventional fall risk assessment tools. The aim of our research is to compare the predictive performance of our new sensor-based method with conventional and established methods, based on prospective data. Methods In a first study phase, 119 inpatients of a geriatric clinic took part in motion measurements using a wireless triaxial accelerometer during a Timed Up&Go (TUG) test and a 20 m walk. Furthermore, the St. Thomas Risk Assessment Tool in Falling Elderly Inpatients (STRATIFY) was performed, and the multidisciplinary geriatric care team estimated the patients' fall risk. In a second follow-up phase of the study, 46 of the participants were interviewed after one year, including a fall and activity assessment. The predictive performances of the TUG, the STRATIFY and team scores are compared. Furthermore, two automatically induced logistic regression models based on conventional clinical and assessment data (CONV) as well as sensor data (SENSOR) are matched. Results Among the risk assessment scores, the geriatric team score (sensitivity 56%, specificity 80%) outperforms STRATIFY and TUG. The induced logistic regression models CONV and SENSOR achieve similar performance values (sensitivity 68%/58%, specificity 74%/78%, AUC 0.74/0.72, +LR 2.64/2.61). Both models are able to identify more persons at risk than the simple scores. Conclusions Sensor-based objective measurements of motion parameters in geriatric patients can be used to assess individual fall risk, and our prediction model's performance matches that of a model based on conventional clinical and assessment data. Sensor-based measurements using a small wearable device may contribute significant information to conventional methods and are feasible in an unsupervised setting. More prospective research is needed to assess the cost-benefit relation of our approach. PMID:21711504

Portfolio: a comprehensive method of assessment for postgraduates in oral and maxillofacial surgery.

PubMed

Kadagad, Poornima; Kotrashetti, S M

2013-03-01

Post graduate learning and assessment is an important responsibility of an academic oral and maxillofacial surgeon. The current method of assessment for post graduate training include formative evaluation in the form of seminars, case presentations, log books and infrequently conducted end of year theory exams. End of the course theory and practical examination is a summative evaluation which awards the degree to the student based on grades obtained. Oral and maxillofacial surgery is mainly a skill based specialty and deliberate practice enhances skill. But the traditional system of assessment of post graduates emphasizes their performance on the summative exam which fails to evaluate the integral picture of the student throughout the course. Emphasis on competency and holistic growth of the post graduate student during training in recent years has lead to research and evaluation of assessment methods to quantify students' progress during training. Portfolio method of assessment has been proposed as a potentially functional method for post graduate evaluation. It is defined as a collection of papers and other forms of evidence that learning has taken place. It allows the collation and integration of evidence on competence and performance from different sources to gain a comprehensive picture of everyday practice. The benefits of portfolio assessment in health professions education are twofold: it's potential to assess performance and its potential to assess outcomes, such as attitudes and professionalism that are difficult to assess using traditional instruments. This paper is an endeavor for the development of portfolio method of assessment for post graduate student in oral and maxillofacial surgery.

Teachers' Reactions towards Performance-Based Language Assessment

ERIC Educational Resources Information Center

Chinda, Bordin

2014-01-01

This research aims at examining the reactions of tertiary EFL teachers towards the use of performance-based language assessment. The study employed a mixed-method research methodology. For the quantitative method, 36 teachers responded to a questionnaire survey. In addition, four teachers participated in the in-depth interviews which were…

Performance-Based Assessment: An Alternative Assessment Process for Young Gifted Children.

ERIC Educational Resources Information Center

Hafenstein, Norma Lu; Tucker, Brooke

Performance-based assessment provides an alternative identification method for young gifted children. A performance-based identification process was developed and implemented to select three-, four-, and five-year-old children for inclusion in a school for gifted children. Literature regarding child development, characteristics of young gifted…

Cluster Detection Tests in Spatial Epidemiology: A Global Indicator for Performance Assessment

PubMed Central

Guttmann, Aline; Li, Xinran; Feschet, Fabien; Gaudart, Jean; Demongeot, Jacques; Boire, Jean-Yves; Ouchchane, Lemlih

2015-01-01

In cluster detection of disease, the use of local cluster detection tests (CDTs) is current. These methods aim both at locating likely clusters and testing for their statistical significance. New or improved CDTs are regularly proposed to epidemiologists and must be subjected to performance assessment. Because location accuracy has to be considered, performance assessment goes beyond the raw estimation of type I or II errors. As no consensus exists for performance evaluations, heterogeneous methods are used, and therefore studies are rarely comparable. A global indicator of performance, which assesses both spatial accuracy and usual power, would facilitate the exploration of CDTs behaviour and help between-studies comparisons. The Tanimoto coefficient (TC) is a well-known measure of similarity that can assess location accuracy but only for one detected cluster. In a simulation study, performance is measured for many tests. From the TC, we here propose two statistics, the averaged TC and the cumulated TC, as indicators able to provide a global overview of CDTs performance for both usual power and location accuracy. We evidence the properties of these two indicators and the superiority of the cumulated TC to assess performance. We tested these indicators to conduct a systematic spatial assessment displayed through performance maps. PMID:26086911

The feasibility and concurrent validity of performing the Movement Assessment Battery for Children - 2nd Edition via telerehabilitation technology.

PubMed

Nicola, Kristy; Waugh, Jemimah; Charles, Emily; Russell, Trevor

2018-06-01

In rural and remote communities children with motor difficulties have less access to rehabilitation services. Telerehabilitation technology is a potential method to overcome barriers restricting access to healthcare in these areas. Assessment is necessary to guide clinical reasoning; however it is unclear which paediatric assessments can be administered remotely. The Movement Assessment Battery for Children - 2nd Edition is commonly used by various health professionals to assess motor performance of children. The aim of this study was to investigate the feasibility and concurrent validity of performing the Movement Assessment Battery for Children - 2nd Edition remotely via telerehabilitation technology compared to the conventional in-person method. Fifty-nine children enrolled in a state school (5-11 years old) volunteered to perform one in-person and one telerehabilitation mediated assessment. The order of the method of delivery and the therapist performing the assessment were randomized. After both assessments were complete, a participant satisfaction questionnaire was completed by each child. The Bland-Altman limits of agreement for the total test standard score were -3.15 to 3.22 which is smaller than a pre-determined clinically acceptable margin based on the smallest detectable change. This study establishes the feasibility and concurrent validity of the administration of the Movement Assessment Battery for Children - 2nd Edition via telerehabilitation technology. Overall, participants perceived their experience with telerehabilitation positively. Copyright © 2018 Elsevier Ltd. All rights reserved.

Effects of Selected Task Performance Criteria at Initiating Adaptive Task Real locations

NASA Technical Reports Server (NTRS)

Montgomery, Demaris A.

2001-01-01

In the current report various performance assessment methods used to initiate mode transfers between manual control and automation for adaptive task reallocation were tested. Participants monitored two secondary tasks for critical events while actively controlling a process in a fictional system. One of the secondary monitoring tasks could be automated whenever operators' performance was below acceptable levels. Automation of the secondary task and transfer of the secondary task back to manual control were either human- or machine-initiated. Human-initiated transfers were based on the operator's assessment of the current task demands while machine-initiated transfers were based on the operators' performance. Different performance assessment methods were tested in two separate experiments.

Performance assessment in a flight simulator test—Validation of a space psychology methodology

NASA Astrophysics Data System (ADS)

Johannes, B.; Salnitski, Vyacheslav; Soll, Henning; Rauch, Melina; Goeters, Klaus-Martin; Maschke, Peter; Stelling, Dirk; Eißfeldt, Hinnerk

2007-02-01

The objective assessment of operator performance in hand controlled docking of a spacecraft on a space station has 30 years of tradition and is well established. In the last years the performance assessment was successfully combined with a psycho-physiological approach for the objective assessment of the levels of physiological arousal and psychological load. These methods are based on statistical reference data. For the enhancement of the statistical power of the evaluation methods, both were actually implemented into a comparable terrestrial task: the flight simulator test of DLR in the selection procedure for ab initio pilot applicants for civil airlines. In the first evaluation study 134 male subjects were analysed. Subjects underwent a flight simulator test including three tasks, which were evaluated by instructors applying well-established and standardised rating scales. The principles of the performance algorithms of the docking training were adapted for the automated flight performance assessment. They are presented here. The increased human errors under instrument flight conditions without visual feedback required a manoeuvre recognition algorithm before calculating the deviation of the flown track from the given task elements. Each manoeuvre had to be evaluated independently of former failures. The expert rated performance showed a highly significant correlation with the automatically calculated performance for each of the three tasks: r=.883, r=.874, r=.872, respectively. An automated algorithm successfully assessed the flight performance. This new method will possibly provide a wide range of other future applications in aviation and space psychology.

Performance Assessment of Kernel Density Clustering for Gene Expression Profile Data

PubMed Central

Zeng, Beiyan; Chen, Yiping P.; Smith, Oscar H.

2003-01-01

Kernel density smoothing techniques have been used in classification or supervised learning of gene expression profile (GEP) data, but their applications to clustering or unsupervised learning of those data have not been explored and assessed. Here we report a kernel density clustering method for analysing GEP data and compare its performance with the three most widely-used clustering methods: hierarchical clustering, K-means clustering, and multivariate mixture model-based clustering. Using several methods to measure agreement, between-cluster isolation, and withincluster coherence, such as the Adjusted Rand Index, the Pseudo F test, the r2 test, and the profile plot, we have assessed the effectiveness of kernel density clustering for recovering clusters, and its robustness against noise on clustering both simulated and real GEP data. Our results show that the kernel density clustering method has excellent performance in recovering clusters from simulated data and in grouping large real expression profile data sets into compact and well-isolated clusters, and that it is the most robust clustering method for analysing noisy expression profile data compared to the other three methods assessed. PMID:18629292

MQAPRank: improved global protein model quality assessment by learning-to-rank.

PubMed

Jing, Xiaoyang; Dong, Qiwen

2017-05-25

Protein structure prediction has achieved a lot of progress during the last few decades and a greater number of models for a certain sequence can be predicted. Consequently, assessing the qualities of predicted protein models in perspective is one of the key components of successful protein structure prediction. Over the past years, a number of methods have been developed to address this issue, which could be roughly divided into three categories: single methods, quasi-single methods and clustering (or consensus) methods. Although these methods achieve much success at different levels, accurate protein model quality assessment is still an open problem. Here, we present the MQAPRank, a global protein model quality assessment program based on learning-to-rank. The MQAPRank first sorts the decoy models by using single method based on learning-to-rank algorithm to indicate their relative qualities for the target protein. And then it takes the first five models as references to predict the qualities of other models by using average GDT_TS scores between reference models and other models. Benchmarked on CASP11 and 3DRobot datasets, the MQAPRank achieved better performances than other leading protein model quality assessment methods. Recently, the MQAPRank participated in the CASP12 under the group name FDUBio and achieved the state-of-the-art performances. The MQAPRank provides a convenient and powerful tool for protein model quality assessment with the state-of-the-art performances, it is useful for protein structure prediction and model quality assessment usages.

Concrete Condition Assessment Using Impact-Echo Method and Extreme Learning Machines

PubMed Central

Zhang, Jing-Kui; Yan, Weizhong; Cui, De-Mi

2016-01-01

The impact-echo (IE) method is a popular non-destructive testing (NDT) technique widely used for measuring the thickness of plate-like structures and for detecting certain defects inside concrete elements or structures. However, the IE method is not effective for full condition assessment (i.e., defect detection, defect diagnosis, defect sizing and location), because the simple frequency spectrum analysis involved in the existing IE method is not sufficient to capture the IE signal patterns associated with different conditions. In this paper, we attempt to enhance the IE technique and enable it for full condition assessment of concrete elements by introducing advanced machine learning techniques for performing comprehensive analysis and pattern recognition of IE signals. Specifically, we use wavelet decomposition for extracting signatures or features out of the raw IE signals and apply extreme learning machine, one of the recently developed machine learning techniques, as classification models for full condition assessment. To validate the capabilities of the proposed method, we build a number of specimens with various types, sizes, and locations of defects and perform IE testing on these specimens in a lab environment. Based on analysis of the collected IE signals using the proposed machine learning based IE method, we demonstrate that the proposed method is effective in performing full condition assessment of concrete elements or structures. PMID:27023563

Portfolios: An Alternative Method of Student and Program Assessment

PubMed Central

Hannam, Susan E.

1995-01-01

The use of performance-based evaluation and alternative assessment techniques has become essential for curriculum programs seeking Commission of Accreditation of Allied Health Education Programs (CAAHEP) accreditation. In athletic training education, few assessment models exist to assess student performance over the entire course of their educational program. This article describes a model of assessment-a student athletic training portfolio of “best works.” The portfolio can serve as a method to assess student development and to assess program effectiveness. The goals of the program include purposes specific to the five NATA performance domains. In addition, four types of portfolio evidence are described: artifacts, attestations, productions, and reproductions. Quality assignments and projects completed by students as they progress through a six-semester program are identified relative to the type of evidence and the domain(s) they represent. The portfolio assists with student development, provides feedback for curriculum planning, allows for student/faculty collaboration and “coaching” of the student, and assists with job searching. This information will serve as a useful model for those athletic training programs looking for an alternative method of assessing student and program outcomes. PMID:16558359

Uncertainty estimates of purity measurements based on current information: toward a "live validation" of purity methods.

PubMed

Apostol, Izydor; Kelner, Drew; Jiang, Xinzhao Grace; Huang, Gang; Wypych, Jette; Zhang, Xin; Gastwirt, Jessica; Chen, Kenneth; Fodor, Szilan; Hapuarachchi, Suminda; Meriage, Dave; Ye, Frank; Poppe, Leszek; Szpankowski, Wojciech

2012-12-01

To predict precision and other performance characteristics of chromatographic purity methods, which represent the most widely used form of analysis in the biopharmaceutical industry. We have conducted a comprehensive survey of purity methods, and show that all performance characteristics fall within narrow measurement ranges. This observation was used to develop a model called Uncertainty Based on Current Information (UBCI), which expresses these performance characteristics as a function of the signal and noise levels, hardware specifications, and software settings. We applied the UCBI model to assess the uncertainty of purity measurements, and compared the results to those from conventional qualification. We demonstrated that the UBCI model is suitable to dynamically assess method performance characteristics, based on information extracted from individual chromatograms. The model provides an opportunity for streamlining qualification and validation studies by implementing a "live validation" of test results utilizing UBCI as a concurrent assessment of measurement uncertainty. Therefore, UBCI can potentially mitigate the challenges associated with laborious conventional method validation and facilitates the introduction of more advanced analytical technologies during the method lifecycle.

A Study of Wind Turbine Comprehensive Operational Assessment Model Based on EM-PCA Algorithm

NASA Astrophysics Data System (ADS)

Zhou, Minqiang; Xu, Bin; Zhan, Yangyan; Ren, Danyuan; Liu, Dexing

2018-01-01

To assess wind turbine performance accurately and provide theoretical basis for wind farm management, a hybrid assessment model based on Entropy Method and Principle Component Analysis (EM-PCA) was established, which took most factors of operational performance into consideration and reach to a comprehensive result. To verify the model, six wind turbines were chosen as the research objects, the ranking obtained by the method proposed in the paper were 4#>6#>1#>5#>2#>3#, which are completely in conformity with the theoretical ranking, which indicates that the reliability and effectiveness of the EM-PCA method are high. The method could give guidance for processing unit state comparison among different units and launching wind farm operational assessment.

Can mixed assessment methods make biology classes more equitable?

PubMed

Cotner, Sehoya; Ballen, Cissy J

2017-01-01

Many factors have been proposed to explain the attrition of women in science, technology, engineering and math fields, among them the lower performance of women in introductory courses resulting from deficits in incoming preparation. We focus on the impact of mixed methods of assessment, which minimizes the impact of high-stakes exams and rewards other methods of assessment such as group participation, low-stakes quizzes and assignments, and in-class activities. We hypothesized that these mixed methods would benefit individuals who otherwise underperform on high-stakes tests. Here, we analyze gender-based performance trends in nine large (N > 1000 students) introductory biology courses in fall 2016. Females underperformed on exams compared to their male counterparts, a difference that does not exist with other methods of assessment that compose course grade. Further, we analyzed three case studies of courses that transitioned their grading schemes to either de-emphasize or emphasize exams as a proportion of total course grade. We demonstrate that the shift away from an exam emphasis consequently benefits female students, thereby closing gaps in overall performance. Further, the exam performance gap itself is reduced when the exams contribute less to overall course grade. We discuss testable predictions that follow from our hypothesis, and advocate for the use of mixed methods of assessments (possibly as part of an overall shift to active learning techniques). We conclude by challenging the student deficit model, and suggest a course deficit model as explanatory of these performance gaps, whereby the microclimate of the classroom can either raise or lower barriers to success for underrepresented groups in STEM.

Can mixed assessment methods make biology classes more equitable?

PubMed Central

Ballen, Cissy J.

2017-01-01

Many factors have been proposed to explain the attrition of women in science, technology, engineering and math fields, among them the lower performance of women in introductory courses resulting from deficits in incoming preparation. We focus on the impact of mixed methods of assessment, which minimizes the impact of high-stakes exams and rewards other methods of assessment such as group participation, low-stakes quizzes and assignments, and in-class activities. We hypothesized that these mixed methods would benefit individuals who otherwise underperform on high-stakes tests. Here, we analyze gender-based performance trends in nine large (N > 1000 students) introductory biology courses in fall 2016. Females underperformed on exams compared to their male counterparts, a difference that does not exist with other methods of assessment that compose course grade. Further, we analyzed three case studies of courses that transitioned their grading schemes to either de-emphasize or emphasize exams as a proportion of total course grade. We demonstrate that the shift away from an exam emphasis consequently benefits female students, thereby closing gaps in overall performance. Further, the exam performance gap itself is reduced when the exams contribute less to overall course grade. We discuss testable predictions that follow from our hypothesis, and advocate for the use of mixed methods of assessments (possibly as part of an overall shift to active learning techniques). We conclude by challenging the student deficit model, and suggest a course deficit model as explanatory of these performance gaps, whereby the microclimate of the classroom can either raise or lower barriers to success for underrepresented groups in STEM. PMID:29281676

Validity of three clinical performance assessments of internal medicine clerks.

PubMed

Hull, A L; Hodder, S; Berger, B; Ginsberg, D; Lindheim, N; Quan, J; Kleinhenz, M E

1995-06-01

To analyze the construct validity of three methods to assess the clinical performances of internal medicine clerks. A multitrait-multimethod (MTMM) study was conducted at the Case Western Reserve University School of Medicine to determine the convergent and divergent validity of a clinical evaluation form (CEF) completed by faculty and residents, an objective structured clinical examination (OSCE), and the medicine subject test of the National Board of Medical Examiners. Three traits were involved in the analysis: clinical skills, knowledge, and personal characteristics. A correlation matrix was computed for 410 third-year students who completed the clerkship between August 1988 and July 1991. There was a significant (p < .01) convergence of the four correlations that assessed the same traits by using different methods. However, the four convergent correlations were of moderate magnitude (ranging from .29 to .47). Divergent validity was assessed by comparing the magnitudes of the convergence correlations with the magnitudes of correlations among unrelated assessments (i.e., different traits by different methods). Seven of nine possible coefficients were smaller than the convergent coefficients, suggesting evidence of divergent validity. A significant CEF method effect was identified. There was convergent validity and some evidence of divergent validity with a significant method effect. The findings were similar for correlations corrected for attenuation. Four conclusions were reached: (1) the reliability of the OSCE must be improved, (2) the CEF ratings must be redesigned to further discriminate among the specific traits assessed, (3) additional methods to assess personal characteristics must be instituted, and (4) several assessment methods should be used to evaluate individual student performances.

Teacher Compliance and Accuracy in State Assessment of Student Motor Skill Performance

ERIC Educational Resources Information Center

Hall, Tina J.; Hicklin, Lori K.; French, Karen E.

2015-01-01

Purpose: The purpose of this study was to investigate teacher compliance with state mandated assessment protocols and teacher accuracy in assessing student motor skill performance. Method: Middle school teachers (N = 116) submitted eighth grade student motor skill performance data from 318 physical education classes to a trained monitoring…

Masticatory performance-related factors in preschool children: establishing a method to assess masticatory performance in preschool children using colour-changeable chewing gum.

PubMed

Hama, Y; Hosoda, A; Komagamine, Y; Gotoh, S; Kubota, C; Kanazawa, M; Minakuchi, S

2017-12-01

A knowledge gap regarding masticatory performance in preschool children exists, which in turn delays intervention for preventive care; therefore, a method to easily assess performance is needed. The purpose of this study is to investigate the feasibility of assessing masticatory performance using colour-changeable chewing gum and to investigate masticatory performance-related factors in preschool children. This cross-sectional survey was conducted in two childcare facilities and our laboratory. First, a one-third quantity of colour-changeable chewing gum was masticated by six adults to assess the nature and progression of colour changes in this quantity. Then, masticatory performance in 370 children 4-6 years of age was assessed using the same quantity of colour-changeable chewing gum (60 chew strokes). The maximum bite force, body height, weight, age and number of healthy teeth were recorded. A t-test was performed to determine whether gum-chewing experience or lack thereof produced a significant difference in masticatory performance. The Spearman's rank correlation coefficient was then determined for masticatory performance assessment values and other factors solely for children with gum-chewing experience. Measurements from 259 children were obtained. Children with gum-chewing experience demons trated significantly higher assessment values and were deemed to have been correctly assessed. A very weak but significant positive correlation was observed only between masticatory performance and the number of healthy teeth. The masticatory performance of preschool children was easily assessed using colour-changeable chewing gum. The assessment values demonstrated significant correlation with the number of healthy teeth, but not with maximum bite force, body height, weight or age. © 2017 John Wiley & Sons Ltd.

Blind image quality assessment based on aesthetic and statistical quality-aware features

NASA Astrophysics Data System (ADS)

Jenadeleh, Mohsen; Masaeli, Mohammad Masood; Moghaddam, Mohsen Ebrahimi

2017-07-01

The main goal of image quality assessment (IQA) methods is the emulation of human perceptual image quality judgments. Therefore, the correlation between objective scores of these methods with human perceptual scores is considered as their performance metric. Human judgment of the image quality implicitly includes many factors when assessing perceptual image qualities such as aesthetics, semantics, context, and various types of visual distortions. The main idea of this paper is to use a host of features that are commonly employed in image aesthetics assessment in order to improve blind image quality assessment (BIQA) methods accuracy. We propose an approach that enriches the features of BIQA methods by integrating a host of aesthetics image features with the features of natural image statistics derived from multiple domains. The proposed features have been used for augmenting five different state-of-the-art BIQA methods, which use statistical natural scene statistics features. Experiments were performed on seven benchmark image quality databases. The experimental results showed significant improvement of the accuracy of the methods.

Towards an operational definition of pharmacy clinical competency

NASA Astrophysics Data System (ADS)

Douglas, Charles Allen

The scope of pharmacy practice and the training of future pharmacists have undergone a strategic shift over the last few decades. The pharmacy profession recognizes greater pharmacist involvement in patient care activities. Towards this strategic objective, pharmacy schools are training future pharmacists to meet these new clinical demands. Pharmacy students have clerkships called Advanced Pharmacy Practice Experiences (APPEs), and these clerkships account for 30% of the professional curriculum. APPEs provide the only opportunity for students to refine clinical skills under the guidance of an experienced pharmacist. Nationwide, schools of pharmacy need to evaluate whether students have successfully completed APPEs and are ready treat patients. Schools are left to their own devices to develop assessment programs that demonstrate to the public and regulatory agencies, students are clinically competent prior to graduation. There is no widely accepted method to evaluate whether these assessment programs actually discriminate between the competent and non-competent students. The central purpose of this study is to demonstrate a rigorous method to evaluate the validity and reliability of APPE assessment programs. The method introduced in this study is applicable to a wide variety of assessment programs. To illustrate this method, the study evaluated new performance criteria with a novel rating scale. The study had two main phases. In the first phase, a Delphi panel was created to bring together expert opinions. Pharmacy schools nominated exceptional preceptors to join a Delphi panel. Delphi is a method to achieve agreement of complex issues among experts. The principal researcher recruited preceptors representing a variety of practice settings and geographical regions. The Delphi panel evaluated and refined the new performance criteria. In the second phase, the study produced a novel set of video vignettes that portrayed student performances based on recommendations of an expert panel. Pharmacy preceptors assessed the performances with the new performance criteria. Estimates of reliability and accuracy from preceptors' assessments can be used to establish benchmarks for future comparisons. Findings from the first phase suggested preceptors held a unique perspective, where APPE assessments are based in relevance to clinical activities. The second phase analyzed assessment results from pharmacy preceptors who watched the video simulations. Reliability results were higher for non-randomized compared to randomized video simulations. Accuracy results showed preceptors more readily identified high and low student performances compared to average students. These results indicated the need for pharmacy preceptor training in performance assessment. The study illustrated a rigorous method to evaluate the validity and reliability of APPE assessment instruments.

What Makes a Change Unsuccessful through the Eyes of Teachers

ERIC Educational Resources Information Center

Cimer, Sabiha Odabasi

2018-01-01

Over the past two decades, Turkey has initiated a reform movement to change her classroom assessment system to accommodate performance-based alternative assessment methods in schools. However, research investigating the impact of assessment reform on learning and teaching in schools report that performance assessment approaches have not been…

Advancing Resident Assessment in Graduate Medical Education

PubMed Central

Swing, Susan R.; Clyman, Stephen G.; Holmboe, Eric S.; Williams, Reed G.

2009-01-01

Background The Outcome Project requires high-quality assessment approaches to provide reliable and valid judgments of the attainment of competencies deemed important for physician practice. Intervention The Accreditation Council for Graduate Medical Education (ACGME) convened the Advisory Committee on Educational Outcome Assessment in 2007–2008 to identify high-quality assessment methods. The assessments selected by this body would form a core set that could be used by all programs in a specialty to assess resident performance and enable initial steps toward establishing national specialty databases of program performance. The committee identified a small set of methods for provisional use and further evaluation. It also developed frameworks and processes to support the ongoing evaluation of methods and the longer-term enhancement of assessment in graduate medical education. Outcome The committee constructed a set of standards, a methodology for applying the standards, and grading rules for their review of assessment method quality. It developed a simple report card for displaying grades on each standard and an overall grade for each method reviewed. It also described an assessment system of factors that influence assessment quality. The committee proposed a coordinated, national-level infrastructure to support enhancements to assessment, including method development and assessor training. It recommended the establishment of a new assessment review group to continue its work of evaluating assessment methods. The committee delivered a report summarizing its activities and 5 related recommendations for implementation to the ACGME Board in September 2008. PMID:21975993

Issues in Benchmarking Human Reliability Analysis Methods: A Literature Review

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ronald L. Boring; Stacey M. L. Hendrickson; John A. Forester

There is a diversity of human reliability analysis (HRA) methods available for use in assessing human performance within probabilistic risk assessments (PRA). Due to the significant differences in the methods, including the scope, approach, and underlying models, there is a need for an empirical comparison investigating the validity and reliability of the methods. To accomplish this empirical comparison, a benchmarking study comparing and evaluating HRA methods in assessing operator performance in simulator experiments is currently underway. In order to account for as many effects as possible in the construction of this benchmarking study, a literature review was conducted, reviewing pastmore » benchmarking studies in the areas of psychology and risk assessment. A number of lessons learned through these studies are presented in order to aid in the design of future HRA benchmarking endeavors.« less

Method performance and multi-laboratory assessment of a normal phase high pressure liquid chromatography-fluorescence detection method for the quantitation of flavanols and procyanidins in cocoa and chocolate containing samples.

PubMed

Robbins, Rebecca J; Leonczak, Jadwiga; Johnson, J Christopher; Li, Julia; Kwik-Uribe, Catherine; Prior, Ronald L; Gu, Liwei

2009-06-12

The quantitative parameters and method performance for a normal-phase HPLC separation of flavanols and procyanidins in chocolate and cocoa-containing food products were optimized and assessed. Single laboratory method performance was examined over three months using three separate secondary standards. RSD(r) ranged from 1.9%, 4.5% to 9.0% for cocoa powder, liquor and chocolate samples containing 74.39, 15.47 and 1.87 mg/g flavanols and procyanidins, respectively. Accuracy was determined by comparison to the NIST Standard Reference Material 2384. Inter-lab assessment indicated that variability was quite low for seven different cocoa-containing samples, with a RSD(R) of less than 10% for the range of samples analyzed.

Performing the lockout/tagout risk assessment.

PubMed

Wallace, W Jon

2007-03-01

Lockout/tagout provides the greatest level routine, repetitive, and integral to the production process, a risk assessment should be performed. If the task performed poses an unacceptable risk, acceptable risk reduction methods should be implemented to reduce the risk to acceptable levels.

Comparison of patient simulation methods used in a physical assessment course.

PubMed

Grice, Gloria R; Wenger, Philip; Brooks, Natalie; Berry, Tricia M

2013-05-13

To determine whether there is a difference in student pharmacists' learning or satisfaction when standardized patients or manikins are used to teach physical assessment. Third-year student pharmacists were randomized to learn physical assessment (cardiac and pulmonary examinations) using either a standardized patient or a manikin. Performance scores on the final examination and satisfaction with the learning method were compared between groups. Eighty and 74 student pharmacists completed the cardiac and pulmonary examinations, respectively. There was no difference in performance scores between student pharmacists who were trained using manikins vs standardized patients (93.8% vs. 93.5%, p=0.81). Student pharmacists who were trained using manikins indicated that they would have probably learned to perform cardiac and pulmonary examinations better had they been taught using standardized patients (p<0.001) and that they were less satisfied with their method of learning (p=0.04). Training using standardized patients and manikins are equally effective methods of learning physical assessment, but student pharmacists preferred using standardized patients.

Performance Measurement and Accommodation: Students with Visual Impairments on Pennsylvania's Alternate Assessment

ERIC Educational Resources Information Center

Zebehazy, Kim T.; Zigmond, Naomi; Zimmerman, George J.

2012-01-01

Introduction: This study investigated the use of accommodations and the performance of students with visual impairments and severe cognitive disabilities on the Pennsylvania Alternate System of Assessment (PASA)yCoan alternate performance-based assessment. Methods: Differences in test scores on the most basic level (level A) of the PASA of 286…

Analysis of Photovoltaic System Energy Performance Evaluation Method

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kurtz, S.; Newmiller, J.; Kimber, A.

2013-11-01

Documentation of the energy yield of a large photovoltaic (PV) system over a substantial period can be useful to measure a performance guarantee, as an assessment of the health of the system, for verification of a performance model to then be applied to a new system, or for a variety of other purposes. Although the measurement of this performance metric might appear to be straight forward, there are a number of subtleties associated with variations in weather and imperfect data collection that complicate the determination and data analysis. A performance assessment is most valuable when it is completed with amore » very low uncertainty and when the subtleties are systematically addressed, yet currently no standard exists to guide this process. This report summarizes a draft methodology for an Energy Performance Evaluation Method, the philosophy behind the draft method, and the lessons that were learned by implementing the method.« less

Bone age assessment by dual-energy X-ray absorptiometry in children: an alternative for X-ray?

PubMed

Heppe, D H M; Taal, H R; Ernst, G D S; Van Den Akker, E L T; Lequin, M M H; Hokken-Koelega, A C S; Geelhoed, J J M; Jaddoe, V W V

2012-02-01

The aim of the study was to validate dual-energy X-ray absorptiometry (DXA) as a method to assess bone age in children. Paired dual-energy X-ray absorptiometry (DXA) scans and X-rays of the left hand were performed in 95 children who attended the paediatric endocrinology outpatient clinic of University Hospital Rotterdam, the Netherlands. We compared bone age assessments by DXA scan with those performed by X-ray. Bone age assessment was performed by two blinded observers according to the reference method of Greulich and Pyle. Intra-observer and interobserver reproducibility were investigated using the intraclass correlation coefficient (ICC), and agreement was tested using Bland and Altman plots. The intra-observer ICCs for both observers were 0.997 and 0.991 for X-ray and 0.993 and 0.987 for DXA assessments. The interobserver ICC was 0.993 and 0.991 for X-ray and DXA assessments, respectively. The mean difference between bone age assessed by X-ray and DXA was 0.11 years. The limits of agreement ranged from -0.82 to 1.05 years, which means that 95% of all differences between the methods were covered by this range. Results of bone age assessment by DXA scan are similar to those obtained by X-ray. The DXA method seems to be an alternative for assessing bone age in a paediatric hospital-based population.

High-speed engine/component performance assessment using exergy and thrust-based methods

NASA Technical Reports Server (NTRS)

Riggins, D. W.

1996-01-01

This investigation summarizes a comparative study of two high-speed engine performance assessment techniques based on energy (available work) and thrust-potential (thrust availability). Simple flow-fields utilizing Rayleigh heat addition and one-dimensional flow with friction are used to demonstrate the fundamental inability of conventional energy techniques to predict engine component performance, aid in component design, or accurately assess flow losses. The use of the thrust-based method on these same examples demonstrates its ability to yield useful information in all these categories. Energy and thrust are related and discussed from the stand-point of their fundamental thermodynamic and fluid dynamic definitions in order to explain the differences in information obtained using the two methods. The conventional definition of energy is shown to include work which is inherently unavailable to an aerospace Brayton engine. An engine-based energy is then developed which accurately accounts for this inherently unavailable work; performance parameters based on this quantity are then shown to yield design and loss information equivalent to the thrust-based method.

Implementation of ANP Method in Determining Supplier to Improve Service towards Supermarket Consumers

NASA Astrophysics Data System (ADS)

Mulyanto, A.; Amalia, T. H.; Novian, D.; Kaluku, M. R. A.

2017-03-01

Performance assessment on the supplier by the supermarket manager is relatively difficult to conduct and implies subjectivity, because there is no measureable and objective performance indicator. This study aims to assist in the decision making process and to look for alternative solutions in assessing the performance of each supplier, so that the service towards the customers will improve as well. ANP method is used to find the weight of each sub-criteria that will be used to measure the supplier performance. The weight result of each sub-criteria derived from the ANP method is used again in measuring the performance and to rank the performance of each supplier by using TOPSIS method. Performance measuring by using the ANP and TOPSIS that generates the highest value of the supplier is 0.71666 while the lowest value is 0.24825. The result of this study shows that the ANP and TOPSIS methods can be used to measure the supplier performance therefore it can assist the selection of supplier which can increase service towards the mart’s consumers.

Statistical assessment of the learning curves of health technologies.

PubMed

Ramsay, C R; Grant, A M; Wallace, S A; Garthwaite, P H; Monk, A F; Russell, I T

2001-01-01

(1) To describe systematically studies that directly assessed the learning curve effect of health technologies. (2) Systematically to identify 'novel' statistical techniques applied to learning curve data in other fields, such as psychology and manufacturing. (3) To test these statistical techniques in data sets from studies of varying designs to assess health technologies in which learning curve effects are known to exist. METHODS - STUDY SELECTION (HEALTH TECHNOLOGY ASSESSMENT LITERATURE REVIEW): For a study to be included, it had to include a formal analysis of the learning curve of a health technology using a graphical, tabular or statistical technique. METHODS - STUDY SELECTION (NON-HEALTH TECHNOLOGY ASSESSMENT LITERATURE SEARCH): For a study to be included, it had to include a formal assessment of a learning curve using a statistical technique that had not been identified in the previous search. METHODS - DATA SOURCES: Six clinical and 16 non-clinical biomedical databases were searched. A limited amount of handsearching and scanning of reference lists was also undertaken. METHODS - DATA EXTRACTION (HEALTH TECHNOLOGY ASSESSMENT LITERATURE REVIEW): A number of study characteristics were abstracted from the papers such as study design, study size, number of operators and the statistical method used. METHODS - DATA EXTRACTION (NON-HEALTH TECHNOLOGY ASSESSMENT LITERATURE SEARCH): The new statistical techniques identified were categorised into four subgroups of increasing complexity: exploratory data analysis; simple series data analysis; complex data structure analysis, generic techniques. METHODS - TESTING OF STATISTICAL METHODS: Some of the statistical methods identified in the systematic searches for single (simple) operator series data and for multiple (complex) operator series data were illustrated and explored using three data sets. The first was a case series of 190 consecutive laparoscopic fundoplication procedures performed by a single surgeon; the second was a case series of consecutive laparoscopic cholecystectomy procedures performed by ten surgeons; the third was randomised trial data derived from the laparoscopic procedure arm of a multicentre trial of groin hernia repair, supplemented by data from non-randomised operations performed during the trial. RESULTS - HEALTH TECHNOLOGY ASSESSMENT LITERATURE REVIEW: Of 4571 abstracts identified, 272 (6%) were later included in the study after review of the full paper. Some 51% of studies assessed a surgical minimal access technique and 95% were case series. The statistical method used most often (60%) was splitting the data into consecutive parts (such as halves or thirds), with only 14% attempting a more formal statistical analysis. The reporting of the studies was poor, with 31% giving no details of data collection methods. RESULTS - NON-HEALTH TECHNOLOGY ASSESSMENT LITERATURE SEARCH: Of 9431 abstracts assessed, 115 (1%) were deemed appropriate for further investigation and, of these, 18 were included in the study. All of the methods for complex data sets were identified in the non-clinical literature. These were discriminant analysis, two-stage estimation of learning rates, generalised estimating equations, multilevel models, latent curve models, time series models and stochastic parameter models. In addition, eight new shapes of learning curves were identified. RESULTS - TESTING OF STATISTICAL METHODS: No one particular shape of learning curve performed significantly better than another. The performance of 'operation time' as a proxy for learning differed between the three procedures. Multilevel modelling using the laparoscopic cholecystectomy data demonstrated and measured surgeon-specific and confounding effects. The inclusion of non-randomised cases, despite the possible limitations of the method, enhanced the interpretation of learning effects. CONCLUSIONS - HEALTH TECHNOLOGY ASSESSMENT LITERATURE REVIEW: The statistical methods used for assessing learning effects in health technology assessment have been crude and the reporting of studies poor. CONCLUSIONS - NON-HEALTH TECHNOLOGY ASSESSMENT LITERATURE SEARCH: A number of statistical methods for assessing learning effects were identified that had not hitherto been used in health technology assessment. There was a hierarchy of methods for the identification and measurement of learning, and the more sophisticated methods for both have had little if any use in health technology assessment. This demonstrated the value of considering fields outside clinical research when addressing methodological issues in health technology assessment. CONCLUSIONS - TESTING OF STATISTICAL METHODS: It has been demonstrated that the portfolio of techniques identified can enhance investigations of learning curve effects. (ABSTRACT TRUNCATED)

Sensors vs. experts - a performance comparison of sensor-based fall risk assessment vs. conventional assessment in a sample of geriatric patients.

PubMed

Marschollek, Michael; Rehwald, Anja; Wolf, Klaus-Hendrik; Gietzelt, Matthias; Nemitz, Gerhard; zu Schwabedissen, Hubertus Meyer; Schulze, Mareike

2011-06-28

Fall events contribute significantly to mortality, morbidity and costs in our ageing population. In order to identify persons at risk and to target preventive measures, many scores and assessment tools have been developed. These often require expertise and are costly to implement. Recent research investigates the use of wearable inertial sensors to provide objective data on motion features which can be used to assess individual fall risk automatically. So far it is unknown how well this new method performs in comparison with conventional fall risk assessment tools. The aim of our research is to compare the predictive performance of our new sensor-based method with conventional and established methods, based on prospective data. In a first study phase, 119 inpatients of a geriatric clinic took part in motion measurements using a wireless triaxial accelerometer during a Timed Up&Go (TUG) test and a 20 m walk. Furthermore, the St. Thomas Risk Assessment Tool in Falling Elderly Inpatients (STRATIFY) was performed, and the multidisciplinary geriatric care team estimated the patients' fall risk. In a second follow-up phase of the study, 46 of the participants were interviewed after one year, including a fall and activity assessment. The predictive performances of the TUG, the STRATIFY and team scores are compared. Furthermore, two automatically induced logistic regression models based on conventional clinical and assessment data (CONV) as well as sensor data (SENSOR) are matched. Among the risk assessment scores, the geriatric team score (sensitivity 56%, specificity 80%) outperforms STRATIFY and TUG. The induced logistic regression models CONV and SENSOR achieve similar performance values (sensitivity 68%/58%, specificity 74%/78%, AUC 0.74/0.72, +LR 2.64/2.61). Both models are able to identify more persons at risk than the simple scores. Sensor-based objective measurements of motion parameters in geriatric patients can be used to assess individual fall risk, and our prediction model's performance matches that of a model based on conventional clinical and assessment data. Sensor-based measurements using a small wearable device may contribute significant information to conventional methods and are feasible in an unsupervised setting. More prospective research is needed to assess the cost-benefit relation of our approach.

Current Knowledge and Projection on Assessing the Effectiveness of Training.

ERIC Educational Resources Information Center

Orlansky, Jesse

This discussion of methods used to assess the effectiveness of training for U.S. Army personnel identifies various types of training, describes methods currently used, and suggests ways of improving the assessment process. The methodology and results of assessments of effectiveness, including the costs associated with the level of performance, are…

A meta-analytic review of self-reported, clinician-rated, and performance-based motivation measures in schizophrenia: Are we measuring the same "stuff"?

PubMed

Luther, Lauren; Firmin, Ruth L; Lysaker, Paul H; Minor, Kyle S; Salyers, Michelle P

2018-04-07

An array of self-reported, clinician-rated, and performance-based measures has been used to assess motivation in schizophrenia; however, the convergent validity evidence for these motivation assessment methods is mixed. The current study is a series of meta-analyses that summarize the relationships between methods of motivation measurement in 45 studies of people with schizophrenia. The overall mean effect size between self-reported and clinician-rated motivation measures (r = 0.27, k = 33) was significant, positive, and approaching medium in magnitude, and the overall effect size between performance-based and clinician-rated motivation measures (r = 0.21, k = 11) was positive, significant, and small in magnitude. The overall mean effect size between self-reported and performance-based motivation measures was negligible and non-significant (r = -0.001, k = 2), but this meta-analysis was underpowered. Findings suggest modest convergent validity between clinician-rated and both self-reported and performance-based motivation measures, but additional work is needed to clarify the convergent validity between self-reported and performance-based measures. Further, there is likely more variability than similarity in the underlying construct that is being assessed across the three methods, particularly between the performance-based and other motivation measurement types. These motivation assessment methods should not be used interchangeably, and measures should be more precisely described as the specific motivational construct or domain they are capturing. Copyright © 2018 Elsevier Ltd. All rights reserved.

A RRKM study and a DFT assessment on gas-phase fragmentation of formamide-M(2+) (M = Ca, Sr).

PubMed

Martín-Sómer, Ana; Gaigeot, Marie-Pierre; Yáñez, Manuel; Spezia, Riccardo

2014-07-28

A kinetic study of the unimolecular reactivity of formamide-M(2+) (M = Ca, Sr) systems was carried out by means of RRKM statistical theory using high-level DFT. The results predict M(2+), [M(NH2)](+) and [HCO](+) as the main products, together with an intermediate that could eventually evolve to produce [M(NH3)](2+) and CO, for high values of internal energy. In this framework, we also evaluated the influence of the external rotational energy on the reaction rate constants. In order to find a method to perform reliable electronic structure calculations for formamide-M(2+) (M = Ca, Sr) at a relatively low computational cost, an assessment of different methods was performed. In the first assessment twenty-one functionals, belonging to different DFT categories, and an MP2 wave function method using a small basis set were evaluated. CCSD(T)/cc-pWCVTZ single point calculations were used as reference. A second assessment has been performed on geometries and energies. We found BLYP/6-31G(d) and G96LYP/6-31+G(d,p) as the best performing methods, for formamide-Ca(2+) and formamide-Sr(2+), respectively. Furthermore, a detailed assessment was done on RRKM reactivity and G96LYP/6-31G(d) provided results in agreement with higher level calculations. The combination of geometrical, energetics and kinetics (RRKM) criteria to evaluate DFT functionals is rather unusual and provides an original assessment procedure. Overall, we suggest using G96LYP as the best performing functional with a small basis set for both systems.

Massive integration of diverse protein quality assessment methods to improve template based modeling in CASP11

PubMed Central

Cao, Renzhi; Bhattacharya, Debswapna; Adhikari, Badri; Li, Jilong; Cheng, Jianlin

2015-01-01

Model evaluation and selection is an important step and a big challenge in template-based protein structure prediction. Individual model quality assessment methods designed for recognizing some specific properties of protein structures often fail to consistently select good models from a model pool because of their limitations. Therefore, combining multiple complimentary quality assessment methods is useful for improving model ranking and consequently tertiary structure prediction. Here, we report the performance and analysis of our human tertiary structure predictor (MULTICOM) based on the massive integration of 14 diverse complementary quality assessment methods that was successfully benchmarked in the 11th Critical Assessment of Techniques of Protein Structure prediction (CASP11). The predictions of MULTICOM for 39 template-based domains were rigorously assessed by six scoring metrics covering global topology of Cα trace, local all-atom fitness, side chain quality, and physical reasonableness of the model. The results show that the massive integration of complementary, diverse single-model and multi-model quality assessment methods can effectively leverage the strength of single-model methods in distinguishing quality variation among similar good models and the advantage of multi-model quality assessment methods of identifying reasonable average-quality models. The overall excellent performance of the MULTICOM predictor demonstrates that integrating a large number of model quality assessment methods in conjunction with model clustering is a useful approach to improve the accuracy, diversity, and consequently robustness of template-based protein structure prediction. PMID:26369671

Effectiveness evaluation of objective and subjective weighting methods for aquifer vulnerability assessment in urban context

NASA Astrophysics Data System (ADS)

Sahoo, Madhumita; Sahoo, Satiprasad; Dhar, Anirban; Pradhan, Biswajeet

2016-10-01

Groundwater vulnerability assessment has been an accepted practice to identify the zones with relatively increased potential for groundwater contamination. DRASTIC is the most popular secondary information-based vulnerability assessment approach. Original DRASTIC approach considers relative importance of features/sub-features based on subjective weighting/rating values. However variability of features at a smaller scale is not reflected in this subjective vulnerability assessment process. In contrast to the subjective approach, the objective weighting-based methods provide flexibility in weight assignment depending on the variation of the local system. However experts' opinion is not directly considered in the objective weighting-based methods. Thus effectiveness of both subjective and objective weighting-based approaches needs to be evaluated. In the present study, three methods - Entropy information method (E-DRASTIC), Fuzzy pattern recognition method (F-DRASTIC) and Single parameter sensitivity analysis (SA-DRASTIC), were used to modify the weights of the original DRASTIC features to include local variability. Moreover, a grey incidence analysis was used to evaluate the relative performance of subjective (DRASTIC and SA-DRASTIC) and objective (E-DRASTIC and F-DRASTIC) weighting-based methods. The performance of the developed methodology was tested in an urban area of Kanpur City, India. Relative performance of the subjective and objective methods varies with the choice of water quality parameters. This methodology can be applied without/with suitable modification. These evaluations establish the potential applicability of the methodology for general vulnerability assessment in urban context.

Energy Information Systems

Science.gov Websites

Energy Analytics Campaign > 2014-2018 Assessment of Automated M&V Methods > 2012-2018 Better Assessment of automated measurement and verification methods. Granderson, J. et al. Lawrence Berkeley . PDF, 726 KB Performance Metrics and Objective Testing Methods for Energy Baseline Modeling Software

The Assessment of Performance in Science Project.

ERIC Educational Resources Information Center

Driver, Rosalind; Worsley, Christopher

1979-01-01

Described are national methods of assessing and monitoring the achievement in science of students of 11, 13, and 16 years old in England and Wales. The tasks of the Assessment of Performance Unit (APU), a unit within the Department of Education and Science, are also described. (HM)

Performance assessment in algebra learning process

NASA Astrophysics Data System (ADS)

Lestariani, Ida; Sujadi, Imam; Pramudya, Ikrar

2017-12-01

The purpose of research to describe the implementation of performance assessment on algebra learning process. The subject in this research is math educator of SMAN 1 Ngawi class X. This research includes descriptive qualitative research type. Techniques of data collecting are done by observation method, interview, and documentation. Data analysis technique is done by data reduction, data presentation, and conclusion. The results showed any indication that the steps taken by the educator in applying the performance assessment are 1) preparing individual worksheets and group worksheets, 2) preparing rubric assessments for independent worksheets and groups and 3) making performance assessments rubric to learners’ performance results with individual or groups task.

Best Practices in Academic Assessment in Higher Education: A Case in Formative and Shared Assessment

ERIC Educational Resources Information Center

López Pastor, Víctor M.

2011-01-01

The aim of this article is three-fold: (a) to present an example of best practices in formative assessment in university instruction, offering three different methods of learning and assessment to pass a subject; (b) to analyze differences in academic performance depending on method of learning and assessment chosen; (c) to consider professors'…

Predictive Validity of Measures of the Pathfinder Scaling Algorithm on Programming Performance: Alternative Assessment Strategy for Programming Education

ERIC Educational Resources Information Center

Lau, Wilfred W. F.; Yuen, Allan H. K.

2009-01-01

Recent years have seen a shift in focus from assessment of learning to assessment for learning and the emergence of alternative assessment methods. However, the reliability and validity of these methods as assessment tools are still questionable. In this article, we investigated the predictive validity of measures of the Pathfinder Scaling…

Self-assessed performance improves statistical fusion of image labels

PubMed Central

Bryan, Frederick W.; Xu, Zhoubing; Asman, Andrew J.; Allen, Wade M.; Reich, Daniel S.; Landman, Bennett A.

2014-01-01

Purpose: Expert manual labeling is the gold standard for image segmentation, but this process is difficult, time-consuming, and prone to inter-individual differences. While fully automated methods have successfully targeted many anatomies, automated methods have not yet been developed for numerous essential structures (e.g., the internal structure of the spinal cord as seen on magnetic resonance imaging). Collaborative labeling is a new paradigm that offers a robust alternative that may realize both the throughput of automation and the guidance of experts. Yet, distributing manual labeling expertise across individuals and sites introduces potential human factors concerns (e.g., training, software usability) and statistical considerations (e.g., fusion of information, assessment of confidence, bias) that must be further explored. During the labeling process, it is simple to ask raters to self-assess the confidence of their labels, but this is rarely done and has not been previously quantitatively studied. Herein, the authors explore the utility of self-assessment in relation to automated assessment of rater performance in the context of statistical fusion. Methods: The authors conducted a study of 66 volumes manually labeled by 75 minimally trained human raters recruited from the university undergraduate population. Raters were given 15 min of training during which they were shown examples of correct segmentation, and the online segmentation tool was demonstrated. The volumes were labeled 2D slice-wise, and the slices were unordered. A self-assessed quality metric was produced by raters for each slice by marking a confidence bar superimposed on the slice. Volumes produced by both voting and statistical fusion algorithms were compared against a set of expert segmentations of the same volumes. Results: Labels for 8825 distinct slices were obtained. Simple majority voting resulted in statistically poorer performance than voting weighted by self-assessed performance. Statistical fusion resulted in statistically indistinguishable performance from self-assessed weighted voting. The authors developed a new theoretical basis for using self-assessed performance in the framework of statistical fusion and demonstrated that the combined sources of information (both statistical assessment and self-assessment) yielded statistically significant improvement over the methods considered separately. Conclusions: The authors present the first systematic characterization of self-assessed performance in manual labeling. The authors demonstrate that self-assessment and statistical fusion yield similar, but complementary, benefits for label fusion. Finally, the authors present a new theoretical basis for combining self-assessments with statistical label fusion. PMID:24593721

The model of flood control using servqual method and importance performance analysis in Surakarta City – Indonesia

NASA Astrophysics Data System (ADS)

Titi Purwantini, V.; Sutanto, Yusuf

2018-05-01

This research is to create a model of flood control in the city of Surakarta using Servqual method and Importance Performance Analysis. Service quality is generally defined as the overall assessment of a service by the customersor the extent to which a service meets customer’s needs or expectations. The purpose of this study is to find the first model of flood control that is appropriate to the condition of the community. Surakarta This means looking for a model that can provide satisfactory service for the people of Surakarta who are in the location of the flood. The second is to find the right model to improve service performance of Surakarta City Government in serving the people in flood location. The method used to determine the satisfaction of the public on the quality of service is to see the difference in the quality of service expected by the community with the reality. This method is Servqual Method While to assess the performance of city government officials is by comparing the actual performance with the quality of services provided, this method is This means looking for a model that can provide satisfactory service for the people of Surakarta who are in the location of the flood.The second is to find the right model to improve service performance of Surakarta City Government in serving the people in flood location. The method used to determine the satisfaction of the public on the quality of service is to see the difference in the quality of service expected by the community with the reality. This method is Servqual Method While to assess the performance of city government officials is by comparing the actual performance with the quality of services provided, this method is Importance Performance Analysis. Samples were people living in flooded areas in the city of Surakarta. Result this research is Satisfaction = Responsiveness+ Realibility + Assurance + Empathy+ Tangible (Servqual Model) and Importance Performance Analysis is From Cartesian diagram can be made Flood Control Formula as follow: Food Control = High performance

A deep learning approach for fetal QRS complex detection.

PubMed

Zhong, Wei; Liao, Lijuan; Guo, Xuemei; Wang, Guoli

2018-04-20

Non-invasive foetal electrocardiography (NI-FECG) has the potential to provide more additional clinical information for detecting and diagnosing fetal diseases. We propose and demonstrate a deep learning approach for fetal QRS complex detection from raw NI-FECG signals by using a convolutional neural network (CNN) model. The main objective is to investigate whether reliable fetal QRS complex detection performance can still be obtained from features of single-channel NI-FECG signals, without canceling maternal ECG (MECG) signals. A deep learning method is proposed for recognizing fetal QRS complexes. Firstly, we collect data from set-a of the PhysioNet/computing in Cardiology Challenge database. The sample entropy method is used for signal quality assessment. Part of the bad quality signals is excluded in the further analysis. Secondly, in the proposed method, the features of raw NI-FECG signals are normalized before they are fed to a CNN classifier to perform fetal QRS complex detection. We use precision, recall, F-measure and accuracy as the evaluation metrics to assess the performance of fetal QRS complex detection. The proposed deep learning method can achieve relatively high precision (75.33%), recall (80.54%), and F-measure scores (77.85%) compared with three other well-known pattern classification methods, namely KNN, naive Bayes and SVM. the proposed deep learning method can attain reliable fetal QRS complex detection performance from the raw NI-FECG signals without canceling MECG signals. In addition, the influence of different activation functions and signal quality assessment on classification performance are evaluated, and results show that Relu outperforms the Sigmoid and Tanh on this particular task, and better classification performance is obtained with the signal quality assessment step in this study.

Which Assessment Method of Malnutrition in Head and Neck Cancer?

PubMed

Saroul, Nicolas; Pastourel, Rémy; Mulliez, Aurélien; Farigon, Nicolas; Dupuch, Vincent; Mom, Thierry; Boirie, Yves; Gilain, Laurent

2018-06-01

Objective To assess the value of several diagnostic methods of nutritional status during the initial management of a head and neck cancer. Study Design Single-center prospective study. Setting Tertiary referral center. Subjects and Methods Ninety patients with head and neck cancer participated in the study. Assessment of their nutritional status was made with anthropometric, biological, body, and muscle measurements (the last by computed tomography: L3 muscle mass index [L3MMI]). Assessment of muscle performance (functional reflection of nutritional status) was made via the Short Physical Performance Battery test. The malnutrition thresholds were set according to the literature. Results Mean body mass index (BMI) was 24.6 ± 5.4 kg/m 2 . Mean weight loss and albumin levels were -4.5 ± 10.5 kg and 37.1 ± 5.2 g/L, respectively. Fourteen percent of patients were diagnosed as malnourished on the basis of BMI, 54% according to the Nutritional Risk Index (NRI), and 58% by L3MMI. There was 64% agreement between NRI and L3MMI ( P < .001). All patients identified as malnourished by BMI were considered as such by the other assessment methods; however, many malnourished patients had normal or high BMI. The Short Physical Performance Battery score was low particularly among patients considered to be the most undernourished by the other methods. Conclusion NRI and L3MMI are the best methods to identify patients as being malnourished. Functional muscle assessment can determine the severity of malnutrition.

Assessing family medicine trainees--what can we learn from the European neighbours?

PubMed

Flum, Elisabeth; Maagaard, Roar; Godycki-Cwirko, Maciek; Scarborough, Nigel; Scherpbier, Nynke; Ledig, Thomas; Roos, Marco; Steinhäuser, Jost

2015-01-01

Although demands on family physicians (FP) are to a large extent similar in the European Union, uniform assessment standards for family medicine (FM) specialty training and assessment do not exist. Aim of this pilot study was to elicit and compare the different modalities and assessment methods of FM specialty training in five European countries. A semi structured survey was undertaken based on a convenient sample in five European countries (Denmark, Germany, Poland, the Netherlands and the United Kingdom). The respondents were asked to respond to ten items about aspects of FM specialty training and assessment methods in their respective countries. If available, this data was completed with information from official websites of the countries involved. FM specialty training is performed heterogeneously in the surveyed countries. Training time periods range from three to five years, in some countries requiring a foundation program of up to two years. Most countries perform longitudinal assessment during FM specialty training using a combination of competence-based approach with additional formative and summative assessment. There is some evidence on the assessments methods used, however the assessment method used and costs of assessment differs remarkably between the participating countries. Longitudinal and competence-based assessment is the presently preferred approach for FM specialty training. Countries which use less multifaceted methods for assessment could learn from best practice. Potential changes have significant cost implications.

Wisdom of crowds for robust gene network inference

PubMed Central

Marbach, Daniel; Costello, James C.; Küffner, Robert; Vega, Nicci; Prill, Robert J.; Camacho, Diogo M.; Allison, Kyle R.; Kellis, Manolis; Collins, James J.; Stolovitzky, Gustavo

2012-01-01

Reconstructing gene regulatory networks from high-throughput data is a long-standing problem. Through the DREAM project (Dialogue on Reverse Engineering Assessment and Methods), we performed a comprehensive blind assessment of over thirty network inference methods on Escherichia coli, Staphylococcus aureus, Saccharomyces cerevisiae, and in silico microarray data. We characterize performance, data requirements, and inherent biases of different inference approaches offering guidelines for both algorithm application and development. We observe that no single inference method performs optimally across all datasets. In contrast, integration of predictions from multiple inference methods shows robust and high performance across diverse datasets. Thereby, we construct high-confidence networks for E. coli and S. aureus, each comprising ~1700 transcriptional interactions at an estimated precision of 50%. We experimentally test 53 novel interactions in E. coli, of which 23 were supported (43%). Our results establish community-based methods as a powerful and robust tool for the inference of transcriptional gene regulatory networks. PMID:22796662

How Should Blood Glucose Meter System Analytical Performance Be Assessed?

PubMed

Simmons, David A

2015-08-31

Blood glucose meter system analytical performance is assessed by comparing pairs of meter system and reference instrument blood glucose measurements measured over time and across a broad array of glucose values. Consequently, no single, complete, and ideal parameter can fully describe the difference between meter system and reference results. Instead, a number of assessment tools, both graphical (eg, regression plots, modified Bland-Altman plots, and error grid analysis) and tabular (eg, International Organization for Standardization guidelines, mean absolute difference, and mean absolute relative difference) have been developed to evaluate meter system performance. The strengths and weaknesses of these methods of presenting meter system performance data, including a new method known as Radar Plots, are described here. © 2015 Diabetes Technology Society.

A Study of the Effect of HyperCard and Pen-Paper Performance Assessment Methods on Expert-Novice Chemistry Problem Solving.

ERIC Educational Resources Information Center

Kumar, David D.; And Others

1994-01-01

Investigates HyperCard as a tool for assessment in science education and determines whether or not a HyperCard assessment instrument could differentiate between expert and novice student performance on balancing stoichiometric equations in science education. (ZWH)

Great Performances: Creating Classroom-Based Assessment Tasks. Second Edition

ERIC Educational Resources Information Center

Shoemaker, Betty; Lewin, Larry

2011-01-01

Get an in-depth understanding of how to create fun, engaging, and challenging performance assessments that require students to elaborate on content and demonstrate mastery of skills. This update of an ASCD (Association for Supervision and Curriculum Development) classic includes new scoring methods, reading assessments, and insights on navigating…

Method of assessing heterogeneity in images

DOEpatents

Jacob, Richard E.; Carson, James P.

2016-08-23

A method of assessing heterogeneity in images is disclosed. 3D images of an object are acquired. The acquired images may be filtered and masked. Iterative decomposition is performed on the masked images to obtain image subdivisions that are relatively homogeneous. Comparative analysis, such as variogram analysis or correlogram analysis, is performed of the decomposed images to determine spatial relationships between regions of the images that are relatively homogeneous.

Information and problem report usage in system saftey engineering division

NASA Technical Reports Server (NTRS)

Morrissey, Stephen J.

1990-01-01

Five basic problems or question areas are examined. They are as follows: (1) Evaluate adequacy of current problem/performance data base; (2) Evaluate methods of performing trend analysis; (3) Methods and sources of data for probabilistic risk assessment; and (4) How is risk assessment documentation upgraded and/or updated. The fifth problem was to provide recommendations for each of the above four areas.

Survey of the Methods and Reporting Practices in Published Meta-analyses of Test Performance: 1987 to 2009

ERIC Educational Resources Information Center

Dahabreh, Issa J.; Chung, Mei; Kitsios, Georgios D.; Terasawa, Teruhiko; Raman, Gowri; Tatsioni, Athina; Tobar, Annette; Lau, Joseph; Trikalinos, Thomas A.; Schmid, Christopher H.

2013-01-01

We performed a survey of meta-analyses of test performance to describe the evolution in their methods and reporting. Studies were identified through MEDLINE (1966-2009), reference lists, and relevant reviews. We extracted information on clinical topics, literature review methods, quality assessment, and statistical analyses. We reviewed 760…

Parasitology: United Kingdom National Quality Assessment Scheme.

PubMed Central

Hawthorne, M.; Chiodini, P. L.; Snell, J. J.; Moody, A. H.; Ramsay, A.

1992-01-01

AIMS: To assess the results from parasitology laboratories taking part in a quality assessment scheme between 1986 and 1991; and to compare performance with repeat specimens. METHODS: Quality assessment of blood parasitology, including tissue parasites (n = 444; 358 UK, 86 overseas), and faecal parasitology, including extra-intestinal parasites (n = 205; 141 UK, 64 overseas), was performed. RESULTS: Overall, the standard of performance was poor. A questionnaire distributed to participants showed that a wide range of methods was used, some of which were considered inadequate to achieve reliable results. Teaching material was distributed to participants from time to time in an attempt to improve standards. CONCLUSIONS: Since the closure of the IMLS fellowship course in 1972, fewer opportunities for specialised training in parasitology are available: more training is needed. Poor performance in the detection of malarial parasites is mainly attributable to incorrect speciation, misidentification, and lack of equipment such as an eyepiece graticule. PMID:1452791

Massive integration of diverse protein quality assessment methods to improve template based modeling in CASP11.

PubMed

Cao, Renzhi; Bhattacharya, Debswapna; Adhikari, Badri; Li, Jilong; Cheng, Jianlin

2016-09-01

Model evaluation and selection is an important step and a big challenge in template-based protein structure prediction. Individual model quality assessment methods designed for recognizing some specific properties of protein structures often fail to consistently select good models from a model pool because of their limitations. Therefore, combining multiple complimentary quality assessment methods is useful for improving model ranking and consequently tertiary structure prediction. Here, we report the performance and analysis of our human tertiary structure predictor (MULTICOM) based on the massive integration of 14 diverse complementary quality assessment methods that was successfully benchmarked in the 11th Critical Assessment of Techniques of Protein Structure prediction (CASP11). The predictions of MULTICOM for 39 template-based domains were rigorously assessed by six scoring metrics covering global topology of Cα trace, local all-atom fitness, side chain quality, and physical reasonableness of the model. The results show that the massive integration of complementary, diverse single-model and multi-model quality assessment methods can effectively leverage the strength of single-model methods in distinguishing quality variation among similar good models and the advantage of multi-model quality assessment methods of identifying reasonable average-quality models. The overall excellent performance of the MULTICOM predictor demonstrates that integrating a large number of model quality assessment methods in conjunction with model clustering is a useful approach to improve the accuracy, diversity, and consequently robustness of template-based protein structure prediction. Proteins 2016; 84(Suppl 1):247-259. © 2015 Wiley Periodicals, Inc. © 2015 Wiley Periodicals, Inc.

Space use optimisation and sustainability-environmental assessment of space use concepts.

PubMed

van den Dobbelsteen, Andy; de Wilde, Sebastiaan

2004-11-01

In this paper, as part of a diptych, we discuss the factor space as a means of improving the environmental performance of building projects. There are indicators for space use efficiency and several more or less broadly supported methods for assessment of environmental issues such as ecological quality, use of building materials and energy consumption. These are discussed in this paper. Assessment methods coupling space use to environmental indicators had not been available until now. Beforehand, plans with different spatial properties could therefore not be environmentally compared. We present a method for the implementation of space use in assessments concerning sustainability. This method was applied to the urban case study presented in our second paper in this journal. In this paper, we also present solutions for improved environmental performance through intensive and multiple use of space in the second, third and fourth dimension.

Extracting information in spike time patterns with wavelets and information theory.

PubMed

Lopes-dos-Santos, Vítor; Panzeri, Stefano; Kayser, Christoph; Diamond, Mathew E; Quian Quiroga, Rodrigo

2015-02-01

We present a new method to assess the information carried by temporal patterns in spike trains. The method first performs a wavelet decomposition of the spike trains, then uses Shannon information to select a subset of coefficients carrying information, and finally assesses timing information in terms of decoding performance: the ability to identify the presented stimuli from spike train patterns. We show that the method allows: 1) a robust assessment of the information carried by spike time patterns even when this is distributed across multiple time scales and time points; 2) an effective denoising of the raster plots that improves the estimate of stimulus tuning of spike trains; and 3) an assessment of the information carried by temporally coordinated spikes across neurons. Using simulated data, we demonstrate that the Wavelet-Information (WI) method performs better and is more robust to spike time-jitter, background noise, and sample size than well-established approaches, such as principal component analysis, direct estimates of information from digitized spike trains, or a metric-based method. Furthermore, when applied to real spike trains from monkey auditory cortex and from rat barrel cortex, the WI method allows extracting larger amounts of spike timing information. Importantly, the fact that the WI method incorporates multiple time scales makes it robust to the choice of partly arbitrary parameters such as temporal resolution, response window length, number of response features considered, and the number of available trials. These results highlight the potential of the proposed method for accurate and objective assessments of how spike timing encodes information. Copyright © 2015 the American Physiological Society.

Promoting Physicians' Self-Assessment and Quality Improvement: The ABIM Diabetes Practice Improvement Module

ERIC Educational Resources Information Center

Holmboe, Eric S.; Meehan, Thomas P.; Lynn, Lorna; Doyle, Paula; Sherwin, Tierney; Duffy, F. Daniel

2006-01-01

Introduction: The American Board of Internal Medicine (ABIM) recognized that certification and recertification must be based on an assessment of performance in practice as well as an examination of medical knowledge. Physician self-assessment of practice performance is proposed as one method that certification boards may use to evaluate competence…

Adapting Objective Structured Clinical Examinations to Assess Social Work Students' Performance and Reflections

ERIC Educational Resources Information Center

Bogo, Marion; Regehr, Cheryl; Logie, Carmen; Katz, Ellen; Mylopoulos, Maria; Regehr, Glenn

2011-01-01

The development of standardized, valid, and reliable methods for assessment of students' practice competence continues to be a challenge for social work educators. In this study, the Objective Structured Clinical Examination (OSCE), originally used in medicine to assess performance through simulated interviews, was adapted for social work to…

Issues in benchmarking human reliability analysis methods : a literature review.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Lois, Erasmia; Forester, John Alan; Tran, Tuan Q.

There is a diversity of human reliability analysis (HRA) methods available for use in assessing human performance within probabilistic risk assessment (PRA). Due to the significant differences in the methods, including the scope, approach, and underlying models, there is a need for an empirical comparison investigating the validity and reliability of the methods. To accomplish this empirical comparison, a benchmarking study is currently underway that compares HRA methods with each other and against operator performance in simulator studies. In order to account for as many effects as possible in the construction of this benchmarking study, a literature review was conducted,more » reviewing past benchmarking studies in the areas of psychology and risk assessment. A number of lessons learned through these studies are presented in order to aid in the design of future HRA benchmarking endeavors.« less

Academic Achievement Survey and Educational Assessment Research

ERIC Educational Resources Information Center

Tanaka, Koji

2009-01-01

The recent "Nationwide academic achievement and study situation survey" was clearly influenced by the idea of "authentic assessment", an educational assessment perspective focused on "quality" and "engagement". However, when "performance assessment", the assessment method corresponding to this…

Use of Web Technology and Active Learning Strategies in a Quality Assessment Methods Course.

ERIC Educational Resources Information Center

Poirier, Therese I.; O'Neil, Christine K.

2000-01-01

The authors describe and evaluate quality assessment methods in a health care course that utilized web technology and various active learning strategies. The course was judged successful by student performance, evaluations and student assessments. The instructors were pleased with the outcomes achieved and the educational pedagogy used for this…

Scientific method, adversarial system, and technology assessment

NASA Technical Reports Server (NTRS)

Mayo, L. H.

1975-01-01

A basic framework is provided for the consideration of the purposes and techniques of scientific method and adversarial systems. Similarities and differences in these two techniques of inquiry are considered with reference to their relevance in the performance of assessments.

Assessing practice-based learning and improvement.

PubMed

Lynch, Deirdre C; Swing, Susan R; Horowitz, Sheldon D; Holt, Kathleen; Messer, Joseph V

2004-01-01

Practice-based learning and improvement (PBLI) is 1 of 6 general competencies expected of physicians who graduate from an accredited residency education program in the United States and is an anticipated requirement for those who wish to maintain certification by the member boards of the American Board of Medical Specialties. This article describes methods used to assess PBLI. Six electronic databases were searched using several search terms pertaining to PBLI. The review indicated that 4 assessment methods have been used to assess some or all steps of PBLI: portfolios, projects, patient record and chart review, and performance ratings. Each method is described, examples of application are provided, and validity, reliability, and feasibility characteristics are discussed. Portfolios may be the most useful approach to assess residents' PBLI abilities. Active participation in peer-driven performance improvement initiatives may be a valuable approach to confirm practicing physician involvement in PBLI.

Impact of workplace based assessment on doctors' education and performance: a systematic review.

PubMed

Miller, Alice; Archer, Julian

2010-09-24

To investigate the literature for evidence that workplace based assessment affects doctors' education and performance. Systematic review. The primary data sources were the databases Journals@Ovid, Medline, Embase, CINAHL, PsycINFO, and ERIC. Evidence based reviews (Bandolier, Cochrane Library, DARE, HTA Database, and NHS EED) were accessed and searched via the Health Information Resources website. Reference lists of relevant studies and bibliographies of review articles were also searched. Review methods Studies of any design that attempted to evaluate either the educational impact of workplace based assessment, or the effect of workplace based assessment on doctors' performance, were included. Studies were excluded if the sampled population was non-medical or the study was performed with medical students. Review articles, commentaries, and letters were also excluded. The final exclusion criterion was the use of simulated patients or models rather than real life clinical encounters. Sixteen studies were included. Fifteen of these were non-comparative descriptive or observational studies; the other was a randomised controlled trial. Study quality was mixed. Eight studies examined multisource feedback with mixed results; most doctors felt that multisource feedback had educational value, although the evidence for practice change was conflicting. Some junior doctors and surgeons displayed little willingness to change in response to multisource feedback, whereas family physicians might be more prepared to initiate change. Performance changes were more likely to occur when feedback was credible and accurate or when coaching was provided to help subjects identify their strengths and weaknesses. Four studies examined the mini-clinical evaluation exercise, one looked at direct observation of procedural skills, and three were concerned with multiple assessment methods: all these studies reported positive results for the educational impact of workplace based assessment tools. However, there was no objective evidence of improved performance with these tools. Considering the emphasis placed on workplace based assessment as a method of formative performance assessment, there are few published articles exploring its impact on doctors' education and performance. This review shows that multisource feedback can lead to performance improvement, although individual factors, the context of the feedback, and the presence of facilitation have a profound effect on the response. There is no evidence that alternative workplace based assessment tools (mini-clinical evaluation exercise, direct observation of procedural skills, and case based discussion) lead to improvement in performance, although subjective reports on their educational impact are positive.

A Control Variate Method for Probabilistic Performance Assessment. Improved Estimates for Mean Performance Quantities of Interest

DOE Office of Scientific and Technical Information (OSTI.GOV)

MacKinnon, Robert J.; Kuhlman, Kristopher L

2016-05-01

We present a method of control variates for calculating improved estimates for mean performance quantities of interest, E(PQI) , computed from Monte Carlo probabilistic simulations. An example of a PQI is the concentration of a contaminant at a particular location in a problem domain computed from simulations of transport in porous media. To simplify the presentation, the method is described in the setting of a one- dimensional elliptical model problem involving a single uncertain parameter represented by a probability distribution. The approach can be easily implemented for more complex problems involving multiple uncertain parameters and in particular for application tomore » probabilistic performance assessment of deep geologic nuclear waste repository systems. Numerical results indicate the method can produce estimates of E(PQI)having superior accuracy on coarser meshes and reduce the required number of simulations needed to achieve an acceptable estimate.« less

Geographic and temporal validity of prediction models: Different approaches were useful to examine model performance

PubMed Central

Austin, Peter C.; van Klaveren, David; Vergouwe, Yvonne; Nieboer, Daan; Lee, Douglas S.; Steyerberg, Ewout W.

2017-01-01

Objective Validation of clinical prediction models traditionally refers to the assessment of model performance in new patients. We studied different approaches to geographic and temporal validation in the setting of multicenter data from two time periods. Study Design and Setting We illustrated different analytic methods for validation using a sample of 14,857 patients hospitalized with heart failure at 90 hospitals in two distinct time periods. Bootstrap resampling was used to assess internal validity. Meta-analytic methods were used to assess geographic transportability. Each hospital was used once as a validation sample, with the remaining hospitals used for model derivation. Hospital-specific estimates of discrimination (c-statistic) and calibration (calibration intercepts and slopes) were pooled using random effects meta-analysis methods. I2 statistics and prediction interval width quantified geographic transportability. Temporal transportability was assessed using patients from the earlier period for model derivation and patients from the later period for model validation. Results Estimates of reproducibility, pooled hospital-specific performance, and temporal transportability were on average very similar, with c-statistics of 0.75. Between-hospital variation was moderate according to I2 statistics and prediction intervals for c-statistics. Conclusion This study illustrates how performance of prediction models can be assessed in settings with multicenter data at different time periods. PMID:27262237

Simultaneous assessment of phase chemistry, phase abundance and bulk chemistry with statistical electron probe micro-analyses: Application to cement clinkers

DOE Office of Scientific and Technical Information (OSTI.GOV)

Wilson, William; Krakowiak, Konrad J.; Ulm, Franz-Josef, E-mail: ulm@mit.edu

2014-01-15

According to recent developments in cement clinker engineering, the optimization of chemical substitutions in the main clinker phases offers a promising approach to improve both reactivity and grindability of clinkers. Thus, monitoring the chemistry of the phases may become part of the quality control at the cement plants, along with the usual measurements of the abundance of the mineralogical phases (quantitative X-ray diffraction) and the bulk chemistry (X-ray fluorescence). This paper presents a new method to assess these three complementary quantities with a single experiment. The method is based on electron microprobe spot analyses, performed over a grid located onmore » a representative surface of the sample and interpreted with advanced statistical tools. This paper describes the method and the experimental program performed on industrial clinkers to establish the accuracy in comparison to conventional methods. -- Highlights: •A new method of clinker characterization •Combination of electron probe technique with cluster analysis •Simultaneous assessment of phase abundance, composition and bulk chemistry •Experimental validation performed on industrial clinkers.« less

Real-time performance assessment and adaptive control for a water chiller unit in an HVAC system

NASA Astrophysics Data System (ADS)

Bai, Jianbo; Li, Yang; Chen, Jianhao

2018-02-01

The paper proposes an adaptive control method for a water chiller unit in a HVAC system. Based on the minimum variance evaluation, the adaptive control method was used to realize better control of the water chiller unit. To verify the performance of the adaptive control method, the proposed method was compared with an a conventional PID controller, the simulation results showed that adaptive control method had superior control performance to that of the conventional PID controller.

Improving Learning through Performance Assessment in a Social Studies Methods Course for Preservice Elementary Teachers

ERIC Educational Resources Information Center

Leaman, Heather; Kistler, Sara Lamb

2009-01-01

This article describes how two instructors used assessment data to improve an undergraduate course, Teaching Social Studies in the Elementary Classroom. This entailed revising the core assignment for the course--the creation of a thematic unit of instruction--and developing a scoring guide to assess teacher candidates' performance. Data collected…

Prioritization of in silico models and molecular descriptors for the assessment of ready biodegradability.

PubMed

Fernández, Alberto; Rallo, Robert; Giralt, Francesc

2015-10-01

Ready biodegradability is a key property for evaluating the long-term effects of chemicals on the environment and human health. As such, it is used as a screening test for the assessment of persistent, bioaccumulative and toxic substances. Regulators encourage the use of non-testing methods, such as in silico models, to save money and time. A dataset of 757 chemicals was collected to assess the performance of four freely available in silico models that predict ready biodegradability. They were applied to develop a new consensus method that prioritizes the use of each individual model according to its performance on chemical subsets driven by the presence or absence of different molecular descriptors. This consensus method was capable of almost eliminating unpredictable chemicals, while the performance of combined models was substantially improved with respect to that of the individual models. Copyright © 2015 Elsevier Inc. All rights reserved.

Intentional Movement Performance Ability (IMPA): a method for robot-aided quantitative assessment of motor function.

PubMed

Shin, Sung Yul; Kim, Jung Yoon; Lee, Sanghyeop; Lee, Junwon; Kim, Seung-Jong; Kim, ChangHwan

2013-06-01

The purpose of this paper is to propose a new assessment method for evaluating motor function of the patients who are suffering from physical weakness after stroke, incomplete spinal cord injury (iSCI) or other diseases. In this work, we use a robotic device to obtain the information of interaction occur between patient and robot, and use it as a measure for assessing the patients. The Intentional Movement Performance Ability (IMPA) is defined by the root mean square of the interactive torque, while the subject performs given periodic movement with the robot. IMPA is proposed to quantitatively determine the level of subject's impaired motor function. The method is indirectly tested by asking the healthy subjects to lift a barbell to disturb their motor function. The experimental result shows that the IMPA has a potential for providing a proper information of the subject's motor function level.

An Analytical Method for Measuring Competence in Project Management

ERIC Educational Resources Information Center

González-Marcos, Ana; Alba-Elías, Fernando; Ordieres-Meré, Joaquín

2016-01-01

The goal of this paper is to present a competence assessment method in project management that is based on participants' performance and value creation. It seeks to close an existing gap in competence assessment in higher education. The proposed method relies on information and communication technology (ICT) tools and combines Project Management…

Assessing Scientific Performance.

ERIC Educational Resources Information Center

Weiner, John M.; And Others

1984-01-01

A method for assessing scientific performance based on relationships displayed numerically in published documents is proposed and illustrated using published documents in pediatric oncology for the period 1979-1982. Contributions of a major clinical investigations group, the Childrens Cancer Study Group, are analyzed. Twenty-nine references are…

A new metric to assess temporal coherence for video retargeting

NASA Astrophysics Data System (ADS)

Li, Ke; Yan, Bo; Yuan, Binhang

2014-10-01

In video retargeting, how to assess the performance in maintaining temporal coherence has become the prominent challenge. In this paper, we will present a new objective measurement to assess temporal coherence after video retargeting. It's a general metric to assess jittery artifact for both discrete and continuous video retargeting methods, the accuracy of which is verified by psycho-visual tests. As a result, our proposed assessment method possesses huge practical significance.

Assessing the driving performance of older adult drivers: on-road versus simulated driving.

PubMed

Lee, Hoe C; Cameron, Don; Lee, Andy H

2003-09-01

To validate a laboratory-based driving simulator in measuring on-road driving performance, 129 older adult drivers were assessed with both the simulator and an on-road test. The driving performance of the participants was gauged by appropriate and reliable age-specific assessment criteria, which were found to be negatively correlated with age. Using principal component analysis, two performance indices were developed from the criteria to represent the overall performance in simulated driving and the on-road assessment. There was significant positive association between the two indices, with the simulated driving performance index explaining over two-thirds of the variability of the on-road driving performance index, after adjustment for age and gender of the drivers. The results supported the validity of the driving simulator and it is a safer and more economical method than the on-road testing to assess the driving performance of older adult drivers.

Gender and Assessment: Differences, Similarities and Implications

ERIC Educational Resources Information Center

Hartley, James; Betts, Lucy; Murray, Wayne

2007-01-01

Background: Recent changes in higher education in the UK have led to much discussion about the performance of men and women students with different methods of assessment. Aim: To see whether or not there were differences between the marks awarded to men and women final-year psychology students as a function of the modes of assessment used. Method:…

Development and Demonstration of an Aerial Imagery Assessment Method to Monitor Changes in Restored Stream Condition

NASA Astrophysics Data System (ADS)

Fong, L. S.; Ambrose, R. F.

2017-12-01

Remote sensing is an excellent way to assess the changing condition of streams and wetlands. Several studies have measured large-scale changes in riparian condition indicators, but few have remotely applied multi-metric assessments on a finer scale to measure changes, such as those caused by restoration, in the condition of small riparian areas. We developed an aerial imagery assessment method (AIAM) that combines landscape, hydrology, and vegetation observations into one index describing overall ecological condition of non-confined streams. Verification of AIAM demonstrated that sites in good condition (as assessed on-site by the California Rapid Assessment Method) received high AIAM scores. (AIAM was not verified with poor condition sites.) Spearman rank correlation tests comparing AIAM and the field-based California Rapid Assessment Method (CRAM) results revealed that some components of the two methods were highly correlated. The application of AIAM is illustrated with time-series restoration trajectories of three southern California stream restoration projects aged 15 to 21 years. The trajectories indicate that the projects improved in condition in years following their restoration, with vegetation showing the most dynamic change over time. AIAM restoration trajectories also overlapped to different degrees with CRAM chronosequence restoration performance curves that demonstrate the hypothetical development of high-performing projects. AIAM has high potential as a remote ecological assessment method and effective tool to determine restoration trajectories. Ultimately, this tool could be used to further improve stream and wetland restoration management.

Prioritization of in silico models and molecular descriptors for the assessment of ready biodegradability

DOE Office of Scientific and Technical Information (OSTI.GOV)

Fernández, Alberto; Rallo, Robert; Giralt, Francesc

2015-10-15

Ready biodegradability is a key property for evaluating the long-term effects of chemicals on the environment and human health. As such, it is used as a screening test for the assessment of persistent, bioaccumulative and toxic substances. Regulators encourage the use of non-testing methods, such as in silico models, to save money and time. A dataset of 757 chemicals was collected to assess the performance of four freely available in silico models that predict ready biodegradability. They were applied to develop a new consensus method that prioritizes the use of each individual model according to its performance on chemical subsetsmore » driven by the presence or absence of different molecular descriptors. This consensus method was capable of almost eliminating unpredictable chemicals, while the performance of combined models was substantially improved with respect to that of the individual models. - Highlights: • Consensus method to predict ready biodegradability by prioritizing multiple QSARs. • Consensus reduced the amount of unpredictable chemicals to less than 2%. • Performance increased with the number of QSAR models considered. • The absence of 2D atom pairs contributed significantly to the consensus model.« less

Readiness to perform testing : a critical analysis of the concept and current practices.

DOT National Transportation Integrated Search

1993-08-01

Readiness to Perform (RTP) testing has become an increasingly popular alternative to biochemical screening as a method for assessing risk factors (i.e., drug, alcohol, fatigue, etc.) in the workplace. The focus of RTP testing is on the assessment of ...

Seating Arrangement, Group Composition and Competition-driven Interaction: Effects on Students' Performance in Physics

DOE Office of Scientific and Technical Information (OSTI.GOV)

Roxas, R. M.; Monterola, C.; Carreon-Monterola, S. L.

2010-07-28

We probe the effect of seating arrangement, group composition and group-based competition on students' performance in Physics using a teaching technique adopted from Mazur's peer instruction method. Ninety eight lectures, involving 2339 students, were conducted across nine learning institutions from February 2006 to June 2009. All the lectures were interspersed with student interaction opportunities (SIO), in which students work in groups to discuss and answer concept tests. Two individual assessments were administered before and after the SIO. The ratio of the post-assessment score to the pre-assessment score and the Hake factor were calculated to establish the improvement in student performance.more » Using actual assessment results and neural network (NN) modeling, an optimal seating arrangement for a class was determined based on student seating location. The NN model also provided a quantifiable method for sectioning students. Lastly, the study revealed that competition-driven interactions increase within-group cooperation and lead to higher improvement on the students' performance.« less

Objective assessment based on motion-related metrics and technical performance in laparoscopic suturing.

PubMed

Sánchez-Margallo, Juan A; Sánchez-Margallo, Francisco M; Oropesa, Ignacio; Enciso, Silvia; Gómez, Enrique J

2017-02-01

The aim of this study is to present the construct and concurrent validity of a motion-tracking method of laparoscopic instruments based on an optical pose tracker and determine its feasibility as an objective assessment tool of psychomotor skills during laparoscopic suturing. A group of novice ([Formula: see text] laparoscopic procedures), intermediate (11-100 laparoscopic procedures) and experienced ([Formula: see text] laparoscopic procedures) surgeons performed three intracorporeal sutures on an ex vivo porcine stomach. Motion analysis metrics were recorded using the proposed tracking method, which employs an optical pose tracker to determine the laparoscopic instruments' position. Construct validation was measured for all 10 metrics across the three groups and between pairs of groups. Concurrent validation was measured against a previously validated suturing checklist. Checklists were completed by two independent surgeons over blinded video recordings of the task. Eighteen novices, 15 intermediates and 11 experienced surgeons took part in this study. Execution time and path length travelled by the laparoscopic dissector presented construct validity. Experienced surgeons required significantly less time ([Formula: see text]), travelled less distance using both laparoscopic instruments ([Formula: see text]) and made more efficient use of the work space ([Formula: see text]) compared with novice and intermediate surgeons. Concurrent validation showed strong correlation between both the execution time and path length and the checklist score ([Formula: see text] and [Formula: see text], [Formula: see text]). The suturing performance was successfully assessed by the motion analysis method. Construct and concurrent validity of the motion-based assessment method has been demonstrated for the execution time and path length metrics. This study demonstrates the efficacy of the presented method for objective evaluation of psychomotor skills in laparoscopic suturing. However, this method does not take into account the quality of the suture. Thus, future works will focus on developing new methods combining motion analysis and qualitative outcome evaluation to provide a complete performance assessment to trainees.

Team-based assessment of professional behavior in medical students

PubMed Central

RAEE, HOJAT; AMINI, MITRA; MOMEN NASAB, AMENEH; MALEK POUR, ABDOLRASOUL; JAFARI, MOHAMMAD MORAD

2014-01-01

Introduction: Self and peer assessment provides important information about the individual’s performance and behavior in all aspects of their professional environment work. The aim of this study is to evaluate the professional behavior and performance in medical students in the form of team based assessment. Methods: In a cross-sectional study, 100 medical students in the 7th year of education were randomly selected and enrolled; for each student five questionnaires were filled out, including one self-assessment, two peer assessments and two residents assessment. The scoring system of the questionnaires was based on seven point Likert scale.  After filling out the questions in the questionnaire, numerical data and written comments provided to the students were collected, analyzed and discussed. Internal consistency (Cronbach’s alpha) of the questionnaires was assessed. A p<0.05 was considered as significant level. Results: Internal consistency was acceptable (Cronbach’s alpha 0.83). Interviews revealed that the majority of students and assessors interviewed found the method acceptable. The range of scores was 1-6 (Mean±SD=4.39±0.57) for the residents' assessment, 2-6 (Mean±SD= 4.49±0.53) for peer assessment, and 3-7 (Mean±SD=5.04±0.32) for self-assessment. There was a significant difference between self assessment and other methods of assessment. Conclusions: This study demonstrates that a team-based assessment is an acceptable and feasible method for peer and self-assessment of medical students’ learning in a clinical clerkship, and has some advantages over traditional assessment methods. Further studies are needed to focus on the strengths and weaknesses. PMID:25512933

Automatic and Objective Assessment of Alternating Tapping Performance in Parkinson's Disease

PubMed Central

Memedi, Mevludin; Khan, Taha; Grenholm, Peter; Nyholm, Dag; Westin, Jerker

2013-01-01

This paper presents the development and evaluation of a method for enabling quantitative and automatic scoring of alternating tapping performance of patients with Parkinson's disease (PD). Ten healthy elderly subjects and 95 patients in different clinical stages of PD have utilized a touch-pad handheld computer to perform alternate tapping tests in their home environments. First, a neurologist used a web-based system to visually assess impairments in four tapping dimensions (‘speed’, ‘accuracy’, ‘fatigue’ and ‘arrhythmia’) and a global tapping severity (GTS). Second, tapping signals were processed with time series analysis and statistical methods to derive 24 quantitative parameters. Third, principal component analysis was used to reduce the dimensions of these parameters and to obtain scores for the four dimensions. Finally, a logistic regression classifier was trained using a 10-fold stratified cross-validation to map the reduced parameters to the corresponding visually assessed GTS scores. Results showed that the computed scores correlated well to visually assessed scores and were significantly different across Unified Parkinson's Disease Rating Scale scores of upper limb motor performance. In addition, they had good internal consistency, had good ability to discriminate between healthy elderly and patients in different disease stages, had good sensitivity to treatment interventions and could reflect the natural disease progression over time. In conclusion, the automatic method can be useful to objectively assess the tapping performance of PD patients and can be included in telemedicine tools for remote monitoring of tapping. PMID:24351667

Automatic and objective assessment of alternating tapping performance in Parkinson's disease.

PubMed

Memedi, Mevludin; Khan, Taha; Grenholm, Peter; Nyholm, Dag; Westin, Jerker

2013-12-09

This paper presents the development and evaluation of a method for enabling quantitative and automatic scoring of alternating tapping performance of patients with Parkinson's disease (PD). Ten healthy elderly subjects and 95 patients in different clinical stages of PD have utilized a touch-pad handheld computer to perform alternate tapping tests in their home environments. First, a neurologist used a web-based system to visually assess impairments in four tapping dimensions ('speed', 'accuracy', 'fatigue' and 'arrhythmia') and a global tapping severity (GTS). Second, tapping signals were processed with time series analysis and statistical methods to derive 24 quantitative parameters. Third, principal component analysis was used to reduce the dimensions of these parameters and to obtain scores for the four dimensions. Finally, a logistic regression classifier was trained using a 10-fold stratified cross-validation to map the reduced parameters to the corresponding visually assessed GTS scores. Results showed that the computed scores correlated well to visually assessed scores and were significantly different across Unified Parkinson's Disease Rating Scale scores of upper limb motor performance. In addition, they had good internal consistency, had good ability to discriminate between healthy elderly and patients in different disease stages, had good sensitivity to treatment interventions and could reflect the natural disease progression over time. In conclusion, the automatic method can be useful to objectively assess the tapping performance of PD patients and can be included in telemedicine tools for remote monitoring of tapping.

Game-Based Assessment: Investigating the Impact on Test Anxiety and Exam Performance

ERIC Educational Resources Information Center

Mavridis, A.; Tsiatsos, T.

2017-01-01

The aim of this study is to assess the impact of a 3D educational computer game on students' test anxiety and exam performance when used in evaluative situations as compared to the traditional method of examination. The participants of the study were students in tertiary education who were examined using game-based assessment and traditional…

Performance of two quantitative PCR methods for microbial source tracking of human sewage and implications for microbial risk assessment in recreational waters

EPA Science Inventory

Before new, rapid quantitative PCR (qPCR) methods for recreational water quality assessment and microbial source tracking (MST) can be useful in a regulatory context, an understanding of the ability of the method to detect a DNA target (marker) when the contaminant soure has been...

Comparison of performance-based assessment and real world skill in people with serious mental illness: Ecological validity of the Test of Grocery Shopping Skills.

PubMed

Faith, Laura A; Rempfer, Melisa V

2018-05-07

Valid functional measures are essential for clinical and research efforts that address recovery and community functioning in people with serious mental illness. Although there is a great deal of interest in functional assessment, there is limited research supporting how well current evaluation methods provide a true assessment of real world functioning or naturalistic behavior. To address this gap in the literature, the present study examined the performance of individuals with serious mental illness (i.e., diagnosis of schizophrenia-spectrum, bipolar disorder, or other depression/anxiety diagnoses and accompanying functional disability) on the Test of Grocery Shopping Skills (TOGSS), a performance-based naturalistic task. We compared TOGSS performance to two dimensions of real world functioning: directly observed real world grocery shopping and ratings of community functioning. Results indicated that the TOGSS was significantly associated with real life grocery shopping, in terms of both shopping accuracy (r = 0.424) and time (r = 0.491). Further, self-report and observer-rated methods of assessing real world shopping behaviors were significantly correlated (r = 0.455). To our knowledge, this is one of the first studies to directly compare a performance-based naturalistic skill assessment with carefully observed real world performance of that skill in people with serious mental illness. These findings support the feasibility and ecological validity of performance-based naturalistic assessment with the TOGSS. Copyright © 2018 Elsevier B.V. All rights reserved.

Climate change vulnerability for species-Assessing the assessments.

PubMed

Wheatley, Christopher J; Beale, Colin M; Bradbury, Richard B; Pearce-Higgins, James W; Critchlow, Rob; Thomas, Chris D

2017-09-01

Climate change vulnerability assessments are commonly used to identify species at risk from global climate change, but the wide range of methodologies available makes it difficult for end users, such as conservation practitioners or policymakers, to decide which method to use as a basis for decision-making. In this study, we evaluate whether different assessments consistently assign species to the same risk categories and whether any of the existing methodologies perform well at identifying climate-threatened species. We compare the outputs of 12 climate change vulnerability assessment methodologies, using both real and simulated species, and validate the methods using historic data for British birds and butterflies (i.e. using historical data to assign risks and more recent data for validation). Our results show that the different vulnerability assessment methods are not consistent with one another; different risk categories are assigned for both the real and simulated sets of species. Validation of the different vulnerability assessments suggests that methods incorporating historic trend data into the assessment perform best at predicting distribution trends in subsequent time periods. This study demonstrates that climate change vulnerability assessments should not be used interchangeably due to the poor overall agreement between methods when considering the same species. The results of our validation provide more support for the use of trend-based rather than purely trait-based approaches, although further validation will be required as data become available. © 2017 The Authors. Global Change Biology Published by John Wiley & Sons Ltd.

An accurate filter loading correction is essential for assessing personal exposure to black carbon using an Aethalometer.

PubMed

Good, Nicholas; Mölter, Anna; Peel, Jennifer L; Volckens, John

2017-07-01

The AE51 micro-Aethalometer (microAeth) is a popular and useful tool for assessing personal exposure to particulate black carbon (BC). However, few users of the AE51 are aware that its measurements are biased low (by up to 70%) due to the accumulation of BC on the filter substrate over time; previous studies of personal black carbon exposure are likely to have suffered from this bias. Although methods to correct for bias in micro-Aethalometer measurements of particulate black carbon have been proposed, these methods have not been verified in the context of personal exposure assessment. Here, five Aethalometer loading correction equations based on published methods were evaluated. Laboratory-generated aerosols of varying black carbon content (ammonium sulfate, Aquadag and NIST diesel particulate matter) were used to assess the performance of these methods. Filters from a personal exposure assessment study were also analyzed to determine how the correction methods performed for real-world samples. Standard correction equations produced correction factors with root mean square errors of 0.10 to 0.13 and mean bias within ±0.10. An optimized correction equation is also presented, along with sampling recommendations for minimizing bias when assessing personal exposure to BC using the AE51 micro-Aethalometer.

Comparison of mathematic models for assessment of glomerular filtration rate with electron-beam CT in pigs.

PubMed

Daghini, Elena; Juillard, Laurent; Haas, John A; Krier, James D; Romero, Juan C; Lerman, Lilach O

2007-02-01

To prospectively compare in pigs three mathematic models for assessment of glomerular filtration rate (GFR) on electron-beam (EB) computed tomographic (CT) images, with concurrent inulin clearance serving as the reference standard. This study was approved by the institutional animal care and use committee. Inulin clearance was measured in nine pigs (18 kidneys) and compared with single-kidney GFR assessed from renal time-attenuation curves (TACs) obtained with EB CT before and after infusion of the vasodilator acetylcholine. CT-derived GFR was calculated with the original and modified Patlak methods and with previously validated extended gamma variate modeling of first-pass cortical TACs. Statistical analysis was performed to assess correlation between CT methods and inulin clearance for estimation of GFR with least-squares regression analysis and Bland-Altman graphical representation. Comparisons within groups were performed with a paired t test. GFR assessed with the original Patlak method indicated poor correlation with inulin clearance, whereas GFR assessed with the modified Patlak method (P < .001, r = 0.75) and with gamma variate modeling (P < .001, r = 0.79) correlated significantly with inulin clearance and indicated an increase in response to acetylcholine. CT-derived estimates of GFR can be significantly improved by modifications in image analysis methods (eg, use of a cortical region of interest). (c) RSNA, 2007.

Towards a Quality Assessment Method for Learning Preference Profiles in Negotiation

NASA Astrophysics Data System (ADS)

Hindriks, Koen V.; Tykhonov, Dmytro

In automated negotiation, information gained about an opponent's preference profile by means of learning techniques may significantly improve an agent's negotiation performance. It therefore is useful to gain a better understanding of how various negotiation factors influence the quality of learning. The quality of learning techniques in negotiation are typically assessed indirectly by means of comparing the utility levels of agreed outcomes and other more global negotiation parameters. An evaluation of learning based on such general criteria, however, does not provide any insight into the influence of various aspects of negotiation on the quality of the learned model itself. The quality may depend on such aspects as the domain of negotiation, the structure of the preference profiles, the negotiation strategies used by the parties, and others. To gain a better understanding of the performance of proposed learning techniques in the context of negotiation and to be able to assess the potential to improve the performance of such techniques a more systematic assessment method is needed. In this paper we propose such a systematic method to analyse the quality of the information gained about opponent preferences by learning in single-instance negotiations. The method includes measures to assess the quality of a learned preference profile and proposes an experimental setup to analyse the influence of various negotiation aspects on the quality of learning. We apply the method to a Bayesian learning approach for learning an opponent's preference profile and discuss our findings.

Developing and evaluating a target-background similarity metric for camouflage detection.

PubMed

Lin, Chiuhsiang Joe; Chang, Chi-Chan; Liu, Bor-Shong

2014-01-01

Measurement of camouflage performance is of fundamental importance for military stealth applications. The goal of camouflage assessment algorithms is to automatically assess the effect of camouflage in agreement with human detection responses. In a previous study, we found that the Universal Image Quality Index (UIQI) correlated well with the psychophysical measures, and it could be a potentially camouflage assessment tool. In this study, we want to quantify the camouflage similarity index and psychophysical results. We compare several image quality indexes for computational evaluation of camouflage effectiveness, and present the results of an extensive human visual experiment conducted to evaluate the performance of several camouflage assessment algorithms and analyze the strengths and weaknesses of these algorithms. The experimental data demonstrates the effectiveness of the approach, and the correlation coefficient result of the UIQI was higher than those of other methods. This approach was highly correlated with the human target-searching results. It also showed that this method is an objective and effective camouflage performance evaluation method because it considers the human visual system and image structure, which makes it consistent with the subjective evaluation results.

Academic Performance in Introductory Accounting: Do Learning Styles Matter?

ERIC Educational Resources Information Center

Tan, Lin Mei; Laswad, Fawzi

2015-01-01

This study examines the impact of learning styles on academic performance using major assessment methods (examinations and assignments including multiple-choice and constructed response questions (CRQs)) in an introductory accounting course. Students' learning styles were assessed using Kolb's Learning Style Inventory Version 3.1. The results…

A Systematic Review to Uncover a Universal Protocol for Accuracy Assessment of 3-Dimensional Virtually Planned Orthognathic Surgery.

PubMed

Gaber, Ramy M; Shaheen, Eman; Falter, Bart; Araya, Sebastian; Politis, Constantinus; Swennen, Gwen R J; Jacobs, Reinhilde

2017-11-01

The aim of this study was to systematically review methods used for assessing the accuracy of 3-dimensional virtually planned orthognathic surgery in an attempt to reach an objective assessment protocol that could be universally used. A systematic review of the currently available literature, published until September 12, 2016, was conducted using PubMed as the primary search engine. We performed secondary searches using the Cochrane Database, clinical trial registries, Google Scholar, and Embase, as well as a bibliography search. Included articles were required to have stated clearly that 3-dimensional virtual planning was used and accuracy assessment performed, along with validation of the planning and/or assessment method. Descriptive statistics and quality assessment of included articles were performed. The initial search yielded 1,461 studies. Only 7 studies were included in our review. An important variability was found regarding methods used for 1) accuracy assessment of virtually planned orthognathic surgery or 2) validation of the tools used. Included studies were of moderate quality; reviewers' agreement regarding quality was calculated to be 0.5 using the Cohen κ test. On the basis of the findings of this review, it is evident that the literature lacks consensus regarding accuracy assessment. Hence, a protocol is suggested for accuracy assessment of virtually planned orthognathic surgery with the lowest margin of error. Copyright © 2017 American Association of Oral and Maxillofacial Surgeons. Published by Elsevier Inc. All rights reserved.

Behind the Final Grade in Hybrid v. Traditional Courses: Comparing Student Performance by Assessment Type, Core Competency, and Course Objective

ERIC Educational Resources Information Center

Bain, Lisa Z.

2012-01-01

There are many different delivery methods used by institutions of higher education. These include traditional, hybrid, and online course offerings. The comparisons of these typically use final grade as the measure of student performance. This research study looks behind the final grade and compares student performance by assessment type, core…

Examining the Validity of the Homework Performance Questionnaire: Multi-Informant Assessment in Elementary and Middle School

ERIC Educational Resources Information Center

Power, Thomas J.; Watkins, Marley W.; Mautone, Jennifer A.; Walcott, Christy M.; Coutts, Michael J.; Sheridan, Susan M.

2015-01-01

Methods for measuring homework performance have been limited primarily to parent reports of homework deficits. The Homework Performance Questionnaire (HPQ) was developed to assess the homework functioning of students in Grades 1 to 8 from the perspective of both teachers and parents. The purpose of this study was to examine the factorial validity…

The importance of quality control in validating concentrations ...

EPA Pesticide Factsheets

A national-scale survey of 247 contaminants of emerging concern (CECs), including organic and inorganic chemical compounds, and microbial contaminants, was conducted in source and treated drinking water samples from 25 treatment plants across the United States. Multiple methods were used to determine these CECs, including six analytical methods to measure 174 pharmaceuticals, personal care products, and pesticides. A three-component quality assurance/quality control (QA/QC) program was designed for the subset of 174 CECs which allowed us to assess and compare performances of the methods used. The three components included: 1) a common field QA/QC protocol and sample design, 2) individual investigator-developed method-specific QA/QC protocols, and 3) a suite of 46 method comparison analytes that were determined in two or more analytical methods. Overall method performance for the 174 organic chemical CECs was assessed by comparing spiked recoveries in reagent, source, and treated water over a two-year period. In addition to the 247 CECs reported in the larger drinking water study, another 48 pharmaceutical compounds measured did not consistently meet predetermined quality standards. Methodologies that did not seem suitable for these analytes are overviewed. The need to exclude analytes based on method performance demonstrates the importance of additional QA/QC protocols. This paper compares the method performance of six analytical methods used to measure 174 emer

Consistency of the Performance and Nonperformance Methods in Gifted Identification

ERIC Educational Resources Information Center

Acar, Selcuk; Sen, Sedat; Cayirdag, Nur

2016-01-01

Current approaches to gifted identification suggest collecting multiple sources of evidence. Some gifted identification guidelines allow for the interchangeable use of "performance" and "nonperformance" identification methods. This multiple criteria approach lacks a strong overlap between the assessment tools; however,…

Sulfur Oxides Risk and Exposure Assessment Planning ...

EPA Pesticide Factsheets

In conducting risk/exposure assessments for the Sulfur Oxides NAAQS review, EPA will first develop a draft Scope and Methods Plan which will describe the proposed scope of the quantitative and qualitative analyses to be performed and the tools/methods that may be employed Provide opportunity for CASAC feedback on EPA's plans for the risk and exposure assessment for the Sulfur Oxides NAAQS review

How Reliable is the Acetabular Cup Position Assessment from Routine Radiographs?

PubMed Central

Carvajal Alba, Jaime A.; Vincent, Heather K.; Sodhi, Jagdeep S.; Latta, Loren L.; Parvataneni, Hari K.

2017-01-01

Abstract Background: Cup position is crucial for optimal outcomes in total hip arthroplasty. Radiographic assessment of component position is routinely performed in the early postoperative period. Aims: The aims of this study were to determine in a controlled environment if routine radiographic methods accurately and reliably assess the acetabular cup position and to assess if there is a statistical difference related to the rater’s level of training. Methods: A pelvic model was mounted in a spatial frame. An acetabular cup was fixed in different degrees of version and inclination. Standardized radiographs were obtained. Ten observers including five fellowship-trained orthopaedic surgeons and five orthopaedic residents performed a blind assessment of cup position. Inclination was assessed from anteroposterior radiographs of the pelvis and version from cross-table lateral radiographs of the hip. Results: The radiographic methods used showed to be imprecise specially when the cup was positioned at the extremes of version and inclination. An excellent inter-observer reliability (Intra-class coefficient > 0,9) was evidenced. There were no differences related to the level of training of the raters. Conclusions: These widely used radiographic methods should be interpreted cautiously and computed tomography should be utilized in cases when further intervention is contemplated. PMID:28852355

Developing Measures of Job Performance for Support Staff in Housing Services for People with Intellectual Disabilities

ERIC Educational Resources Information Center

Hatton, Chris; Wigham, Sarah; Craig, Jaime

2009-01-01

Background: There is an absence of research concerning the assessment of housing support worker job performance, particularly in the development of job performance measures that reflect the priorities of people with intellectual disabilities and their families. Method: A worker-oriented job analysis method was used to develop four short job…

Methods for land use impact assessment: A review

DOE Office of Scientific and Technical Information (OSTI.GOV)

Perminova, Tataina, E-mail: tatiana.perminova@utt.fr; Department of Geoecology and Geochemistry, Institute of Natural Resources, National Research Tomsk Polytechnic University, 30 Lenin Avenue, 634050 Tomsk; Sirina, Natalia, E-mail: natalia.sirina@utt.fr

Many types of methods to assess land use impact have been developed. Nevertheless a systematic synthesis of all these approaches is necessary to highlight the most commonly used and most effective methods. Given the growing interest in this area of research, a review of the different methods of assessing land use impact (LUI) was performed using bibliometric analysis. One hundred eighty seven articles of agricultural and biological science, and environmental sciences were examined. According to our results, the most frequently used land use assessment methods are Life-Cycle Assessment, Material Flow Analysis/Input–Output Analysis, Environmental Impact Assessment and Ecological Footprint. Comparison ofmore » the methods allowed their specific features to be identified and to arrive at the conclusion that a combination of several methods is the best basis for a comprehensive analysis of land use impact assessment. - Highlights: • We identified the most frequently used methods in land use impact assessment. • A comparison of the methods based on several criteria was carried out. • Agricultural land use is by far the most common area of study within the methods. • Incentive driven methods, like LCA, arouse the most interest in this field.« less

Feasibility of peer assessment and clinical audit to self-regulate the quality of physiotherapy services: a mixed methods study

PubMed Central

Nijhuis-van der Sanden, Maria W G; Driehuis, Femke; Heerkens, Yvonne F; van der Vleuten, Cees P M; van der Wees, Philip J

2017-01-01

Objectives To evaluate the feasibility of a quality improvement programme aimed to enhance the client-centeredness, effectiveness and transparency of physiotherapy services by addressing three feasibility domains: (1) acceptability of the programme design, (2) appropriateness of the implementation strategy and (3) impact on quality improvement. Design Mixed methods study. Participants and setting 64 physiotherapists working in primary care, organised in a network of communities of practice in the Netherlands. Methods The programme contained: (1) two cycles of online self-assessment and peer assessment (PA) of clinical performance using client records and video-recordings of client communication followed by face-to-face group discussions, and (2) clinical audit assessing organisational performance. Assessment was based on predefined performance indicators which could be scored on a 5-point Likert scale. Discussions addressed performance standards and scoring differences. All feasibility domains were evaluated qualitatively with two focus groups and 10 in-depth interviews. In addition, we evaluated the impact on quality improvement quantitatively by comparing self-assessment and PA scores in cycles 1 and 2. Results We identified critical success features relevant to programme development and implementation, such as clarifying expectations at baseline, training in PA skills, prolonged engagement with video-assessment and competent group coaches. Self-reported impact on quality improvement included awareness of clinical and organisational performance, improved evidence-based practice and client-centeredness and increased motivation to self-direct quality improvement. Differences between self-scores and peer scores on performance indicators were not significant. Between cycles 1 and 2, scores for record keeping showed significant improvement, however not for client communication. Conclusions This study demonstrated that bottom-up initiatives to improve healthcare quality can be effective. The results justify ongoing evaluation to inform nationwide implementation when the critical success features are addressed. Further research is necessary to explore the sustainability of the results and the impact on client outcomes in a full-scale study. PMID:28188156

Assessment of Student Professional Outcomes for Continuous Improvement

ERIC Educational Resources Information Center

Keshavarz, Mohsen; Baghdarnia, Mostafa

2013-01-01

This article describes a method for the assessment of professional student outcomes (performance-type outcomes or soft skills). The method is based upon group activities, research on modern electrical engineering topics by individual students, classroom presentations on chosen research topics, final presentations, and technical report writing.…

Comments on ``Use of conditional simulation in nuclear waste site performance assessment`` by Carol Gotway

DOE Office of Scientific and Technical Information (OSTI.GOV)

Downing, D.J.

1993-10-01

This paper discusses Carol Gotway`s paper, ``The Use of Conditional Simulation in Nuclear Waste Site Performance Assessment.`` The paper centers on the use of conditional simulation and the use of geostatistical methods to simulate an entire field of values for subsequent use in a complex computer model. The issues of sampling designs for geostatistics, semivariogram estimation and anisotropy, turning bands method for random field generation, and estimation of the comulative distribution function are brought out.

Team-based assessment of professional behavior in medical students.

PubMed

Raee, Hojat; Amini, Mitra; Momen Nasab, Ameneh; Malek Pour, Abdolrasoul; Jafari, Mohammad Morad

2014-07-01

Self and peer assessment provides important information about the individual's performance and behavior in all aspects of their professional environment work. The aim of this study is to evaluate the professional behavior and performance in medical students in the form of team based assessment. In a cross-sectional study, 100 medical students in the 7(th) year of education were randomly selected and enrolled; for each student five questionnaires were filled out, including one self-assessment, two peer assessments and two residents assessment. The scoring system of the questionnaires was based on seven point Likert scale.  After filling out the questions in the questionnaire, numerical data and written comments provided to the students were collected, analyzed and discussed. Internal consistency (Cronbach's alpha) of the questionnaires was assessed. A p<0.05 was considered as significant level. Internal consistency was acceptable (Cronbach's alpha 0.83). Interviews revealed that the majority of students and assessors interviewed found the method acceptable. The range of scores was 1-6 (Mean±SD=4.39±0.57) for the residents' assessment, 2-6 (Mean±SD= 4.49±0.53) for peer assessment, and 3-7 (Mean±SD=5.04±0.32) for self-assessment. There was a significant difference between self assessment and other methods of assessment. This study demonstrates that a team-based assessment is an acceptable and feasible method for peer and self-assessment of medical students' learning in a clinical clerkship, and has some advantages over traditional assessment methods. Further studies are needed to focus on the strengths and weaknesses.

A clinically guided approach for improving performance measurement for hypertension.

PubMed

Steinman, Michael A; Lee, Sei J; Peterson, Carolyn A; Fung, Kathy Z; Goldstein, Mary K

2012-05-01

Performance measures often fail to account for legitimate reasons why patients do not achieve recommended treatment targets. We tested a novel performance measurement system for blood pressure (BP) control that was designed to mimic clinical reasoning. This clinically guided approach focuses on (1) exempting patients for whom tight BP control may not be appropriate or feasible and (2) assessing BP over time. Trained abstractors conducted structured chart reviews of 201 adults with hypertension in 2 VA health care systems. Results were compared with traditional methods of performance measurement. Among 201 veterans, 183 (91%) were male, and the mean age was 71±11 years. Using the clinically guided approach, 61 patients (30%) were exempted from performance measurement. The most common reasons for exemption were inadequate opportunity to manage BP (35 patients, 17%) and the use of 4 or more antihypertensive medications (19 patients, 9%). Among patients eligible for performance measurement, there was little agreement on the presence of controlled versus uncontrolled BP when comparing the most recent BP (the traditional approach) with an integrated assessment of BP control (κ 0.14). After accounting for clinically guided exemptions and methods of BP assessment, only 15 of 72 patients (21%) whose last BP was ≥140/90 mm Hg were classified as problematic by the clinically guided approach. Many patients have legitimate reasons for not achieving tight BP control, and the methods used for BP assessment have marked effects on whether a patient is classified as having adequate or inadequate BP control.

RECOVERY ACT - Methods for Decision under Technological Change Uncertainty and Risk Assessment for Integrated Assessment of Climate Change

DOE Office of Scientific and Technical Information (OSTI.GOV)

Webster, Mort David

2015-03-10

This report presents the final outcomes and products of the project as performed at the Massachusetts Institute of Technology. The research project consists of three main components: methodology development for decision-making under uncertainty, improving the resolution of the electricity sector to improve integrated assessment, and application of these methods to integrated assessment. Results in each area is described in the report.

Should Athletic Training Educators Utilize Grades When Evaluating Student Clinical Performance?

ERIC Educational Resources Information Center

Scriber, Kent; Gray, Courtney; Millspaugh, Rose

2010-01-01

Objective: To explore and address some of the challenges for assessing, interpreting, and grading athletic training students' clinical performance and to suggest athletic training educators consider using a more universal assessment method for professional consistency. Background: In years past students learned from teachers or mentors on an…

Teachers, Micro-Credentials, and the Performance Assessment Movement

ERIC Educational Resources Information Center

French, Dan; Berry, Barnett

2017-01-01

Micro-credentials, a new form of personalized professional development for teachers, offer a unique solution to the challenge of training school staff to design and implement performance assessments. In a relatively short period of time, micro-credentials have shown promise in enabling a more personalized, effective method of promoting teacher…

Probabilistic Risk Assessment Procedures Guide for NASA Managers and Practitioners (Second Edition)

NASA Technical Reports Server (NTRS)

Stamatelatos,Michael; Dezfuli, Homayoon; Apostolakis, George; Everline, Chester; Guarro, Sergio; Mathias, Donovan; Mosleh, Ali; Paulos, Todd; Riha, David; Smith, Curtis;

Multi-constituent determination and fingerprint analysis of Scutellaria indica L. using ultra high performance liquid chromatography coupled with quadrupole time-of-flight mass spectrometry.

PubMed

Liang, Xianrui; Zhao, Cui; Su, Weike

2015-11-01

An ultra-performance liquid chromatography coupled with quadrupole time-of-flight mass spectrometry method integrating multi-constituent determination and fingerprint analysis has been established for quality assessment and control of Scutellaria indica L. The optimized method possesses the advantages of speediness, efficiency, and allows multi-constituents determination and fingerprint analysis in one chromatographic run within 11 min. 36 compounds were detected, and 23 of them were unequivocally identified or tentatively assigned. The established fingerprint method was applied to the analysis of ten S. indica samples from different geographic locations. The quality assessment was achieved by using principal component analysis. The proposed method is useful and reliable for the characterization of multi-constituents in a complex chemical system and the overall quality assessment of S. indica. © 2015 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.

Kinespell: Kinesthetic Learning Activity and Assessment in a Digital Game-Based Learning Environment

NASA Astrophysics Data System (ADS)

Cariaga, Ada Angeli; Salvador, Jay Andrae; Solamo, Ma. Rowena; Feria, Rommel

Various approaches in learning are commonly classified into visual, auditory and kinesthetic (VAK) learning styles. One way of addressing the VAK learning styles is through game-based learning which motivates learners pursue knowledge holistically. The paper presents Kinespell, an unconventional method of learning through digital game-based learning. Kinespell is geared towards enhancing not only the learner’s spelling abilities but also the motor skills through utilizing wireless controllers. It monitors player’s performance through integrated assessment scheme. Results show that Kinespell may accommodate the VAK learning styles and is a promising alternative to established methods in learning and assessing students’ performance in Spelling.

Assessing the reliability of ecotoxicological studies: An overview of current needs and approaches.

PubMed

Moermond, Caroline; Beasley, Amy; Breton, Roger; Junghans, Marion; Laskowski, Ryszard; Solomon, Keith; Zahner, Holly

2017-07-01

In general, reliable studies are well designed and well performed, and enough details on study design and performance are reported to assess the study. For hazard and risk assessment in various legal frameworks, many different types of ecotoxicity studies need to be evaluated for reliability. These studies vary in study design, methodology, quality, and level of detail reported (e.g., reviews, peer-reviewed research papers, or industry-sponsored studies documented under Good Laboratory Practice [GLP] guidelines). Regulators have the responsibility to make sound and verifiable decisions and should evaluate each study for reliability in accordance with scientific principles regardless of whether they were conducted in accordance with GLP and/or standardized methods. Thus, a systematic and transparent approach is needed to evaluate studies for reliability. In this paper, 8 different methods for reliability assessment were compared using a number of attributes: categorical versus numerical scoring methods, use of exclusion and critical criteria, weighting of criteria, whether methods are tested with case studies, domain of applicability, bias toward GLP studies, incorporation of standard guidelines in the evaluation method, number of criteria used, type of criteria considered, and availability of guidance material. Finally, some considerations are given on how to choose a suitable method for assessing reliability of ecotoxicity studies. Integr Environ Assess Manag 2017;13:640-651. © 2016 The Authors. Integrated Environmental Assessment and Management published by Wiley Periodicals, Inc. on behalf of Society of Environmental Toxicology & Chemistry (SETAC). © 2016 The Authors. Integrated Environmental Assessment and Management published by Wiley Periodicals, Inc. on behalf of Society of Environmental Toxicology & Chemistry (SETAC).

Proposal for an Evaluation Method for the Performance of Work Procedures.

PubMed

Mohammed, Mouda; Mébarek, Djebabra; Wafa, Boulagouas; Makhlouf, Chati

2016-12-01

Noncompliance of operators with work procedures is a recurrent problem. This human behavior has been said to be situational and studied by many different approaches (ergonomic and others), which consider the noncompliance with work procedures to be obvious and seek to analyze its causes as well as consequences. The object of the proposed method is to solve this problem by focusing on the performance of work procedures and ensuring improved performance on a continuous basis. This study has multiple results: (1) assessment of the work procedures' performance by a multicriteria approach; (2) the use of a continuous improvement approach as a framework for the sustainability of the assessment method of work procedures' performance; and (3) adaptation of the Stop-Card as a facilitator support for continuous improvement of work procedures. The proposed method emphasizes to put in value the inputs of continuous improvement of the work procedures in relation with the conventional approaches which adopt the obvious evidence of the noncompliance to the working procedures and seek to analyze the cause-effect relationships related to this unacceptable phenomenon, especially in strategic industry.

Near-infrared fluorescence image quality test methods for standardized performance evaluation

NASA Astrophysics Data System (ADS)

Kanniyappan, Udayakumar; Wang, Bohan; Yang, Charles; Ghassemi, Pejhman; Wang, Quanzeng; Chen, Yu; Pfefer, Joshua

2017-03-01

Near-infrared fluorescence (NIRF) imaging has gained much attention as a clinical method for enhancing visualization of cancers, perfusion and biological structures in surgical applications where a fluorescent dye is monitored by an imaging system. In order to address the emerging need for standardization of this innovative technology, it is necessary to develop and validate test methods suitable for objective, quantitative assessment of device performance. Towards this goal, we develop target-based test methods and investigate best practices for key NIRF imaging system performance characteristics including spatial resolution, depth of field and sensitivity. Characterization of fluorescence properties was performed by generating excitation-emission matrix properties of indocyanine green and quantum dots in biological solutions and matrix materials. A turbid, fluorophore-doped target was used, along with a resolution target for assessing image sharpness. Multi-well plates filled with either liquid or solid targets were generated to explore best practices for evaluating detection sensitivity. Overall, our results demonstrate the utility of objective, quantitative, target-based testing approaches as well as the need to consider a wide range of factors in establishing standardized approaches for NIRF imaging system performance.

United3D: a protein model quality assessment program that uses two consensus based methods.

PubMed

Terashi, Genki; Oosawa, Makoto; Nakamura, Yuuki; Kanou, Kazuhiko; Takeda-Shitaka, Mayuko

2012-01-01

In protein structure prediction, such as template-based modeling and free modeling (ab initio modeling), the step that assesses the quality of protein models is very important. We have developed a model quality assessment (QA) program United3D that uses an optimized clustering method and a simple Cα atom contact-based potential. United3D automatically estimates the quality scores (Qscore) of predicted protein models that are highly correlated with the actual quality (GDT_TS). The performance of United3D was tested in the ninth Critical Assessment of protein Structure Prediction (CASP9) experiment. In CASP9, United3D showed the lowest average loss of GDT_TS (5.3) among the QA methods participated in CASP9. This result indicates that the performance of United3D to identify the high quality models from the models predicted by CASP9 servers on 116 targets was best among the QA methods that were tested in CASP9. United3D also produced high average Pearson correlation coefficients (0.93) and acceptable Kendall rank correlation coefficients (0.68) between the Qscore and GDT_TS. This performance was competitive with the other top ranked QA methods that were tested in CASP9. These results indicate that United3D is a useful tool for selecting high quality models from many candidate model structures provided by various modeling methods. United3D will improve the accuracy of protein structure prediction.

Relationships between academic performance of medical students and their workplace performance as junior doctors.

PubMed

Carr, Sandra E; Celenza, Antonio; Puddey, Ian B; Lake, Fiona

2014-07-30

Little recent published evidence explores the relationship between academic performance in medical school and performance as a junior doctor. Although many forms of assessment are used to demonstrate a medical student's knowledge or competence, these measures may not reliably predict performance in clinical practice following graduation. This descriptive cohort study explores the relationship between academic performance of medical students and workplace performance as junior doctors, including the influence of age, gender, ethnicity, clinical attachment, assessment type and summary score measures (grade point average) on performance in the workplace as measured by the Junior Doctor Assessment Tool. There were two hundred participants. There were significant correlations between performance as a Junior Doctor (combined overall score) and the grade point average (r = 0.229, P = 0.002), the score from the Year 6 Emergency Medicine attachment (r = 0.361, P < 0.001) and the Written Examination in Year 6 (r = 0.178, P = 0.014). There was no significant effect of any individual method of assessment in medical school, gender or ethnicity on the overall combined score of performance of the junior doctor. Performance on integrated assessments from medical school is correlated to performance as a practicing physician as measured by the Junior Doctor Assessment Tool. These findings support the value of combining undergraduate assessment scores to assess competence and predict future performance.

A closer look at cross-validation for assessing the accuracy of gene regulatory networks and models.

PubMed

Tabe-Bordbar, Shayan; Emad, Amin; Zhao, Sihai Dave; Sinha, Saurabh

2018-04-26

Cross-validation (CV) is a technique to assess the generalizability of a model to unseen data. This technique relies on assumptions that may not be satisfied when studying genomics datasets. For example, random CV (RCV) assumes that a randomly selected set of samples, the test set, well represents unseen data. This assumption doesn't hold true where samples are obtained from different experimental conditions, and the goal is to learn regulatory relationships among the genes that generalize beyond the observed conditions. In this study, we investigated how the CV procedure affects the assessment of supervised learning methods used to learn gene regulatory networks (or in other applications). We compared the performance of a regression-based method for gene expression prediction estimated using RCV with that estimated using a clustering-based CV (CCV) procedure. Our analysis illustrates that RCV can produce over-optimistic estimates of the model's generalizability compared to CCV. Next, we defined the 'distinctness' of test set from training set and showed that this measure is predictive of performance of the regression method. Finally, we introduced a simulated annealing method to construct partitions with gradually increasing distinctness and showed that performance of different gene expression prediction methods can be better evaluated using this method.

Data Challenges of Leveraging a Simulation to Assess Learning

ERIC Educational Resources Information Center

Gibson, David; Jakl, Peter

2013-01-01

Among the unique affordances of digital simulations are changes in the possibilities for targets as well as the methods of assessment, most significantly, toward integration of thinking with action, embedding of tasks-as-performance of knowledge-in-action, and unobtrusive observational methods. This paper raises and briefly defines key data…

An Ecological Approach to the On-Line Assessment of Problem-Solving Paths: Principles and Applications.

ERIC Educational Resources Information Center

Shaw, Robert E.; And Others

1997-01-01

Proposes a theoretical framework for designing online-situated assessment tools for multimedia instructional systems. Uses a graphic method based on ecological psychology to monitor student performance through a learning activity. Explores the method's feasibility in case studies describing instructional systems teaching critical-thinking and…

COMPARISONS OF ACUTE REFERENCE VALUES IN DEVELOPING AN ACUTE INHALATION ASSESSMENT METHOD

EPA Science Inventory

A method is being developed for performing assessments of human health risk from acute (less than 24 hour) inhalation exposures. The methodology will be flexible in its ability to utilize variously robust data sets of dose-response information. A supporting task is a comparati...

SELF-ORGANIZING MAPS FOR INTEGRATED ASSESSMENT OF THE MID-ATLANTIC REGION

EPA Science Inventory

A. new method was developed to perform an environmental assessment for the
Mid-Atlantic Region (MAR). This was a combination of the self-organizing map (SOM) neural network and principal component analysis (PCA). The method is capable of clustering ecosystems in terms of envi...

A suite of phantom-based test methods for assessing image quality of photoacoustic tomography systems

NASA Astrophysics Data System (ADS)

Vogt, William C.; Jia, Congxian; Wear, Keith A.; Garra, Brian S.; Pfefer, T. Joshua

2017-03-01

As Photoacoustic Tomography (PAT) matures and undergoes clinical translation, objective performance test methods are needed to facilitate device development, regulatory clearance and clinical quality assurance. For mature medical imaging modalities such as CT, MRI, and ultrasound, tissue-mimicking phantoms are frequently incorporated into consensus standards for performance testing. A well-validated set of phantom-based test methods is needed for evaluating performance characteristics of PAT systems. To this end, we have constructed phantoms using a custom tissue-mimicking material based on PVC plastisol with tunable, biologically-relevant optical and acoustic properties. Each phantom is designed to enable quantitative assessment of one or more image quality characteristics including 3D spatial resolution, spatial measurement accuracy, ultrasound/PAT co-registration, uniformity, penetration depth, geometric distortion, sensitivity, and linearity. Phantoms contained targets including high-intensity point source targets and dye-filled tubes. This suite of phantoms was used to measure the dependence of performance of a custom PAT system (equipped with four interchangeable linear array transducers of varying design) on design parameters (e.g., center frequency, bandwidth, element geometry). Phantoms also allowed comparison of image artifacts, including surface-generated clutter and bandlimited sensing artifacts. Results showed that transducer design parameters create strong variations in performance including a trade-off between resolution and penetration depth, which could be quantified with our method. This study demonstrates the utility of phantom-based image quality testing in device performance assessment, which may guide development of consensus standards for PAT systems.

Glycemic penalty index for adequately assessing and comparing different blood glucose control algorithms

PubMed Central

Van Herpe, Tom; De Brabanter, Jos; Beullens, Martine; De Moor, Bart; Van den Berghe, Greet

2008-01-01

Introduction Blood glucose (BG) control performed by intensive care unit (ICU) nurses is becoming standard practice for critically ill patients. New (semi-automated) 'BG control' algorithms (or 'insulin titration' algorithms) are under development, but these require stringent validation before they can replace the currently used algorithms. Existing methods for objectively comparing different insulin titration algorithms show weaknesses. In the current study, a new approach for appropriately assessing the adequacy of different algorithms is proposed. Methods Two ICU patient populations (with different baseline characteristics) were studied, both treated with a similar 'nurse-driven' insulin titration algorithm targeting BG levels of 80 to 110 mg/dl. A new method for objectively evaluating BG deviations from normoglycemia was founded on a smooth penalty function. Next, the performance of this new evaluation tool was compared with the current standard assessment methods, on an individual as well as a population basis. Finally, the impact of four selected parameters (the average BG sampling frequency, the duration of algorithm application, the severity of disease, and the type of illness) on the performance of an insulin titration algorithm was determined by multiple regression analysis. Results The glycemic penalty index (GPI) was proposed as a tool for assessing the overall glycemic control behavior in ICU patients. The GPI of a patient is the average of all penalties that are individually assigned to each measured BG value based on the optimized smooth penalty function. The computation of this index returns a number between 0 (no penalty) and 100 (the highest penalty). For some patients, the assessment of the BG control behavior using the traditional standard evaluation methods was different from the evaluation with GPI. Two parameters were found to have a significant impact on GPI: the BG sampling frequency and the duration of algorithm application. A higher BG sampling frequency and a longer algorithm application duration resulted in an apparently better performance, as indicated by a lower GPI. Conclusion The GPI is an alternative method for evaluating the performance of BG control algorithms. The blood glucose sampling frequency and the duration of algorithm application should be similar when comparing algorithms. PMID:18302732

Using Support Vector Machine on EEG for Advertisement Impact Assessment.

PubMed

Wei, Zhen; Wu, Chao; Wang, Xiaoyi; Supratak, Akara; Wang, Pan; Guo, Yike

2018-01-01

The advertising industry depends on an effective assessment of the impact of advertising as a key performance metric for their products. However, current assessment methods have relied on either indirect inference from observing changes in consumer behavior after the launch of an advertising campaign, which has long cycle times and requires an ad campaign to have already have been launched (often meaning costs having been sunk). Or through surveys or focus groups, which have a potential for experimental biases, peer pressure, and other psychological and sociological phenomena that can reduce the effectiveness of the study. In this paper, we investigate a new approach to assess the impact of advertisement by utilizing low-cost EEG headbands to record and assess the measurable impact of advertising on the brain. Our evaluation shows the desired performance of our method based on user experiment with 30 recruited subjects after watching 220 different advertisements. We believe the proposed SVM method can be further developed to a general and scalable methodology that can enable advertising agencies to assess impact rapidly, quantitatively, and without bias.

Using Support Vector Machine on EEG for Advertisement Impact Assessment

PubMed Central

Wei, Zhen; Wu, Chao; Wang, Xiaoyi; Supratak, Akara; Wang, Pan; Guo, Yike

2018-01-01

The advertising industry depends on an effective assessment of the impact of advertising as a key performance metric for their products. However, current assessment methods have relied on either indirect inference from observing changes in consumer behavior after the launch of an advertising campaign, which has long cycle times and requires an ad campaign to have already have been launched (often meaning costs having been sunk). Or through surveys or focus groups, which have a potential for experimental biases, peer pressure, and other psychological and sociological phenomena that can reduce the effectiveness of the study. In this paper, we investigate a new approach to assess the impact of advertisement by utilizing low-cost EEG headbands to record and assess the measurable impact of advertising on the brain. Our evaluation shows the desired performance of our method based on user experiment with 30 recruited subjects after watching 220 different advertisements. We believe the proposed SVM method can be further developed to a general and scalable methodology that can enable advertising agencies to assess impact rapidly, quantitatively, and without bias. PMID:29593481

Multi-ingredients determination and fingerprint analysis of leaves from Ilex latifolia using ultra-performance liquid chromatography coupled with quadrupole time-of-flight mass spectrometry.

PubMed

Fan, Chunlin; Deng, Jiewei; Yang, Yunyun; Liu, Junshan; Wang, Ying; Zhang, Xiaoqi; Fai, Kuokchiu; Zhang, Qingwen; Ye, Wencai

2013-10-01

An ultra-performance liquid chromatography coupled with quadrupole time-of-flight mass spectrometry (UPLC-QTOF-MS) method integrating multi-ingredients determination and fingerprint analysis has been established for quality assessment and control of leaves from Ilex latifolia. The method possesses the advantages of speediness, efficiency, accuracy, and allows the multi-ingredients determination and fingerprint analysis in one chromatographic run within 13min. Multi-ingredients determination was performed based on the extracted ion chromatograms of the exact pseudo-molecular ions (with a 0.01Da window), and fingerprint analysis was performed based on the base peak chromatograms, obtained by negative-ion electrospray ionization QTOF-MS. The method validation results demonstrated our developed method possessing desirable specificity, linearity, precision and accuracy. The method was utilized to analyze 22 I. latifolia samples from different origins. The quality assessment was achieved by using both similarity analysis (SA) and principal component analysis (PCA), and the results from SA were consistent with those from PCA. Our experimental results demonstrate that the strategy integrated multi-ingredients determination and fingerprint analysis using UPLC-QTOF-MS technique is a useful approach for rapid pharmaceutical analysis, with promising prospects for the differentiation of origin, the determination of authenticity, and the overall quality assessment of herbal medicines. Copyright © 2013 Elsevier B.V. All rights reserved.

On the method of Ermakov and Zolotukhin for multiple integration

NASA Technical Reports Server (NTRS)

Cranley, R.; Patterson, T. N. L.

1971-01-01

By introducing the idea of pseudo-implementation, a practical assessment of the method for multiple integration is made. The performance of the method is found to be unimpressive in comparison with a recent regression method.

Determination of lead, cadmium and mercury in blood for assessment of environmental exposure: A comparison between inductively coupled plasma mass spectrometry and atomic absorption spectrometry

NASA Astrophysics Data System (ADS)

Palmer, Christopher D.; Lewis, Miles E.; Geraghty, Ciaran M.; Barbosa, Fernando; Parsons, Patrick J.

2006-08-01

A biomonitoring method for the determination of Pb, Cd, and Hg at background levels in whole blood by inductively coupled plasma-mass spectrometry is described. While this method was optimized for assessing Pb, Cd and Hg at environmental levels, it also proved suitable for assessing concentrations associated with occupational exposure. The method requires as little as 200 μl of blood that is diluted 1 + 49 for direct analysis in the inductively coupled plasma-mass spectrometer. Method performance is compared to well-established AAS methods. Initial method validation was accomplished using National Institute of Standards and Technology (NIST) Standard Reference Material 966, Toxic Metals in Bovine Blood. Method detection limits (3s) are 0.05 μg dl - 1 for Pb, 0.09 μg l - 1 for Cd; and 0.17 μg l - 1 for Hg. Repeatability ranged from 1.4% to 2.8% for Pb; 3% to 10% for Cd; and 2.6% to 8.8% for Hg. In contrast, AAS method detection limits were 1 μg dl - 1 , 0.54 μg l - 1 , and 0.6 μg l - 1 , for Pb, Cd, and Hg, respectively. Further performance assessments were conducted over a 2-year period via participation in four international External Quality Assessment Schemes (EQAS) operated specifically for toxic metals in blood. This includes schemes operated by (a) the New York State Department of Health's Wadsworth Center, Albany, NY, USA (b) L'Institut National de Santé Publique du Québec, Centre de Toxicologie du Québec, Canada, (c) Friedrich-Alexander University, Erlangen, Germany, and (d) the University of Surrey, Guildford, UK Trace Elements scheme. The EQAS data reflect analytical performance for blind samples analyzed independently by both inductively coupled plasma-mass spectrometry and AAS methods.

GENOTOXICITY RISK ASSESSMENT: A PROPOSED CLASSIFICATION STRATEGY

EPA Science Inventory

Recent advances in genetic toxicity (mutagenicity) testing methods and in approaches to performing risk assessment are prompting a renewed effort to harmonize genotoxicity risk assessment across the world. The US Environmental Protection Agency (EPA) first published Guidelines fo...

Learning Style and Ability Grouping in the High School System: Some Caribbean Findings.

ERIC Educational Resources Information Center

Richardson, Arthur G.; Fergus, Eudora E.

1993-01-01

The Inventory of Learning Processes assessed the learning styles of Caribbean ninth graders (47 boys, 67 girls) in 2 ability groups. The higher ability group performed better in deep processing, fact retention, and methodical study. Girls performed better in methodical study. (SK)

A qualitative and quantitative assessment for a bone marrow harvest simulator.

PubMed

Machado, Liliane S; Moraes, Ronei M

2009-01-01

Several approaches to perform assessment in training simulators based on virtual reality have been proposed. There are two kinds of assessment methods: offline and online. The main requirements related to online training assessment methodologies applied to virtual reality systems are the low computational complexity and the high accuracy. In the literature it can be found several approaches for general cases which can satisfy such requirements. An inconvenient about those approaches is related to an unsatisfactory solution for specific cases, as in some medical procedures, where there are quantitative and qualitative information available to perform the assessment. In this paper, we present an approach to online training assessment based on a Modified Naive Bayes which can manipulate qualitative and quantitative variables simultaneously. A special medical case was simulated in a bone marrow harvest simulator. The results obtained were satisfactory and evidenced the applicability of the method.

Comparison of two- and three-dimensional assessment methods of nasolabial appearance in cleft lip and palate patients: Do the assessment methods measure the same outcome?

PubMed

Mosmuller, David G M; Maal, Thomas J; Prahl, Charlotte; Tan, Robin A; Mulder, Frans J; Schwirtz, Roderic M F; de Vet, Henrica C W; Bergé, Stefaan J; Don Griot, J P W

2017-08-01

For the assessment of the nasolabial appearance in cleft patients, a widely accepted, reliable scoring system is not available. In this study four different methods of assessment are compared, including 2D and 3D asymmetry and aesthetic assessments. The data and ratings from an earlier study using the Asher-McDade aesthetic index on 3D photographs and the outcomes of 3D facial distance mapping were compared to a 2D aesthetic assessment, the Cleft Aesthetic Rating Scale, and to SymNose, a computerized 2D asymmetry assessment technique. The reliability and correlation between the four assessment techniques were tested using a sample of 79 patients. The 3D asymmetry assessment had the highest reliability and could be performed by just one observer (Intraclass correlation coefficient (ICC): 0.99). The 2D asymmetry assessment of the nose was highly reliable when performed by just one observer (ICC: 0.89). However, for the 2D asymmetry assessment of the lip more observers were needed. For the 2D aesthetic assessments 3 observers were needed. The 3D aesthetic assessment had the lowest single-observer reliability (ICC: 0.38-0.56) of all four techniques. The agreement between the different assessment methods is poor to very poor. The highest correlation (R: 0.48) was found between 2D and 3D aesthetic assessments. Remarkably, the lowest correlations were found between 2D and 3D asymmetry assessments (0.08-0.17). Different assessment methods are not in agreement and seem to measure different nasolabial aspects. More research is needed to establish exactly what each assessment technique measures and which measurements or outcomes are relevant for the patients. Copyright © 2017 European Association for Cranio-Maxillo-Facial Surgery. Published by Elsevier Ltd. All rights reserved.

GIS-based regionalized life cycle assessment: how big is small enough? Methodology and case study of electricity generation.

PubMed

Mutel, Christopher L; Pfister, Stephan; Hellweg, Stefanie

2012-01-17

We describe a new methodology for performing regionalized life cycle assessment and systematically choosing the spatial scale of regionalized impact assessment methods. We extend standard matrix-based calculations to include matrices that describe the mapping from inventory to impact assessment spatial supports. Uncertainty in inventory spatial data is modeled using a discrete spatial distribution function, which in a case study is derived from empirical data. The minimization of global spatial autocorrelation is used to choose the optimal spatial scale of impact assessment methods. We demonstrate these techniques on electricity production in the United States, using regionalized impact assessment methods for air emissions and freshwater consumption. Case study results show important differences between site-generic and regionalized calculations, and provide specific guidance for future improvements of inventory data sets and impact assessment methods.

Practical session assessments in human anatomy: Weightings and performance.

PubMed

McDonald, Aaron C; Chan, Siew-Pang; Schuijers, Johannes A

2016-07-08

Assessment weighting within a given module can be a motivating factor for students when deciding on their commitment level and time given to study a specific topic. In this study, an analysis of assessment performances of second year anatomy students was performed over four years to determine if (1) students performed better when a higher weighting was given to a set of practical session assessments and (2) whether an improved performance in the practical session assessments had a carry-over effect on other assessment tasks within that anatomy module and/or other anatomy modules that follow. Results showed that increasing the weighting of practical session assessments improved the average mark in that assessment and also improved the percentage of students passing that assessment. Further, it significantly improved performance in the written end-semester examination within the same module and had a carry-over effect on the anatomy module taught in the next teaching period, as students performed better in subsequent practical session assessments as well as subsequent end-semester examinations. It was concluded that the weighting of assessments had significant influences on a student's performance in that, and subsequent, assessments. It is postulated that practical session assessments, designed to develop deep learning skills in anatomy, improved efficacy in student performance in assessments undertaken in that and subsequent anatomy modules when the weighting of these assessments was greater. These deep learning skills were also transferable to other methods of assessing anatomy. Anat Sci Educ 9: 330-336. © 2015 American Association of Anatomists. © 2015 American Association of Anatomists.

Validating the Assessment for Measuring Indonesian Secondary School Students Performance in Ecology

NASA Astrophysics Data System (ADS)

Rachmatullah, A.; Roshayanti, F.; Ha, M.

2017-09-01

The aims of this current study are validating the American Association for the Advancement of Science (AAAS) Ecology assessment and examining the performance of Indonesian secondary school students on the assessment. A total of 611 Indonesian secondary school students (218 middle school students and 393 high school students) participated in the study. Forty-five items of AAAS assessment in the topic of Interdependence in Ecosystems were divided into two versions which every version has 21 similar items. Linking item method was used as the method to combine those two versions of assessment and further Rasch analyses were utilized to validate the instrument. Independent sample t-test was also run to compare the performance of Indonesian students and American students based on the mean of item difficulty. We found that from the total of 45 items, three items were identified as misfitting items. Later on, we also found that both Indonesian middle and high school students were significantly lower performance with very large and medium effect size compared to American students. We will discuss our findings in the regard of validation issue and the connection to Indonesian student’s science literacy.

Problematizing the concept of the "borderline" group in performance assessments.

PubMed

Homer, Matt; Pell, Godfrey; Fuller, Richard

2017-05-01

Many standard setting procedures focus on the performance of the "borderline" group, defined through expert judgments by assessors. In performance assessments such as Objective Structured Clinical Examinations (OSCEs), these judgments usually apply at the station level. Using largely descriptive approaches, we analyze the assessment profile of OSCE candidates at the end of a five year undergraduate medical degree program to investigate the consistency of the borderline group across stations. We look specifically at those candidates who are borderline in individual stations, and in the overall assessment. While the borderline group can be clearly defined at the individual station level, our key finding is that the membership of this group varies considerably across stations. These findings pose challenges for some standard setting methods, particularly the borderline group and objective borderline methods. They also suggest that institutions should ensure appropriate conjunctive rules to limit compensation in performance between stations to maximize "diagnostic accuracy". In addition, this work highlights a key benefit of sequential testing formats in OSCEs. In comparison with a traditional, single-test format, sequential models allow assessment of "borderline" candidates across a wider range of content areas with concomitant improvements in pass/fail decision-making.

Use of cognitive task analysis to guide the development of performance-based assessments for intraoperative decision making.

PubMed

Pugh, Carla M; DaRosa, Debra A

2013-10-01

There is a paucity of performance-based assessments that focus on intraoperative decision making. The purpose of this article is to review the performance outcomes and usefulness of two performance-based assessments that were developed using cognitive task analysis (CTA) frameworks. Assessment-A used CTA to create a "think aloud" oral examination that was administered while junior residents (PGY 1-2's, N = 69) performed a porcine-based laparoscopic cholecystectomy. Assessment-B used CTA to create a simulation-based, formative assessment of senior residents' (PGY 4-5's, N = 29) decision making during a laparoscopic ventral hernia repair. In addition to survey-based assessments of usefulness, a multiconstruct evaluation was performed using eight variables. When comparing performance outcomes, both approaches revealed major deficiencies in residents' intraoperative decision-making skills. Multiconstruct evaluation of the two CTA approaches revealed assessment method advantages for five of the eight evaluation areas: (1) Cognitive Complexity, (2) Content Quality, (3) Content Coverage, (4) Meaningfulness, and (5) Transfer and Generalizability. The two CTA performance assessments were useful in identifying significant training needs. While there are pros and cons to each approach, the results serve as a useful blueprint for program directors seeking to develop performance-based assessments for intraoperative decision making. Reprint & Copyright © 2013 Association of Military Surgeons of the U.S.

The performance evaluation model of mining project founded on the weight optimization entropy value method

NASA Astrophysics Data System (ADS)

Mao, Chao; Chen, Shou

2017-01-01

According to the traditional entropy value method still have low evaluation accuracy when evaluating the performance of mining projects, a performance evaluation model of mineral project founded on improved entropy is proposed. First establish a new weight assignment model founded on compatible matrix analysis of analytic hierarchy process (AHP) and entropy value method, when the compatibility matrix analysis to achieve consistency requirements, if it has differences between subjective weights and objective weights, moderately adjust both proportions, then on this basis, the fuzzy evaluation matrix for performance evaluation. The simulation experiments show that, compared with traditional entropy and compatible matrix analysis method, the proposed performance evaluation model of mining project based on improved entropy value method has higher accuracy assessment.

Comparing health system performance assessment and management approaches in the Netherlands and Ontario, Canada

PubMed Central

Tawfik-Shukor, Ali R; Klazinga, Niek S; Arah, Onyebuchi A

2007-01-01

Background Given the proliferation and the growing complexity of performance measurement initiatives in many health systems, the Netherlands and Ontario, Canada expressed interests in cross-national comparisons in an effort to promote knowledge transfer and best practise. To support this cross-national learning, a study was undertaken to compare health system performance approaches in The Netherlands with Ontario, Canada. Methods We explored the performance assessment framework and system of each constituency, the embeddedness of performance data in management and policy processes, and the interrelationships between the frameworks. Methods used included analysing governmental strategic planning and policy documents, literature and internet searches, comparative descriptive tables, and schematics. Data collection and analysis took place in Ontario and The Netherlands. A workshop to validate and discuss the findings was conducted in Toronto, adding important insights to the study. Results Both Ontario and The Netherlands conceive health system performance within supportive frameworks. However they differ in their assessment approaches. Ontario's Scorecard links performance measurement with strategy, aimed at health system integration. The Dutch Health Care Performance Report (Zorgbalans) does not explicitly link performance with strategy, and focuses on the technical quality of healthcare by measuring dimensions of quality, access, and cost against healthcare needs. A backbone 'five diamond' framework maps both frameworks and articulates the interrelations and overlap between their goals, themes, dimensions and indicators. The workshop yielded more contextual insights and further validated the comparative values of each constituency's performance assessment system. Conclusion To compare the health system performance approaches between The Netherlands and Ontario, Canada, several important conceptual and contextual issues must be addressed, before even attempting any future content comparisons and benchmarking. Such issues would lend relevant interpretational credibility to international comparative assessments of the two health systems. PMID:17319947

Team Objective Structured Bedside Assessment (TOSBA) as formative assessment in undergraduate Obstetrics and Gynaecology: a cohort study.

PubMed

Deane, Richard P; Joyce, Pauline; Murphy, Deirdre J

2015-10-09

Team Objective Structured Bedside Assessment (TOSBA) is a learning approach in which a team of medical students undertake a set of structured clinical tasks with real patients in order to reach a diagnosis and formulate a management plan and receive immediate feedback on their performance from a facilitator. TOSBA was introduced as formative assessment to an 8-week undergraduate teaching programme in Obstetrics and Gynaecology (O&G) in 2013/14. Each student completed 5 TOSBA sessions during the rotation. The aim of the study was to evaluate TOSBA as a teaching method to provide formative assessment for medical students during their clinical rotation. The research questions were: Does TOSBA improve clinical, communication and/or reasoning skills? Does TOSBA provide quality feedback? A prospective cohort study was conducted over a full academic year (2013/14). The study used 2 methods to evaluate TOSBA as a teaching method to provide formative assessment: (1) an online survey of TOSBA at the end of the rotation and (2) a comparison of the student performance in TOSBA with their performance in the final summative examination. During the 2013/14 academic year, 157 students completed the O&G programme and the final summative examination . Each student completed the required 5 TOSBA tasks. The response rate to the student survey was 68 % (n = 107/157). Students reported that TOSBA was a beneficial learning experience with a positive impact on clinical, communication and reasoning skills. Students rated the quality of feedback provided by TOSBA as high. Students identified the observation of the performance and feedback of other students within their TOSBA team as key features. High achieving students performed well in both TOSBA and summative assessments. The majority of students who performed poorly in TOSBA subsequently passed the summative assessments (n = 20/21, 95 %). Conversely, the majority of students who failed the summative assessments had satisfactory scores in TOSBA (n = 6/7, 86 %). TOSBA has a positive impact on the clinical, communication and reasoning skills of medical students through the provision of high-quality feedback. The use of structured pre-defined tasks, the observation of the performance and feedback of other students and the use of real patients are key elements of TOSBA. Avoiding student complacency and providing accurate feedback from TOSBA are on-going challenges.

Automatic Human Movement Assessment With Switching Linear Dynamic System: Motion Segmentation and Motor Performance.

PubMed

de Souza Baptista, Roberto; Bo, Antonio P L; Hayashibe, Mitsuhiro

2017-06-01

Performance assessment of human movement is critical in diagnosis and motor-control rehabilitation. Recent developments in portable sensor technology enable clinicians to measure spatiotemporal aspects to aid in the neurological assessment. However, the extraction of quantitative information from such measurements is usually done manually through visual inspection. This paper presents a novel framework for automatic human movement assessment that executes segmentation and motor performance parameter extraction in time-series of measurements from a sequence of human movements. We use the elements of a Switching Linear Dynamic System model as building blocks to translate formal definitions and procedures from human movement analysis. Our approach provides a method for users with no expertise in signal processing to create models for movements using labeled dataset and later use it for automatic assessment. We validated our framework on preliminary tests involving six healthy adult subjects that executed common movements in functional tests and rehabilitation exercise sessions, such as sit-to-stand and lateral elevation of the arms and five elderly subjects, two of which with limited mobility, that executed the sit-to-stand movement. The proposed method worked on random motion sequences for the dual purpose of movement segmentation (accuracy of 72%-100%) and motor performance assessment (mean error of 0%-12%).

The effectiveness of digital microscopy as a teaching tool in medical laboratory science curriculum.

PubMed

Castillo, Demetra

2012-01-01

A fundamental component to the practice of Medical Laboratory Science (MLS) is the microscope. While traditional microscopy (TM) is gold standard, the high cost of maintenance has led to an increased demand for alternative methods, such as digital microscopy (DM). Slides embedded with blood specimens are converted into a digital form that can be run with computer driven software. The aim of this study was to investigate the effectiveness of digital microscopy as a teaching tool in the field of Medical Laboratory Science. Participants reviewed known study slides using both traditional and digital microscopy methods and were assessed using both methods. Participants were randomly divided into two groups. Group 1 performed TM as the primary method and DM as the alternate. Group 2 performed DM as the primary and TM as the alternate. Participants performed differentials with their primary method, were assessed with both methods, and then performed differentials with their alternate method. A detailed assessment rubric was created to determine the accuracy of student responses through comparison of clinical laboratory and instructor results. Student scores were reflected as a percentage correct from these methods. This assessment was done over two different classes. When comparing results between methods for each, independent of the primary method used, results were not statistically different. However, when comparing methods between groups, Group 1 (n = 11) (TM = 73.79% +/- 9.19, DM = 81.43% +/- 8.30; paired t10 = 0.182, p < 0.001) showed a significant difference from Group 2 (n = 14) (TM = 85.64% +/- 5.30, DM = 85.91% +/- 7.62; paired t13 = 3.647, p = 0.860). In the subsequent class, results between both groups (n = 13, n = 16, respectively) did not show any significant difference between groups (Group 1 TM = 86.38% +/- 8.17, Group 1 DM = 88.69% +/- 3.86; paired t12 = 1.253, p = 0.234; Group 2 TM = 86.75% +/- 5.37, Group 2 DM = 86.25% +/- 7.01, paired t15 = 0.280, p = 0.784). The data suggest that DM is comparable to TM. DM could be used as an enhancement model after foundational information was provided using TM.

Error Ratio Analysis: Alternate Mathematics Assessment for General and Special Educators.

ERIC Educational Resources Information Center

Miller, James H.; Carr, Sonya C.

1997-01-01

Eighty-seven elementary students in grades four, five, and six, were administered a 30-item multiplication instrument to assess performance in computation across grade levels. An interpretation of student performance using error ratio analysis is provided and the use of this method with groups of students for instructional decision making is…

Assessment and Remediation for Physicians with Suspected Performance Problems: An International Survey

ERIC Educational Resources Information Center

Humphrey, Charlotte

2010-01-01

Introduction: Little is known about the overall appropriateness and value of the various programs available internationally for assessment and remediation for individual physicians whose performance in their clinical practice has been identified as giving cause for concern. Method: A questionnaire was e-mailed to members of the International…

Multi-type sensor placement and response reconstruction for building structures: Experimental investigations

NASA Astrophysics Data System (ADS)

Hu, Rong-Pan; Xu, You-Lin; Zhan, Sheng

2018-01-01

Estimation of lateral displacement and acceleration responses is essential to assess safety and serviceability of high-rise buildings under dynamic loadings including earthquake excitations. However, the measurement information from the limited number of sensors installed in a building structure is often insufficient for the complete structural performance assessment. An integrated multi-type sensor placement and response reconstruction method has thus been proposed by the authors to tackle this problem. To validate the feasibility and effectiveness of the proposed method, an experimental investigation using a cantilever beam with multi-type sensors is performed and reported in this paper. The experimental setup is first introduced. The finite element modelling and model updating of the cantilever beam are then performed. The optimal sensor placement for the best response reconstruction is determined by the proposed method based on the updated FE model of the beam. After the sensors are installed on the physical cantilever beam, a number of experiments are carried out. The responses at key locations are reconstructed and compared with the measured ones. The reconstructed responses achieve a good match with the measured ones, manifesting the feasibility and effectiveness of the proposed method. Besides, the proposed method is also examined for the cases of different excitations and unknown excitation, and the results prove the proposed method to be robust and effective. The superiority of the optimized sensor placement scheme is finally demonstrated through comparison with two other different sensor placement schemes: the accelerometer-only scheme and non-optimal sensor placement scheme. The proposed method can be applied to high-rise buildings for seismic performance assessment.

Estimating optical imaging system performance for space applications

NASA Technical Reports Server (NTRS)

Sinclair, K. F.

1972-01-01

The critical system elements of an optical imaging system are identified and a method for an initial assessment of system performance is presented. A generalized imaging system is defined. A system analysis is considered, followed by a component analysis. An example of the method is given using a film imaging system.

A Comparison of Lifting-Line and CFD Methods with Flight Test Data from a Research Puma Helicopter

NASA Technical Reports Server (NTRS)

Bousman, William G.; Young, Colin; Toulmay, Francois; Gilbert, Neil E.; Strawn, Roger C.; Miller, Judith V.; Maier, Thomas H.; Costes, Michel; Beaumier, Philippe

1996-01-01

Four lifting-line methods were compared with flight test data from a research Puma helicopter and the accuracy assessed over a wide range of flight speeds. Hybrid Computational Fluid Dynamics (CFD) methods were also examined for two high-speed conditions. A parallel analytical effort was performed with the lifting-line methods to assess the effects of modeling assumptions and this provided insight into the adequacy of these methods for load predictions.

An examination of the hexokinase method for serum glucose assay using external quality assessment data.

PubMed

Westwood, A; Bullock, D G; Whitehead, T P

1986-01-01

Hexokinase methods for serum glucose assay appeared to give slightly but consistently higher inter-laboratory coefficients of variation than all methods combined in the UK External Quality Assessment Scheme; their performance over a two-year period was therefore compared with that for three groups of glucose oxidase methods. This assessment showed no intrinsic inferiority in the hexokinase method. The greater variation may be due to the more heterogeneous group of instruments, particularly discrete analysers, on which the method is used. The Beckman Glucose Analyzer and Astra group (using a glucose oxidase method) showed the least inter-laboratory variability but also the lowest mean value. No comment is offered on the absolute accuracy of any of the methods.

Structured assessment of microsurgery skills in the clinical setting.

PubMed

Chan, WoanYi; Niranjan, Niri; Ramakrishnan, Venkat

2010-08-01

Microsurgery is an essential component in plastic surgery training. Competence has become an important issue in current surgical practice and training. The complexity of microsurgery requires detailed assessment and feedback on skills components. This article proposes a method of Structured Assessment of Microsurgery Skills (SAMS) in a clinical setting. Three types of assessment (i.e., modified Global Rating Score, errors list and summative rating) were incorporated to develop the SAMS method. Clinical anastomoses were recorded on videos using a digital microscope system and were rated by three consultants independently and in a blinded fashion. Fifteen clinical cases of microvascular anastomoses performed by trainees and a consultant microsurgeon were assessed using SAMS. The consultant had consistently the highest scores. Construct validity was also demonstrated by improvement of SAMS scores of microsurgery trainees. The overall inter-rater reliability was strong (alpha=0.78). The SAMS method provides both formative and summative assessment of microsurgery skills. It is demonstrated to be a valid, reliable and feasible assessment tool of operating room performance to provide systematic and comprehensive feedback as part of the learning cycle. Copyright 2009 British Association of Plastic, Reconstructive and Aesthetic Surgeons. Published by Elsevier Ltd. All rights reserved.

Assessing resident's knowledge and communication skills using four different evaluation tools.

PubMed

Nuovo, Jim; Bertakis, Klea D; Azari, Rahman

2006-07-01

This study assesses the relationship between 4 Accreditation Council for Graduate Medical Education (ACGME) outcome project measures for interpersonal and communication skills and medical knowledge; specifically, monthly performance evaluations, objective structured clinical examinations (OSCEs), the American Board of Family Practice in-training examination (ABFP-ITE) and the Davis observation code (DOC) practice style profiles. Based on previous work, we have DOC scoring for 29 residents from the University of California, Davis Department of Family and Community Medicine. For all these residents we also had the results of monthly performance evaluations, 2 required OSCE exercises, and the results of 3 American Board of Family Medicine (ABFM) ITEs. Data for each of these measures were abstracted for each resident. The Pearson correlation coefficient was used to assess the presence or lack of correlation between each of these evaluation methods. There is little correlation between various evaluation methods used to assess medical knowledge, and there is also little correlation between various evaluation methods used to assess communication skills. The outcome project remains a 'work in progress', with the need for larger studies to assess the value of different assessment measures of resident competence. It is unlikely that DOC will become a useful evaluation tool.

Clinical utility of the Structured Observation of Motor Performance in Infants within the child health services

PubMed Central

Persson, Kristina; Sonnander, Karin; Magnusson, Margaretha; Sarkadi, Anna; Lucas, Steven

2017-01-01

Aim This study aimed to evaluate the clinical utility of the Structured Observation of Motor Performance in Infants (SOMP-I) when used by nurses in routine child healthcare by analyzing the nurses’ SOMP-I assessments and the actions taken when motor problems were suspected. Method Infants from three child health centers in Uppsala County, Sweden, were consecutively enrolled in a longitudinal study. The 242 infants were assessed using SOMP-I by the nurse responsible for the infant as part of the regular well-child visits at as close to 2, 4, 6 and 10 months of age as possible. The nurses noted actions taken such as giving advice, scheduling an extra follow-up or referring the infant to specialized care. The infants’ motor development was reassessed at 18 months of age through review of medical records or parental report. Results The assessments of level of motor development at 2 and 10 months showed a distribution corresponding to the percentile distribution of the SOMP-I method. Fewer infants than expected were assessed as delayed at 4 and 6 months or deficient in quality at all assessment ages. When an infant was assessed as delayed in level or deficient in quality, the likelihood of the nurse taking actions increased. This increased further if both delay and quality deficit were found at the same assessment or if one or both were found at repeated assessments. The reassessment of the motor development at 18 months did not reveal any missed infants with major motor impairments. Interpretation The use of SOMP-I appears to demonstrate favorable clinical utility in routine child healthcare as tested here. Child health nurses can assess early motor performance using this standardized assessment method, and using the method appears to support them the clinical decision-making. PMID:28723929

Comparative performance assessment of point-of-care testing devices for measuring glucose and ketones at the patient bedside.

PubMed

Ceriotti, Ferruccio; Kaczmarek, Ewa; Guerra, Elena; Mastrantonio, Fabrizio; Lucarelli, Fausto; Valgimigli, Francesco; Mosca, Andrea

2015-03-01

Point-of-care (POC) testing devices for monitoring glucose and ketones can play a key role in the management of dysglycemia in hospitalized diabetes patients. The accuracy of glucose devices can be influenced by biochemical changes that commonly occur in critically ill hospital patients and by the medication prescribed. Little is known about the influence of these factors on ketone POC measurements. The aim of this study was to assess the analytical performance of POC hospital whole-blood glucose and ketone meters and the extent of glucose interference factors on the design and accuracy of ketone results. StatStrip glucose/ketone, Optium FreeStyle glucose/ketone, and Accu-Chek Performa glucose were also assessed and results compared to a central laboratory reference method. The analytical evaluation was performed according to Clinical and Laboratory Standards Institute (CLSI) protocols for precision, linearity, method comparison, and interference. The interferences assessed included acetoacetate, acetaminophen, ascorbic acid, galactose, maltose, uric acid, and sodium. The accuracies of both Optium ketone and glucose measurements were significantly influenced by varying levels of hematocrit and ascorbic acid. StatStrip ketone and glucose measurements were unaffected by the interferences tested with exception of ascorbic acid, which reduced the higher level ketone value. The accuracy of Accu-Chek glucose measurements was affected by hematocrit, by ascorbic acid, and significantly by galactose. The method correlation assessment indicated differences between the meters in compliance to ISO 15197 and CLSI 12-A3 performance criteria. Combined POC glucose/ketone methods are now available. The use of these devices in a hospital setting requires careful consideration with regard to the selection of instruments not sensitive to hematocrit variation and presence of interfering substances. © 2014 Diabetes Technology Society.

Method of assessing the state of a rolling bearing based on the relative compensation distance of multiple-domain features and locally linear embedding

NASA Astrophysics Data System (ADS)

Kang, Shouqiang; Ma, Danyang; Wang, Yujing; Lan, Chaofeng; Chen, Qingguo; Mikulovich, V. I.

2017-03-01

To effectively assess different fault locations and different degrees of performance degradation of a rolling bearing with a unified assessment index, a novel state assessment method based on the relative compensation distance of multiple-domain features and locally linear embedding is proposed. First, for a single-sample signal, time-domain and frequency-domain indexes can be calculated for the original vibration signal and each sensitive intrinsic mode function obtained by improved ensemble empirical mode decomposition, and the singular values of the sensitive intrinsic mode function matrix can be extracted by singular value decomposition to construct a high-dimensional hybrid-domain feature vector. Second, a feature matrix can be constructed by arranging each feature vector of multiple samples, the dimensions of each row vector of the feature matrix can be reduced by the locally linear embedding algorithm, and the compensation distance of each fault state of the rolling bearing can be calculated using the support vector machine. Finally, the relative distance between different fault locations and different degrees of performance degradation and the normal-state optimal classification surface can be compensated, and on the basis of the proposed relative compensation distance, the assessment model can be constructed and an assessment curve drawn. Experimental results show that the proposed method can effectively assess different fault locations and different degrees of performance degradation of the rolling bearing under certain conditions.

Performance assessment of methods for estimation of fractal dimension from scanning electron microscope images.

PubMed

Risović, Dubravko; Pavlović, Zivko

2013-01-01

Processing of gray scale images in order to determine the corresponding fractal dimension is very important due to widespread use of imaging technologies and application of fractal analysis in many areas of science, technology, and medicine. To this end, many methods for estimation of fractal dimension from gray scale images have been developed and routinely used. Unfortunately different methods (dimension estimators) often yield significantly different results in a manner that makes interpretation difficult. Here, we report results of comparative assessment of performance of several most frequently used algorithms/methods for estimation of fractal dimension. To that purpose, we have used scanning electron microscope images of aluminum oxide surfaces with different fractal dimensions. The performance of algorithms/methods was evaluated using the statistical Z-score approach. The differences between performances of six various methods are discussed and further compared with results obtained by electrochemical impedance spectroscopy on the same samples. The analysis of results shows that the performance of investigated algorithms varies considerably and that systematically erroneous fractal dimensions could be estimated using certain methods. The differential cube counting, triangulation, and box counting algorithms showed satisfactory performance in the whole investigated range of fractal dimensions. Difference statistic is proved to be less reliable generating 4% of unsatisfactory results. The performances of the Power spectrum, Partitioning and EIS were unsatisfactory in 29%, 38%, and 75% of estimations, respectively. The results of this study should be useful and provide guidelines to researchers using/attempting fractal analysis of images obtained by scanning microscopy or atomic force microscopy. © Wiley Periodicals, Inc.

Developing and Evaluating a Target-Background Similarity Metric for Camouflage Detection

PubMed Central

Lin, Chiuhsiang Joe; Chang, Chi-Chan; Liu, Bor-Shong

2014-01-01

Background Measurement of camouflage performance is of fundamental importance for military stealth applications. The goal of camouflage assessment algorithms is to automatically assess the effect of camouflage in agreement with human detection responses. In a previous study, we found that the Universal Image Quality Index (UIQI) correlated well with the psychophysical measures, and it could be a potentially camouflage assessment tool. Methodology In this study, we want to quantify the camouflage similarity index and psychophysical results. We compare several image quality indexes for computational evaluation of camouflage effectiveness, and present the results of an extensive human visual experiment conducted to evaluate the performance of several camouflage assessment algorithms and analyze the strengths and weaknesses of these algorithms. Significance The experimental data demonstrates the effectiveness of the approach, and the correlation coefficient result of the UIQI was higher than those of other methods. This approach was highly correlated with the human target-searching results. It also showed that this method is an objective and effective camouflage performance evaluation method because it considers the human visual system and image structure, which makes it consistent with the subjective evaluation results. PMID:24498310

Two Methods for Classifying Jobs into Equal Employment Opportunity Categories. Working Paper 83/84-4-21.

ERIC Educational Resources Information Center

Potter, Penny F.; Graham-Moore, Brian E.

Most organizations planning to assess adverse impact or perform a stock analysis for affirmative action planning must correctly classify their jobs into appropriate occupational categories. Two methods of job classification were assessed in a combination archival and field study. Classification results from expert judgment of functional job…

Performance map of a cluster detection test using extended power

PubMed Central

2013-01-01

Background Conventional power studies possess limited ability to assess the performance of cluster detection tests. In particular, they cannot evaluate the accuracy of the cluster location, which is essential in such assessments. Furthermore, they usually estimate power for one or a few particular alternative hypotheses and thus cannot assess performance over an entire region. Takahashi and Tango developed the concept of extended power that indicates both the rate of null hypothesis rejection and the accuracy of the cluster location. We propose a systematic assessment method, using here extended power, to produce a map showing the performance of cluster detection tests over an entire region. Methods To explore the behavior of a cluster detection test on identical cluster types at any possible location, we successively applied four different spatial and epidemiological parameters. These parameters determined four cluster collections, each covering the entire study region. We simulated 1,000 datasets for each cluster and analyzed them with Kulldorff’s spatial scan statistic. From the area under the extended power curve, we constructed a map for each parameter set showing the performance of the test across the entire region. Results Consistent with previous studies, the performance of the spatial scan statistic increased with the baseline incidence of disease, the size of the at-risk population and the strength of the cluster (i.e., the relative risk). Performance was heterogeneous, however, even for very similar clusters (i.e., similar with respect to the aforementioned factors), suggesting the influence of other factors. Conclusions The area under the extended power curve is a single measure of performance and, although needing further exploration, it is suitable to conduct a systematic spatial evaluation of performance. The performance map we propose enables epidemiologists to assess cluster detection tests across an entire study region. PMID:24156765

48 CFR 37.601 - General.

Code of Federal Regulations, 2010 CFR

2010-10-01

... a performance work statement or a statement of objectives (see 37.602). (b) Performance-based contracts for services shall include— (1) A performance work statement (PWS); (2) Measurable performance standards (i.e., in terms of quality, timeliness, quantity, etc.) and the method of assessing contractor...

48 CFR 37.601 - General.

Code of Federal Regulations, 2012 CFR

2012-10-01

... a performance work statement or a statement of objectives (see 37.602). (b) Performance-based contracts for services shall include— (1) A performance work statement (PWS); (2) Measurable performance standards (i.e., in terms of quality, timeliness, quantity, etc.) and the method of assessing contractor...

48 CFR 37.601 - General.

Code of Federal Regulations, 2014 CFR

2014-10-01

... a performance work statement or a statement of objectives (see 37.602). (b) Performance-based contracts for services shall include— (1) A performance work statement (PWS); (2) Measurable performance standards (i.e., in terms of quality, timeliness, quantity, etc.) and the method of assessing contractor...

The effect of texture granularity on texture synthesis quality

NASA Astrophysics Data System (ADS)

Golestaneh, S. Alireza; Subedar, Mahesh M.; Karam, Lina J.

2015-09-01

Natural and artificial textures occur frequently in images and in video sequences. Image/video coding systems based on texture synthesis can make use of a reliable texture synthesis quality assessment method in order to improve the compression performance in terms of perceived quality and bit-rate. Existing objective visual quality assessment methods do not perform satisfactorily when predicting the synthesized texture quality. In our previous work, we showed that texture regularity can be used as an attribute for estimating the quality of synthesized textures. In this paper, we study the effect of another texture attribute, namely texture granularity, on the quality of synthesized textures. For this purpose, subjective studies are conducted to assess the quality of synthesized textures with different levels (low, medium, high) of perceived texture granularity using different types of texture synthesis methods.

Assessment in Early Intervention and Early Childhood Special Education: Building on the Past to Project into Our Future.

ERIC Educational Resources Information Center

McConnell, Scott R.

2000-01-01

This article discusses three future directions of early childhood assessment: attention to assessment of progress and growth, adaptation of methods typically associated with ecobehavioral research to assess environmental conditions that affect performance, and continued integration and linkage of assessment and intervention, which will yield more…

Quantification for Complex Assessment: Uncertainty Estimation in Final Year Project Thesis Assessment

ERIC Educational Resources Information Center

Kim, Ho Sung

2013-01-01

A quantitative method for estimating an expected uncertainty (reliability and validity) in assessment results arising from the relativity between four variables, viz examiner's expertise, examinee's expertise achieved, assessment task difficulty and examinee's performance, was developed for the complex assessment applicable to final…

Statistical assessment of speech system performance

NASA Technical Reports Server (NTRS)

Moshier, Stephen L.

1977-01-01

Methods for the normalization of performance tests results of speech recognition systems are presented. Technological accomplishments in speech recognition systems, as well as planned research activities are described.

Comparison of the performance of IFA, CFA, and ELISA assays for the serodiagnosis of acute Q fever by quality assessment.

PubMed

Herremans, Tineke; Hogema, Boris M; Nabuurs, Marrigje; Peeters, Marcel; Wegdam-Blans, Marjolijn; Schneeberger, Peter; Nijhuis, Carla; Notermans, Daan W; Galama, Joep; Horrevorts, Anton; van Loo, Inge H M; Vlaminckx, Bart; Zaaijer, Hans L; Koopmans, Marion P; Berkhout, Hanneke; Socolovschi, Cristina; Raoult, Didier; Stenos, John; Nicholson, William; Bijlmer, Henk

2013-01-01

The indirect immunofluorescence assay (IFA) is considered the reference method for diagnosing Q fever, but serology is also performed by complement fixation assay (CFA) or enzyme-linked immunosorbent assay (ELISA). However, comparability between these assays is not clear, and therefore a quality assessment was performed. A total of 25 serum samples from negative controls, Q fever patients, and a serial diluted high-positive sample were analyzed in 10 Dutch laboratories. Six laboratories performed CFA, 5 performed IFA, and 5 performed ELISAs. Three international reference laboratories from Australia, France, and the USA also participated in this study. Qualitative values between laboratories using the same methods were within close range, and all 3 methods correctly identified acute Q fever patients. The IFA, ELISA, and CFA are all suitable serodiagnostic assays to diagnose acute Q fever, but the IFA remains an important tool in the follow-up of patients and in identifying patients at risk for developing chronic Q fever. Copyright © 2013 Elsevier Inc. All rights reserved.

Advanced Technology Composite Fuselage-Structural Performance

NASA Technical Reports Server (NTRS)

Walker, T. H.; Minguet, P. J.; Flynn, B. W.; Carbery, D. J.; Swanson, G. D.; Ilcewicz, L. B.

1997-01-01

Boeing is studying the technologies associated with the application of composite materials to commercial transport fuselage structure under the NASA-sponsored contracts for Advanced Technology Composite Aircraft Structures (ATCAS) and Materials Development Omnibus Contract (MDOC). This report addresses the program activities related to structural performance of the selected concepts, including both the design development and subsequent detailed evaluation. Design criteria were developed to ensure compliance with regulatory requirements and typical company objectives. Accurate analysis methods were selected and/or developed where practical, and conservative approaches were used where significant approximations were necessary. Design sizing activities supported subsequent development by providing representative design configurations for structural evaluation and by identifying the critical performance issues. Significant program efforts were directed towards assessing structural performance predictive capability. The structural database collected to perform this assessment was intimately linked to the manufacturing scale-up activities to ensure inclusion of manufacturing-induced performance traits. Mechanical tests were conducted to support the development and critical evaluation of analysis methods addressing internal loads, stability, ultimate strength, attachment and splice strength, and damage tolerance. Unresolved aspects of these performance issues were identified as part of the assessments, providing direction for future development.

[The study of establishment of the " Chinese provincial Blindness prevention technical guidance group performance evaluation system"].

PubMed

Lu, L N; He, X G; Zhu, J F; Xu, X; Zhang, R; Hu, X; Zou, H D

2016-11-11

Objective: To establish an assessment system, including indexes and scoring methods, that can be used for performance evaluation of the provincial blindness prevention technical guidance group properly and effectively . Methods: The indexes and scoring methods were set based on the core content of The " National Plan of Prevention and Treatment of Blindness (2012-2015)" , the specific requirement and target of the World Health Organization (WHO) "For the General Eye Health: Global plan of Action (2014-2019)" , and the current situation of the China's provinces and autonomous regions. These indexes should be of effectiveness, feasibility, comparability, guidance and advancing. Formed by a literature review of candidate indicators, the framework of the system is built by qualitative assessment. With the Delphi method, the system was further revised and improved. Empirical pilot study was then used to prove the feasibility, followed by the final qualitative analysis that establish the " Chinese provincial Blindness prevention technical guidance group performance evaluation system" . Results: Through the literature review and qualitative assessment, a six dimensional system framework was built, including 6 first-level indicators, 16 second-level indicators, and 29 third-level indicators through Delphi method evaluation. With the variation coefficient method, the coeffiences of the first-level index weight were calculated as: Organization and management 0.15, Development and implementation of blindness prevention plans 0.15, Implementation of blindness prevention projects 0.14, Training 0.17, Health education 0.18, and Cooperation and exchanges 0.21. The specific scoring method for this system is confirmed as: data and files check, field interview, and record interview, sampling investigation. Empirical pilot study was conducted in the Jilin, Guizhou and Gansu provinces, and the self-assessment results from local experts were consistent with the scores from the systems. Conclusion: This system established is appropriate at current time, and it can effectively evaluate the performance of the Chinese provincial Blindness prevention technical guidance group. (Chin J Ophthalmol, 2016, 52:814-824) .

Assessing deep and shallow learning methods for quantitative prediction of acute chemical toxicity.

PubMed

Liu, Ruifeng; Madore, Michael; Glover, Kyle P; Feasel, Michael G; Wallqvist, Anders

2018-05-02

Animal-based methods for assessing chemical toxicity are struggling to meet testing demands. In silico approaches, including machine-learning methods, are promising alternatives. Recently, deep neural networks (DNNs) were evaluated and reported to outperform other machine-learning methods for quantitative structure-activity relationship modeling of molecular properties. However, most of the reported performance evaluations relied on global performance metrics, such as the root mean squared error (RMSE) between the predicted and experimental values of all samples, without considering the impact of sample distribution across the activity spectrum. Here, we carried out an in-depth analysis of DNN performance for quantitative prediction of acute chemical toxicity using several datasets. We found that the overall performance of DNN models on datasets of up to 30,000 compounds was similar to that of random forest (RF) models, as measured by the RMSE and correlation coefficients between the predicted and experimental results. However, our detailed analyses demonstrated that global performance metrics are inappropriate for datasets with a highly uneven sample distribution, because they show a strong bias for the most populous compounds along the toxicity spectrum. For highly toxic compounds, DNN and RF models trained on all samples performed much worse than the global performance metrics indicated. Surprisingly, our variable nearest neighbor method, which utilizes only structurally similar compounds to make predictions, performed reasonably well, suggesting that information of close near neighbors in the training sets is a key determinant of acute toxicity predictions.

Assessing hospital disaster preparedness: a comparison of an on-site survey, directly observed drill performance, and video analysis of teamwork.

PubMed

Kaji, Amy H; Langford, Vinette; Lewis, Roger J

2008-09-01

There is currently no validated method for assessing hospital disaster preparedness. We determine the degree of correlation between the results of 3 methods for assessing hospital disaster preparedness: administration of an on-site survey, drill observation using a structured evaluation tool, and video analysis of team performance in the hospital incident command center. This was a prospective, observational study conducted during a regional disaster drill, comparing the results from an on-site survey, a structured disaster drill evaluation tool, and a video analysis of teamwork, performed at 6 911-receiving hospitals in Los Angeles County, CA. The on-site survey was conducted separately from the drill and assessed hospital disaster plan structure, vendor agreements, modes of communication, medical and surgical supplies, involvement of law enforcement, mutual aid agreements with other facilities, drills and training, surge capacity, decontamination capability, and pharmaceutical stockpiles. The drill evaluation tool, developed by Johns Hopkins University under contract from the Agency for Healthcare Research and Quality, was used to assess various aspects of drill performance, such as the availability of the hospital disaster plan, the geographic configuration of the incident command center, whether drill participants were identifiable, whether the noise level interfered with effective communication, and how often key information (eg, number of available staffed floor, intensive care, and isolation beds; number of arriving victims; expected triage level of victims; number of potential discharges) was received by the incident command center. Teamwork behaviors in the incident command center were quantitatively assessed, using the MedTeams analysis of the video recordings obtained during the disaster drill. Spearman rank correlations of the results between pair-wise groupings of the 3 assessment methods were calculated. The 3 evaluation methods demonstrated qualitatively different results with respect to each hospital's level of disaster preparedness. The Spearman rank correlation coefficient between the results of the on-site survey and the video analysis of teamwork was -0.34; between the results of the on-site survey and the structured drill evaluation tool, 0.15; and between the results of the video analysis and the drill evaluation tool, 0.82. The disparate results obtained from the 3 methods suggest that each measures distinct aspects of disaster preparedness, and perhaps no single method adequately characterizes overall hospital preparedness.

Graduate performance of science education department in implementing conservation-based science teaching

NASA Astrophysics Data System (ADS)

Parmin; Savitri, E. N.; Amalia, A. V.; Pratama, M. R.

2018-04-01

This study aims to measure the performance of graduates in implementing conservation-based science teaching. The study employed a qualitative method by collecting the self-assessment data from alumni and the performance assessment from the headmasters of schools where the graduates are currently teaching. There are nine indicators of conservation insight examined in this study. The study concluded that the 78 alumni, who have become teachers when the study was conducted, perform well in implementing conservative science lessons.

A new method for assessing surface solar irradiance: Heliosat-4

NASA Astrophysics Data System (ADS)

Qu, Z.; Oumbe, A.; Blanc, P.; Lefèvre, M.; Wald, L.; Schroedter-Homscheidt, M.; Gesell, G.

2012-04-01

Downwelling shortwave irradiance at surface (SSI) is more and more often assessed by means of satellite-derived estimates of optical properties of the atmosphere. Performances are judged satisfactory for the time being but there is an increasing need for the assessment of the direct and diffuse components of the SSI. MINES ParisTech and the German Aerospace Center (DLR) are currently developing the Heliosat-4 method to assess the SSI and its components in a more accurate way than current practices. This method is composed by two parts: a clear sky module based on the radiative transfer model libRadtran, and a cloud-ground module using two-stream and delta-Eddington approximations for clouds and a database of ground albedo. Advanced products derived from geostationary satellites and recent Earth Observation missions are the inputs of the Heliosat-4 method. Such products are: cloud optical depth, cloud phase, cloud type and cloud coverage from APOLLO of DLR, aerosol optical depth, aerosol type, water vapor in clear-sky, ozone from MACC products (FP7), and ground albedo from MODIS of NASA. In this communication, we briefly present Heliosat-4 and focus on its performances. The results of Heliosat-4 for the period 2004-2010 will be compared to the measurements made in five stations within the Baseline Surface Radiation Network. Extensive statistic analysis as well as case studies are performed in order to better understand Heliosat-4 and have an in-depth view of the performance of Heliosat-4, to understand its advantages comparing to existing methods and to identify its defaults for future improvements. The research leading to these results has received funding from the European Union's Seventh Framework Programme (FP7/2007-2013) under Grant Agreement no. 218793 (MACC project) and no. 283576 (MACC-II project).

An improved method to detect correct protein folds using partial clustering.

PubMed

Zhou, Jianjun; Wishart, David S

2013-01-16

Structure-based clustering is commonly used to identify correct protein folds among candidate folds (also called decoys) generated by protein structure prediction programs. However, traditional clustering methods exhibit a poor runtime performance on large decoy sets. We hypothesized that a more efficient "partial" clustering approach in combination with an improved scoring scheme could significantly improve both the speed and performance of existing candidate selection methods. We propose a new scheme that performs rapid but incomplete clustering on protein decoys. Our method detects structurally similar decoys (measured using either C(α) RMSD or GDT-TS score) and extracts representatives from them without assigning every decoy to a cluster. We integrated our new clustering strategy with several different scoring functions to assess both the performance and speed in identifying correct or near-correct folds. Experimental results on 35 Rosetta decoy sets and 40 I-TASSER decoy sets show that our method can improve the correct fold detection rate as assessed by two different quality criteria. This improvement is significantly better than two recently published clustering methods, Durandal and Calibur-lite. Speed and efficiency testing shows that our method can handle much larger decoy sets and is up to 22 times faster than Durandal and Calibur-lite. The new method, named HS-Forest, avoids the computationally expensive task of clustering every decoy, yet still allows superior correct-fold selection. Its improved speed, efficiency and decoy-selection performance should enable structure prediction researchers to work with larger decoy sets and significantly improve their ab initio structure prediction performance.

An improved method to detect correct protein folds using partial clustering

PubMed Central

2013-01-01

Background Structure-based clustering is commonly used to identify correct protein folds among candidate folds (also called decoys) generated by protein structure prediction programs. However, traditional clustering methods exhibit a poor runtime performance on large decoy sets. We hypothesized that a more efficient “partial“ clustering approach in combination with an improved scoring scheme could significantly improve both the speed and performance of existing candidate selection methods. Results We propose a new scheme that performs rapid but incomplete clustering on protein decoys. Our method detects structurally similar decoys (measured using either Cα RMSD or GDT-TS score) and extracts representatives from them without assigning every decoy to a cluster. We integrated our new clustering strategy with several different scoring functions to assess both the performance and speed in identifying correct or near-correct folds. Experimental results on 35 Rosetta decoy sets and 40 I-TASSER decoy sets show that our method can improve the correct fold detection rate as assessed by two different quality criteria. This improvement is significantly better than two recently published clustering methods, Durandal and Calibur-lite. Speed and efficiency testing shows that our method can handle much larger decoy sets and is up to 22 times faster than Durandal and Calibur-lite. Conclusions The new method, named HS-Forest, avoids the computationally expensive task of clustering every decoy, yet still allows superior correct-fold selection. Its improved speed, efficiency and decoy-selection performance should enable structure prediction researchers to work with larger decoy sets and significantly improve their ab initio structure prediction performance. PMID:23323835

Statistical Issues in the Comparison of Quantitative Imaging Biomarker Algorithms using Pulmonary Nodule Volume as an Example

PubMed Central

2014-01-01

Quantitative imaging biomarkers (QIBs) are being used increasingly in medicine to diagnose and monitor patients’ disease. The computer algorithms that measure QIBs have different technical performance characteristics. In this paper we illustrate the appropriate statistical methods for assessing and comparing the bias, precision, and agreement of computer algorithms. We use data from three studies of pulmonary nodules. The first study is a small phantom study used to illustrate metrics for assessing repeatability. The second study is a large phantom study allowing assessment of four algorithms’ bias and reproducibility for measuring tumor volume and the change in tumor volume. The third study is a small clinical study of patients whose tumors were measured on two occasions. This study allows a direct assessment of six algorithms’ performance for measuring tumor change. With these three examples we compare and contrast study designs and performance metrics, and we illustrate the advantages and limitations of various common statistical methods for QIB studies. PMID:24919828

Factors Associated with the Performance and Cost-Effectiveness of Using Lymphatic Filariasis Transmission Assessment Surveys for Monitoring Soil-Transmitted Helminths: A Case Study in Kenya

PubMed Central

Smith, Jennifer L.; Sturrock, Hugh J. W.; Assefa, Liya; Nikolay, Birgit; Njenga, Sammy M.; Kihara, Jimmy; Mwandawiro, Charles S.; Brooker, Simon J.

2015-01-01

Transmission assessment surveys (TAS) for lymphatic filariasis have been proposed as a platform to assess the impact of mass drug administration (MDA) on soil-transmitted helminths (STHs). This study used computer simulation and field data from pre- and post-MDA settings across Kenya to evaluate the performance and cost-effectiveness of the TAS design for STH assessment compared with alternative survey designs. Variations in the TAS design and different sample sizes and diagnostic methods were also evaluated. The district-level TAS design correctly classified more districts compared with standard STH designs in pre-MDA settings. Aggregating districts into larger evaluation units in a TAS design decreased performance, whereas age group sampled and sample size had minimal impact. The low diagnostic sensitivity of Kato-Katz and mini-FLOTAC methods was found to increase misclassification. We recommend using a district-level TAS among children 8–10 years of age to assess STH but suggest that key consideration is given to evaluation unit size. PMID:25487730

Computational Tools to Assess Turbine Biological Performance

DOE Office of Scientific and Technical Information (OSTI.GOV)

Richmond, Marshall C.; Serkowski, John A.; Rakowski, Cynthia L.

2014-07-24

Public Utility District No. 2 of Grant County (GCPUD) operates the Priest Rapids Dam (PRD), a hydroelectric facility on the Columbia River in Washington State. The dam contains 10 Kaplan-type turbine units that are now more than 50 years old. Plans are underway to refit these aging turbines with new runners. The Columbia River at PRD is a migratory pathway for several species of juvenile and adult salmonids, so passage of fish through the dam is a major consideration when upgrading the turbines. In this paper, a method for turbine biological performance assessment (BioPA) is demonstrated. Using this method, amore » suite of biological performance indicators is computed based on simulated data from a CFD model of a proposed turbine design. Each performance indicator is a measure of the probability of exposure to a certain dose of an injury mechanism. Using known relationships between the dose of an injury mechanism and frequency of injury (dose–response) from laboratory or field studies, the likelihood of fish injury for a turbine design can be computed from the performance indicator. By comparing the values of the indicators from proposed designs, the engineer can identify the more-promising alternatives. We present an application of the BioPA method for baseline risk assessment calculations for the existing Kaplan turbines at PRD that will be used as the minimum biological performance that a proposed new design must achieve.« less

Improving Academic Achievement through Continuous Assessment Methods: In the Case of Year Two Students of Animal and Range Sciences Department in Wolaita Sodo University, Ethiopia

ERIC Educational Resources Information Center

Sarka, Samuel; Lijalem, Tsegay; Shibiru, Tilaye

2017-01-01

The aim of this study was to assessing and implementing of continuous assessment to enhance academic performance of 2nd year Animal and Range Sciences department students in Wolaita sodo university; and to take action (train) to raise the academic performance to a desirable state. For the purpose of surveying the students' level of performance…

Accuracy assessment of high resolution satellite imagery orientation by leave-one-out method

NASA Astrophysics Data System (ADS)

Brovelli, Maria Antonia; Crespi, Mattia; Fratarcangeli, Francesca; Giannone, Francesca; Realini, Eugenio

Interest in high-resolution satellite imagery (HRSI) is spreading in several application fields, at both scientific and commercial levels. Fundamental and critical goals for the geometric use of this kind of imagery are their orientation and orthorectification, processes able to georeference the imagery and correct the geometric deformations they undergo during acquisition. In order to exploit the actual potentialities of orthorectified imagery in Geomatics applications, the definition of a methodology to assess the spatial accuracy achievable from oriented imagery is a crucial topic. In this paper we want to propose a new method for accuracy assessment based on the Leave-One-Out Cross-Validation (LOOCV), a model validation method already applied in different fields such as machine learning, bioinformatics and generally in any other field requiring an evaluation of the performance of a learning algorithm (e.g. in geostatistics), but never applied to HRSI orientation accuracy assessment. The proposed method exhibits interesting features which are able to overcome the most remarkable drawbacks involved by the commonly used method (Hold-Out Validation — HOV), based on the partitioning of the known ground points in two sets: the first is used in the orientation-orthorectification model (GCPs — Ground Control Points) and the second is used to validate the model itself (CPs — Check Points). In fact the HOV is generally not reliable and it is not applicable when a low number of ground points is available. To test the proposed method we implemented a new routine that performs the LOOCV in the software SISAR, developed by the Geodesy and Geomatics Team at the Sapienza University of Rome to perform the rigorous orientation of HRSI; this routine was tested on some EROS-A and QuickBird images. Moreover, these images were also oriented using the world recognized commercial software OrthoEngine v. 10 (included in the Geomatica suite by PCI), manually performing the LOOCV since only the HOV is implemented. The software comparison guaranteed about the overall correctness and good performances of the SISAR model, whereas the results showed the good features of the LOOCV method.

Dynamic frame resizing with convolutional neural network for efficient video compression

NASA Astrophysics Data System (ADS)

Kim, Jaehwan; Park, Youngo; Choi, Kwang Pyo; Lee, JongSeok; Jeon, Sunyoung; Park, JeongHoon

2017-09-01

In the past, video codecs such as vc-1 and H.263 used a technique to encode reduced-resolution video and restore original resolution from the decoder for improvement of coding efficiency. The techniques of vc-1 and H.263 Annex Q are called dynamic frame resizing and reduced-resolution update mode, respectively. However, these techniques have not been widely used due to limited performance improvements that operate well only under specific conditions. In this paper, video frame resizing (reduced/restore) technique based on machine learning is proposed for improvement of coding efficiency. The proposed method features video of low resolution made by convolutional neural network (CNN) in encoder and reconstruction of original resolution using CNN in decoder. The proposed method shows improved subjective performance over all the high resolution videos which are dominantly consumed recently. In order to assess subjective quality of the proposed method, Video Multi-method Assessment Fusion (VMAF) which showed high reliability among many subjective measurement tools was used as subjective metric. Moreover, to assess general performance, diverse bitrates are tested. Experimental results showed that BD-rate based on VMAF was improved by about 51% compare to conventional HEVC. Especially, VMAF values were significantly improved in low bitrate. Also, when the method is subjectively tested, it had better subjective visual quality in similar bit rate.

E-learning teaches attendings "how to" objectively assess pediatric urology trainees' surgery skills for orchiopexy.

PubMed

Fernandez, Nicolas; Maizels, Max; Farhat, Walid; Smith, Edwin; Liu, Dennis; Chua, Michael; Bhanji, Yasin

2018-04-01

Established methods to train pediatric urology surgery by residency training programs require updating in response to administrative changes such as new, reduced trainee duty hours. Therefore, new objective methods must be developed to teach trainees. We approached this need by creating e-learning to teach attendings objective assessment of trainee skills using the Zwisch scale, an established assessment tool. The aim of this study was to identify whether or not e-learning is an appropriate platform for effective teaching of this assessment tool, by assessing inter-rater correlation of assessments made by the attendings after participation in the e-learning. Pediatric orchiopexy was used as the index case. An e-learning tool was created to teach attending surgeons objective assessment of trainees' surgical skills. First, e-learning content was created which showed the assessment method videotape of resident surgery done in the operating room. Next, attendings were enrolled to e-learn this method. Finally, the ability of enrollees to assess resident surgery skill performance was tested. Namely, test video was made showing a trainee performing inguinal orchiopexy. All enrollees viewed the same online videos. Assessments of surgical skills (Zwisch scale) were entered into an online survey. Data were analyzed by intercorrelation coefficient kappa analysis (strong correlation was ICC ≥ 0.7). A total of 11 attendings were enrolled. All accessed the online learning and then made assessments of surgical skills trainees showed on videotapes. The e-learning comprised three modules: 1. "Core concepts," in which users learned the assessment tool methods; 2. "Learn to assess," in which users learned how to assess by watching video clips, explaining the assessment method; and 3. "Test," in which users tested their skill at making assessments by watching video clips and then actively inputting their ratings of surgical and global skills as viewed in the video clips (Figure). A total of 89 surgical skill ratings were performed with 56 (65%) exact matches between raters and 89 (100%) matched within one rank. Interclass correlation coefficient (ANOVA) showed statistically significant correlation. (r = 0.725, 95% CI 0.571-0.837, F = 3.976, p ≤ 0.00001). Kappa analysis of inter-rater reliability showed strong consensus between attendings for average measures with ICC = 0.71, 95% CI 0.46-0.95 (p = 0.03). We launched e-learning to teach pediatric urology attendings "how to" assess trainee surgical skills objectively (Zwisch scale). After e-learning, there was strong inter-rater correlation in assessments made. We plan to extend such e-learning to pediatric urology surgical training programs. Copyright © 2017 Journal of Pediatric Urology Company. Published by Elsevier Ltd. All rights reserved.

Facility Condition Assessment from A to Z

ERIC Educational Resources Information Center

Kaleba, Frank

2013-01-01

This article will provide an overview of the options for performing facility condition assessments. Quite often, the facility manager will choose a condition assessment method without deliberate examination of what type of assessment is best suited to the needs of the organization. In addition, the needs of diverse audiences usually differ--for…

A simplified method in comparison with comprehensive interaction incremental dynamic analysis to assess seismic performance of jacket-type offshore platforms

NASA Astrophysics Data System (ADS)

Zolfaghari, M. R.; Ajamy, A.; Asgarian, B.

2015-12-01

The primary goal of seismic reassessment procedures in oil platform codes is to determine the reliability of a platform under extreme earthquake loading. Therefore, in this paper, a simplified method is proposed to assess seismic performance of existing jacket-type offshore platforms (JTOP) in regions ranging from near-elastic to global collapse. The simplified method curve exploits well agreement between static pushover (SPO) curve and the entire summarized interaction incremental dynamic analysis (CI-IDA) curve of the platform. Although the CI-IDA method offers better understanding and better modelling of the phenomenon, it is a time-consuming and challenging task. To overcome the challenges, the simplified procedure, a fast and accurate approach, is introduced based on SPO analysis. Then, an existing JTOP in the Persian Gulf is presented to illustrate the procedure, and finally a comparison is made between the simplified method and CI-IDA results. The simplified method is very informative and practical for current engineering purposes. It is able to predict seismic performance elasticity to global dynamic instability with reasonable accuracy and little computational effort.

Computer-enhanced visual learning method: a paradigm to teach and document surgical skills.

PubMed

Maizels, Max; Mickelson, Jennie; Yerkes, Elizabeth; Maizels, Evelyn; Stork, Rachel; Young, Christine; Corcoran, Julia; Holl, Jane; Kaplan, William E

2009-09-01

Changes in health care are stimulating residency training programs to develop new methods for teaching surgical skills. We developed Computer-Enhanced Visual Learning (CEVL) as an innovative Internet-based learning and assessment tool. The CEVL method uses the educational procedures of deliberate practice and performance to teach and learn surgery in a stylized manner. CEVL is a learning and assessment tool that can provide students and educators with quantitative feedback on learning a specific surgical procedure. Methods involved examine quantitative data of improvement in surgical skills. Herein, we qualitatively describe the method and show how program directors (PDs) may implement this technique in their residencies. CEVL allows an operation to be broken down into teachable components. The process relies on feedback and remediation to improve performance, with a focus on learning that is applicable to the next case being performed. CEVL has been shown to be effective for teaching pediatric orchiopexy and is being adapted to additional adult and pediatric procedures and to office examination skills. The CEVL method is available to other residency training programs.

Computer-Enhanced Visual Learning Method: A Paradigm to Teach and Document Surgical Skills

PubMed Central

Maizels, Max; Mickelson, Jennie; Yerkes, Elizabeth; Maizels, Evelyn; Stork, Rachel; Young, Christine; Corcoran, Julia; Holl, Jane; Kaplan, William E.

2009-01-01

Innovation Changes in health care are stimulating residency training programs to develop new methods for teaching surgical skills. We developed Computer-Enhanced Visual Learning (CEVL) as an innovative Internet-based learning and assessment tool. The CEVL method uses the educational procedures of deliberate practice and performance to teach and learn surgery in a stylized manner. Aim of Innovation CEVL is a learning and assessment tool that can provide students and educators with quantitative feedback on learning a specific surgical procedure. Methods involved examine quantitative data of improvement in surgical skills. Herein, we qualitatively describe the method and show how program directors (PDs) may implement this technique in their residencies. Results CEVL allows an operation to be broken down into teachable components. The process relies on feedback and remediation to improve performance, with a focus on learning that is applicable to the next case being performed. CEVL has been shown to be effective for teaching pediatric orchiopexy and is being adapted to additional adult and pediatric procedures and to office examination skills. The CEVL method is available to other residency training programs. PMID:21975716

Effectiveness of Integrating Simulation with Art-Based Teaching Strategies on Oncology Fellows' Performance Regarding Breaking Bad News.

PubMed

Yakhforoshha, Afsaneh; Emami, Seyed Amir Hossein; Shahi, Farhad; Shahsavari, Saeed; Cheraghi, Mohammadali; Mojtahedzadeh, Rita; Mahmoodi-Bakhtiari, Behrooz; Shirazi, Mandana

2018-02-21

The task of breaking bad news (BBN) may be improved by incorporating simulation with art-based teaching methods. The aim of the present study was to assess the effect of an integrating simulation with art-based teaching strategies, on fellows' performance regarding BBN, in Iran. The study was carried out using quasi-experimental methods, interrupted time series. The participants were selected from medical oncology fellows at two teaching hospitals of Tehran University of Medical Sciences (TUMS), Iran. Participants were trained through workshop, followed by engaging participants with different types of art-based teaching methods. In order to assess the effectiveness of the integrating model, fellows' performance was rated by two independent raters (standardized patients (SPs) and faculty members) using the BBN assessment checklist. This assessment tool measured seven different domains of BBN skill. Segmented regression was used to analyze the results of study. Performance of all oncology fellows (n = 19) was assessed for 228 time points during the study, by rating three time points before and three time points after the intervention by two raters. Based on SP ratings, fellows' performance scores in post-training showed significant level changes in three domains of BBN checklist (B = 1.126, F = 3.221, G = 2.241; p < 0.05). Similarly, the significant level change in fellows' score rated by faculty members in post-training was B = 1.091, F = 3.273, G = 1.724; p < 0.05. There was no significant change in trend of fellows' performance after the intervention. Our results showed that using an integrating simulation with art-based teaching strategies may help oncology fellows to improve their communication skills in different facets of BBN performance. Iranian Registry of Clinical Trials ID: IRCT2016011626039N1.

Assessing Interval Estimation Methods for Hill Model ...

EPA Pesticide Factsheets

The Hill model of concentration-response is ubiquitous in toxicology, perhaps because its parameters directly relate to biologically significant metrics of toxicity such as efficacy and potency. Point estimates of these parameters obtained through least squares regression or maximum likelihood are commonly used in high-throughput risk assessment, but such estimates typically fail to include reliable information concerning confidence in (or precision of) the estimates. To address this issue, we examined methods for assessing uncertainty in Hill model parameter estimates derived from concentration-response data. In particular, using a sample of ToxCast concentration-response data sets, we applied four methods for obtaining interval estimates that are based on asymptotic theory, bootstrapping (two varieties), and Bayesian parameter estimation, and then compared the results. These interval estimation methods generally did not agree, so we devised a simulation study to assess their relative performance. We generated simulated data by constructing four statistical error models capable of producing concentration-response data sets comparable to those observed in ToxCast. We then applied the four interval estimation methods to the simulated data and compared the actual coverage of the interval estimates to the nominal coverage (e.g., 95%) in order to quantify performance of each of the methods in a variety of cases (i.e., different values of the true Hill model paramet

Practitioner Review: Do Performance-Based Measures and Ratings of Executive Function Assess the Same Construct?

ERIC Educational Resources Information Center

Toplak, Maggie E.; West, Richard F.; Stanovich, Keith E.

2013-01-01

Background: Both performance-based and rating measures are commonly used to index executive function in clinical and neuropsychological assessments. They are intended to index the same broad underlying mental construct of executive function. The association between these two types of measures was investigated in the current article. Method and…

Assessment of Postural Control in Children with Cerebral Palsy: A Review

ERIC Educational Resources Information Center

Pavao, Silvia Leticia; dos Santos, Adriana Neves; Woollacott, Marjorie Hines; Rocha, Nelci Adriana Cicuto Ferreira

2013-01-01

This paper aimed to review studies that assessed postural control (PC) in children with cerebral palsy (CP) and describe the methods used to investigate postural control in this population. It also intended to describe the performance of children with CP in postural control. An extensive database search was performed using the keywords: postural…

Computer-Based Assessment of Collaborative Problem Solving: Exploring the Feasibility of Human-to-Agent Approach

ERIC Educational Resources Information Center

Rosen, Yigal

2015-01-01

How can activities in which collaborative skills of an individual are measured be standardized? In order to understand how students perform on collaborative problem solving (CPS) computer-based assessment, it is necessary to examine empirically the multi-faceted performance that may be distributed across collaboration methods. The aim of this…

Diagnostic Tools for Performance Evaluation of Innovative In-Situ Remediation Technologies at Chlorinated Solvent-Contaminated Sites

DTIC Science & Technology

2011-07-01

to any penalty for failing to comply with a collection of information if it does not display a currently valid OMB control number. PLEASE DO NOT...these innovative methods with conventional diagnostic tools that are currently used for assessing bioremediation performance. 132 Rula Deeb (510) 596...conventional diagnostic tools that are currently used for assessing bioremediation performance. DEMONSTRATION RESULTS 3-D multi-level systems

10 CFR 963.16 - Postclosure suitability evaluation method.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 10 Energy 4 2014-01-01 2014-01-01 false Postclosure suitability evaluation method. 963.16 Section... Determination, Methods, and Criteria § 963.16 Postclosure suitability evaluation method. (a) DOE will evaluate postclosure suitability using the total system performance assessment method. DOE will conduct a total system...

10 CFR 963.16 - Postclosure suitability evaluation method.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 10 Energy 4 2011-01-01 2011-01-01 false Postclosure suitability evaluation method. 963.16 Section... Determination, Methods, and Criteria § 963.16 Postclosure suitability evaluation method. (a) DOE will evaluate postclosure suitability using the total system performance assessment method. DOE will conduct a total system...

10 CFR 963.16 - Postclosure suitability evaluation method.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 10 Energy 4 2012-01-01 2012-01-01 false Postclosure suitability evaluation method. 963.16 Section... Determination, Methods, and Criteria § 963.16 Postclosure suitability evaluation method. (a) DOE will evaluate postclosure suitability using the total system performance assessment method. DOE will conduct a total system...

On the method of Ermakov and Zolotukhin for multiple integration

NASA Technical Reports Server (NTRS)

Cranley, R.; Patterson, T. N. L.

1971-01-01

The method of Ermakov and Zolotukhin is discussed along with its later developments. By introducing the idea of pseudo-implementation a practical assessment of the method is made. The performance of the method is found to be unimpressive in comparison with a recent regression method.

Promotion Factors For Enlisted Infantry Marines

DTIC Science & Technology

2017-06-01

description , billet accomplishments, mission accomplishment, individual character, leadership, intellect and wisdom, fulfillment of evaluation , RS...staff sergeant. To assess which ranks proportionally promote more high-quality Marines, we compare two performance evaluation methods: proficiency and...adverse fitness reports. From the two performance evaluation methods we find that the Marine Corps promotes proportionally more high-quality Marines

FOLLOW-UP DURABILITY MEASUREMENTS AND MITIGATION PERFORMANCE IMPROVEMENT TESTS IN 38 EASTERN PENNSYL- VANIA HOUSES HAVING INDOOR REDUCTION SYSTEMS

EPA Science Inventory

The report gives results of follow-up tests in 38 difficult- to-mitigate Pennsylvania houses where indoor radon reduction systems had been installed 2 to 4 years earlier. bjectives were to assess system durability, methods for improving performance, and methods for reducing insta...

Quantitative Imaging Biomarkers: A Review of Statistical Methods for Technical Performance Assessment

PubMed Central

2017-01-01

Technological developments and greater rigor in the quantitative measurement of biological features in medical images have given rise to an increased interest in using quantitative imaging biomarkers (QIBs) to measure changes in these features. Critical to the performance of a QIB in preclinical or clinical settings are three primary metrology areas of interest: measurement linearity and bias, repeatability, and the ability to consistently reproduce equivalent results when conditions change, as would be expected in any clinical trial. Unfortunately, performance studies to date differ greatly in designs, analysis method and metrics used to assess a QIB for clinical use. It is therefore, difficult or not possible to integrate results from different studies or to use reported results to design studies. The Radiological Society of North America (RSNA) and the Quantitative Imaging Biomarker Alliance (QIBA) with technical, radiological and statistical experts developed a set of technical performance analysis methods, metrics and study designs that provide terminology, metrics and methods consistent with widely accepted metrological standards. This document provides a consistent framework for the conduct and evaluation of QIB performance studies so that results from multiple studies can be compared, contrasted or combined. PMID:24919831

Performance Degradation Assessment of Rolling Element Bearings using Improved Fuzzy Entropy

NASA Astrophysics Data System (ADS)

Zhu, Keheng; Jiang, Xiaohui; Chen, Liang; Li, Haolin

2017-10-01

Rolling element bearings are an important unit in the rotating machines, and their performance degradation assessment is the basis of condition-based maintenance. Targeting the non-linear dynamic characteristics of faulty signals of rolling element bearings, a bearing performance degradation assessment approach based on improved fuzzy entropy (FuzzyEn) is proposed in this paper. FuzzyEn has less dependence on data length and achieves more freedom of parameter selection and more robustness to noise. However, it neglects the global trend of the signal when calculating similarity degree of two vectors, and thus cannot reflect the running state of the rolling element bearings accurately. Based on this consideration, the algorithm of FuzzyEn is improved in this paper and the improved FuzzyEn is utilized as an indicator for bearing performance degradation evaluation. The vibration data from run-to-failure test of rolling element bearings are used to validate the proposed method. The experimental results demonstrate that, compared with the traditional kurtosis and root mean square, the proposed method can detect the incipient fault in advance and can reflect the whole performance degradation process more clearly.

The Learning of Compost Practice in University

NASA Astrophysics Data System (ADS)

Agustina, T. W.; Rustaman, N. Y.; Riandi; Purwianingsih, W.

2017-09-01

The compost as one of the topics of the Urban Farming Movement in Bandung city, Indonesia. The preliminary study aims to obtain a description of the performance capabilities and compost products made by students with STREAM (Science-Technology-Religion-Art-Mathematics) approach. The method was explanatory sequential mixed method. The study was conducted on one class of Biology Education students at the one of the universities in Bandung, Indonesia. The sample was chosen purposively with the number of students as many as 44 people. The instruments were making Student Worksheets, Observation Sheets of Performance and Product Assessment, Rubric of Performance and Product, and Field Notes. The indicators of performance assessment rubrics include Stirring of Compost Materials and Composting Technology in accordance with the design. The product assessment rubric are a Good Composting Criteria and Compost Packaging. The result of can be stated most students have good performance. However, the ability to design of compost technology, compost products and the ability to pack compost are still lacking. The implication of study is students of Biology Education require habituation in the ability of designing technology.

Reliability assessment of serviceability performance of braced retaining walls using a neural network approach

NASA Astrophysics Data System (ADS)

Goh, A. T. C.; Kulhawy, F. H.

2005-05-01

In urban environments, one major concern with deep excavations in soft clay is the potentially large ground deformations in and around the excavation. Excessive movements can damage adjacent buildings and utilities. There are many uncertainties associated with the calculation of the ultimate or serviceability performance of a braced excavation system. These include the variabilities of the loadings, geotechnical soil properties, and engineering and geometrical properties of the wall. A risk-based approach to serviceability performance failure is necessary to incorporate systematically the uncertainties associated with the various design parameters. This paper demonstrates the use of an integrated neural network-reliability method to assess the risk of serviceability failure through the calculation of the reliability index. By first performing a series of parametric studies using the finite element method and then approximating the non-linear limit state surface (the boundary separating the safe and failure domains) through a neural network model, the reliability index can be determined with the aid of a spreadsheet. Two illustrative examples are presented to show how the serviceability performance for braced excavation problems can be assessed using the reliability index.

NC roadway lighting needs assessment, maintenance prioritization tool and performance measures.

DOT National Transportation Integrated Search

2013-05-01

The objectives of this project are to 1) develop an assessment report and summary of accumulated modernization / replacement needs, 2) assess current lighting needs and develop a method to allocate funds at NCDOT Division level, 3) research and docum...

10 CFR 851.21 - Hazard identification and assessment.

Code of Federal Regulations, 2013 CFR

2013-01-01

.... Procedures must include methods to: (1) Assess worker exposure to chemical, physical, biological, or safety workplace hazards through appropriate workplace monitoring; (2) Document assessment for chemical, physical... hazards; (6) Perform routine job activity-level hazard analyses; (7) Review site safety and health...

10 CFR 851.21 - Hazard identification and assessment.

Code of Federal Regulations, 2014 CFR

2014-01-01

.... Procedures must include methods to: (1) Assess worker exposure to chemical, physical, biological, or safety workplace hazards through appropriate workplace monitoring; (2) Document assessment for chemical, physical... hazards; (6) Perform routine job activity-level hazard analyses; (7) Review site safety and health...

Digital image color analysis compared to direct dental CIE colorimeter assessment under different ambient conditions.

PubMed

Knösel, Michael; Attin, Rengin; Jung, Klaus; Brunner, Edgar; Kubein-Meesenburg, Dietmar; Attin, Thomas

2009-04-01

To evaluate the concordance and repeatability of two in vivo methods for dental color assessment and to clarify the influence of different ambient light conditions and subject's head position on the assessed color variables. Color assessments were performed by two examiners on 16 arbitrarily selected subjects under two different, standardized conditions of illumination and at two different standardized head angulations. CIE (L*a*b*) data for upper and lower central incisors were recorded in two different ways: (1) by an intra-oral contact dental colorimeter and (2) by processing digital images for performing color calculation using Adobe Photoshop software. The influence of the different ambient conditions on both methods, as well as the concordance of measurements was analyzed statistically using several mixed linear models. Ambient light as a single factor had no significant influence on maxillary L*, a* and b* values, but it did have an effect on mandible assessments. Head angulation variation resulted in significant L* value differences using the photo method. The operator had a significant influence on values a* and b* for the photo method and on a* values for the colorimeter method. In fully lit ambient condition, the operator had a significant influence on the segregated L*, a*, and b* values. With dimmed lights, head angulation became significant, but not the operator. Evaluation of segregated L* values was error prone in both methods. Comparing both methods, deltaE values did not exceed 2.85 units, indicating that color differences between methods and recorded under varying ambient conditions were well below the sensitivity of the naked eye.

Objective comparison of particle tracking methods.

PubMed

Chenouard, Nicolas; Smal, Ihor; de Chaumont, Fabrice; Maška, Martin; Sbalzarini, Ivo F; Gong, Yuanhao; Cardinale, Janick; Carthel, Craig; Coraluppi, Stefano; Winter, Mark; Cohen, Andrew R; Godinez, William J; Rohr, Karl; Kalaidzidis, Yannis; Liang, Liang; Duncan, James; Shen, Hongying; Xu, Yingke; Magnusson, Klas E G; Jaldén, Joakim; Blau, Helen M; Paul-Gilloteaux, Perrine; Roudot, Philippe; Kervrann, Charles; Waharte, François; Tinevez, Jean-Yves; Shorte, Spencer L; Willemse, Joost; Celler, Katherine; van Wezel, Gilles P; Dan, Han-Wei; Tsai, Yuh-Show; Ortiz de Solórzano, Carlos; Olivo-Marin, Jean-Christophe; Meijering, Erik

2014-03-01

Particle tracking is of key importance for quantitative analysis of intracellular dynamic processes from time-lapse microscopy image data. Because manually detecting and following large numbers of individual particles is not feasible, automated computational methods have been developed for these tasks by many groups. Aiming to perform an objective comparison of methods, we gathered the community and organized an open competition in which participating teams applied their own methods independently to a commonly defined data set including diverse scenarios. Performance was assessed using commonly defined measures. Although no single method performed best across all scenarios, the results revealed clear differences between the various approaches, leading to notable practical conclusions for users and developers.

Limitations of student-driven formative assessment in a clinical clerkship. A randomised controlled trial

PubMed Central

Palmer, Edward J; Devitt, Peter G

2008-01-01

Background Teachers strive to motivate their students to be self-directed learners. One of the methods used is to provide online formative assessment material. The concept of formative assessment and use of these processes is heavily promoted, despite limited evidence as to their efficacy. Methods Fourth year medical students, in their first year of clinical work were divided into four groups. In addition to the usual clinical material, three of the groups were provided with some form of supplementary learning material. For two groups, this was provided as online formative assessment. The amount of time students spent on the supplementary material was measured, their opinion on learning methods was surveyed, and their performance in summative exams at the end of their surgical attachments was measured. Results The performance of students was independent of any educational intervention imposed by this study. Despite its ready availability and promotion, student use of the online formative tools was poor. Conclusion Formative learning is an ideal not necessarily embraced by students. If formative assessment is to work students need to be encouraged to participate, probably by implementing some form of summative assessment. PMID:18471324

Assessment of Recovery of Milk Protein Allergens from Processed Food for Mass Spectrometry Quantification.

PubMed

Groves, Kate; Cryar, Adam; Walker, Michael; Quaglia, Milena

2018-01-01

Assessing the recovery of food allergens from solid processed matrixes is one of the most difficult steps that needs to be overcome to enable the accurate quantification of protein allergens by immunoassay and MS. A feasibility study is described herein applying International System of Units (SI)-traceably quantified milk protein solutions to assess recovery by an improved extraction method. Untargeted MS analysis suggests that this novel extraction method can be further developed to provide high recoveries for a broad range of food allergens. A solution of α-casein was traceably quantified to the SI for the content of α-S1 casein. Cookie dough was prepared by spiking a known amount of the SI-traceable quantified solution into a mixture of flour, sugar, and soya spread, followed by baking. A novel method for the extraction of protein food allergens from solid matrixes based on proteolytic digestion was developed, and its performance was compared with the performance of methods reported in the literature.

Follow-up of solar lentigo depigmentation with a retinaldehyde-based cream by clinical evaluation and calibrated colour imaging.

PubMed

Questel, E; Durbise, E; Bardy, A-L; Schmitt, A-M; Josse, G

2015-05-01

To assess an objective method evaluating the effects of a retinaldehyde-based cream (RA-cream) on solar lentigines; 29 women randomly applied RA-cream on lentigines of one hand and a control cream on the other, once daily for 3 months. A specific method enabling a reliable visualisation of the lesions was proposed, using high-magnification colour-calibrated camera imaging. Assessment was performed using clinical evaluation by Physician Global Assessment score and image analysis. Luminance determination on the numeric images was performed either on the basis of 5 independent expert's consensus borders or probability map analysis via an algorithm automatically detecting the pigmented area. Both image analysis methods showed a similar lightening of ΔL* = 2 after a 3-month treatment by RA-cream, in agreement with single-blind clinical evaluation. High-magnification colour-calibrated camera imaging combined with probability map analysis is a fast and precise method to follow lentigo depigmentation. © 2014 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

A 3D front tracking method on a CPU/GPU system

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bo, Wurigen; Grove, John

2011-01-21

We describe the method to port a sequential 3D interface tracking code to a GPU with CUDA. The interface is represented as a triangular mesh. Interface geometry properties and point propagation are performed on a GPU. Interface mesh adaptation is performed on a CPU. The convergence of the method is assessed from the test problems with given velocity fields. Performance results show overall speedups from 11 to 14 for the test problems under mesh refinement. We also briefly describe our ongoing work to couple the interface tracking method with a hydro solver.

Technology Alignment and Portfolio Prioritization (TAPP)

NASA Technical Reports Server (NTRS)

Funaro, Gregory V.; Alexander, Reginald A.

2015-01-01

Technology Alignment and Portfolio Prioritization (TAPP) is a method being developed by the Advanced Concepts Office, at NASA Marshall Space Flight Center. The TAPP method expands on current technology assessment methods by incorporating the technological structure underlying technology development, e.g., organizational structures and resources, institutional policy and strategy, and the factors that motivate technological change. This paper discusses the methods ACO is currently developing to better perform technology assessments while taking into consideration Strategic Alignment, Technology Forecasting, and Long Term Planning.

Introducing a design exigency to promote student learning through assessment: A case study.

PubMed

Grealish, Laurie A; Shaw, Julie M

2018-02-01

Assessment technologies are often used to classify student and newly qualified nurse performance as 'pass' or 'fail', with little attention to how these decisions are achieved. Examining the design exigencies of classification technologies, such as performance assessment technologies, provides opportunities to explore flexibility and change in the process of using those technologies. Evaluate an established assessment technology for nursing performance as a classification system. A case study analysis that is focused on the assessment approach and a priori design exigencies of performance assessment technology, in this case the Australian Nursing Standards Assessment Tool 2016. Nurse assessors are required to draw upon their expertise to judge performance, but that judgement is described as a source of bias, creating confusion. The definition of satisfactory performance is 'ready to enter practice'. To pass, the performance on each criterion must be at least satisfactory, indicating to the student that no further improvement is required. The Australian Nursing Standards Assessment Tool 2016 does not have a third 'other' category, which is usually found in classification systems. Introducing a 'not yet competent' category and creating a two-part, mixed methods assessment process can improve the Australian Nursing Standards Assessment Tool 2016 assessment technology. Using a standards approach in the first part, judgement is valued and can generate learning opportunities across a program. Using a measurement approach in the second part, student performance can be 'not yet competent' but still meet criteria for year level performance and a graded pass. Subjecting the Australian Nursing Standards Assessment Tool 2016 assessment technology to analysis as a classification system provides opportunities for innovation in design. This design innovation has the potential to support students who move between programs and clinicians who assess students from different universities. Copyright © 2017 Elsevier Ltd. All rights reserved.

Development of the Canadian Physiotherapy Assessment of Clinical Performance: A New Tool to Assess Physiotherapy Students' Performance in Clinical Education.

PubMed

Mori, Brenda; Brooks, Dina; Norman, Kathleen E; Herold, Jodi; Beaton, Dorcas E

2015-08-01

To develop the first draft of a Canadian tool to assess physiotherapy (PT) students' performance in clinical education (CE). Phase 1: to gain consensus on the items within the new tool, the number and placement of the comment boxes, and the rating scale; Phase 2: to explore the face and content validity of the draft tool. Phase 1 used the Delphi method; Phase 2 used cognitive interviewing methods with recent graduates and clinical instructors (CIs) and detailed interviews with clinical education and measurement experts. Consensus was reached on the first draft of the new tool by round 3 of the Delphi process, which was completed by 21 participants. Interviews were completed with 13 CIs, 6 recent graduates, and 7 experts. Recent graduates and CIs were able to interpret the tool accurately, felt they could apply it to a recent CE experience, and provided suggestions to improve the draft. Experts provided salient advice. The first draft of a new tool to assess PT students in CE, the Canadian Physiotherapy Assessment of Clinical Performance (ACP), was developed and will undergo further development and testing, including national consultation with stakeholders. Data from Phase 2 will contribute to developing an online education module for CIs and students.

Evaluating Tidal Energy Resource Assessment Guidelines

NASA Astrophysics Data System (ADS)

Haas, K. A.

2016-02-01

All tidal energy projects require resource assessments for determining the feasibility of a particular site, performing the project layout design and providing the projected annual energy production (AEP). The methods for the different resource assessments depend on both the assessment scope as well as the project scale. To assist with the development of the hydrokinetic industry as a whole, much work over the past decade has been completed to develop international technical standards that can be used by the full range of stakeholders in the hydrokinetic industry. In particular, a new International Electrotechnical Commission (IEC) Technical Specification (TS) has recently been published outlining a standardized methodology for performing tidal energy resource assessments. This presentation will cover the various methods for performing the different types of tidal resource assessments (national reconnaissance, regional feasibility and layout design). Illustrations through case studies will be presented for each type of resource assessment. In particular, the ability of a grid refinement technique which satisfies the TS grid resolution requirements for the assessment of tidal current energy while maintaining low computational expenses will be evaluated. Example applications will be described for mapping the tidal resources near two facilities (Portsmouth Naval Shipyard in Maine and Key West Naval Station in Florida) for possible future deployments of Marine Hydro-Kinetic (MHK) technologies. These assessments will include and demonstrate the importance of the effect of energy extraction as required by the TS.

Blind Demodulation of Pass Band OFDMA Signals and Jamming Battle Damage Assessment Utilizing Link Adaptation

DTIC Science & Technology

2014-03-27

Access (OFDMA) signal so that jamming effectiveness can be assessed; referred to in this research as Battle Damage Assessment ( BDA ). The research extends...the 802.16 Wireless Metropolitan Area Network (MAN) OFDMA standard, and presents a novel method for performing BDA via observation of Sub Carrier (SC...interferer is also evaluated where the blind demodulator’s performance is degraded. BDA is achieved via observing SC LA modulation behavior of the

Dehydration: physiology, assessment, and performance effects.

PubMed

Cheuvront, Samuel N; Kenefick, Robert W

2014-01-01

This article provides a comprehensive review of dehydration assessment and presents a unique evaluation of the dehydration and performance literature. The importance of osmolality and volume are emphasized when discussing the physiology, assessment, and performance effects of dehydration. The underappreciated physiologic distinction between a loss of hypo-osmotic body water (intracellular dehydration) and an iso-osmotic loss of body water (extracellular dehydration) is presented and argued as the single most essential aspect of dehydration assessment. The importance of diagnostic and biological variation analyses to dehydration assessment methods is reviewed and their use in gauging the true potential of any dehydration assessment method highlighted. The necessity for establishing proper baselines is discussed, as is the magnitude of dehydration required to elicit reliable and detectable osmotic or volume-mediated compensatory physiologic responses. The discussion of physiologic responses further helps inform and explain our analysis of the literature suggesting a ≥ 2% dehydration threshold for impaired endurance exercise performance mediated by volume loss. In contrast, no clear threshold or plausible mechanism(s) support the marginal, but potentially important, impairment in strength, and power observed with dehydration. Similarly, the potential for dehydration to impair cognition appears small and related primarily to distraction or discomfort. The impact of dehydration on any particular sport skill or task is therefore likely dependent upon the makeup of the task itself (e.g., endurance, strength, cognitive, and motor skill). © 2014 American Physiological Society.

Noise Estimation and Quality Assessment of Gaussian Noise Corrupted Images

NASA Astrophysics Data System (ADS)

Kamble, V. M.; Bhurchandi, K.

2018-03-01

Evaluating the exact quantity of noise present in an image and quality of an image in the absence of reference image is a challenging task. We propose a near perfect noise estimation method and a no reference image quality assessment method for images corrupted by Gaussian noise. The proposed methods obtain initial estimate of noise standard deviation present in an image using the median of wavelet transform coefficients and then obtains a near to exact estimate using curve fitting. The proposed noise estimation method provides the estimate of noise within average error of +/-4%. For quality assessment, this noise estimate is mapped to fit the Differential Mean Opinion Score (DMOS) using a nonlinear function. The proposed methods require minimum training and yields the noise estimate and image quality score. Images from Laboratory for image and Video Processing (LIVE) database and Computational Perception and Image Quality (CSIQ) database are used for validation of the proposed quality assessment method. Experimental results show that the performance of proposed quality assessment method is at par with the existing no reference image quality assessment metric for Gaussian noise corrupted images.

A statistical assessment of differences and equivalences between genetically modified and reference plant varieties

PubMed Central

2011-01-01

Background Safety assessment of genetically modified organisms is currently often performed by comparative evaluation. However, natural variation of plant characteristics between commercial varieties is usually not considered explicitly in the statistical computations underlying the assessment. Results Statistical methods are described for the assessment of the difference between a genetically modified (GM) plant variety and a conventional non-GM counterpart, and for the assessment of the equivalence between the GM variety and a group of reference plant varieties which have a history of safe use. It is proposed to present the results of both difference and equivalence testing for all relevant plant characteristics simultaneously in one or a few graphs, as an aid for further interpretation in safety assessment. A procedure is suggested to derive equivalence limits from the observed results for the reference plant varieties using a specific implementation of the linear mixed model. Three different equivalence tests are defined to classify any result in one of four equivalence classes. The performance of the proposed methods is investigated by a simulation study, and the methods are illustrated on compositional data from a field study on maize grain. Conclusions A clear distinction of practical relevance is shown between difference and equivalence testing. The proposed tests are shown to have appropriate performance characteristics by simulation, and the proposed simultaneous graphical representation of results was found to be helpful for the interpretation of results from a practical field trial data set. PMID:21324199

A performance analysis method for distributed real-time robotic systems: A case study of remote teleoperation

NASA Technical Reports Server (NTRS)

Lefebvre, D. R.; Sanderson, A. C.

1994-01-01

Robot coordination and control systems for remote teleoperation applications are by necessity implemented on distributed computers. Modeling and performance analysis of these distributed robotic systems is difficult, but important for economic system design. Performance analysis methods originally developed for conventional distributed computer systems are often unsatisfactory for evaluating real-time systems. The paper introduces a formal model of distributed robotic control systems; and a performance analysis method, based on scheduling theory, which can handle concurrent hard-real-time response specifications. Use of the method is illustrated by a case of remote teleoperation which assesses the effect of communication delays and the allocation of robot control functions on control system hardware requirements.

Residual Risk Assessment for the Ferroalloys Source Category in Support of the September Supplemental Proposal

EPA Pesticide Factsheets

This document contains the methods and the results of baseline risk assessments (i.e., after the implementation of the MACT standard) and the results of the post-control scenario risk assessment performed for the ferroalloys source category.

An integrated environmental modeling framework for performing Quantitative Microbial Risk Assessments

EPA Science Inventory

Standardized methods are often used to assess the likelihood of a human-health effect from exposure to a specified hazard, and inform opinions and decisions about risk management and communication. A Quantitative Microbial Risk Assessment (QMRA) is specifically adapted to detail ...

Exploring approaches to dietetic assessment of a common task across different universities through assessment moderation.

PubMed

Palermo, C; Volders, E; Gibson, S; Kennedy, M; Wray, A; Thomas, J; Hannan-Jones, M; Gallegos, D; Beck, E

2018-02-01

Assessment presents one of the greatest challenges to evaluating health professional trainee performance, as a result of the subjectivity of judgements and variability in assessor standards. The present study aimed to test a moderation procedure for assessment across four independent universities and explore approaches to assessment and the factors that influence assessment decisions. Assessment tasks designed independently by each of the four universities to assess student readiness for placement were chosen for the present study. Each university provided four student performance recordings for moderation. Eight different academic assessors viewed the student performances and assessed them using the corresponding university assessment instrument. Assessment results were collated and presented back to the assessors, together with the original university assessment results. Results were discussed with assessors to explore variations. The discussion was recorded, transcribed, thematically analysed and presented back to all assessors to achieve consensus on the emerging major learnings. Although there were differences in absolute scores, there was consistency (12 out of 16 performances) in overall judgement decisions regarding placement readiness. Proficient communication skills were considered a key factor when determining placement readiness. The discussion revealed: (i) assessment instruments; (ii) assessor factors; and (iii) the subjectivity of judgement as the major factors influencing assessment. Assessment moderation is a useful method for improving the quality of assessment decisions by sharing understanding and aligning standards of performance. © 2017 The British Dietetic Association Ltd.

High-Accuracy Decoupling Estimation of the Systematic Coordinate Errors of an INS and Intensified High Dynamic Star Tracker Based on the Constrained Least Squares Method

PubMed Central

Jiang, Jie; Yu, Wenbo; Zhang, Guangjun

2017-01-01

Navigation accuracy is one of the key performance indicators of an inertial navigation system (INS). Requirements for an accuracy assessment of an INS in a real work environment are exceedingly urgent because of enormous differences between real work and laboratory test environments. An attitude accuracy assessment of an INS based on the intensified high dynamic star tracker (IHDST) is particularly suitable for a real complex dynamic environment. However, the coupled systematic coordinate errors of an INS and the IHDST severely decrease the attitude assessment accuracy of an INS. Given that, a high-accuracy decoupling estimation method of the above systematic coordinate errors based on the constrained least squares (CLS) method is proposed in this paper. The reference frame of the IHDST is firstly converted to be consistent with that of the INS because their reference frames are completely different. Thereafter, the decoupling estimation model of the systematic coordinate errors is established and the CLS-based optimization method is utilized to estimate errors accurately. After compensating for error, the attitude accuracy of an INS can be assessed based on IHDST accurately. Both simulated experiments and real flight experiments of aircraft are conducted, and the experimental results demonstrate that the proposed method is effective and shows excellent performance for the attitude accuracy assessment of an INS in a real work environment. PMID:28991179

The Use of Video Technology in Science Teaching: A Vehicle for Alternative Assessment.

ERIC Educational Resources Information Center

Lawrence, Michael

1994-01-01

A secondary physics teacher used video assessments in science as an economical assessment form that required students to use the scientific method, explanation, feedback, critical thinking, and metacognition. When using video assessment in optics, he found his scoring was not biased and that students improved their performance following video…

Computer game-based and traditional learning method: a comparison regarding students’ knowledge retention

PubMed Central

2013-01-01

Background Educational computer games are examples of computer-assisted learning objects, representing an educational strategy of growing interest. Given the changes in the digital world over the last decades, students of the current generation expect technology to be used in advancing their learning requiring a need to change traditional passive learning methodologies to an active multisensory experimental learning methodology. The objective of this study was to compare a computer game-based learning method with a traditional learning method, regarding learning gains and knowledge retention, as means of teaching head and neck Anatomy and Physiology to Speech-Language and Hearing pathology undergraduate students. Methods Students were randomized to participate to one of the learning methods and the data analyst was blinded to which method of learning the students had received. Students’ prior knowledge (i.e. before undergoing the learning method), short-term knowledge retention and long-term knowledge retention (i.e. six months after undergoing the learning method) were assessed with a multiple choice questionnaire. Students’ performance was compared considering the three moments of assessment for both for the mean total score and for separated mean scores for Anatomy questions and for Physiology questions. Results Students that received the game-based method performed better in the pos-test assessment only when considering the Anatomy questions section. Students that received the traditional lecture performed better in both post-test and long-term post-test when considering the Anatomy and Physiology questions. Conclusions The game-based learning method is comparable to the traditional learning method in general and in short-term gains, while the traditional lecture still seems to be more effective to improve students’ short and long-term knowledge retention. PMID:23442203

Assessment techniques for a learning-centered curriculum: evaluation design for adventures in supercomputing

DOE Office of Scientific and Technical Information (OSTI.GOV)

Helland, B.; Summers, B.G.

1996-09-01

As the classroom paradigm shifts from being teacher-centered to being learner-centered, student assessments are evolving from typical paper and pencil testing to other methods of evaluation. Students should be probed for understanding, reasoning, and critical thinking abilities rather than their ability to return memorized facts. The assessment of the Department of Energy`s pilot program, Adventures in Supercomputing (AiS), offers one example of assessment techniques developed for learner-centered curricula. This assessment has employed a variety of methods to collect student data. Methods of assessment used were traditional testing, performance testing, interviews, short questionnaires via email, and student presentations of projects. Themore » data obtained from these sources have been analyzed by a professional assessment team at the Center for Children and Technology. The results have been used to improve the AiS curriculum and establish the quality of the overall AiS program. This paper will discuss the various methods of assessment used and the results.« less

The Impact of Preceptor and Student Learning Styles on Experiential Performance Measures

PubMed Central

Cox, Craig D.; Seifert, Charles F.

2012-01-01

Objectives. To identify preceptors’ and students’ learning styles to determine how these impact students’ performance on pharmacy practice experience assessments. Methods. Students and preceptors were asked to complete a validated Pharmacist’s Inventory of Learning Styles (PILS) questionnaire to identify dominant and secondary learning styles. The significance of “matched” and “unmatched” learning styles between students and preceptors was evaluated based on performance on both subjective and objective practice experience assessments. Results. Sixty-one percent of 67 preceptors and 57% of 72 students who participated reported “assimilator” as their dominant learning style. No differences were found between student and preceptor performance on evaluations, regardless of learning style match. Conclusion. Determination of learning styles may encourage preceptors to use teaching methods to challenge students during pharmacy practice experiences; however, this does not appear to impact student or preceptor performance. PMID:23049100

GFO and JASON Altimeter Engineering Assessment Report. Update: GFO--Acceptance to December 27, 2007, JASON--Acceptance to December 26, 2007. Version 1: June 2008

NASA Technical Reports Server (NTRS)

Conger, A. M.; Hancock, D. W.; Hayne, G. S.; Brooks, R. L.

2008-01-01

The purpose of this document is to present and document GEOSAT Follow-On (GFO) performance analyses and results. This is the eighth Assessment Report since the initial report. This report extends the performance assessment since acceptance to 27 December 2007. Since launch, a variety of GFO performance studies have been performed: Appendix A provides an accumulative index of those studies. We began the inclusion of analyses of the JASON altimeter after the end of the Topographic Experiment (TOPEX) mission. Prior to this, JASON and TOPEX were compared during our assessment of theTOPEX altimeter. With the end of the TOPEX mission, we developed methods to report on JASON as it relates to GFO.

Utility of Combining a Simulation-Based Method With a Lecture-Based Method for Fundoscopy Training in Neurology Residency.

PubMed

Gupta, Deepak K; Khandker, Namir; Stacy, Kristin; Tatsuoka, Curtis M; Preston, David C

2017-10-01

Fundoscopic examination is an essential component of the neurologic examination. Competence in its performance is mandated as a required clinical skill for neurology residents by the American Council of Graduate Medical Education. Government and private insurance agencies require its performance and documentation for moderate- and high-level neurologic evaluations. Traditionally, assessment and teaching of this key clinical examination technique have been difficult in neurology residency training. To evaluate the utility of a simulation-based method and the traditional lecture-based method for assessment and teaching of fundoscopy to neurology residents. This study was a prospective, single-blinded, education research study of 48 neurology residents recruited from July 1, 2015, through June 30, 2016, at a large neurology residency training program. Participants were equally divided into control and intervention groups after stratification by training year. Baseline and postintervention assessments were performed using questionnaire, survey, and fundoscopy simulators. After baseline assessment, both groups initially received lecture-based training, which covered fundamental knowledge on the components of fundoscopy and key neurologic findings observed on fundoscopic examination. The intervention group additionally received simulation-based training, which consisted of an instructor-led, hands-on workshop that covered practical skills of performing fundoscopic examination and identifying neurologically relevant findings on another fundoscopy simulator. The primary outcome measures were the postintervention changes in fundoscopy knowledge, skills, and total scores. A total of 30 men and 18 women were equally distributed between the 2 groups. The intervention group had significantly higher mean (SD) increases in skills (2.5 [2.3] vs 0.8 [1.8], P = .01) and total (9.3 [4.3] vs 5.3 [5.8], P = .02) scores compared with the control group. Knowledge scores (6.8 [3.3] vs 4.5 [4.9], P = .11) increased nonsignificantly in both groups. This study supports the use of a simulation-based method as a supplementary tool to the lecture-based method in the assessment and teaching of fundoscopic examination in neurology residency.

An Experimental Comparison of Similarity Assessment Measures for 3D Models on Constrained Surface Deformation

NASA Astrophysics Data System (ADS)

Quan, Lulin; Yang, Zhixin

2010-05-01

To address the issues in the area of design customization, this paper expressed the specification and application of the constrained surface deformation, and reported the experimental performance comparison of three prevail effective similarity assessment algorithms on constrained surface deformation domain. Constrained surface deformation becomes a promising method that supports for various downstream applications of customized design. Similarity assessment is regarded as the key technology for inspecting the success of new design via measuring the difference level between the deformed new design and the initial sample model, and indicating whether the difference level is within the limitation. According to our theoretical analysis and pre-experiments, three similarity assessment algorithms are suitable for this domain, including shape histogram based method, skeleton based method, and U system moment based method. We analyze their basic functions and implementation methodologies in detail, and do a series of experiments on various situations to test their accuracy and efficiency using precision-recall diagram. Shoe model is chosen as an industrial example for the experiments. It shows that shape histogram based method gained an optimal performance in comparison. Based on the result, we proposed a novel approach that integrating surface constrains and shape histogram description with adaptive weighting method, which emphasize the role of constrains during the assessment. The limited initial experimental result demonstrated that our algorithm outperforms other three algorithms. A clear direction for future development is also drawn at the end of the paper.

A Comparison of Online and Face-to-Face Collaboration on the Performance of Middle School Math Students' Standardized Assessment

ERIC Educational Resources Information Center

Eliason, Norma Lynn

2014-01-01

The effects of incorporating an online social networking platform, hosted through Wikispace, as a method to potential improve the performance of middle school students on standardized math assessments was investigated in this study. A principal strategy for any educational setting may provide an instructional approach that improves the delivery of…

Improving the Quality of School Facilities through Building Performance Assessment: Educational Reform and School Building Quality in Sao Paulo, Brazil

ERIC Educational Resources Information Center

Ornstein, Sheila Walbe; Moreira, Nanci Saraiva; Ono, Rosaria; Limongi Franca, Ana J. G.; Nogueira, Roselene A. M. F.

2009-01-01

Purpose: The paper describes the purpose of and strategies for conducting post-occupancy evaluations (POEs) as a method for assessing school building performance. Set within the larger context of global efforts to develop and apply common indicators of school building quality, the authors describe research conducted within the newest generation of…

Validity, Reliability, and Equity Issues in an Observational Talent Assessment Process in the Performing Arts

ERIC Educational Resources Information Center

Oreck, Barry A.; Owen, Steven V.; Baum, Susan M.

2003-01-01

The lack of valid, research-based methods to identify potential artistic talent hampers the inclusion of the arts in programs for the gifted and talented. The Talent Assessment Process in Dance, Music, and Theater (D/M/T TAP) was designed to identify potential performing arts talent in diverse populations, including bilingual and special education…

Effect of Assessment Task and Letter Writing Ability on Preschool Children's Spelling Performance

ERIC Educational Resources Information Center

Puranik, Cynthia; Apel, Kenn

2010-01-01

The purpose of this study was to examine whether spelling performance in preschool children varied as a function of the method of assessment and letter writing ability. The authors manipulated the motoric element and memory demands of the task by having children spell single words using letter tiles, orally, and by writing. The authors also…

Cognitive assessment in mathematics with the least squares distance method.

PubMed

Ma, Lin; Çetin, Emre; Green, Kathy E

2012-01-01

This study investigated the validation of comprehensive cognitive attributes of an eighth-grade mathematics test using the least squares distance method and compared performance on attributes by gender and region. A sample of 5,000 students was randomly selected from the data of the 2005 Turkish national mathematics assessment of eighth-grade students. Twenty-five math items were assessed for presence or absence of 20 cognitive attributes (content, cognitive processes, and skill). Four attributes were found to be misspecified or nonpredictive. However, results demonstrated the validity of cognitive attributes in terms of the revised set of 17 attributes. The girls had similar performance on the attributes as the boys. The students from the two eastern regions significantly underperformed on the most attributes.

Strapdown Airborne Gravimetry Quality Assessment Method Based on Single Survey Line Data: A Study by SGA-WZ02 Gravimeter

PubMed Central

Wu, Meiping; Cao, Juliang; Zhang, Kaidong; Cai, Shaokun; Yu, Ruihang

2018-01-01

Quality assessment is an important part in the strapdown airborne gravimetry. Root mean square error (RMSE) evaluation method is a classical way to evaluate the gravimetry quality, but classical evaluation methods are preconditioned by extra flight or reference data. Thus, a method, which is able to largely conquer the premises of classical quality assessment methods and can be used in single survey line, has been developed in this paper. According to theoretical analysis, the method chooses the stability of two horizontal attitude angles, horizontal specific force and vertical specific force as the determinants of quality assessment method. The actual data, collected by SGA-WZ02 from 13 flights 21 lines in certain survey, was used to build the model and elaborate the method. To substantiate the performance of the quality assessment model, the model is applied in extra repeat line flights from two surveys. Compared with internal RMSE, standard deviation of assessment residuals are 0.23 mGal and 0.16 mGal in two surveys, which shows that the quality assessment method is reliable and stricter. The extra flights are not necessary by specially arranging the route of flights. The method, summarized from SGA-WZ02, is a feasible approach to assess gravimetry quality using single line data and is also suitable for other strapdown gravimeters. PMID:29373535

Roles and methods of performance evaluation of hospital academic leadership.

PubMed

Zhou, Ying; Yuan, Huikang; Li, Yang; Zhao, Xia; Yi, Lihua

2016-01-01

The rapidly advancing implementation of public hospital reform urgently requires the identification and classification of a pool of exceptional medical specialists, corresponding with incentives to attract and retain them, providing a nucleus of distinguished expertise to ensure public hospital preeminence. This paper examines the significance of academic leadership, from a strategic management perspective, including various tools, methods and mechanisms used in the theory and practice of performance evaluation, and employed in the selection, training and appointment of academic leaders. Objective methods of assessing leadership performance are also provided for reference.

Relationship Between Body Fat and Physical Fitness in Army ROTC Cadets.

PubMed

Steed, Carly L; Krull, Benjamin R; Morgan, Amy L; Tucker, Robin M; Ludy, Mary-Jon

2016-09-01

The Army Physical Fitness Test (APFT), including timed push-ups, sit-ups, and run, assesses physical performance for the Army. Percent body fat is estimated using height and circumference measurements. The objectives of the study were to (a) compare the accuracy of height and circumference measurements to other, more accepted, body fat assessment methods and (b) determine the relationships between body composition and APFT results. Participants included Reserve Officer Training Corps (ROTC) cadets (n = 11 males, 2 females, 21.6 ± 3.5 years) from a midwestern university). At one visit, percent body fat was assessed using height and circumference measurements, air-displacement plethysmography, and bioelectrical impedance analysis. APFT results were provided by the ROTC director. All assessment methods for percent body fat were strongly associated (r ≥ 0.7, p < 0.01), implying that height and circumference measurement is a practical tool to estimate percent body fat of ROTC cadets. Total APFT score was not associated with any body fat assessment method. Push-up number was negatively associated with percent body fat by all assessment methods (r ≥ -0.8, p = 0.001), although run time was positively associated (r ≥ 0.6, p < 0.05). This suggests that percent body fat may be an important variable in determining or improving cardiovascular and muscular endurance, but not APFT performance. Reprint & Copyright © 2016 Association of Military Surgeons of the U.S.

A community effort to assess and improve drug sensitivity prediction algorithms

PubMed Central

Costello, James C; Heiser, Laura M; Georgii, Elisabeth; Gönen, Mehmet; Menden, Michael P; Wang, Nicholas J; Bansal, Mukesh; Ammad-ud-din, Muhammad; Hintsanen, Petteri; Khan, Suleiman A; Mpindi, John-Patrick; Kallioniemi, Olli; Honkela, Antti; Aittokallio, Tero; Wennerberg, Krister; Collins, James J; Gallahan, Dan; Singer, Dinah; Saez-Rodriguez, Julio; Kaski, Samuel; Gray, Joe W; Stolovitzky, Gustavo

2015-01-01

Predicting the best treatment strategy from genomic information is a core goal of precision medicine. Here we focus on predicting drug response based on a cohort of genomic, epigenomic and proteomic profiling data sets measured in human breast cancer cell lines. Through a collaborative effort between the National Cancer Institute (NCI) and the Dialogue on Reverse Engineering Assessment and Methods (DREAM) project, we analyzed a total of 44 drug sensitivity prediction algorithms. The top-performing approaches modeled nonlinear relationships and incorporated biological pathway information. We found that gene expression microarrays consistently provided the best predictive power of the individual profiling data sets; however, performance was increased by including multiple, independent data sets. We discuss the innovations underlying the top-performing methodology, Bayesian multitask MKL, and we provide detailed descriptions of all methods. This study establishes benchmarks for drug sensitivity prediction and identifies approaches that can be leveraged for the development of new methods. PMID:24880487

A community effort to assess and improve drug sensitivity prediction algorithms.

PubMed

Costello, James C; Heiser, Laura M; Georgii, Elisabeth; Gönen, Mehmet; Menden, Michael P; Wang, Nicholas J; Bansal, Mukesh; Ammad-ud-din, Muhammad; Hintsanen, Petteri; Khan, Suleiman A; Mpindi, John-Patrick; Kallioniemi, Olli; Honkela, Antti; Aittokallio, Tero; Wennerberg, Krister; Collins, James J; Gallahan, Dan; Singer, Dinah; Saez-Rodriguez, Julio; Kaski, Samuel; Gray, Joe W; Stolovitzky, Gustavo

2014-12-01

Predicting the best treatment strategy from genomic information is a core goal of precision medicine. Here we focus on predicting drug response based on a cohort of genomic, epigenomic and proteomic profiling data sets measured in human breast cancer cell lines. Through a collaborative effort between the National Cancer Institute (NCI) and the Dialogue on Reverse Engineering Assessment and Methods (DREAM) project, we analyzed a total of 44 drug sensitivity prediction algorithms. The top-performing approaches modeled nonlinear relationships and incorporated biological pathway information. We found that gene expression microarrays consistently provided the best predictive power of the individual profiling data sets; however, performance was increased by including multiple, independent data sets. We discuss the innovations underlying the top-performing methodology, Bayesian multitask MKL, and we provide detailed descriptions of all methods. This study establishes benchmarks for drug sensitivity prediction and identifies approaches that can be leveraged for the development of new methods.

The Arthroscopic Surgical Skill Evaluation Tool (ASSET).

PubMed

Koehler, Ryan J; Amsdell, Simon; Arendt, Elizabeth A; Bisson, Leslie J; Braman, Jonathan P; Bramen, Jonathan P; Butler, Aaron; Cosgarea, Andrew J; Harner, Christopher D; Garrett, William E; Olson, Tyson; Warme, Winston J; Nicandri, Gregg T

2013-06-01

Surgeries employing arthroscopic techniques are among the most commonly performed in orthopaedic clinical practice; however, valid and reliable methods of assessing the arthroscopic skill of orthopaedic surgeons are lacking. The Arthroscopic Surgery Skill Evaluation Tool (ASSET) will demonstrate content validity, concurrent criterion-oriented validity, and reliability when used to assess the technical ability of surgeons performing diagnostic knee arthroscopic surgery on cadaveric specimens. Cross-sectional study; Level of evidence, 3. Content validity was determined by a group of 7 experts using the Delphi method. Intra-articular performance of a right and left diagnostic knee arthroscopic procedure was recorded for 28 residents and 2 sports medicine fellowship-trained attending surgeons. Surgeon performance was assessed by 2 blinded raters using the ASSET. Concurrent criterion-oriented validity, interrater reliability, and test-retest reliability were evaluated. Content validity: The content development group identified 8 arthroscopic skill domains to evaluate using the ASSET. Concurrent criterion-oriented validity: Significant differences in the total ASSET score (P < .05) between novice, intermediate, and advanced experience groups were identified. Interrater reliability: The ASSET scores assigned by each rater were strongly correlated (r = 0.91, P < .01), and the intraclass correlation coefficient between raters for the total ASSET score was 0.90. Test-retest reliability: There was a significant correlation between ASSET scores for both procedures attempted by each surgeon (r = 0.79, P < .01). The ASSET appears to be a useful, valid, and reliable method for assessing surgeon performance of diagnostic knee arthroscopic surgery in cadaveric specimens. Studies are ongoing to determine its generalizability to other procedures as well as to the live operating room and other simulated environments.

Factors Influencing Academic Performance in Quantitative Courses among Undergraduate Business Students of a Public Higher Education Institution

ERIC Educational Resources Information Center

Yousef, Darwish Abdulrahamn

2017-01-01

Purpose: This paper aims to investigate the impacts of teaching style, English language and communication and assessment methods on the academic performance of undergraduate business students in introductory quantitative courses such as Statistics for Business 1 and 2, Quantitative Methods for Business, Operations and Production Management and…

Rating Scale Impact on EFL Essay Marking: A Mixed-Method Study

ERIC Educational Resources Information Center

Barkaoui, Khaled

2007-01-01

Educators often have to choose among different types of rating scales to assess second-language (L2) writing performance. There is little research, however, on how different rating scales affect rater performance. This study employed a mixed-method approach to investigate the effects of two different rating scales on EFL essay scores, rating…

Mapping species distributions with MAXENT using a geographically biased sample of presence data: a performance assessment of methods for correcting sampling bias.

PubMed

Fourcade, Yoan; Engler, Jan O; Rödder, Dennis; Secondi, Jean

2014-01-01

MAXENT is now a common species distribution modeling (SDM) tool used by conservation practitioners for predicting the distribution of a species from a set of records and environmental predictors. However, datasets of species occurrence used to train the model are often biased in the geographical space because of unequal sampling effort across the study area. This bias may be a source of strong inaccuracy in the resulting model and could lead to incorrect predictions. Although a number of sampling bias correction methods have been proposed, there is no consensual guideline to account for it. We compared here the performance of five methods of bias correction on three datasets of species occurrence: one "virtual" derived from a land cover map, and two actual datasets for a turtle (Chrysemys picta) and a salamander (Plethodon cylindraceus). We subjected these datasets to four types of sampling biases corresponding to potential types of empirical biases. We applied five correction methods to the biased samples and compared the outputs of distribution models to unbiased datasets to assess the overall correction performance of each method. The results revealed that the ability of methods to correct the initial sampling bias varied greatly depending on bias type, bias intensity and species. However, the simple systematic sampling of records consistently ranked among the best performing across the range of conditions tested, whereas other methods performed more poorly in most cases. The strong effect of initial conditions on correction performance highlights the need for further research to develop a step-by-step guideline to account for sampling bias. However, this method seems to be the most efficient in correcting sampling bias and should be advised in most cases.

Mapping Species Distributions with MAXENT Using a Geographically Biased Sample of Presence Data: A Performance Assessment of Methods for Correcting Sampling Bias

PubMed Central

Fourcade, Yoan; Engler, Jan O.; Rödder, Dennis; Secondi, Jean

2014-01-01

MAXENT is now a common species distribution modeling (SDM) tool used by conservation practitioners for predicting the distribution of a species from a set of records and environmental predictors. However, datasets of species occurrence used to train the model are often biased in the geographical space because of unequal sampling effort across the study area. This bias may be a source of strong inaccuracy in the resulting model and could lead to incorrect predictions. Although a number of sampling bias correction methods have been proposed, there is no consensual guideline to account for it. We compared here the performance of five methods of bias correction on three datasets of species occurrence: one “virtual” derived from a land cover map, and two actual datasets for a turtle (Chrysemys picta) and a salamander (Plethodon cylindraceus). We subjected these datasets to four types of sampling biases corresponding to potential types of empirical biases. We applied five correction methods to the biased samples and compared the outputs of distribution models to unbiased datasets to assess the overall correction performance of each method. The results revealed that the ability of methods to correct the initial sampling bias varied greatly depending on bias type, bias intensity and species. However, the simple systematic sampling of records consistently ranked among the best performing across the range of conditions tested, whereas other methods performed more poorly in most cases. The strong effect of initial conditions on correction performance highlights the need for further research to develop a step-by-step guideline to account for sampling bias. However, this method seems to be the most efficient in correcting sampling bias and should be advised in most cases. PMID:24818607

The Australian Medical Schools Assessment Collaboration: benchmarking the preclinical performance of medical students.

PubMed

O'Mara, Deborah A; Canny, Ben J; Rothnie, Imogene P; Wilson, Ian G; Barnard, John; Davies, Llewelyn

2015-02-02

To report the level of participation of medical schools in the Australian Medical Schools Assessment Collaboration (AMSAC); and to measure differences in student performance related to medical school characteristics and implementation methods. Retrospective analysis of data using the Rasch statistical model to correct for missing data and variability in item difficulty. Linear model analysis of variance was used to assess differences in student performance. 6401 preclinical students from 13 medical schools that participated in AMSAC from 2011 to 2013. Rasch estimates of preclinical basic and clinical science knowledge. Representation of Australian medical schools and students in AMSAC more than doubled between 2009 and 2013. In 2013 it included 12 of 19 medical schools and 68% of medical students. Graduate-entry students scored higher than students entering straight from school. Students at large schools scored higher than students at small schools. Although the significance level was high (P < 0.001), the main effect sizes were small (4.5% and 2.3%, respectively). The time allowed per multiple choice question was not significantly associated with student performance. The effect on performance of multiple assessments compared with the test items as part of a single end-of-year examination was negligible. The variables investigated explain only 12% of the total variation in student performance. An increasing number of medical schools are participating in AMSAC to monitor student performance in preclinical sciences against an external benchmark. Medical school characteristics account for only a small part of overall variation in student performance. Student performance was not affected by the different methods of administering test items.

Cooperation, Technology, and Performance: A Case Study.

ERIC Educational Resources Information Center

Cavanagh, Thomas; Dickenson, Sabrina; Brandt, Suzanne

1999-01-01

Describes the CTP (Cooperation, Technology, and Performance) model and explains how it is used by the Department of Veterans Affairs-Veteran's Benefit Administration (VBA) for training. Discusses task analysis; computer-based training; cooperative-based learning environments; technology-based learning; performance-assessment methods; courseware…

Assessing the effect of high school students’ training program on peers performance suffering from asthma

PubMed Central

Ghazavi, Zohreh; Hemmati, Zeinab; Hasanpour, Marziyeh; Iranpour, Ramin

2010-01-01

BACKGROUND: Asthma is the most common disease in childhood which is considered as the forerunner of the acute diseases and simply can cause disability among the children. Since childhood and adolescence are the most important periods of growth and perfection and incidence of asthma can bring about distortion in this process, the present study done aimed to assess the effect of conducting high school training program on peers’ performance with asthma. METHODS: This was a quasi-experimental study in which the performance rate of the students at the time of artificial attack of asthma was directly observed, assessed and compared through demographic data questionnaire and performance assessment check list. Eighty individuals from the second grade of high school students in 2010 in Isfahan City were randomly selected to participate in the present study, among which, 40 individuals were entered in the test group and 40 of them also were placed in the control group. After conducting the training program for the test group, which had been designed both by direct method (in person and face to face by asking and answering and group discussion) and by indirect method (using pamphlet and other educational materials), the level of the training effectiveness was assessed on the students’ performance. RESULTS: The findings of the present study indicated that the performance of students at the test group increased from 2.2 (0.6) to 91.8 (1.3) which emphasized that the training program for the young adolescent peers had a positive effect on promoting their health. CONCLUSIONS: Considering the results of the present study and regarding to the importance and role of students as the future makers of the country, and also the cost-effectiveness of the training programs and the positive effect of peers on increasing the level of health among the students with asthma and consequently decreasing the school absence, it obviously seems necessary to generalize and expand these training programs. PMID:22069400

Comparing Assessment Methods in Undergraduate Statistics Courses

ERIC Educational Resources Information Center

Baxter, Sarah E.

2017-01-01

The purpose of this study was to compare undergraduate students' academic performance and attitudes about statistics in the context of two different types of assessment structures for an introductory statistics course. One assessment structure used in-class quizzes that emphasized computation and procedural fluency as well as vocabulary…

An integrated environmental modeling framework for performing quantitative microbial risk assessments

USDA-ARS?s Scientific Manuscript database

Standardized methods are often used to assess the likelihood of a human-health effect from exposure to a specified hazard, and inform opinions and decisions about risk management and communication. A Quantitative Microbial Risk Assessment (QMRA) is specifically adapted to detail potential human-heal...

Video conference quality assessment based on cooperative sensing of video and audio

NASA Astrophysics Data System (ADS)

Wang, Junxi; Chen, Jialin; Tian, Xin; Zhou, Cheng; Zhou, Zheng; Ye, Lu

2015-12-01

This paper presents a method to video conference quality assessment, which is based on cooperative sensing of video and audio. In this method, a proposed video quality evaluation method is used to assess the video frame quality. The video frame is divided into noise image and filtered image by the bilateral filters. It is similar to the characteristic of human visual, which could also be seen as a low-pass filtering. The audio frames are evaluated by the PEAQ algorithm. The two results are integrated to evaluate the video conference quality. A video conference database is built to test the performance of the proposed method. It could be found that the objective results correlate well with MOS. Then we can conclude that the proposed method is efficiency in assessing video conference quality.

Video and accelerometer-based motion analysis for automated surgical skills assessment.

PubMed

Zia, Aneeq; Sharma, Yachna; Bettadapura, Vinay; Sarin, Eric L; Essa, Irfan

2018-03-01

Basic surgical skills of suturing and knot tying are an essential part of medical training. Having an automated system for surgical skills assessment could help save experts time and improve training efficiency. There have been some recent attempts at automated surgical skills assessment using either video analysis or acceleration data. In this paper, we present a novel approach for automated assessment of OSATS-like surgical skills and provide an analysis of different features on multi-modal data (video and accelerometer data). We conduct a large study for basic surgical skill assessment on a dataset that contained video and accelerometer data for suturing and knot-tying tasks. We introduce "entropy-based" features-approximate entropy and cross-approximate entropy, which quantify the amount of predictability and regularity of fluctuations in time series data. The proposed features are compared to existing methods of Sequential Motion Texture, Discrete Cosine Transform and Discrete Fourier Transform, for surgical skills assessment. We report average performance of different features across all applicable OSATS-like criteria for suturing and knot-tying tasks. Our analysis shows that the proposed entropy-based features outperform previous state-of-the-art methods using video data, achieving average classification accuracies of 95.1 and 92.2% for suturing and knot tying, respectively. For accelerometer data, our method performs better for suturing achieving 86.8% average accuracy. We also show that fusion of video and acceleration features can improve overall performance for skill assessment. Automated surgical skills assessment can be achieved with high accuracy using the proposed entropy features. Such a system can significantly improve the efficiency of surgical training in medical schools and teaching hospitals.

An unsupervised method for estimating the global horizontal irradiance from photovoltaic power measurements

NASA Astrophysics Data System (ADS)

Nespoli, Lorenzo; Medici, Vasco

2017-12-01

In this paper, we present a method to determine the global horizontal irradiance (GHI) from the power measurements of one or more PV systems, located in the same neighborhood. The method is completely unsupervised and is based on a physical model of a PV plant. The precise assessment of solar irradiance is pivotal for the forecast of the electric power generated by photovoltaic (PV) plants. However, on-ground measurements are expensive and are generally not performed for small and medium-sized PV plants. Satellite-based services represent a valid alternative to on site measurements, but their space-time resolution is limited. Results from two case studies located in Switzerland are presented. The performance of the proposed method at assessing GHI is compared with that of free and commercial satellite services. Our results show that the presented method is generally better than satellite-based services, especially at high temporal resolutions.

Tooth-size discrepancy: A comparison between manual and digital methods

PubMed Central

Correia, Gabriele Dória Cabral; Habib, Fernando Antonio Lima; Vogel, Carlos Jorge

2014-01-01

Introduction Technological advances in Dentistry have emerged primarily in the area of diagnostic tools. One example is the 3D scanner, which can transform plaster models into three-dimensional digital models. Objective This study aimed to assess the reliability of tooth size-arch length discrepancy analysis measurements performed on three-dimensional digital models, and compare these measurements with those obtained from plaster models. Material and Methods To this end, plaster models of lower dental arches and their corresponding three-dimensional digital models acquired with a 3Shape R700T scanner were used. All of them had lower permanent dentition. Four different tooth size-arch length discrepancy calculations were performed on each model, two of which by manual methods using calipers and brass wire, and two by digital methods using linear measurements and parabolas. Results Data were statistically assessed using Friedman test and no statistically significant differences were found between the two methods (P > 0.05), except for values found by the linear digital method which revealed a slight, non-significant statistical difference. Conclusions Based on the results, it is reasonable to assert that any of these resources used by orthodontists to clinically assess tooth size-arch length discrepancy can be considered reliable. PMID:25279529

A Multi-Method Analysis of Evaluation Criteria Used to Assess the Speaking Proficiency of Graduate Student Instructors

ERIC Educational Resources Information Center

Plough, India C.; Briggs, Sarah L.; Van Bonn, Sarah

2010-01-01

The study reported here examined the evaluation criteria used to assess the proficiency and effectiveness of the language produced in an oral performance test of English conducted in an American university context. Empirical methods were used to analyze qualitatively and quantitatively transcriptions of the Oral English Tests (OET) of 44…

Language Testing: An Overview and Language Testing in Educational Institutions of Bangladesh

ERIC Educational Resources Information Center

Hossain, Md. Mahroof; Ahmed, Md. Kawser

2015-01-01

Test is procedures for measuring ability, knowledge or performance. Testing can be defined as a method of assessment and improvement of the students. Language testing in any point is an extremely multifarious task that ought to be based on method as well as exercise. The results of assessments are used for one or more purposes. So they have an…

Computer game-based and traditional learning method: a comparison regarding students' knowledge retention.

PubMed

Rondon, Silmara; Sassi, Fernanda Chiarion; Furquim de Andrade, Claudia Regina

2013-02-25

Educational computer games are examples of computer-assisted learning objects, representing an educational strategy of growing interest. Given the changes in the digital world over the last decades, students of the current generation expect technology to be used in advancing their learning requiring a need to change traditional passive learning methodologies to an active multisensory experimental learning methodology. The objective of this study was to compare a computer game-based learning method with a traditional learning method, regarding learning gains and knowledge retention, as means of teaching head and neck Anatomy and Physiology to Speech-Language and Hearing pathology undergraduate students. Students were randomized to participate to one of the learning methods and the data analyst was blinded to which method of learning the students had received. Students' prior knowledge (i.e. before undergoing the learning method), short-term knowledge retention and long-term knowledge retention (i.e. six months after undergoing the learning method) were assessed with a multiple choice questionnaire. Students' performance was compared considering the three moments of assessment for both for the mean total score and for separated mean scores for Anatomy questions and for Physiology questions. Students that received the game-based method performed better in the pos-test assessment only when considering the Anatomy questions section. Students that received the traditional lecture performed better in both post-test and long-term post-test when considering the Anatomy and Physiology questions. The game-based learning method is comparable to the traditional learning method in general and in short-term gains, while the traditional lecture still seems to be more effective to improve students' short and long-term knowledge retention.

Measuring Gait Quality in Parkinson’s Disease through Real-Time Gait Phase Recognition

PubMed Central

Mileti, Ilaria; Germanotta, Marco; Di Sipio, Enrica; Imbimbo, Isabella; Pacilli, Alessandra; Erra, Carmen; Petracca, Martina; Del Prete, Zaccaria; Bentivoglio, Anna Rita; Padua, Luca

2018-01-01

Monitoring gait quality in daily activities through wearable sensors has the potential to improve medical assessment in Parkinson’s Disease (PD). In this study, four gait partitioning methods, two based on thresholds and two based on a machine learning approach, considering the four-phase model, were compared. The methods were tested on 26 PD patients, both in OFF and ON levodopa conditions, and 11 healthy subjects, during walking tasks. All subjects were equipped with inertial sensors placed on feet. Force resistive sensors were used to assess reference time sequence of gait phases. Goodness Index (G) was evaluated to assess accuracy in gait phases estimation. A novel synthetic index called Gait Phase Quality Index (GPQI) was proposed for gait quality assessment. Results revealed optimum performance (G < 0.25) for three tested methods and good performance (0.25 < G < 0.70) for one threshold method. The GPQI resulted significantly higher in PD patients than in healthy subjects, showing a moderate correlation with clinical scales score. Furthermore, in patients with severe gait impairment, GPQI was found higher in OFF than in ON state. Our results unveil the possibility of monitoring gait quality in PD through real-time gait partitioning based on wearable sensors. PMID:29558410

Preceptors’ Self-Assessment of Their Ability to Perform the Learning Objectives of an Experiential Program

PubMed Central

2012-01-01

Objective. To evaluate preceptors’ perception of their ability to perform the Structured Practical Experiences in Pharmacy (SPEP) learning objectives through a self-assessment activity. Methods. A self-assessment instrument consisting of 28 learning objectives associated with clinic, community, and hospital pharmacy practice experiences were developed. Preceptors rated their performance ability for each of the learning objectives using a 3-point Likert scale. Results. Of the 116 preceptors, 89 (77%) completed the self-assessment survey instrument. The overall preceptor responses to the items on performance of the 28 SPEP learning objectives ranged from good to excellent. Years of experience, practice experience setting, and involvement as a SPEP or SPEP and PharmD preceptor had no influence on their self-reported capabilities. Conclusion. Most preceptors rated their ability to perform the learning objectives for the structured practical experiences in pharmacy as high. Competency areas requiring further preceptor development were identified. PMID:23193333

Economic method for helical gear flank surface characterisation

NASA Astrophysics Data System (ADS)

Koulin, G.; Reavie, T.; Frazer, R. C.; Shaw, B. A.

2018-03-01

Typically the quality of a gear pair is assessed based on simplified geometric tolerances which do not always correlate with functional performance. In order to identify and quantify functional performance based parameters, further development of the gear measurement approach is required. Methodology for interpolation of the full active helical gear flank surface, from sparse line measurements, is presented. The method seeks to identify the minimum number of line measurements required to sufficiently characterise an active gear flank. In the form ground gear example presented, a single helix and three profile line measurements was considered to be acceptable. The resulting surfaces can be used to simulate the meshing engagement of a gear pair and therefore provide insight into functional performance based parameters. Therefore the assessment of the quality can be based on the predicted performance in the context of an application.

Evaluation of the performance of existing non-laboratory based cardiovascular risk assessment algorithms

PubMed Central

2013-01-01

Background The high burden and rising incidence of cardiovascular disease (CVD) in resource constrained countries necessitates implementation of robust and pragmatic primary and secondary prevention strategies. Many current CVD management guidelines recommend absolute cardiovascular (CV) risk assessment as a clinically sound guide to preventive and treatment strategies. Development of non-laboratory based cardiovascular risk assessment algorithms enable absolute risk assessment in resource constrained countries. The objective of this review is to evaluate the performance of existing non-laboratory based CV risk assessment algorithms using the benchmarks for clinically useful CV risk assessment algorithms outlined by Cooney and colleagues. Methods A literature search to identify non-laboratory based risk prediction algorithms was performed in MEDLINE, CINAHL, Ovid Premier Nursing Journals Plus, and PubMed databases. The identified algorithms were evaluated using the benchmarks for clinically useful cardiovascular risk assessment algorithms outlined by Cooney and colleagues. Results Five non-laboratory based CV risk assessment algorithms were identified. The Gaziano and Framingham algorithms met the criteria for appropriateness of statistical methods used to derive the algorithms and endpoints. The Swedish Consultation, Framingham and Gaziano algorithms demonstrated good discrimination in derivation datasets. Only the Gaziano algorithm was externally validated where it had optimal discrimination. The Gaziano and WHO algorithms had chart formats which made them simple and user friendly for clinical application. Conclusion Both the Gaziano and Framingham non-laboratory based algorithms met most of the criteria outlined by Cooney and colleagues. External validation of the algorithms in diverse samples is needed to ascertain their performance and applicability to different populations and to enhance clinicians’ confidence in them. PMID:24373202

SMART empirical approaches for predicting field performance of PV modules from results of reliability tests

NASA Astrophysics Data System (ADS)

Hardikar, Kedar Y.; Liu, Bill J. J.; Bheemreddy, Venkata

2016-09-01

Gaining an understanding of degradation mechanisms and their characterization are critical in developing relevant accelerated tests to ensure PV module performance warranty over a typical lifetime of 25 years. As newer technologies are adapted for PV, including new PV cell technologies, new packaging materials, and newer product designs, the availability of field data over extended periods of time for product performance assessment cannot be expected within the typical timeframe for business decisions. In this work, to enable product design decisions and product performance assessment for PV modules utilizing newer technologies, Simulation and Mechanism based Accelerated Reliability Testing (SMART) methodology and empirical approaches to predict field performance from accelerated test results are presented. The method is demonstrated for field life assessment of flexible PV modules based on degradation mechanisms observed in two accelerated tests, namely, Damp Heat and Thermal Cycling. The method is based on design of accelerated testing scheme with the intent to develop relevant acceleration factor models. The acceleration factor model is validated by extensive reliability testing under different conditions going beyond the established certification standards. Once the acceleration factor model is validated for the test matrix a modeling scheme is developed to predict field performance from results of accelerated testing for particular failure modes of interest. Further refinement of the model can continue as more field data becomes available. While the demonstration of the method in this work is for thin film flexible PV modules, the framework and methodology can be adapted to other PV products.

Use of diagnostic accuracy as a metric for evaluating laboratory proficiency with microarray assays using mixed-tissue RNA reference samples.

PubMed

Pine, P S; Boedigheimer, M; Rosenzweig, B A; Turpaz, Y; He, Y D; Delenstarr, G; Ganter, B; Jarnagin, K; Jones, W D; Reid, L H; Thompson, K L

2008-11-01

Effective use of microarray technology in clinical and regulatory settings is contingent on the adoption of standard methods for assessing performance. The MicroArray Quality Control project evaluated the repeatability and comparability of microarray data on the major commercial platforms and laid the groundwork for the application of microarray technology to regulatory assessments. However, methods for assessing performance that are commonly applied to diagnostic assays used in laboratory medicine remain to be developed for microarray assays. A reference system for microarray performance evaluation and process improvement was developed that includes reference samples, metrics and reference datasets. The reference material is composed of two mixes of four different rat tissue RNAs that allow defined target ratios to be assayed using a set of tissue-selective analytes that are distributed along the dynamic range of measurement. The diagnostic accuracy of detected changes in expression ratios, measured as the area under the curve from receiver operating characteristic plots, provides a single commutable value for comparing assay specificity and sensitivity. The utility of this system for assessing overall performance was evaluated for relevant applications like multi-laboratory proficiency testing programs and single-laboratory process drift monitoring. The diagnostic accuracy of detection of a 1.5-fold change in signal level was found to be a sensitive metric for comparing overall performance. This test approaches the technical limit for reliable discrimination of differences between two samples using this technology. We describe a reference system that provides a mechanism for internal and external assessment of laboratory proficiency with microarray technology and is translatable to performance assessments on other whole-genome expression arrays used for basic and clinical research.

Pharmacodynamics of Promethazine in Human Subjects

NASA Technical Reports Server (NTRS)

Gatlin, K. T.; Boyd, J. L.; Wang, Z.; Das, H.; Putcha, L.

2005-01-01

Promethazine (PMZ) is the drug of choice for the treatment of symptoms associated with space motion sickness in astronauts. Side effects of PMZ include sedation, dizziness and cognitive performance impairment. In this study, we examined pharmacodynamics (PD) in human subjects and validated methods for evaluating cognitive performance effects of medications in space. METHODS: PMZ (12.5,25, and 50 mg) or placebo was administered by IM injection to human subjects in a randomized double-blind treatment design. Samples and data were collected for 72 h post dose. PD evaluation was performed using a battery of performance tests administered using WinSCAT (Windows based Space Cognitive Assessment Test) on a laptop computer, and ARES (ANAM Readiness Evaluation System) on a PDA, plasma concentrations of PMZ were measured using a LC-MS method. RESULTS: Results indicate a linear correlation between PMZ concentration and cognitive performance parameters (p<0.01). Test accuracy decreased and test completion time and response time increased significantly with increasing plasma PMZ concentration. CONCLUSIONS: These results suggest a concentration dependent decrement in cognitive performance associated with PMZ. WinSCAT and ARES are sensitive tools for the assessment PMZ PD and may be applicable for such evaluations with other neurocognitive drugs.

The assessment of biases in the acoustic discrimination of individuals

PubMed Central

Šálek, Martin

2017-01-01

Animal vocalizations contain information about individual identity that could potentially be used for the monitoring of individuals. However, the performance of individual discrimination is subjected to many biases depending on factors such as the amount of identity information, or methods used. These factors need to be taken into account when comparing results of different studies or selecting the most cost-effective solution for a particular species. In this study, we evaluate several biases associated with the discrimination of individuals. On a large sample of little owl male individuals, we assess how discrimination performance changes with methods of call description, an increasing number of individuals, and number of calls per male. Also, we test whether the discrimination performance within the whole population can be reliably estimated from a subsample of individuals in a pre-screening study. Assessment of discrimination performance at the level of the individual and at the level of call led to different conclusions. Hence, studies interested in individual discrimination should optimize methods at the level of individuals. The description of calls by their frequency modulation leads to the best discrimination performance. In agreement with our expectations, discrimination performance decreased with population size. Increasing the number of calls per individual linearly increased the discrimination of individuals (but not the discrimination of calls), likely because it allows distinction between individuals with very similar calls. The available pre-screening index does not allow precise estimation of the population size that could be reliably monitored. Overall, projects applying acoustic monitoring at the individual level in population need to consider limitations regarding the population size that can be reliably monitored and fine-tune their methods according to their needs and limitations. PMID:28486488

Validation of the virtual elevation field test method when assessing the aerodynamics of para-cyclists with a uni-lateral trans-tibial amputation.

PubMed

Dyer, Bryce; Disley, B Xavier

2018-02-01

Lower-limb amputees typically require some form of prosthetic limb to ride a bicycle for recreation or when competing. At elite-level racing speeds, aerodynamic drag can represent the majority of the resistance acting against a cyclists' forward motion. As a result, the reduction of such resistance is beneficial to an amputee whereby the form and function of the prosthetic limb can be optimized through engineering. To measure the performance of such limbs, field testing provides a cost-effective and context-specific method of aerodynamic drag measurement. However, few methods have been formally validated and none have been applied to amputees with lower-limb amputations. In this paper, an elite level para-cyclist wore two different prosthetic limb designs and had their total aerodynamic drag of a wind tunnel reference method statistically correlated against a velodrome-based virtual elevation field test method. The calculated coefficient of variation was in the range of 0.7-0.9% for the wind tunnel method and 2-3% for the virtual elevation method. A 0.03 m 2 difference was identified in the absolute values recorded between the two methods. Ultimately, both methods exhibited high levels of precision, yet relative results to each other. The virtual elevation method is proposed as a suitable technique to assess the aerodynamic drag of amputee para-cyclists. Implications for rehabilitation This assessment method will provide practitioners a reliable means of assessing the impact of changes made to prosthetics design for cyclists with limb absence. The proposed method offers a low cost and geographically accessible solution compared to others proposed in the past. This assessment method has significant potential for impact among prosthetic limb users looking to improve their cycling performance whereas previous attention in this field has been extremely limited.

An Assessment Tool of Performance Based Logistics Appropriateness

DTIC Science & Technology

2012-03-01

weighted tool score. The reason might be the willing to use PBL as an acquisition method . There is an 8.51% positive difference is present. Figure 20 shows...performance-based acquisition methods to the maximum extent practicable when acquiring services with little exclusion’ is mandated. Although PBL...determines the factors affecting the success in selecting PBL as an acquisition method . Each factor is examined in detail and built into a spreadsheet tool

Using Reflective Writing as a Predictor of Academic Success in Different Assessment Formats.

PubMed

Tsingos-Lucas, Cherie; Bosnic-Anticevich, Sinthia; Schneider, Carl R; Smith, Lorraine

2017-02-25

Objectives. To investigate whether reflective-writing skills are associated with academic success. Methods. Two hundred sixty-four students enrolled in a pharmacy practice course completed reflective statements. Regression procedures were conducted to determine whether reflective-writing skills were associated with academic success in different assessment formats: written, oral, and video tasks. Results. Reflective-writing skills were found to be a predictor of academic performance in some formats of assessment: written examination; oral assessment task and overall score for the Unit of Study (UoS). Reflective writing skills were not found to predict academic success in the video assessment task. Conclusions. Possessing good reflective-writing skills was associated with improved academic performance. Further research is recommended investigating the impact of reflective skill development on academic performance measures in other health education.

Development of a Self-Rated Mixed Methods Skills Assessment: The National Institutes of Health Mixed Methods Research Training Program for the Health Sciences.

PubMed

Guetterman, Timothy C; Creswell, John W; Wittink, Marsha; Barg, Fran K; Castro, Felipe G; Dahlberg, Britt; Watkins, Daphne C; Deutsch, Charles; Gallo, Joseph J

2017-01-01

Demand for training in mixed methods is high, with little research on faculty development or assessment in mixed methods. We describe the development of a self-rated mixed methods skills assessment and provide validity evidence. The instrument taps six research domains: "Research question," "Design/approach," "Sampling," "Data collection," "Analysis," and "Dissemination." Respondents are asked to rate their ability to define or explain concepts of mixed methods under each domain, their ability to apply the concepts to problems, and the extent to which they need to improve. We administered the questionnaire to 145 faculty and students using an internet survey. We analyzed descriptive statistics and performance characteristics of the questionnaire using the Cronbach alpha to assess reliability and an analysis of variance that compared a mixed methods experience index with assessment scores to assess criterion relatedness. Internal consistency reliability was high for the total set of items (0.95) and adequate (≥0.71) for all but one subscale. Consistent with establishing criterion validity, respondents who had more professional experiences with mixed methods (eg, published a mixed methods article) rated themselves as more skilled, which was statistically significant across the research domains. This self-rated mixed methods assessment instrument may be a useful tool to assess skills in mixed methods for training programs. It can be applied widely at the graduate and faculty level. For the learner, assessment may lead to enhanced motivation to learn and training focused on self-identified needs. For faculty, the assessment may improve curriculum and course content planning.

Study on the Filament Yarns Spreading Techniques and Assessment Methods of the Electronic Fiberglass Fabric

NASA Astrophysics Data System (ADS)

Wang, Xi; Chen, Shouhui; Zheng, Tianyong; Ning, Xiangchun; Dai, Yifei

2018-03-01

The filament yarns spreading techniques of electronic fiberglass fabric were developed in the past few years in order to meet the requirements of the development of electronic industry. Copper clad laminate (CCL) requires that the warp and weft yarns of the fabric could be spread out of apart and formed flat. The penetration performance of resin could be improved due to the filament yarns spreading techniques of electronic fiberglass fabric, the same as peeling strength of CCL and drilling performance of printed circuit board (PCB). This paper shows the filament yarns spreading techniques of electronic fiberglass fabric from several aspects, such as methods and functions, also with the assessment methods of their effects.

Fluorescent quantification of melanin.

PubMed

Fernandes, Bruno; Matamá, Teresa; Guimarães, Diana; Gomes, Andreia; Cavaco-Paulo, Artur

2016-11-01

Melanin quantification is reportedly performed by absorption spectroscopy, commonly at 405 nm. Here, we propose the implementation of fluorescence spectroscopy for melanin assessment. In a typical in vitro assay to assess melanin production in response to an external stimulus, absorption spectroscopy clearly overvalues melanin content. This method is also incapable of distinguishing non-melanotic/amelanotic control cells from those that are actually capable of performing melanogenesis. Therefore, fluorescence spectroscopy is the best method for melanin quantification as it proved to be highly specific and accurate, detecting even small variations in the synthesis of melanin. This method can also be applied to the quantification of melanin in more complex biological matrices like zebrafish embryos and human hair. © 2016 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Development and validation of a Clinical Assessment Tool for Nursing Education (CAT-NE).

PubMed

Skúladóttir, Hafdís; Svavarsdóttir, Margrét Hrönn

2016-09-01

The aim of this study was to develop a valid assessment tool to guide clinical education and evaluate students' performance in clinical nursing education. The development of the Clinical Assessment Tool for Nursing Education (CAT-NE) was based on the theory of nursing as professional caring and the Bologna learning outcomes. Benson and Clark's four steps of instrument development and validation guided the development and assessment of the tool. A mixed-methods approach with individual structured cognitive interviewing and quantitative assessments was used to validate the tool. Supervisory teachers, a pedagogical consultant, clinical expert teachers, clinical teachers, and nursing students at the University of Akureyri in Iceland participated in the process. This assessment tool is valid to assess the clinical performance of nursing students; it consists of rubrics that list the criteria for the students' expected performance. According to the students and their clinical teachers, the assessment tool clarified learning objectives, enhanced the focus of the assessment process, and made evaluation more objective. Training clinical teachers on how to assess students' performances in clinical studies and use the tool enhanced the quality of clinical assessment in nursing education. Copyright © 2016 Elsevier Ltd. All rights reserved.

Test Methodologies for Hydrogen Sensor Performance Assessment: Chamber vs. Flow Through Test Apparatus: Preprint

DOE Office of Scientific and Technical Information (OSTI.GOV)

Buttner, William J; Hartmann, Kevin S; Schmidt, Kara

Certification of hydrogen sensors to standards often prescribes using large-volume test chambers [1, 2]. However, feedback from stakeholders such as sensor manufacturers and end-users indicate that chamber test methods are often viewed as too slow and expensive for routine assessment. Flow through test methods potentially are an efficient, cost-effective alternative for sensor performance assessment. A large number of sensors can be simultaneously tested, in series or in parallel, with an appropriate flow through test fixture. The recent development of sensors with response times of less than 1s mandates improvements in equipment and methodology to properly capture the performance of thismore » new generation of fast sensors; flow methods are a viable approach for accurate response and recovery time determinations, but there are potential drawbacks. According to ISO 26142 [1], flow through test methods may not properly simulate ambient applications. In chamber test methods, gas transport to the sensor can be dominated by diffusion which is viewed by some users as mimicking deployment in rooms and other confined spaces. Alternatively, in flow through methods, forced flow transports the gas to the sensing element. The advective flow dynamics may induce changes in the sensor behaviour relative to the quasi-quiescent condition that may prevail in chamber test methods. One goal of the current activity in the JRC and NREL sensor laboratories [3, 4] is to develop a validated flow through apparatus and methods for hydrogen sensor performance testing. In addition to minimizing the impact on sensor behaviour induced by differences in flow dynamics, challenges associated with flow through methods include the ability to control environmental parameters (humidity, pressure and temperature) during the test and changes in the test gas composition induced by chemical reactions with upstream sensors. Guidelines on flow through test apparatus design and protocols for the evaluation of hydrogen sensor performance are being developed. Various commercial sensor platforms (e.g., thermal conductivity, catalytic and metal semiconductor) were used to demonstrate the advantages and issues with the flow through methodology.« less

Unified Multimodal Measurement for Performance Indication Research, Evaluation, and Effectiveness (UMMPIREE): Phase I Report

DTIC Science & Technology

2018-01-25

generally a researcher into methods and techniques (i.e., the science) of assessment. This stakeholder may observe ongoing events/experiments or may use... Research Visualization Tool. A first step toward finding a method to link research . 3.1.2 Phase II: Linking and the Network Approach During Phase I, we...innovations. In the former realm, UMMPIREE will develop a method to link assessments from different research studies to guide research

The Effect of Technical Performance on Patient Outcomes in Surgery: A Systematic Review.

PubMed

Fecso, Andras B; Szasz, Peter; Kerezov, Georgi; Grantcharov, Teodor P

2017-03-01

Systematic review of the effect of intraoperative technical performance on patient outcomes. The operating room is a high-stakes, high-risk environment. As a result, the quality of surgical interventions affecting patient outcomes has been the subject of discussion and research for years. MEDLINE, EMBASE, PsycINFO, and Cochrane databases were searched. All surgical specialties were eligible for inclusion. Data were reviewed in regards to the methods by which technical performance was measured, what patient outcomes were assessed, and how intraoperative technical performance affected patient outcomes. Quality of evidence was assessed using the Medical Education Research Study Quality Instrument (MERSQI). Of the 12,758 studies initially identified, 24 articles (7775 total participants) were ultimately included in this review. Seventeen studies assessed the performance of the faculty alone, 2 assessed both the faculty and trainees, 1 assessed trainees alone, and in 4 studies, the level of the operating surgeon was not specified. In 18 studies, a performance assessment tool was used. Patient outcomes were evaluated using intraoperative complications, short-term morbidity, long-term morbidity, short-term mortality, and long-term mortality. The average MERSQI score was 11.67 (range 9.5-14.5). Twenty-one studies demonstrated that superior technical performance was related to improved patient outcomes. The results of this systematic review demonstrated that superior technical performance positively affects patient outcomes. Despite this initial evidence, more robust research is needed to directly assess intraoperative technical performance and its effect on postoperative patient outcomes using meaningful assessment instruments and reliable processes.

Objective comparison of particle tracking methods

PubMed Central

Chenouard, Nicolas; Smal, Ihor; de Chaumont, Fabrice; Maška, Martin; Sbalzarini, Ivo F.; Gong, Yuanhao; Cardinale, Janick; Carthel, Craig; Coraluppi, Stefano; Winter, Mark; Cohen, Andrew R.; Godinez, William J.; Rohr, Karl; Kalaidzidis, Yannis; Liang, Liang; Duncan, James; Shen, Hongying; Xu, Yingke; Magnusson, Klas E. G.; Jaldén, Joakim; Blau, Helen M.; Paul-Gilloteaux, Perrine; Roudot, Philippe; Kervrann, Charles; Waharte, François; Tinevez, Jean-Yves; Shorte, Spencer L.; Willemse, Joost; Celler, Katherine; van Wezel, Gilles P.; Dan, Han-Wei; Tsai, Yuh-Show; de Solórzano, Carlos Ortiz; Olivo-Marin, Jean-Christophe; Meijering, Erik

2014-01-01

Particle tracking is of key importance for quantitative analysis of intracellular dynamic processes from time-lapse microscopy image data. Since manually detecting and following large numbers of individual particles is not feasible, automated computational methods have been developed for these tasks by many groups. Aiming to perform an objective comparison of methods, we gathered the community and organized, for the first time, an open competition, in which participating teams applied their own methods independently to a commonly defined data set including diverse scenarios. Performance was assessed using commonly defined measures. Although no single method performed best across all scenarios, the results revealed clear differences between the various approaches, leading to important practical conclusions for users and developers. PMID:24441936

[Multifactorial method for assessing the physical work capacity of mice].

PubMed

Dubovik, B V; Bogomazov, S D

1987-01-01

Based on the swimming test according to Kiplinger, in experiments on (CBA X C57BL)F1 mice there were elaborated criteria for animal performance evaluation in the process of repeated swimming of a standard distance thus measuring power, volume of work and rate of the fatigue development in relative units. From the study of effects of sydnocarb, bemethyl and phenazepam on various parameters of physical performance of mice a conclusion was made that the proposed method provides a more informative evaluation of the pharmacological effect on physical performance of animals as compared to the methods based on the record of time of performing the load.

Assessing Equating Results on Different Equating Criteria

ERIC Educational Resources Information Center

Tong, Ye; Kolen, Michael

2005-01-01

The performance of three equating methods--the presmoothed equipercentile method, the item response theory (IRT) true score method, and the IRT observed score method--were examined based on three equating criteria: the same distributions property, the first-order equity property, and the second-order equity property. The magnitude of the…

Children's Physical Fitness and Academic Performance

ERIC Educational Resources Information Center

Wittberg, Richard A.; Northrup, Karen L.; Cottrel, Lesley

2009-01-01

Background: Childhood obesity is a major public health threat. Increased fitness may have a positive influence on cognitive performance in both adults and children. Purpose: To examine which aspects of children's fitness assessment are associated with their performance on four different academic areas. Methods: FITNESSGRAM measures aerobic…

Stakeholder Perspectives on Workplace-Based Performance Assessment: Towards a Better Understanding of Assessor Behaviour

ERIC Educational Resources Information Center

de Jonge, Laury P. J. W. M.; Timmerman, Angelique A.; Govaerts, Marjan J. B.; Muris, Jean W. M.; Muijtjens, Arno M. M.; Kramer, Anneke W. M.; van der Vleuten, Cees P. M.

2017-01-01

Workplace-Based Assessment (WBA) plays a pivotal role in present-day competency-based medical curricula. Validity in WBA mainly depends on how stakeholders (e.g. clinical supervisors and learners) use the assessments--rather than on the intrinsic qualities of instruments and methods. Current research on assessment in clinical contexts seems to…

The Future Value of Serious Games for Assessment: Where Do We Go Now?

ERIC Educational Resources Information Center

de Klerk, Sebastiaan; Kato, Pamela M.

2017-01-01

Game-based assessments will most likely be an increasing part of testing programs in future generations because they provide promising possibilities for more valid and reliable measurement of students' skills as compared to the traditional methods of assessment like paper-and-pencil tests or performance-based assessments. The current status of…

Terahertz Imaging and Backscatter Radiography Probability of Detection Study for Space Shuttle Foam Inspections

NASA Technical Reports Server (NTRS)

Ussery, Warren; Johnson, Kenneth; Walker, James; Rummel, Ward

2008-01-01

This slide presentation reviews the use of terahertz imaging and Backscatter Radiography in a probability of detection study of the foam on the external tank (ET) shedding and damaging the shuttle orbiter. Non-destructive Examination (NDE) is performed as one method of preventing critical foam debris during the launch. Conventional NDE methods for inspection of the foam are assessed and the deficiencies are reviewed. Two methods for NDE inspection are reviewed: Backscatter Radiography (BSX) and Terahertz (THZ) Imaging. The purpose of the Probability of Detection (POD) study was to assess performance and reliability of the use of BSX and or THZ as an appropriate NDE method. The study used a test article with inserted defects, and a sample of blanks included to test for false positives. The results of the POD study are reported.

An Assessment Instrument to Measure Geospatial Thinking Expertise

ERIC Educational Resources Information Center

Huynh, Niem Tu; Sharpe, Bob

2013-01-01

Spatial thinking is fundamental to the practice and theory of geography, however there are few valid and reliable assessment methods in geography to measure student performance in spatial thinking. This article presents the development and evaluation of a geospatial thinking assessment instrument to measure participant understanding of spatial…

Assessing Bilingual Dominance.

ERIC Educational Resources Information Center

Flege, James Emil; Mackay, Ian R. A.; Piske, Thorsten

2002-01-01

Used two methods to assess bilingual dominance in four groups of Italian-English bilinguals. Ratios were derived from bilinguals' self-rating of ability to speak and understand Italian compared to English. Dominance in Italian was associated with a relatively high level of performance in Italian (assessed in a translation task) and relatively poor…

Formats for Assessing Students' Self-Assessment Abilities.

ERIC Educational Resources Information Center

Miller, Maurice; Turner, Tamrah

The paper examines some self-assessment techniques used with handicapped students and discusses the advantages and disadvantages of these techniques. The use of self-rating scales is reviewed, and questionable results are cited. Another method, in which students view an item and estimate whether they can perform it before attempting it…

A solution quality assessment method for swarm intelligence optimization algorithms.

PubMed

Zhang, Zhaojun; Wang, Gai-Ge; Zou, Kuansheng; Zhang, Jianhua

2014-01-01

Nowadays, swarm intelligence optimization has become an important optimization tool and wildly used in many fields of application. In contrast to many successful applications, the theoretical foundation is rather weak. Therefore, there are still many problems to be solved. One problem is how to quantify the performance of algorithm in finite time, that is, how to evaluate the solution quality got by algorithm for practical problems. It greatly limits the application in practical problems. A solution quality assessment method for intelligent optimization is proposed in this paper. It is an experimental analysis method based on the analysis of search space and characteristic of algorithm itself. Instead of "value performance," the "ordinal performance" is used as evaluation criteria in this method. The feasible solutions were clustered according to distance to divide solution samples into several parts. Then, solution space and "good enough" set can be decomposed based on the clustering results. Last, using relative knowledge of statistics, the evaluation result can be got. To validate the proposed method, some intelligent algorithms such as ant colony optimization (ACO), particle swarm optimization (PSO), and artificial fish swarm algorithm (AFS) were taken to solve traveling salesman problem. Computational results indicate the feasibility of proposed method.

Statistical issues in the comparison of quantitative imaging biomarker algorithms using pulmonary nodule volume as an example.

PubMed

Obuchowski, Nancy A; Barnhart, Huiman X; Buckler, Andrew J; Pennello, Gene; Wang, Xiao-Feng; Kalpathy-Cramer, Jayashree; Kim, Hyun J Grace; Reeves, Anthony P

2015-02-01

Quantitative imaging biomarkers are being used increasingly in medicine to diagnose and monitor patients' disease. The computer algorithms that measure quantitative imaging biomarkers have different technical performance characteristics. In this paper we illustrate the appropriate statistical methods for assessing and comparing the bias, precision, and agreement of computer algorithms. We use data from three studies of pulmonary nodules. The first study is a small phantom study used to illustrate metrics for assessing repeatability. The second study is a large phantom study allowing assessment of four algorithms' bias and reproducibility for measuring tumor volume and the change in tumor volume. The third study is a small clinical study of patients whose tumors were measured on two occasions. This study allows a direct assessment of six algorithms' performance for measuring tumor change. With these three examples we compare and contrast study designs and performance metrics, and we illustrate the advantages and limitations of various common statistical methods for quantitative imaging biomarker studies. © The Author(s) 2014 Reprints and permissions: sagepub.co.uk/journalsPermissions.nav.

Postoperative evaluation of the folded pharyngeal flap operation for cleft palate patients with velopharyngeal insufficiency

PubMed Central

Yoshimasu, Hidemi; Sato, Yutaka; Mishimagi, Takashi; Negishi, Akihide

2015-01-01

Background: Velopharyngeal function is very important for patients with cleft palate to acquire good speech. For patients with velopharyngeal insufficiency, prosthetic speech appliances and speech therapy are applied first, and then pharyngeal flap surgery to improve velopharyngeal function is performed in our hospital. The folded pharyngeal flap operation was first reported by Isshiki and Morimoto in 1975. We usually use a modification of the original method. Purpose: The purpose of this research was to introduce our method of the folded pharyngeal flap operation and report the results. Materials and Methods: The folded pharyngeal flap operation was performed for 110 patients with velopharyngeal insufficiency from 1982 to 2010. Of these, the 97 whose postoperative speech function was evaluated are reported. The cases included 61 males and 36 females, ranging in age from 7 to 50 years. The time from surgery to speech assessment ranged from 5 months to 6 years. In order to evaluate preoperative velopharyngeal function, assessment of speech by a trained speech pathologist, nasopharyngoscopy, and cephalometric radiography with contrast media were performed before surgery, and then the appropriate surgery was selected and performed. Postoperative velopharyngeal function was assessed by a trained speech pathologist. Results: Of the 97 patients who underwent the folded pharyngeal flap operation, 85 (87.6%) showed velopharyngeal competence, 8 (8.2%) showed marginal velopharyngeal incompetence, and only 2 (2.1%) showed velopharyngeal incompetence; in 2 cases (2.1%), hyponasality was present. Approximately 95% of patients showed improved velopharyngeal function. Conclusions: The folded pharyngeal flap operation based on appropriate preoperative assessment has been shown to be an effective method for the treatment of cleft palate patients with velopharyngeal insufficiency. PMID:26389036

Assessing the Effectiveness of a Learning Community Course Design to Improve the Math Performance of First-Year Students

ERIC Educational Resources Information Center

Hansen, Michele J.; Meshulam, Susan; Parker, Brooke

2013-01-01

National attention is focused on the persistent high failure rates for students enrolled in math courses, and the search for strategies to change these outcomes is on. This study used a mixed-method research design to assess the effectiveness of a learning community course designed to improve the math performance levels of firstyear students.…

Advanced MRI Methods for Assessment of Chronic Liver Disease

PubMed Central

Taouli, Bachir; Ehman, Richard L.; Reeder, Scott B.

2010-01-01

MRI plays an increasingly important role for assessment of patients with chronic liver disease. MRI has numerous advantages, including lack of ionizing radiation and the possibility of performing multiparametric imaging. With recent advances in technology, advanced MRI methods such as diffusion-, perfusion-weighted MRI, MR elastography, chemical shift based fat-water separation and MR spectroscopy can now be applied to liver imaging. We will review the respective roles of these techniques for assessment of chronic liver disease. PMID:19542391

Computer assessment of interview data using latent semantic analysis.

PubMed

Dam, Gregory; Kaufmann, Stefan

2008-02-01

Clinical interviews are a powerful method for assessing students' knowledge and conceptualdevelopment. However, the analysis of the resulting data is time-consuming and can create a "bottleneck" in large-scale studies. This article demonstrates the utility of computational methods in supporting such an analysis. Thirty-four 7th-grade student explanations of the causes of Earth's seasons were assessed using latent semantic analysis (LSA). Analyses were performed on transcriptions of student responses during interviews administered, prior to (n = 21) and after (n = 13) receiving earth science instruction. An instrument that uses LSA technology was developed to identify misconceptions and assess conceptual change in students' thinking. Its accuracy, as determined by comparing its classifications to the independent coding performed by four human raters, reached 90%. Techniques for adapting LSA technology to support the analysis of interview data, as well as some limitations, are discussed.

A Microbial Assessment Scheme to measure microbial performance of Food Safety Management Systems.

PubMed

Jacxsens, L; Kussaga, J; Luning, P A; Van der Spiegel, M; Devlieghere, F; Uyttendaele, M

2009-08-31

A Food Safety Management System (FSMS) implemented in a food processing industry is based on Good Hygienic Practices (GHP), Hazard Analysis Critical Control Point (HACCP) principles and should address both food safety control and assurance activities in order to guarantee food safety. One of the most emerging challenges is to assess the performance of a present FSMS. The objective of this work is to explain the development of a Microbial Assessment Scheme (MAS) as a tool for a systematic analysis of microbial counts in order to assess the current microbial performance of an implemented FSMS. It is assumed that low numbers of microorganisms and small variations in microbial counts indicate an effective FSMS. The MAS is a procedure that defines the identification of critical sampling locations, the selection of microbiological parameters, the assessment of sampling frequency, the selection of sampling method and method of analysis, and finally data processing and interpretation. Based on the MAS assessment, microbial safety level profiles can be derived, indicating which microorganisms and to what extent they contribute to food safety for a specific food processing company. The MAS concept is illustrated with a case study in the pork processing industry, where ready-to-eat meat products are produced (cured, cooked ham and cured, dried bacon).

[Aerosol deposition and clinical performance verified with a spacer device made in Brazil

PubMed

Camargos, P A; Rubim, J A; Simal, C J; Lasmar, L M

2000-01-01

OBJECTIVE: To assess the lung deposition pattern of radioaerosol and the clinical performance of a spacer developed and made in Brazil. METHODS: Qualitative - in a patient with cystic fibrosis - and semi-quantitative - in two healthy volunteers - assessment of pulmonary deposition of (99)mtechnetium was done using the Aerogama Medical oxigen driven nebulizer system attached to the spacer and a gama-camera (Siemens, model Orbiter) connected to a microcomputer. In the next step, clinical assessment was carried out in 50 asthmatic children, aged from four months to 13 years old with an acute attack, using conventional doses of albuterol through a metered dose inhaler attached to the spacer device. RESULTS: Qualitative assessment revealed a lung silhouette comparable with those obtained in the inhalation scintigraphy and semiquantitative assessment reveals that 7.5% to 8.0% of the inhaled (99m)technetium reached the volunteerś lungs. Statistically significant differences (p < 0.001) were observed comparing clinical scores at admission with those verified 20 and 40 minutes after albuterol inhalation; conversely, no significance was obtained for scores taken at 60 and 80 minutes. CONCLUSIONS: Although we used an alternative method, the scintigraphic assessment reveals an expected pattern of pulmonary deposition. Similarly, clinical performance in the treatment of an acute attack showed results comparable with those obtained with other spacers devices.

The Safety Course Design and Operations of Composite Overwrapped Pressure Vessels (COPV)

NASA Technical Reports Server (NTRS)

Saulsberry, Regor; Prosser, William

2015-01-01

Following a Commercial Launch Vehicle On-Pad COPV (Composite Overwrapped Pressure Vessels) failure, a request was received by the NESC (NASA Engineering and Safety Center) June 14, 2014. An assessment was approved July 10, 2014, to develop and assess the capability of scanning eddy current (EC) nondestructive evaluation (NDE) methods for mapping thickness and inspection for flaws. Current methods could not identify thickness reduction from necking and critical flaw detection was not possible with conventional dye penetrant (PT) methods, so sensitive EC scanning techniques were needed. Developmental methods existed, but had not been fully developed, nor had the requisite capability assessment (i.e., a POD (Probability of Detection) study) been performed.

A Retrospective Performance Assessment of the Developmental Neurotoxicity Study in Support of OECD Test Guideline 426

PubMed Central

Makris, Susan L.; Raffaele, Kathleen; Allen, Sandra; Bowers, Wayne J.; Hass, Ulla; Alleva, Enrico; Calamandrei, Gemma; Sheets, Larry; Amcoff, Patric; Delrue, Nathalie; Crofton, Kevin M.

2009-01-01

Objective We conducted a review of the history and performance of developmental neurotoxicity (DNT) testing in support of the finalization and implementation of Organisation of Economic Co-operation and Development (OECD) DNT test guideline 426 (TG 426). Information sources and analysis In this review we summarize extensive scientific efforts that form the foundation for this testing paradigm, including basic neurotoxicology research, interlaboratory collaborative studies, expert workshops, and validation studies, and we address the relevance, applicability, and use of the DNT study in risk assessment. Conclusions The OECD DNT guideline represents the best available science for assessing the potential for DNT in human health risk assessment, and data generated with this protocol are relevant and reliable for the assessment of these end points. The test methods used have been subjected to an extensive history of international validation, peer review, and evaluation, which is contained in the public record. The reproducibility, reliability, and sensitivity of these methods have been demonstrated, using a wide variety of test substances, in accordance with OECD guidance on the validation and international acceptance of new or updated test methods for hazard characterization. Multiple independent, expert scientific peer reviews affirm these conclusions. PMID:19165382

Quantitative imaging biomarkers: a review of statistical methods for technical performance assessment.

PubMed

Raunig, David L; McShane, Lisa M; Pennello, Gene; Gatsonis, Constantine; Carson, Paul L; Voyvodic, James T; Wahl, Richard L; Kurland, Brenda F; Schwarz, Adam J; Gönen, Mithat; Zahlmann, Gudrun; Kondratovich, Marina V; O'Donnell, Kevin; Petrick, Nicholas; Cole, Patricia E; Garra, Brian; Sullivan, Daniel C

2015-02-01

Technological developments and greater rigor in the quantitative measurement of biological features in medical images have given rise to an increased interest in using quantitative imaging biomarkers to measure changes in these features. Critical to the performance of a quantitative imaging biomarker in preclinical or clinical settings are three primary metrology areas of interest: measurement linearity and bias, repeatability, and the ability to consistently reproduce equivalent results when conditions change, as would be expected in any clinical trial. Unfortunately, performance studies to date differ greatly in designs, analysis method, and metrics used to assess a quantitative imaging biomarker for clinical use. It is therefore difficult or not possible to integrate results from different studies or to use reported results to design studies. The Radiological Society of North America and the Quantitative Imaging Biomarker Alliance with technical, radiological, and statistical experts developed a set of technical performance analysis methods, metrics, and study designs that provide terminology, metrics, and methods consistent with widely accepted metrological standards. This document provides a consistent framework for the conduct and evaluation of quantitative imaging biomarker performance studies so that results from multiple studies can be compared, contrasted, or combined. © The Author(s) 2014 Reprints and permissions: sagepub.co.uk/journalsPermissions.nav.

The Role of Simulation in Microsurgical Training.

PubMed

Evgeniou, Evgenios; Walker, Harriet; Gujral, Sameer

Simulation has been established as an integral part of microsurgical training. The aim of this study was to assess and categorize the various simulation models in relation to the complexity of the microsurgical skill being taught and analyze the assessment methods commonly employed in microsurgical simulation training. Numerous courses have been established using simulation models. These models can be categorized, according to the level of complexity of the skill being taught, into basic, intermediate, and advanced. Microsurgical simulation training should be assessed using validated assessment methods. Assessment methods vary significantly from subjective expert opinions to self-assessment questionnaires and validated global rating scales. The appropriate assessment method should carefully be chosen based on the simulation modality. Simulation models should be validated, and a model with appropriate fidelity should be chosen according to the microsurgical skill being taught. Assessment should move from traditional simple subjective evaluations of trainee performance to validated tools. Future studies should assess the transferability of skills gained during simulation training to the real-life setting. Copyright © 2018 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Modeling instructor preferences for CPR and AED competence estimation.

PubMed

Birnbaum, Alice; McBurnie, Mary Ann; Powell, Judy; Ottingham, Lois Van; Riegel, Barbara; Potts, Jerry; Hedges, Jerris R

2005-03-01

Cardiopulmonary resuscitation (CPR) and automated external defibrillator (AED) skills competency can be tested using a checklist of component skills, individually graded "pass" or "fail." Scores are typically calculated as the percentage of skills passed, but may differ from an instructor's overall subjective assessment of simulated CPR or AED adequacy. To identify and evaluate composite measures (methods for scoring checklists) that reflect instructors' subjective assessments of CPR or AED skills performance best. Associations between instructor assessment and lay-volunteer skill performance were made using 6380 CPR and 3313 AED skill retention tests collected in the Public Access Defibrillation Trial. Checklists included CPR skills (e.g., calling 911, administering compressions) and AED skills (e.g., positioning electrodes, shocking within 90 s of AED arrival). The instructor's subjective overall assessment (adequate/inadequate) of CPR performance (perfusion) or AED competence (effective shock) was compared to composite measures. We evaluated the traditional composite measure (assigning equal weights to individual skills) and several nontraditional composite measures (assigning variable weights). Skills performed out of sequence were further weighted from 0% (no credit) to 100% (full credit). Composite measures providing full credit for skills performed out of sequence and down-weighting process skills (e.g., calling 911, clearing oneself from the AED) had the strongest association with the instructor's subjective assessment; the traditional CPR composite measure had the weakest association. Our findings suggest that instructors in public CPR and AED classes may tend to down-weight process skills and to excuse step sequencing errors when evaluating CPR and AED skills subjectively for overall proficiency. Testing methods that relate classroom performance to actual performance in the field and to clinical outcomes require further research.

Static aeroelastic analysis and tailoring of a single-element racing car wing

NASA Astrophysics Data System (ADS)

Sadd, Christopher James

This thesis presents the research from an Engineering Doctorate research programme in collaboration with Reynard Motorsport Ltd, a manufacturer of racing cars. Racing car wing design has traditionally considered structures to be rigid. However, structures are never perfectly rigid and the interaction between aerodynamic loading and structural flexibility has a direct impact on aerodynamic performance. This interaction is often referred to as static aeroelasticity and the focus of this research has been the development of a computational static aeroelastic analysis method to improve the design of a single-element racing car wing. A static aeroelastic analysis method has been developed by coupling a Reynolds-Averaged Navier-Stokes CFD analysis method with a Finite Element structural analysis method using an iterative scheme. Development of this method has included assessment of CFD and Finite Element analysis methods and development of data transfer and mesh deflection methods. Experimental testing was also completed to further assess the computational analyses. The computational and experimental results show a good correlation and these studies have also shown that a Navier-Stokes static aeroelastic analysis of an isolated wing can be performed at an acceptable computational cost. The static aeroelastic analysis tool was used to assess methods of tailoring the structural flexibility of the wing to increase its aerodynamic performance. These tailoring methods were then used to produce two final wing designs to increase downforce and reduce drag respectively. At the average operating dynamic pressure of the racing car, the computational analysis predicts that the downforce-increasing wing has a downforce of C[1]=-1.377 in comparison to C[1]=-1.265 for the original wing. The computational analysis predicts that the drag-reducing wing has a drag of C[d]=0.115 in comparison to C[d]=0.143 for the original wing.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Olsen, Tim; Preus, Robert

Site assessment for small wind energy systems is one of the key factors in the successful installation, operation, and performance of a small wind turbine. A proper site assessment is a difficult process that includes wind resource assessment and the evaluation of site characteristics. These guidelines address many of the relevant parts of a site assessment with an emphasis on wind resource assessment, using methods other than on-site data collection and creating a small wind site assessment report.

A multi-objective assessment of an air quality monitoring network using environmental, economic, and social indicators and GIS-based models.

PubMed

Pope, Ronald; Wu, Jianguo

2014-06-01

In the United States, air pollution is primarily measured by Air Quality Monitoring Networks (AQMN). These AQMNs have multiple objectives, including characterizing pollution patterns, protecting the public health, and determining compliance with air quality standards. In 2006, the U.S. Environmental Protection Agency issued a directive that air pollution agencies assess the performance of their AQMNs. Although various methods to design and assess AQMNs exist, here we demonstrate a geographic information system (GIS)-based approach that combines environmental, economic, and social indicators through the assessment of the ozone (O3) and particulate matter (PM10) networks in Maricopa County, Arizona. The assessment was conducted in three phases: (1) to evaluate the performance of the existing networks, (2) to identify areas that would benefit from the addition of new monitoring stations, and (3) to recommend changes to the AQMN. A comprehensive set of indicators was created for evaluating differing aspects of the AQMNs' objectives, and weights were applied to emphasize important indicators. Indicators were also classified according to their sustainable development goal. Our results showed that O3 was well represented in the county with some redundancy in terms of the urban monitors. The addition of weights to the indicators only had a minimal effect on the results. For O3, urban monitors had greater social scores, while rural monitors had greater environmental scores. The results did not suggest a need for adding more O3 monitoring sites. For PM10, clustered urban monitors were redundant, and weights also had a minimal effect on the results. The clustered urban monitors had overall low scores; sites near point sources had high environmental scores. Several areas were identified as needing additional PM10 monitors. This study demonstrates the usefulness of a multi-indicator approach to assess AQMNs. Network managers and planners may use this method to assess the performance of air quality monitoring networks in urban regions. The U.S. Environmental Protection Agency issued a directive in 2006 that air pollution agencies assess the performance of their AQMNs; as a result, we developed a GIS-based, multi-objective assessment approach that integrates environmental, economic, and social indicators, and demonstrates its use through assessing the O3 and PM10 monitoring networks in the Phoenix metropolitan area. We exhibit a method of assessing network performance and identifying areas that would benefit from new monitoring stations; also, we demonstrate the effect of adding weights to the indicators. Our study shows that using a multi-indicator approach gave detailed assessment results for the Phoenix AQMN.

The Effects of Teaching and Assessment Methods on Academic Performance: A Study of an Operations Management Course

ERIC Educational Resources Information Center

Sacristán-Díaz, Macarena; Garrido-Vega, Pedro; Alfalla-Luque, Rafaela; González-Zamora, María-del-Mar

2016-01-01

Whether the use of more active teaching-learning methods has a positive impact on academic performance remains unanswered. This article seeks to contribute to the issue by conducting a study of an Operations Management course with almost 1000 students per year over three consecutive academic years. The study compares three scenarios with differing…

Development of ultrasonic methods for hemodynamic measurements

NASA Technical Reports Server (NTRS)

Histand, M. B.; Miller, C. W.; Wells, M. K.; Mcleod, F. D.; Greene, E. R.; Winter, D.

1975-01-01

A transcutanous method to measure instantaneous mean blood flow in peripheral arteries of the human body was defined. Transcutanous and implanted cuff ultrasound velocity measurements were evaluated, and the accuracies of velocity, flow, and diameter measurements were assessed for steady flow. Performance criteria were established for the pulsed Doppler velocity meter (PUDVM), and performance tests were conducted. Several improvements are suggested.

An Assessment of the Effects of Teaching Methods on Academic Performance of Students in Accounting Courses

ERIC Educational Resources Information Center

Hosal-Akman, Nazli; Simga-Mugan, Can

2010-01-01

This study explores the effect of teaching methods on the academic performance of students in accounting courses. The study was carried out over two semesters at a well-known university in Turkey in principles of financial accounting and managerial accounting courses. Students enrolled in the courses were assigned to treatment and control groups.…

An Investigation into Native and Non-Native Teachers' Judgments of Oral English Performance: A Mixed Methods Approach

ERIC Educational Resources Information Center

Kim, Youn-Hee

2009-01-01

This study used a mixed methods research approach to examine how native English-speaking (NS) and non-native English-speaking (NNS) teachers assess students' oral English performance. The evaluation behaviors of two groups of teachers (12 Canadian NS teachers and 12 Korean NNS teachers) were compared with regard to internal consistency, severity,…

Mathematics Curriculum Based Measurement to Predict State Test Performance: A Comparison of Measures and Methods

ERIC Educational Resources Information Center

Stevens, Olinger; Leigh, Erika

2012-01-01

Scope and Method of Study: The purpose of the study is to use an empirical approach to identify a simple, economical, efficient, and technically adequate performance measure that teachers can use to assess student growth in mathematics. The current study has been designed to expand the body of research for math CBM to further examine technical…

[Concepts of pain in preschoolers and children of early school age and their parents after painful interventions during hospitalization].

PubMed

Kloos, H D

1999-06-01

Subject of the present study are individual pain concepts of preschoolers and children of early school age. Their parents' concepts of pain were considered as well. In a qualitative study interviews were performed with 9 children and their parents in a children's hospital to investigate their individual concepts of pain, their methods of pain assessment, and self-initiated strategies of pain alleviation. Already 4-6 year old children are able to remember painful experiences and to communicate about pain. Strategies of pain alleviation used by children are distraction methods as well as methods of physical relief. The child's parents play an important role concerning pain assessment and coping. The parents' presence is also very important to communicate the child's needs to nurses. Parents want nurses to consider physiological as well as behavioral aspects in the assessment of the child's pain. Besides, they expect nurses to have competences concerning prevention, assessment and alleviation of pain. To perform a trustful relationship to children and parents, more intensified counselling by nurses seems necessary.

Why Measure Outcomes?

PubMed

Kuhn, John E

2016-01-01

The concept of measuring the outcomes of treatment in health care was promoted by Ernest Amory Codman in the early 1900s, but, until recently, his ideas were generally ignored. The forces that have advanced outcome measurement to the forefront of health care include the shift in payers for health care from the patient to large insurance companies or government agencies, the movement toward assessing the care of populations not individuals, and the effort to find value (or cost-effective treatments) amid rising healthcare costs. No ideal method exists to measure outcomes, and the information gathered depends on the reason the outcome information is required. Outcome measures used in research are best able to answer research questions. The methods for assessing physician and hospital performance include process measures, patient-experience measures, structure measures, and measures used to assess the outcomes of treatment. The methods used to assess performance should be validated, be reliable, and reflect a patient's perception of the treatment results. The healthcare industry must measure outcomes to identify which treatments are most effective and provide the most benefit to patients.

Reliability of Volumetry and Perimetry to Assess Knee Volume.

PubMed

Nunes, Guilherme S; Yamashitafuji, Igor; Wageck, Bruna; Teixeira, Guilherme Garcia; Karloh, Manuela; de Noronha, Marcos

2016-08-24

The treatment of edema after a knee injury is usually 1 of the main objectives during rehabilitation. To assess the success of treatment, 2 methods are commonly used in clinical practice: volumetry and perimetry. To investigate the intra- and interassessor reliability of volumetry and perimetry to assess knee volume. Cross-sectional. Laboratory. 45 healthy participants (26 women) with mean age of 22.4 ± 2.8 y. Knee volume was assessed by 3 assessors (A, B, and C) with 3 methods (lower-limb volumetry [LLV], knee volumetry [KV], and knee perimetry [KP]). Assessor A was the most-experienced assessor, and assessor C, the least experienced. LLV and KV were performed with participants in the orthostatic position, while KP was performed with participants in supine. For the interassessor analysis, the ICC2,1 was high (.82) for KV and very high for LLV (.99) and KP (.99). For the intra-assessor analysis, ICC2,1 ranged from moderate to high for KV (.69-.83) and was very high for LLV (.99) and KP (.97-.99). KV, LLV, and KP are reliable methods, both intra- and interassessor, to measure knee volume.

A framework for improving the cost-effectiveness of DSM program evaluations

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sonnenblick, R.; Eto, J.

The prudence of utility demand-side management (DSM) investments hinges on their performance, yet evaluating performance is complicated because the energy saved by DSM programs can never be observed directly but only inferred. This study frames and begins to answer the following questions: (1) how well do current evaluation methods perform in improving confidence in the measurement of energy savings produced by DSM programs; (2) in view of this performance, how can limited evaluation resources be best allocated to maximize the value of the information they provide? The authors review three major classes of methods for estimating annual energy savings: trackingmore » database (sometimes called engineering estimates), end-use metering, and billing analysis and examine them in light of the uncertainties in current estimates of DSM program measure lifetimes. The authors assess the accuracy and precision of each method and construct trade-off curves to examine the costs of increases in accuracy or precision. Several approaches for improving evaluations for the purpose of assessing program cost effectiveness are demonstrated. The methods can be easily generalized to other evaluation objectives, such as shared savings incentive payments.« less

Performance indicators of work activity.

PubMed

Lahoz, Manoela de Assis; Camarotto, João Alberto

2012-01-01

The measurement of performance is a current topic in the management of people in companies, used as a parameter of effectiveness of processes and operations of production. The methods and models of the indicators of current use in the production have concentrated in the assessment of people's performance as determinative resource of the organizational success in the search for the competitiveness. Associated with the classic indicators of performance assessment of the production proceeding, other indicators are used in the assessment of risks and hazards, however with methods focused in the tasks, without connection with the real work activity. The present article explores literature on the models of performance measurement in use in companies and a field research to understand how companies interpret and use indicators that relate health and work, to direct future studies on the subject. Regarding the literature review, one can see that health indicators can be basically divided into two major groups: the legal and managerial indicators. When conducting case studies, it can be realized that companies do not have precisely the concept of health indicator, or were unable to define which of the indicators could be considered indicators of health, considering that absenteeism was the indicator mentioned by the four companies.

Field Assessment of Enclosed Cab Filtration System Performance Using Particle Counting Measurements

PubMed Central

Organiscak, John A.; Cecala, Andrew B.; Noll, James D.

2015-01-01

Enclosed cab filtration systems are typically used on mobile mining equipment to reduce miners’ exposure to airborne dust generated during mining operations. The National Institute for Occupational Safety and Health (NIOSH) Office of Mine Safety and Health Research (OMSHR) has recently worked with a mining equipment manufacturer to examine a new cab filtration system design for underground industrial minerals equipment. This cab filtration system uses a combination of three particulate filters to reduce equipment operators’ exposure to dust and diesel particulates present in underground industrial mineral mines. NIOSH initially examined this cab filtration system using a two-instrument particle counting method at the equipment company’s manufacturing shop facility to assess several alternative filters. This cab filtration system design was further studied on several pieces of equipment during a two- to seven-month period at two underground limestone mines. The two-instrument particle counting method was used outside the underground mine at the end of the production shifts to regularly test the cabs’ long-term protection factor performance with particulates present in the ambient air. This particle counting method showed that three of the four cabs achieved protection factors greater than 1,000 during the field studies. The fourth cab did not perform at this level because it had a damaged filter in the system. The particle counting measurements of submicron particles present in the ambient air were shown to be a timely and useful quantification method in assessing cab performance during these field studies. PMID:23915268

Evaluation of the precision of contrast sensitivity function assessment on a tablet device

PubMed Central

Dorr, Michael; Lesmes, Luis A.; Elze, Tobias; Wang, Hui; Lu, Zhong-Lin; Bex, Peter J.

2017-01-01

The contrast sensitivity function (CSF) relates the visibility of a spatial pattern to both its size and contrast, and is therefore a more comprehensive assessment of visual function than acuity, which only determines the smallest resolvable pattern size. Because of the additional dimension of contrast, estimating the CSF can be more time-consuming. Here, we compare two methods for rapid assessment of the CSF that were implemented on a tablet device. For a single-trial assessment, we asked 63 myopes and 38 emmetropes to tap the peak of a “sweep grating” on the tablet’s touch screen. For a more precise assessment, subjects performed 50 trials of the quick CSF method in a 10-AFC letter recognition task. Tests were performed with and without optical correction, and in monocular and binocular conditions; one condition was measured twice to assess repeatability. Results show that both methods are highly correlated; using both common and novel measures for test-retest repeatability, however, the quick CSF delivers more precision with testing times of under three minutes. Further analyses show how a population prior can improve convergence rate of the quick CSF, and how the multi-dimensional output of the quick CSF can provide greater precision than scalar outcome measures. PMID:28429773

Safety assessment in plant layout design using indexing approach: implementing inherent safety perspective. Part 1 - guideword applicability and method description.

PubMed

Tugnoli, Alessandro; Khan, Faisal; Amyotte, Paul; Cozzani, Valerio

2008-12-15

Layout planning plays a key role in the inherent safety performance of process plants since this design feature controls the possibility of accidental chain-events and the magnitude of possible consequences. A lack of suitable methods to promote the effective implementation of inherent safety in layout design calls for the development of new techniques and methods. In the present paper, a safety assessment approach suitable for layout design in the critical early phase is proposed. The concept of inherent safety is implemented within this safety assessment; the approach is based on an integrated assessment of inherent safety guideword applicability within the constraints typically present in layout design. Application of these guidewords is evaluated along with unit hazards and control devices to quantitatively map the safety performance of different layout options. Moreover, the economic aspects related to safety and inherent safety are evaluated by the method. Specific sub-indices are developed within the integrated safety assessment system to analyze and quantify the hazard related to domino effects. The proposed approach is quick in application, auditable and shares a common framework applicable in other phases of the design lifecycle (e.g. process design). The present work is divided in two parts: Part 1 (current paper) presents the application of inherent safety guidelines in layout design and the index method for safety assessment; Part 2 (accompanying paper) describes the domino hazard sub-index and demonstrates the proposed approach with a case study, thus evidencing the introduction of inherent safety features in layout design.

Development of a Self-Rated Mixed Methods Skills Assessment: The NIH Mixed Methods Research Training Program for the Health Sciences

PubMed Central

Guetterman, Timothy C.; Creswell, John W.; Wittink, Marsha; Barg, Fran K.; Castro, Felipe G.; Dahlberg, Britt; Watkins, Daphne C.; Deutsch, Charles; Gallo, Joseph J.

2017-01-01

Introduction Demand for training in mixed methods is high, with little research on faculty development or assessment in mixed methods. We describe the development of a Self-Rated Mixed Methods Skills Assessment and provide validity evidence. The instrument taps six research domains: “Research question,” “Design/approach,” “Sampling,” “Data collection,” “Analysis,” and “Dissemination.” Respondents are asked to rate their ability to define or explain concepts of mixed methods under each domain, their ability to apply the concepts to problems, and the extent to which they need to improve. Methods We administered the questionnaire to 145 faculty and students using an internet survey. We analyzed descriptive statistics and performance characteristics of the questionnaire using Cronbach’s alpha to assess reliability and an ANOVA that compared a mixed methods experience index with assessment scores to assess criterion-relatedness. Results Internal consistency reliability was high for the total set of items (.95) and adequate (>=.71) for all but one subscale. Consistent with establishing criterion validity, respondents who had more professional experiences with mixed methods (e.g., published a mixed methods paper) rated themselves as more skilled, which was statistically significant across the research domains. Discussion This Self-Rated Mixed Methods Assessment instrument may be a useful tool to assess skills in mixed methods for training programs. It can be applied widely at the graduate and faculty level. For the learner, assessment may lead to enhanced motivation to learn and training focused on self-identified needs. For faculty, the assessment may improve curriculum and course content planning. PMID:28562495

Factors That Influence the Rating of Perceived Exertion After Endurance Training.

PubMed

Roos, Lilian; Taube, Wolfgang; Tuch, Carolin; Frei, Klaus Michael; Wyss, Thomas

2018-03-15

Session rating of perceived exertion (sRPE) is an often used measure to assess athletes' training load. However, little is known which factors could optimize the quality of data collection thereof. The aim of the present study was to investigate the effects of (i) the survey methods and (ii) the time points when sRPE was assessed on the correlation between subjective (sRPE) and objective (heart rate training impulse; TRIMP) assessment of training load. In the first part, 45 well-trained subjects (30 men, 15 women) performed 20 running sessions with a heart rate monitor and reported sRPE 30 minutes after training cessation. For the reporting the subjects were grouped into three survey method groups (paper-pencil, online questionnaire, and mobile device). In the second part of the study, another 40 athletes (28 men, 12 women) performed 4x5 running sessions with the four time points to report the sRPE randomly assigned (directly after training cessation, 30 minutes post-exercise, in the evening of the same day, the next morning directly after waking up). The assessment of sRPE is influenced by time point, survey method, TRIMP, sex, and training type. It is recommended to assess sRPE values via a mobile device or online tool, as the survey method "paper" displayed lower correlations between sRPE and TRIMP. Subjective training load measures are highly individual. When compared at the same relative intensity, lower sRPE values were reported by women, for the training types representing slow runs, and for time points with greater duration between training cessation and sRPE assessment. The assessment method for sRPE should be kept constant for each athlete and comparisons between athletes or sexes are not recommended.

Summary of EPA Emission Test Methods

EPA Pesticide Factsheets

This document provides the publication date and rule status for the air emission test methods, performance specifications and quality assurance procedures. It is updated by the Measurement Technology Group, part of the Air Quality Assessment Div., OAQPS.

Analysis of Sampling Methodologies for Noise Pollution Assessment and the Impact on the Population.

PubMed

Rey Gozalo, Guillermo; Barrigón Morillas, Juan Miguel

2016-05-11

Today, noise pollution is an increasing environmental stressor. Noise maps are recognised as the main tool for assessing and managing environmental noise, but their accuracy largely depends on the sampling method used. The sampling methods most commonly used by different researchers (grid, legislative road types and categorisation methods) were analysed and compared using the city of Talca (Chile) as a test case. The results show that the stratification of sound values in road categories has a significantly lower prediction error and a higher capacity for discrimination and prediction than in the legislative road types used by the Ministry of Transport and Telecommunications in Chile. Also, the use of one or another method implies significant differences in the assessment of population exposure to noise pollution. Thus, the selection of a suitable method for performing noise maps through measurements is essential to achieve an accurate assessment of the impact of noise pollution on the population.

Histological evaluation and optimization of surgical vessel sealing systems

NASA Astrophysics Data System (ADS)

Lathrop, Robert; Ryan, Thomas; Gaspredes, Jonathan; Woloszko, Jean; Coad, James E.

2017-02-01

Surgical vessel sealing systems are widely used to achieve hemostasis and dissection in open surgery and minimally invasive, laparoscopic surgery. This enabling technology was developed about 17 years ago and continues to evolve with new devices and systems achieving improved outcomes. Histopathological assessment of thermally sealed tissues is a valuable tool for refining and comparing performance among surgical vessel sealing systems. Early work in this field typically assessed seal time, burst rate, and failure rate (in-situ). Later work compared histological staining methods with birefringence to assess the extent of thermal damage to tissues adjacent to the device. Understanding the microscopic architecture of a sealed vessel is crucial to optimizing the performance of power delivery algorithms and device design parameters. Manufacturers rely on these techniques to develop new products. A system for histopathological evaluation of vessels and sealing performance was established, to enable the direct assessment of a treatment's tissue effects. The parameters included the commonly used seal time, pressure burst rate and failure rate, as well as extensions of the assessment to include its likelihood to form steam vacuoles, adjacent thermal effect near the device, and extent of thermally affected tissue extruded back into the vessel lumen. This comprehensive assessment method provides an improved means of assessing the quality of a sealed vessel and understanding the exact mechanisms which create an optimally sealed vessel.

Benthic macroinvertebrates in lake ecological assessment: A review of methods, intercalibration and practical recommendations.

PubMed

Poikane, Sandra; Johnson, Richard K; Sandin, Leonard; Schartau, Ann Kristin; Solimini, Angelo G; Urbanič, Gorazd; Arbačiauskas, Kęstutis; Aroviita, Jukka; Gabriels, Wim; Miler, Oliver; Pusch, Martin T; Timm, Henn; Böhmer, Jürgen

2016-02-01

Legislation in Europe has been adopted to determine and improve the ecological integrity of inland and coastal waters. Assessment is based on four biotic groups, including benthic macroinvertebrate communities. For lakes, benthic invertebrates have been recognized as one of the most difficult organism groups to use in ecological assessment, and hitherto their use in ecological assessment has been limited. In this study, we review and intercalibrate 13 benthic invertebrate-based tools across Europe. These assessment tools address different human impacts: acidification (3 methods), eutrophication (3 methods), morphological alterations (2 methods), and a combination of the last two (5 methods). For intercalibration, the methods were grouped into four intercalibration groups, according to the habitat sampled and putative pressure. Boundaries of the 'good ecological status' were compared and harmonized using direct or indirect comparison approaches. To enable indirect comparison of the methods, three common pressure indices and two common biological multimetric indices were developed for larger geographical areas. Additionally, we identified the best-performing methods based on their responsiveness to different human impacts. Based on these experiences, we provide practical recommendations for the development and harmonization of benthic invertebrate assessment methods in lakes and similar habitats. Copyright © 2015 The Authors. Published by Elsevier B.V. All rights reserved.

Use of microcomputers for self-assessment and continuing education in anaesthesia.

PubMed Central

Schmulian, C; Kenny, G N; Campbell, D

1982-01-01

The suitability of computer-assisted self-assessment was evaluated as a means of quality assurance in anaesthesia. Altogether 202 anaesthetists participated in four trials of the method. Analyses of their performance in a self-assessment programme dealing with obstetric anaesthesia showed significant differences in the levels of knowledge of anaesthetists practising for different numbers of years. The acceptability of computer-assisted self-assessment ranged from 91% to 100% for the four trials. Similar programs have been shown to be of value in medical education and thus computer-assisted self-assessment appears to fulfil simultaneously the functions of self-assessment and continuing education. The criteria for a method of quality assurance are met. PMID:6800476

Competency assessment of microbiology medical laboratory technologists in Ontario, Canada.

PubMed

Desjardins, Marc; Fleming, Christine Ann

2014-08-01

Accreditation in Ontario, Canada, requires that licensed clinical laboratories participate in external quality assessment (also known as proficiency testing) and perform competency evaluation of their staff. To assess the extent of ongoing competency assessment practices, the Quality Management Program--Laboratory Services (QMP-LS) Microbiology Committee surveyed all 112 licensed Ontario microbiology laboratories. The questionnaire consisted of a total of 21 questions that included yes/no, multiple-choice, and short-answer formats. Participants were asked to provide information about existing programs, the frequency of testing, what areas are evaluated, and how results are communicated to the staff. Of the 111 responding laboratories, 6 indicated they did not have a formal evaluation program since they perform only limited bacteriology testing. Of the remaining 105 respondents, 87% perform evaluations at least annually or every 2 years, and 61% include any test or task performed, whereas 16% and 10% focus only on problem areas and high-volume complex tasks, respectively. The most common methods of evaluation were review of external quality assessment (EQA) challenges, direct observation, and worksheet review. With the exception of one participant, all communicate results to staff, and most take remedial action to correct the deficiencies. Although most accredited laboratories have a program to assess the ongoing competency of their staff, the methods used are not standardized or consistently applied, indicating that there is room for improvement. The survey successfully highlighted potential areas for improvement and allowed the QMP-LS Microbiology Committee to provide guidance to Ontario laboratories for establishing or improving existing microbiology-specific competency assessment programs. Copyright © 2014, American Society for Microbiology. All Rights Reserved.

Competency Assessment of Microbiology Medical Laboratory Technologists in Ontario, Canada

PubMed Central

Fleming, Christine Ann

2014-01-01

Accreditation in Ontario, Canada, requires that licensed clinical laboratories participate in external quality assessment (also known as proficiency testing) and perform competency evaluation of their staff. To assess the extent of ongoing competency assessment practices, the Quality Management Program—Laboratory Services (QMP-LS) Microbiology Committee surveyed all 112 licensed Ontario microbiology laboratories. The questionnaire consisted of a total of 21 questions that included yes/no, multiple-choice, and short-answer formats. Participants were asked to provide information about existing programs, the frequency of testing, what areas are evaluated, and how results are communicated to the staff. Of the 111 responding laboratories, 6 indicated they did not have a formal evaluation program since they perform only limited bacteriology testing. Of the remaining 105 respondents, 87% perform evaluations at least annually or every 2 years, and 61% include any test or task performed, whereas 16% and 10% focus only on problem areas and high-volume complex tasks, respectively. The most common methods of evaluation were review of external quality assessment (EQA) challenges, direct observation, and worksheet review. With the exception of one participant, all communicate results to staff, and most take remedial action to correct the deficiencies. Although most accredited laboratories have a program to assess the ongoing competency of their staff, the methods used are not standardized or consistently applied, indicating that there is room for improvement. The survey successfully highlighted potential areas for improvement and allowed the QMP-LS Microbiology Committee to provide guidance to Ontario laboratories for establishing or improving existing microbiology-specific competency assessment programs. PMID:24899030

PLAB and UK graduates' performance on MRCP(UK) and MRCGP examinations: data linkage study.

PubMed

McManus, I C; Wakeford, Richard

2014-04-17

To assess whether international medical graduates passing the two examinations set by the Professional and Linguistic Assessments Board (PLAB1 and PLAB2) of the General Medical Council (GMC) are equivalent to UK graduates at the end of the first foundation year of medical training (F1), as the GMC requires, and if not, to assess what changes in the PLAB pass marks might produce equivalence. Data linkage of GMC PLAB performance data with data from the Royal Colleges of Physicians and the Royal College of General Practitioners on performance of PLAB graduates and UK graduates at the MRCP(UK) and MRCGP examinations. Doctors in training for internal medicine or general practice in the United Kingdom. 7829, 5135, and 4387 PLAB graduates on their first attempt at MRCP(UK) Part 1, Part 2, and PACES assessments from 2001 to 2012 compared with 18,532, 14,094, and 14,376 UK graduates taking the same assessments; 3160 PLAB1 graduates making their first attempt at the MRCGP AKT during 2007-12 compared with 14,235 UK graduates; and 1411 PLAB2 graduates making their first attempt at the MRCGP CSA during 2010-12 compared with 6935 UK graduates. Performance at MRCP(UK) Part 1, Part 2, and PACES assessments, and MRCGP AKT and CSA assessments in relation to performance on PLAB1 and PLAB2 assessments, as well as to International English Language Testing System (IELTS) scores. MRCP(UK), MRCGP, and PLAB results were analysed as marks relative to the pass mark at the first attempt. PLAB1 marks were a valid predictor of MRCP(UK) Part 1, MRCP(UK) Part 2, and MRCGP AKT (r=0.521, 0.390, and 0.490; all P<0.001). PLAB2 marks correlated with MRCP(UK) PACES and MRCGP CSA (r=0.274, 0.321; both P<0.001). PLAB graduates had significantly lower MRCP(UK) and MRCGP assessments (Glass's Δ=0.94, 0.91, 1.40, 1.01, and 1.82 for MRCP(UK) Part 1, Part 2, and PACES and MRCGP AKT and CSA), and were more likely to fail assessments and to progress more slowly than UK medical graduates. IELTS scores correlated significantly with later performance, multiple regression showing that the effect of PLAB1 (β=0.496) was much stronger than the effect of IELTS (β=0.086). Changes to PLAB pass marks that would result in international medical graduate and UK medical graduate equivalence were assessed in two ways. Method 1 adjusted PLAB pass marks to equate median performance of PLAB and UK graduates. Method 2 divided PLAB graduates into 12 equally spaced groups according to PLAB performance, and compared these with mean performance of graduates from individual UK medical schools, assessing which PLAB groups were equivalent in MRCP(UK) and MRCGP performance to UK graduates. The two methods produced similar results. To produce equivalent performance on the MRCP and MRGP examinations, the pass mark for PLAB1 would require raising by about 27 marks (13%) and for PLAB2 by about 15-16 marks (20%) above the present standard. PLAB is a valid assessment of medical knowledge and clinical skills, correlating well with performance at MRCP(UK) and MRCGP. PLAB graduates' knowledge and skills at MRCP(UK) and MRCGP are over one standard deviation below those of UK graduates, although differences in training quality cannot be taken into account. Equivalent performance in MRCGP(UK) and MRCGP would occur if the pass marks of PLAB1 and PLAB2 were raised considerably, but that would also reduce the pass rate, with implications for medical workforce planning. Increasing IELTS requirements would have less impact on equivalence than raising PLAB pass marks.

PLAB and UK graduates’ performance on MRCP(UK) and MRCGP examinations: data linkage study

PubMed Central

Wakeford, Richard

2014-01-01

Objectives To assess whether international medical graduates passing the two examinations set by the Professional and Linguistic Assessments Board (PLAB1 and PLAB2) of the General Medical Council (GMC) are equivalent to UK graduates at the end of the first foundation year of medical training (F1), as the GMC requires, and if not, to assess what changes in the PLAB pass marks might produce equivalence. Design Data linkage of GMC PLAB performance data with data from the Royal Colleges of Physicians and the Royal College of General Practitioners on performance of PLAB graduates and UK graduates at the MRCP(UK) and MRCGP examinations. Setting Doctors in training for internal medicine or general practice in the United Kingdom. Participants 7829, 5135, and 4387 PLAB graduates on their first attempt at MRCP(UK) Part 1, Part 2, and PACES assessments from 2001 to 2012 compared with 18 532, 14 094, and 14 376 UK graduates taking the same assessments; 3160 PLAB1 graduates making their first attempt at the MRCGP AKT during 2007-12 compared with 14 235 UK graduates; and 1411 PLAB2 graduates making their first attempt at the MRCGP CSA during 2010-12 compared with 6935 UK graduates. Main outcome measures Performance at MRCP(UK) Part 1, Part 2, and PACES assessments, and MRCGP AKT and CSA assessments in relation to performance on PLAB1 and PLAB2 assessments, as well as to International English Language Testing System (IELTS) scores. MRCP(UK), MRCGP, and PLAB results were analysed as marks relative to the pass mark at the first attempt. Results PLAB1 marks were a valid predictor of MRCP(UK) Part 1, MRCP(UK) Part 2, and MRCGP AKT (r=0.521, 0.390, and 0.490; all P<0.001). PLAB2 marks correlated with MRCP(UK) PACES and MRCGP CSA (r=0.274, 0.321; both P<0.001). PLAB graduates had significantly lower MRCP(UK) and MRCGP assessments (Glass’s Δ=0.94, 0.91, 1.40, 1.01, and 1.82 for MRCP(UK) Part 1, Part 2, and PACES and MRCGP AKT and CSA), and were more likely to fail assessments and to progress more slowly than UK medical graduates. IELTS scores correlated significantly with later performance, multiple regression showing that the effect of PLAB1 (β=0.496) was much stronger than the effect of IELTS (β=0.086). Changes to PLAB pass marks that would result in international medical graduate and UK medical graduate equivalence were assessed in two ways. Method 1 adjusted PLAB pass marks to equate median performance of PLAB and UK graduates. Method 2 divided PLAB graduates into 12 equally spaced groups according to PLAB performance, and compared these with mean performance of graduates from individual UK medical schools, assessing which PLAB groups were equivalent in MRCP(UK) and MRCGP performance to UK graduates. The two methods produced similar results. To produce equivalent performance on the MRCP and MRGP examinations, the pass mark for PLAB1 would require raising by about 27 marks (13%) and for PLAB2 by about 15-16 marks (20%) above the present standard. Conclusions PLAB is a valid assessment of medical knowledge and clinical skills, correlating well with performance at MRCP(UK) and MRCGP. PLAB graduates’ knowledge and skills at MRCP(UK) and MRCGP are over one standard deviation below those of UK graduates, although differences in training quality cannot be taken into account. Equivalent performance in MRCGP(UK) and MRCGP would occur if the pass marks of PLAB1 and PLAB2 were raised considerably, but that would also reduce the pass rate, with implications for medical workforce planning. Increasing IELTS requirements would have less impact on equivalence than raising PLAB pass marks. PMID:24742473

Iranian Expert Opinion about Necessary Criteria for Hospitals Management Performance Assessments

PubMed Central

Dadgar, Elham; Janati, Ali; Tabrizi, Jafar Sadegh; Asghari-Jafarabadi, Mohammad; Barati, Omid

2012-01-01

Background: Managers in the hospital should have enough managerial skill to be coordinated with the complex environment. Defining a competency framework assessment for hospital man-agement will help to establish core competencies for hospital managers. The aim of this study was to develop concrete and suitable performance assessment criteria using expert's view. Methods: In this qualitative study in total, 20 professionals participated in the interview and Fo¬cus Group Discussions (FGD). Two of informants were interviewed and 18 professionals par¬ticipants in three focus group discussions. Discussions and interviews were well planned, the FGD environments were suitable and after interviews completion the notes were checked with participant for completeness. Thematic analysis method was used for the analysis of qualitative data. Results: Findings from 3 FGDs and 2 semi structured interviews done with 20 professionals were categorized accordance to themes. The findings were classified in 7 major and 41 sub themes. The major themes include competency related to planning, organization and staff per-formance management, leadership, information management, and clinical governance and per-formance indicators. Conclusion: All participants had hospital administration experience; so their explanation impor¬tant in identifying the criteria and developing hospital managers’ performance assessment tool. In addition to professional perspectives and studies done in other countries, in order to design this kind of tools, it is necessary to adopt the obtained findings to the local hospital conditions. PMID:24688938

Assessment of repeatability of composition of perfumed waters by high-performance liquid chromatography combined with numerical data analysis based on cluster analysis (HPLC UV/VIS - CA).

PubMed

Ruzik, L; Obarski, N; Papierz, A; Mojski, M

2015-06-01

High-performance liquid chromatography (HPLC) with UV/VIS spectrophotometric detection combined with the chemometric method of cluster analysis (CA) was used for the assessment of repeatability of composition of nine types of perfumed waters. In addition, the chromatographic method of separating components of the perfume waters under analysis was subjected to an optimization procedure. The chromatograms thus obtained were used as sources of data for the chemometric method of cluster analysis (CA). The result was a classification of a set comprising 39 perfumed water samples with a similar composition at a specified level of probability (level of agglomeration). A comparison of the classification with the manufacturer's declarations reveals a good degree of consistency and demonstrates similarity between samples in different classes. A combination of the chromatographic method with cluster analysis (HPLC UV/VIS - CA) makes it possible to quickly assess the repeatability of composition of perfumed waters at selected levels of probability. © 2014 Society of Cosmetic Scientists and the Société Française de Cosmétologie.

The practical application of signal detection theory to image quality assessment in x-ray image intensifier-TV fluoroscopy.

PubMed

Marshall, N W

2001-06-01

This paper applies a published version of signal detection theory to x-ray image intensifier fluoroscopy data and compares the results with more conventional subjective image quality measures. An eight-bit digital framestore was used to acquire temporally contiguous frames of fluoroscopy data from which the modulation transfer function (MTF(u)) and noise power spectrum were established. These parameters were then combined to give detective quantum efficiency (DQE(u)) and used in conjunction with signal detection theory to calculate contrast-detail performance. DQE(u) was found to lie between 0.1 and 0.5 for a range of fluoroscopy systems. Two separate image quality experiments were then performed in order to assess the correspondence between the objective and subjective methods. First, image quality for a given fluoroscopy system was studied as a function of doserate using objective parameters and a standard subjective contrast-detail method. Following this, the two approaches were used to assess three different fluoroscopy units. Agreement between objective and subjective methods was good; doserate changes were modelled correctly while both methods ranked the three systems consistently.

Body composition and size in sprint athletes.

PubMed

Barbieri, Davide; Zaccagni, Luciana; Babić, Vesna; Rakovac, Marija; Mišigoj-Duraković, Marjeta; Gualdi-Russo, Emanuela

2017-09-01

The aims of the present study were to assess competitive sprinters' body size and composition and to determine their impact on performance. Ninety-eight competitive male sprinters (100 m) participated in this cross-sectional study. A series of measurements was directly taken and data on muscular strength and power tests were self-reported. Body composition was assessed by skinfold method and somatotype was calculated by the Heath-Carter anthropometric method. Sprinters were classified into three groups depending on their personal best time and comparisons were performed between the athletes in the top and in the bottom tertiles. Relationships between anthropometric traits and performance were assessed by Pearson's correlation coefficients. Top sprinters had significantly greater body mass index, relaxed and contracted upper arm girths, thigh and calf girths, fat free mass and fat free mass index, and lower ectomorphy than the lowest tertile. Strength and power were significantly higher. Personal best time was significantly correlated with several anthropometric traits and indices of lean body mass. Body size, composition and somatotype differ between performance levels in speed running. Being less ectomorphic, with a greater fat free mass and strength, can explain significant differences in sprinting performances. The results presented in this study provide a point of reference about sprinter characteristics, which can help coaches and sport scientists to improve sprinter performance.

ASSESSMENT OF ATTENTION THRESHOLD IN RATS BY TITRATION OF VISUAL CUE DURATION DURING THE FIVE CHOICE SERIAL REACTION TIME TASK

PubMed Central

Martin, Thomas J.; Grigg, Amanda; Kim, Susy A.; Ririe, Douglas G.; Eisenach, James C.

2014-01-01

Background The 5 choice serial reaction time task (5CSRTT) is commonly used to assess attention in rodents. We sought to develop a variant of the 5CSRTT that would speed training to objective success criteria, and to test whether this variant could determine attention capability in each subject. New Method Fisher 344 rats were trained to perform a variant of the 5CSRTT in which the duration of visual cue presentation (cue duration) was titrated between trials based upon performance. The cue duration was decreased when the subject made a correct response, or increased with incorrect responses or omissions. Additionally, test day challenges were provided consisting of lengthening the intertrial interval and inclusion of a visual distracting stimulus. Results Rats readily titrated the cue duration to less than 1 sec in 25 training sessions or less (mean ± SEM, 22.9 ± 0.7), and the median cue duration (MCD) was calculated as a measure of attention threshold. Increasing the intertrial interval increased premature responses, decreased the number of trials completed, and increased the MCD. Decreasing the intertrial interval and time allotted for consuming the food reward demonstrated that a minimum of 3.5 sec is required for rats to consume two food pellets and successfully attend to the next trial. Visual distraction in the form of a 3 Hz flashing light increased the MCD and both premature and time out responses. Comparison with existing method The titration variant of the 5CSRTT is a useful method that dynamically measures attention threshold across a wide range of subject performance, and significantly decreases the time required for training. Task challenges produce similar effects in the titration method as reported for the classical procedure. Conclusions The titration 5CSRTT method is an efficient training procedure for assessing attention and can be utilized to assess the limit in performance ability across subjects and various schedule manipulations. PMID:25528113

Proposal of an environmental performance index to assess solid waste treatment technologies

DOE Office of Scientific and Technical Information (OSTI.GOV)

Goulart Coelho, Hosmanny Mauro, E-mail: hosmanny@hotmail.com; Lange, Lisete Celina; Coelho, Lineker Max Goulart

2012-07-15

Highlights: Black-Right-Pointing-Pointer Proposal of a new concept in waste management: Cleaner Treatment. Black-Right-Pointing-Pointer Development of an index to assess quantitatively waste treatment technologies. Black-Right-Pointing-Pointer Delphi Method was carried out so as to define environmental indicators. Black-Right-Pointing-Pointer Environmental performance evaluation of waste-to-energy plants. - Abstract: Although the concern with sustainable development and environment protection has considerably grown in the last years it is noted that the majority of decision making models and tools are still either excessively tied to economic aspects or geared to the production process. Moreover, existing models focus on the priority steps of solid waste management, beyond wastemore » energy recovery and disposal. So, in order to help the lack of models and tools aiming at the waste treatment and final disposal, a new concept is proposed: the Cleaner Treatment, which is based on the Cleaner Production principles. This paper focuses on the development and validation of the Cleaner Treatment Index (CTI), to assess environmental performance of waste treatment technologies based on the Cleaner Treatment concept. The index is formed by aggregation (summation or product) of several indicators that consists in operational parameters. The weights of the indicator were established by Delphi Method and Brazilian Environmental Laws. In addition, sensitivity analyses were carried out comparing both aggregation methods. Finally, index validation was carried out by applying the CTI to 10 waste-to-energy plants data. From sensitivity analysis and validation results it is possible to infer that summation model is the most suitable aggregation method. For summation method, CTI results were superior to 0.5 (in a scale from 0 to 1) for most facilities evaluated. So, this study demonstrates that CTI is a simple and robust tool to assess and compare the environmental performance of different treatment plants being an excellent quantitative tool to support Cleaner Treatment implementation.« less

Performance degradation of helicopter rotor in forward flight due to ice

NASA Technical Reports Server (NTRS)

Korkan, K. D.; Dadone, L.; Shaw, R. J.

1985-01-01

This study addresses the analytical assessment of the degradation in the forward flight performance of the front rotor Boeing Vertol CH47D helicopter in a rime ice natural icing encounter. The front rotor disk was divided into 24 15-deg sections and the local Mach number and angle of attack were evaluated as a function of azimuthal and radial location for a specified flight condition. Profile drag increments were then calculated as a function of azimuthal and radial position for different times of exposure to icing, and the rotor performance was re-evaluated including these drag increments. The results of the analytical prediction method, such as horsepower required to maintain a specific flight condition, as a function of icing time have been generated. The method to illustrate the value of such an approach in assessing performance changes experienced by a helicopter rotor as a result of rime ice accretion is described.

Specification and implementation of IFC based performance metrics to support building life cycle assessment of hybrid energy systems

DOE Office of Scientific and Technical Information (OSTI.GOV)

Morrissey, Elmer; O'Donnell, James; Keane, Marcus

2004-03-29

Minimizing building life cycle energy consumption is becoming of paramount importance. Performance metrics tracking offers a clear and concise manner of relating design intent in a quantitative form. A methodology is discussed for storage and utilization of these performance metrics through an Industry Foundation Classes (IFC) instantiated Building Information Model (BIM). The paper focuses on storage of three sets of performance data from three distinct sources. An example of a performance metrics programming hierarchy is displayed for a heat pump and a solar array. Utilizing the sets of performance data, two discrete performance effectiveness ratios may be computed, thus offeringmore » an accurate method of quantitatively assessing building performance.« less

Holistic rubric vs. analytic rubric for measuring clinical performance levels in medical students.

PubMed

Yune, So Jung; Lee, Sang Yeoup; Im, Sun Ju; Kam, Bee Sung; Baek, Sun Yong

2018-06-05

Task-specific checklists, holistic rubrics, and analytic rubrics are often used for performance assessments. We examined what factors evaluators consider important in holistic scoring of clinical performance assessment, and compared the usefulness of applying holistic and analytic rubrics respectively, and analytic rubrics in addition to task-specific checklists based on traditional standards. We compared the usefulness of a holistic rubric versus an analytic rubric in effectively measuring the clinical skill performances of 126 third-year medical students who participated in a clinical performance assessment conducted by Pusan National University School of Medicine. We conducted a questionnaire survey of 37 evaluators who used all three evaluation methods-holistic rubric, analytic rubric, and task-specific checklist-for each student. The relationship between the scores on the three evaluation methods was analyzed using Pearson's correlation. Inter-rater agreement was analyzed by Kappa index. The effect of holistic and analytic rubric scores on the task-specific checklist score was analyzed using multiple regression analysis. Evaluators perceived accuracy and proficiency to be major factors in objective structured clinical examinations evaluation, and history taking and physical examination to be major factors in clinical performance examinations evaluation. Holistic rubric scores were highly related to the scores of the task-specific checklist and analytic rubric. Relatively low agreement was found in clinical performance examinations compared to objective structured clinical examinations. Meanwhile, the holistic and analytic rubric scores explained 59.1% of the task-specific checklist score in objective structured clinical examinations and 51.6% in clinical performance examinations. The results show the usefulness of holistic and analytic rubrics in clinical performance assessment, which can be used in conjunction with task-specific checklists for more efficient evaluation.

Environmental impact assessment and eco-friendly decision-making in civil structures.

PubMed

Kim, Sang-Hyo; Choi, Moon-Seock; Mha, Ho-Seong; Joung, Jung-Yeun

2013-09-15

This study develops two useful procedures in performing an environmental-impact assessment. One is the advanced life-cycle assessment (LCA) method, which effectively tracks the flow of materials and considers the recycling and demolition of a civil structure. The other is an eco-friendly decision-making procedure, which may effectively apply when determining the prototype of a civil structure. The advanced LCA method differs from traditional LCA procedure, as it classifies the input material prior to the impact assessment. Classification work is performed to establish independent life-cycle stages for each material. The processes of recycling and demolition are appropriately added to the life-cycle stages. The impact assessment is performed separately for the materials, and results are aggregated at the end of the analysis. The eco-friendly decision-making procedure enables designers to choose an economical, and environmentally friendly, alternative during the planning phase of the construction project. This procedure rationally amalgamates economical value and environmental effects into a single indicator. The life cycle cost (LCC) of a structure can be analysed by using conventional LCC tools, whereas the environmental impact is estimated by LCA. The results from LCC and LCA are then integrated by using either a CO2 conversion method or an analytical hierarchy process (AHP). The CO2 conversion method presents the result as a monetary value, whereas the AHP presents the result as a non-dimensional value. A practical example using a steel box girder bridge and a pre-stressed concrete (PSC) box-girder bridge is also given in order to aid the understanding of the presented procedure. Copyright © 2013 Elsevier Ltd. All rights reserved.

Assessing the surgical skills of trainees in the operating theatre: a prospective observational study of the methodology.

PubMed

Beard, J D; Marriott, J; Purdie, H; Crossley, J

2011-01-01

To compare user satisfaction and acceptability, reliability and validity of three different methods of assessing the surgical skills of trainees by direct observation in the operating theatre across a range of different surgical specialties and index procedures. A 2-year prospective, observational study in the operating theatres of three teaching hospitals in Sheffield. The assessment methods were procedure-based assessment (PBA), Objective Structured Assessment of Technical Skills (OSATS) and Non-technical Skills for Surgeons (NOTSS). The specialties were obstetrics and gynaecology (O&G) and upper gastrointestinal, colorectal, cardiac, vascular and orthopaedic surgery. Two to four typical index procedures were selected from each specialty. Surgical trainees were directly observed performing typical index procedures and assessed using a combination of two of the three methods (OSATS or PBA and NOTSS for O&G, PBA and NOTSS for the other specialties) by the consultant clinical supervisor for the case and the anaesthetist and/or scrub nurse, as well as one or more independent assessors from the research team. Information on user satisfaction and acceptability of each assessment method from both assessor and trainee perspectives was obtained from structured questionnaires. The reliability of each method was measured using generalisability theory. Aspects of validity included the internal structure of each tool and correlation between tools, construct validity, predictive validity, interprocedural differences, the effect of assessor designation and the effect of assessment on performance. Of the 558 patients who were consented, a total of 437 (78%) cases were included in the study: 51 consultant clinical supervisors, 56 anaesthetists, 39 nurses, 2 surgical care practitioners and 4 independent assessors provided 1635 assessments on 85 trainees undertaking the 437 cases. A total of 749 PBAs, 695 NOTSS and 191 OSATSs were performed. Non-O&G clinical supervisors and trainees provided mixed, but predominantly positive, responses about a range of applications of PBA. Most felt that PBA was important in surgical education, and would use it again in the future and did not feel that it added time to the operating list. The overall satisfaction of O&G clinical supervisors and trainees with OSATS was not as high, and a majority of those who used both preferred PBA. A majority of anaesthetists and nurses felt that NOTSS allowed them to rate interpersonal skills (communication, teamwork and leadership) more easily than cognitive skills (situation awareness and decision-making), that it had formative value and that it was a valuable adjunct to the assessment of technical skills. PBA demonstrated high reliability (G > 0.8 for only three assessor judgements on the same index procedure). OSATS had lower reliability (G > 0.8 for five assessor judgements on the same index procedure). Both were less reliable on a mix of procedures because of strong procedure-specific factors. A direct comparison of PBA between O&G and non-O&G cases showed a striking difference in reliability. Within O&G, a good level of reliability (G > 0.8) could not be obtained using a feasible number of assessments. Conversely, the reliability within non-O&G cases was exceptionally high, with only two assessor judgements being required. The reasons for this difference probably include the more summative purpose of assessment in O&G and the much higher proportion of O&G trainees in this study with training concerns (42% vs 4%). The reliability of NOTSS was lower than that for PBA. Reliability for the same procedure (G > 0.8) required six assessor judgements. However, as procedure-specific factors exerted a lesser influence on NOTSS, reliability on a mix of procedures could be achieved using only eight assessor judgements. NOTSS also demonstrated a valid internal structure. The strongest correlations between NOTSS and PBA or OSATS were in the 'decision-making' domain. PBA and NOTSS showed better construct validity than OSATS, the year of training and the number of recent index procedures performed being significant independent predictors of performance. There was little variation in scoring between different procedures or different designations of assessor. The results suggest that PBA is a reliable and acceptable method of assessing surgical skills, with good construct validity. Specialties that use OSATS may wish to consider changing the design or switching to PBA. Whatever workplace-based assessment method is used, the purpose, timing and frequency of assessment require detailed guidance. NOTSS is a promising tool for the assessment of non-technical skills, and surgical specialties may wish to consider its inclusion in their assessment framework. Further research is required into the use of health-care professionals other than consultant surgeons to assess trainees, the relationship between performance and experience, the educational impact of assessment and the additional value of video recording.

The Arthroscopic Surgical Skill Evaluation Tool (ASSET)

PubMed Central

Koehler, Ryan J.; Amsdell, Simon; Arendt, Elizabeth A; Bisson, Leslie J; Braman, Jonathan P; Butler, Aaron; Cosgarea, Andrew J; Harner, Christopher D; Garrett, William E; Olson, Tyson; Warme, Winston J.; Nicandri, Gregg T.

2014-01-01

Background Surgeries employing arthroscopic techniques are among the most commonly performed in orthopaedic clinical practice however, valid and reliable methods of assessing the arthroscopic skill of orthopaedic surgeons are lacking. Hypothesis The Arthroscopic Surgery Skill Evaluation Tool (ASSET) will demonstrate content validity, concurrent criterion-oriented validity, and reliability, when used to assess the technical ability of surgeons performing diagnostic knee arthroscopy on cadaveric specimens. Study Design Cross-sectional study; Level of evidence, 3 Methods Content validity was determined by a group of seven experts using a Delphi process. Intra-articular performance of a right and left diagnostic knee arthroscopy was recorded for twenty-eight residents and two sports medicine fellowship trained attending surgeons. Subject performance was assessed by two blinded raters using the ASSET. Concurrent criterion-oriented validity, inter-rater reliability, and test-retest reliability were evaluated. Results Content validity: The content development group identified 8 arthroscopic skill domains to evaluate using the ASSET. Concurrent criterion-oriented validity: Significant differences in total ASSET score (p<0.05) between novice, intermediate, and advanced experience groups were identified. Inter-rater reliability: The ASSET scores assigned by each rater were strongly correlated (r=0.91, p <0.01) and the intra-class correlation coefficient between raters for the total ASSET score was 0.90. Test-retest reliability: there was a significant correlation between ASSET scores for both procedures attempted by each individual (r = 0.79, p<0.01). Conclusion The ASSET appears to be a useful, valid, and reliable method for assessing surgeon performance of diagnostic knee arthroscopy in cadaveric specimens. Studies are ongoing to determine its generalizability to other procedures as well as to the live OR and other simulated environments. PMID:23548808

Spiral and Project-Based Learning with Peer Assessment in a Computer Science Project Management Course

NASA Astrophysics Data System (ADS)

Jaime, Arturo; Blanco, José Miguel; Domínguez, César; Sánchez, Ana; Heras, Jónathan; Usandizaga, Imanol

2016-06-01

Different learning methods such as project-based learning, spiral learning and peer assessment have been implemented in science disciplines with different outcomes. This paper presents a proposal for a project management course in the context of a computer science degree. Our proposal combines three well-known methods: project-based learning, spiral learning and peer assessment. Namely, the course is articulated during a semester through the structured (progressive and incremental) development of a sequence of four projects, whose duration, scope and difficulty of management increase as the student gains theoretical and instrumental knowledge related to planning, monitoring and controlling projects. Moreover, the proposal is complemented using peer assessment. The proposal has already been implemented and validated for the last 3 years in two different universities. In the first year, project-based learning and spiral learning methods were combined. Such a combination was also employed in the other 2 years; but additionally, students had the opportunity to assess projects developed by university partners and by students of the other university. A total of 154 students have participated in the study. We obtain a gain in the quality of the subsequently projects derived from the spiral project-based learning. Moreover, this gain is significantly bigger when peer assessment is introduced. In addition, high-performance students take advantage of peer assessment from the first moment, whereas the improvement in poor-performance students is delayed.

Normative Data for an Instrumental Assessment of the Upper-Limb Functionality.

PubMed

Caimmi, Marco; Guanziroli, Eleonora; Malosio, Matteo; Pedrocchi, Nicola; Vicentini, Federico; Molinari Tosatti, Lorenzo; Molteni, Franco

2015-01-01

Upper-limb movement analysis is important to monitor objectively rehabilitation interventions, contributing to improving the overall treatments outcomes. Simple, fast, easy-to-use, and applicable methods are required to allow routinely functional evaluation of patients with different pathologies and clinical conditions. This paper describes the Reaching and Hand-to-Mouth Evaluation Method, a fast procedure to assess the upper-limb motor control and functional ability, providing a set of normative data from 42 healthy subjects of different ages, evaluated for both the dominant and the nondominant limb motor performance. Sixteen of them were reevaluated after two weeks to perform test-retest reliability analysis. Data were clustered into three subgroups of different ages to test the method sensitivity to motor control differences. Experimental data show notable test-retest reliability in all tasks. Data from older and younger subjects show significant differences in the measures related to the ability for coordination thus showing the high sensitivity of the method to motor control differences. The presented method, provided with control data from healthy subjects, appears to be a suitable and reliable tool for the upper-limb functional assessment in the clinical environment.

Normative Data for an Instrumental Assessment of the Upper-Limb Functionality

PubMed Central

Caimmi, Marco; Guanziroli, Eleonora; Malosio, Matteo; Pedrocchi, Nicola; Vicentini, Federico; Molinari Tosatti, Lorenzo; Molteni, Franco

2015-01-01

Upper-limb movement analysis is important to monitor objectively rehabilitation interventions, contributing to improving the overall treatments outcomes. Simple, fast, easy-to-use, and applicable methods are required to allow routinely functional evaluation of patients with different pathologies and clinical conditions. This paper describes the Reaching and Hand-to-Mouth Evaluation Method, a fast procedure to assess the upper-limb motor control and functional ability, providing a set of normative data from 42 healthy subjects of different ages, evaluated for both the dominant and the nondominant limb motor performance. Sixteen of them were reevaluated after two weeks to perform test-retest reliability analysis. Data were clustered into three subgroups of different ages to test the method sensitivity to motor control differences. Experimental data show notable test-retest reliability in all tasks. Data from older and younger subjects show significant differences in the measures related to the ability for coordination thus showing the high sensitivity of the method to motor control differences. The presented method, provided with control data from healthy subjects, appears to be a suitable and reliable tool for the upper-limb functional assessment in the clinical environment. PMID:26539500

Subjective global assessment of nutritional status – A systematic review of the literature.

PubMed

da Silva Fink, Jaqueline; Daniel de Mello, Paula; Daniel de Mello, Elza

2015-10-01

Subjective Global Assessment (SGA) is a nutritional assessment tool widely used in hospital clinical practice, even though it is not exempted of limitations in relation to its use. This systematic review intended to update knowledge on the performance of SGA as a method for the assessment of the nutritional status of hospitalized adults. PubMed data base was consulted, using the search term "subjective global assessment". Studies published in English, Portuguese or Spanish, between 2002 and 2012 were selected, excluding those not found in full, letters to the editor, pilot studies, narrative reviews, studies with n < 30, studies with population younger than 18 years of age, research with non-hospitalized populations or those which used a modified version of the SGA. Of 454 eligible studies, 110 presented eligibility criteria. After applying the exclusion criteria, 21 studies were selected, 6 with surgical patients, 7 with clinical patients, and 8 with both. Most studies demonstrated SGA performance similar or better than the usual assessment methods for nutritional status, such as anthropometry and laboratory data, but the same result was not found when comparing SGA and nutritional screening methods. Recently published literature demonstrates SGA as a valid tool for the nutritional diagnosis of hospitalized clinical and surgical patients, and point to a potential superiority of nutritional screening methods in the early detection of malnutrition. Copyright © 2014 Elsevier Ltd and European Society for Clinical Nutrition and Metabolism. All rights reserved.

A knowledge-driven probabilistic framework for the prediction of protein-protein interaction networks.

PubMed

Browne, Fiona; Wang, Haiying; Zheng, Huiru; Azuaje, Francisco

2010-03-01

This study applied a knowledge-driven data integration framework for the inference of protein-protein interactions (PPI). Evidence from diverse genomic features is integrated using a knowledge-driven Bayesian network (KD-BN). Receiver operating characteristic (ROC) curves may not be the optimal assessment method to evaluate a classifier's performance in PPI prediction as the majority of the area under the curve (AUC) may not represent biologically meaningful results. It may be of benefit to interpret the AUC of a partial ROC curve whereby biologically interesting results are represented. Therefore, the novel application of the assessment method referred to as the partial ROC has been employed in this study to assess predictive performance of PPI predictions along with calculating the True positive/false positive rate and true positive/positive rate. By incorporating domain knowledge into the construction of the KD-BN, we demonstrate improvement in predictive performance compared with previous studies based upon the Naive Bayesian approach. Copyright (c) 2010 Elsevier Ltd. All rights reserved.

DEVELOPMENT OF A PHYSICAL PERFORMANCE ASSESSMENT CHECKLIST FOR ATHLETES WHO SUSTAINED A LOWER EXTREMITY INJURY IN PREPARATION FOR RETURN TO SPORT: A DELPHI STUDY

PubMed Central

Haines, Sara; Baker, Tricia

2013-01-01

Purpose/Background: To develop a consensus on the critical constructs necessary to be included in a physical performance assessment checklist (PPAC) to assess an athlete's ability for return to sport following a lower extremity injury. Methods: The study used a 3‐round Delphi method to finalize the PPAI originally developed by a panel of experts. Fourteen Delphi representative sample participants were randomly derived from the authors of peer‐reviewed publications of lower extremity injuries. Nine participants completed all 3 rounds. Results: Throughout the 3 rounds, the 10 initial constructs were modified and revised to produce the finalized PPAC consisting of 12 constructs necessary to consider for an athlete's return to sport after a lower extremity injury. Conclusions: This instrument can be used as a checklist to advocate for prospective batteries of physical performance tests to incorporate the elements identified by this study. Level of Evidence: 5 PMID:23439809

The MIMIC Method with Scale Purification for Detecting Differential Item Functioning

ERIC Educational Resources Information Center

Wang, Wen-Chung; Shih, Ching-Lin; Yang, Chih-Chien

2009-01-01

This study implements a scale purification procedure onto the standard MIMIC method for differential item functioning (DIF) detection and assesses its performance through a series of simulations. It is found that the MIMIC method with scale purification (denoted as M-SP) outperforms the standard MIMIC method (denoted as M-ST) in controlling…

Entropy and generalized least square methods in assessment of the regional value of streamgages

USGS Publications Warehouse

Markus, M.; Vernon, Knapp H.; Tasker, Gary D.

2003-01-01

The Illinois State Water Survey performed a study to assess the streamgaging network in the State of Illinois. One of the important aspects of the study was to assess the regional value of each station through an assessment of the information transfer among gaging records for low, average, and high flow conditions. This analysis was performed for the main hydrologic regions in the State, and the stations were initially evaluated using a new approach based on entropy analysis. To determine the regional value of each station within a region, several information parameters, including total net information, were defined based on entropy. Stations were ranked based on the total net information. For comparison, the regional value of the same stations was assessed using the generalized least square regression (GLS) method, developed by the US Geological Survey. Finally, a hybrid combination of GLS and entropy was created by including a function of the negative net information as a penalty function in the GLS. The weights of the combined model were determined to maximize the average correlation with the results of GLS and entropy. The entropy and GLS methods were evaluated using the high-flow data from southern Illinois stations. The combined method was compared with the entropy and GLS approaches using the high-flow data from eastern Illinois stations. ?? 2003 Elsevier B.V. All rights reserved.

GeneNetWeaver: in silico benchmark generation and performance profiling of network inference methods.

PubMed

Schaffter, Thomas; Marbach, Daniel; Floreano, Dario

2011-08-15

Over the last decade, numerous methods have been developed for inference of regulatory networks from gene expression data. However, accurate and systematic evaluation of these methods is hampered by the difficulty of constructing adequate benchmarks and the lack of tools for a differentiated analysis of network predictions on such benchmarks. Here, we describe a novel and comprehensive method for in silico benchmark generation and performance profiling of network inference methods available to the community as an open-source software called GeneNetWeaver (GNW). In addition to the generation of detailed dynamical models of gene regulatory networks to be used as benchmarks, GNW provides a network motif analysis that reveals systematic prediction errors, thereby indicating potential ways of improving inference methods. The accuracy of network inference methods is evaluated using standard metrics such as precision-recall and receiver operating characteristic curves. We show how GNW can be used to assess the performance and identify the strengths and weaknesses of six inference methods. Furthermore, we used GNW to provide the international Dialogue for Reverse Engineering Assessments and Methods (DREAM) competition with three network inference challenges (DREAM3, DREAM4 and DREAM5). GNW is available at http://gnw.sourceforge.net along with its Java source code, user manual and supporting data. Supplementary data are available at Bioinformatics online. dario.floreano@epfl.ch.

Impact of missing data imputation methods on gene expression clustering and classification.

PubMed

de Souto, Marcilio C P; Jaskowiak, Pablo A; Costa, Ivan G

2015-02-26

Several missing value imputation methods for gene expression data have been proposed in the literature. In the past few years, researchers have been putting a great deal of effort into presenting systematic evaluations of the different imputation algorithms. Initially, most algorithms were assessed with an emphasis on the accuracy of the imputation, using metrics such as the root mean squared error. However, it has become clear that the success of the estimation of the expression value should be evaluated in more practical terms as well. One can consider, for example, the ability of the method to preserve the significant genes in the dataset, or its discriminative/predictive power for classification/clustering purposes. We performed a broad analysis of the impact of five well-known missing value imputation methods on three clustering and four classification methods, in the context of 12 cancer gene expression datasets. We employed a statistical framework, for the first time in this field, to assess whether different imputation methods improve the performance of the clustering/classification methods. Our results suggest that the imputation methods evaluated have a minor impact on the classification and downstream clustering analyses. Simple methods such as replacing the missing values by mean or the median values performed as well as more complex strategies. The datasets analyzed in this study are available at http://costalab.org/Imputation/ .

The impact of various assessment parameters on medical students’ performance in first professional examination in physiology

PubMed Central

Adeniyi, Olasupo Stephen; Ogli, Sunday Adakole; Ojabo, Cecelia Omaile; Musa, Danladi Ibrahim

2013-01-01

Background: This study was carried out to assess the relationship between thevarious assessment parameters, viz. continuous assessment (CA), multiple choice questions (MCQ), essay, practical, oral with the overall performance in the first professional examination in Physiology. Materials and Methods: The results of all 244 students that sat for the examination over 4 years were used. The CA, MCQ, essay, practical, oral and overall performance scores were obtained. All the scores were rounded up to 100% to give each parameter equal weighting. Results: Analysis showed that the average overall performance was 50.8 ± 5.3. The best average performance was in practical (55.5 ± 9.1), while the least was in MCQ (44.1 ± 7.8). In the study, 81.1% of students passed orals, 80.3% passed practical, 72.5% passed CA, 58.6% passed essay, 22.5% passed MCQ and 71.7% of students passed on the overall performance. All assessment parameters significantly correlated with overall performance. Continuous assessment had the best correlation (r = 0.801, P = 0.000), while oral had the least correlation (r = 0.277, P = 0.000) with overall performance. Essay was the best predictor of overall performance (β = 0.421, P = 000), followed by MCQ (β = 0.356, P = 000), while practical was the least predictor of performance (β = 0.162, P = 000). Conclusion: We suggest that the department should uphold the principle of continuous assessment and more effort be made in the design of MCQ so that performance can improve. PMID:24403705

Mixed Methods Design Study Investigating the Use of a Music Authentic Performance Assessment Tool by High School Band Directors to Measure Student Musical Growth

ERIC Educational Resources Information Center

Beason, Christine F.

2017-01-01

This research project was designed to determine if the Model Cornerstone Assessment for Performance, Proficient level, published by the National Association for Music Education would be an appropriate tool to use to demonstrate student growth as one element of teacher evaluations, specifically the T-TESS. This study focused on four main research…

The learning of aquaponics practice in university

NASA Astrophysics Data System (ADS)

Agustina, T. W.; Rustaman, N. Y.; Riandi; Purwianingsih, W.

2018-05-01

This study aims to obtain a description of the perfomance capabilities of aquaponic technology and the assessment of product and packaging of harvest kale. The aquaponic practice used a STREAM (Science Technology Religion Art Matematics) approach. The method was explanatory sequential mixed method. The research was conducted on one class of Biology Education students in 6th semester. The sample was chosen purposively with 49 students. The study instruments are student worksheet, observation sheet, rubric performance and product assessment, interview sheet and field notes. The indicator of performance rubrics on the manufacture of aquaponic technology consisted of the product rubric, cultivation criteria and packing method of kale. The interview rubric is in the form of student constraints on the manufacture of aquaponics. Based on the results, most students have performance in designing technology that is categorized as enough up to good. Almost all students produce a very good kale harvest. Most of the students produce kale packaging products that are categorized as enough. The implications of this research are the learning of aquaponic with the STREAM approach can equip student’s performance and product capabilities.

Emergency medicine resident crisis resource management ability: a simulation-based longitudinal study

PubMed Central

Clarke, Samuel; Horeczko, Timothy; Carlisle, Matthew; Barton, Joseph D.; Ng, Vivienne; Al-Somali, Sameerah; Bair, Aaron E.

2014-01-01

Background Simulation has been identified as a means of assessing resident physicians’ mastery of technical skills, but there is a lack of evidence for its utility in longitudinal assessments of residents’ non-technical clinical abilities. We evaluated the growth of crisis resource management (CRM) skills in the simulation setting using a validated tool, the Ottawa Crisis Resource Management Global Rating Scale (Ottawa GRS). We hypothesized that the Ottawa GRS would reflect progressive growth of CRM ability throughout residency. Methods Forty-five emergency medicine residents were tracked with annual simulation assessments between 2006 and 2011. We used mixed-methods repeated-measures regression analyses to evaluate elements of the Ottawa GRS by level of training to predict performance growth throughout a 3-year residency. Results Ottawa GRS scores increased over time, and the domains of leadership, problem solving, and resource utilization, in particular, were predictive of overall performance. There was a significant gain in all Ottawa GRS components between postgraduate years 1 and 2, but no significant difference in GRS performance between years 2 and 3. Conclusions In summary, CRM skills are progressive abilities, and simulation is a useful modality for tracking their development. Modification of this tool may be needed to assess advanced learners’ gains in performance. PMID:25499769

The Effect of Initial Knee Angle on Concentric-Only Squat Jump Performance

ERIC Educational Resources Information Center

Mitchell, Lachlan J.; Argus, Christos K.; Taylor, Kristie-Lee; Sheppard, Jeremy M.; Chapman, Dale W.

2017-01-01

Purpose: There is uncertainty as to which knee angle during a squat jump (SJ) produces maximal jump performance. Importantly, understanding this information will aid in determining appropriate ratios for assessment and monitoring of the explosive characteristics of athletes. Method: This study compared SJ performance across different knee…

The Testing Methods and Gender Differences in Multiple-Choice Assessment

NASA Astrophysics Data System (ADS)

Ng, Annie W. Y.; Chan, Alan H. S.

2009-10-01

This paper provides a comprehensive review of the multiple-choice assessment in the past two decades for facilitating people to conduct effective testing in various subject areas. It was revealed that a variety of multiple-choice test methods viz. conventional multiple-choice, liberal multiple-choice, elimination testing, confidence marking, probability testing, and order-of-preference scheme are available for use in assessing subjects' knowledge and decision ability. However, the best multiple-choice test method for use has not yet been identified. The review also indicated that the existence of gender differences in multiple-choice task performance might be due to the test area, instruction/scoring condition, and item difficulty.

Errors Using Observational Methods for Ergonomics Assessment in Real Practice.

PubMed

Diego-Mas, Jose-Antonio; Alcaide-Marzal, Jorge; Poveda-Bautista, Rocio

2017-12-01

The degree in which practitioners use the observational methods for musculoskeletal disorder risks assessment correctly was evaluated. Ergonomics assessment is a key issue for the prevention and reduction of work-related musculoskeletal disorders in workplaces. Observational assessment methods appear to be better matched to the needs of practitioners than direct measurement methods, and for this reason, they are the most widely used techniques in real work situations. Despite the simplicity of observational methods, those responsible for assessing risks using these techniques should have some experience and know-how in order to be able to use them correctly. We analyzed 442 risk assessments of actual jobs carried out by 290 professionals from 20 countries to determine their reliability. The results show that approximately 30% of the assessments performed by practitioners had errors. In 13% of the assessments, the errors were severe and completely invalidated the results of the evaluation. Despite the simplicity of observational method, approximately 1 out of 3 assessments conducted by practitioners in actual work situations do not adequately evaluate the level of potential musculoskeletal disorder risks. This study reveals a problem that suggests greater effort is needed to ensure that practitioners possess better knowledge of the techniques used to assess work-related musculoskeletal disorder risks and that laws and regulations should be stricter as regards qualifications and skills required by professionals.

The Coordinators of Psychiatric Education (COPE) Residency In-Training Exam: A Preliminary Psychometric Assessment

ERIC Educational Resources Information Center

Montgomery, Gregory P. J.; Crockford, David N.; Hecker, Kent

2010-01-01

Objective: The Coordinators of Psychiatric Education (COPE) Residency In-Training Exam is a formative exam for Canadian psychiatric residents that was reconstructed using assessment best practices. An assessment of psychometric properties was subsequently performed on the exam to ensure preliminary validity and reliability. Methods: An exam…

Assessing Collaborative Learning: Big Data, Analytics and University Futures

ERIC Educational Resources Information Center

Williams, Peter

2017-01-01

Assessment in higher education has focused on the performance of individual students. This focus has been a practical as well as an epistemic one: methods of assessment are constrained by the technology of the day, and in the past they required the completion by individuals under controlled conditions of set-piece academic exercises. Recent…

A Comparison of Self versus Tutor Assessment among Hungarian Undergraduate Business Students

ERIC Educational Resources Information Center

Kun, András István

2016-01-01

This study analyses the self-assessment behaviour and efficiency of 163 undergraduate business students from Hungary. Using various statistical methods, the results support the hypothesis that high-achieving students are more accurate in their pre- and post-examination self-assessments, and also less likely to overestimate their performance, and,…

Assessing Students in Human-to-Agent Settings to Inform Collaborative Problem-Solving Learning

ERIC Educational Resources Information Center

Rosen, Yigal

2017-01-01

In order to understand potential applications of collaborative problem-solving (CPS) assessment tasks, it is necessary to examine empirically the multifaceted student performance that may be distributed across collaboration methods and purposes of the assessment. Ideally, each student should be matched with various types of group members and must…

Leveraging Educational Data Mining for Real-Time Performance Assessment of Scientific Inquiry Skills within Microworlds

ERIC Educational Resources Information Center

Gobert, Janice D.; Sao Pedro, Michael A.; Baker, Ryan S. J. D.; Toto, Ermal; Montalvo, Orlando

2012-01-01

We present "Science Assistments," an interactive environment, which assesses students' inquiry skills as they engage in inquiry using science microworlds. We frame our variables, tasks, assessments, and methods of analyzing data in terms of "evidence-centered design." Specifically, we focus on the "student model," the…

Predicting End-of-Year Achievement Test Performance: A Comparison of Assessment Methods

ERIC Educational Resources Information Center

Kettler, Ryan J.; Elliott, Stephen N.; Kurz, Alexander; Zigmond, Naomi; Lemons, Christopher J.; Kloo, Amanda; Shrago, Jacqueline; Beddow, Peter A.; Williams, Leila; Bruen, Charles; Lupp, Lynda; Farmer, Jeanie; Mosiman, Melanie

2014-01-01

Motivated by the multiple-measures clause of recent federal policy regarding student eligibility for alternate assessments based on modified academic achievement standards (AA-MASs), this study examined how scores or combinations of scores from a diverse set of assessments predicted students' end-of-year proficiency status on statewide achievement…

Investment decisions with the social and environmental impacts of new technology

DOE Office of Scientific and Technical Information (OSTI.GOV)

Evans, D.A.C.

1985-01-01

The purpose of this study was to analyze technology assessment from a finance point of view. Specifically, the study investigated the opinions of firms in the chemical, the computer, and the pharmaceutical industries on technology assessment and the practices they currently use. In addition, it examined the effect of these practices on the financial performances of the firms. Results indicated that the accountability of the firm is the primary explanation for (1) the firm's perceived feasibility of assessing the impacts of new technology, and (2) the firm's emphasis of those impacts in its investment decision. Technology assessment was seen asmore » beneficial because it helped to identify areas of financial and market exposure and to stay in legal compliance. The firms indicated a mistrust of the public and the government. The technology assessment methods used confirmed that assessment is performed as a defensive action. Firms establish the relative importance of their impacts based on the punishment they might face for neglecting them (e.g., government penalties). Likewise, the most selected method of identifying impacts (determining whether the technology will meet government regulation) displays defensiveness.« less

Predicting Airport Screening Officers' Visual Search Competency With a Rapid Assessment.

PubMed

Mitroff, Stephen R; Ericson, Justin M; Sharpe, Benjamin

2018-03-01

Objective The study's objective was to assess a new personnel selection and assessment tool for aviation security screeners. A mobile app was modified to create a tool, and the question was whether it could predict professional screeners' on-job performance. Background A variety of professions (airport security, radiology, the military, etc.) rely on visual search performance-being able to detect targets. Given the importance of such professions, it is necessary to maximize performance, and one means to do so is to select individuals who excel at visual search. A critical question is whether it is possible to predict search competency within a professional search environment. Method Professional searchers from the USA Transportation Security Administration (TSA) completed a rapid assessment on a tablet-based X-ray simulator (XRAY Screener, derived from the mobile technology app Airport Scanner; Kedlin Company). The assessment contained 72 trials that were simulated X-ray images of bags. Participants searched for prohibited items and tapped on them with their finger. Results Performance on the assessment significantly related to on-job performance measures for the TSA officers such that those who were better XRAY Screener performers were both more accurate and faster at the actual airport checkpoint. Conclusion XRAY Screener successfully predicted on-job performance for professional aviation security officers. While questions remain about the underlying cognitive mechanisms, this quick assessment was found to significantly predict on-job success for a task that relies on visual search performance. Application It may be possible to quickly assess an individual's visual search competency, which could help organizations select new hires and assess their current workforce.

Assessing the accuracy and stability of variable selection methods for random forest modeling in ecology

EPA Science Inventory

Random forest (RF) modeling has emerged as an important statistical learning method in ecology due to its exceptional predictive performance. However, for large and complex ecological datasets there is limited guidance on variable selection methods for RF modeling. Typically, e...

RELIABILITY AND VALIDITY OF A MODIFIED ISOMETRIC DYNAMOMETER IN THE ASSESSMENT OF MUSCULAR PERFORMANCE IN INDIVIDUALS WITH ANTERIOR CRUCIATE LIGAMENT RECONSTRUCTION

PubMed Central

de Vasconcelos, Rodrigo Antunes; Bevilaqua-Grossi, Débora; Shimano, Antonio Carlos; Paccola, Cleber Jansen; Salvini, Tânia Fátima; Prado, Christiane Lanatovits; Junior, Wilson A. Mello

2015-01-01

Objectives: The aim of this study was to evaluate the reliability and validity of a modified isometric dynamometer (MID) in performance deficits of the knee extensor and flexor muscles in normal individuals and in those with ACL reconstructions. Methods: Sixty male subjects were invited to participate of the study, being divided into three groups with 20 subjects each: control group (GC), group of individuals with ACL reconstruction with patellar tendon graft (GTP, and group of individuals with ACL reconstruction with hamstrings graft (GTF). All individuals performed isometric tests in the MID, muscular strength deficits collected were subsequently compared to the tests performed on the Biodex System 3 operating in the isometric and isokinetic mode at speeds of 60°/s and 180o/s. Intraclass ICC correlation calculations were done in order to assess MID reliability, specificity, sensitivity and Kappa's consistency coefficient calculations, respectively, for assessing the MID's validity in detecting muscular deficits and intra- and intergroup comparisons when performing the four strength tests using the ANOVA method. Results: The modified isometric dynamometer (MID) showed excellent reliability and good validity in the assessment of the performance of the knee extensor and flexor muscles groups. In the comparison between groups, the GTP showed significantly greater deficits as compared to the GTF and GC groups. Conclusion: Isometric dynamometers connected to mechanotherapy equipments could be an alternative option to collect data concerning performance deficits of the extensor and flexor muscles groups of the knee in subjects with ACL reconstruction. PMID:27004175

A novel hybrid MCDM model for performance evaluation of research and technology organizations based on BSC approach.

PubMed

Varmazyar, Mohsen; Dehghanbaghi, Maryam; Afkhami, Mehdi

2016-10-01

Balanced Scorecard (BSC) is a strategic evaluation tool using both financial and non-financial indicators to determine the business performance of organizations or companies. In this paper, a new integrated approach based on the Balanced Scorecard (BSC) and multi-criteria decision making (MCDM) methods are proposed to evaluate the performance of research centers of research and technology organization (RTO) in Iran. Decision-Making Trial and Evaluation Laboratory (DEMATEL) are employed to reflect the interdependencies among BSC perspectives. Then, Analytic Network Process (ANP) is utilized to weight the indices influencing the considered problem. In the next step, we apply four MCDM methods including Additive Ratio Assessment (ARAS), Complex Proportional Assessment (COPRAS), Multi-Objective Optimization by Ratio Analysis (MOORA), and Technique for Order Preference by Similarity to Ideal Solution (TOPSIS) for ranking of alternatives. Finally, the utility interval technique is applied to combine the ranking results of MCDM methods. Weighted utility intervals are computed by constructing a correlation matrix between the ranking methods. A real case is presented to show the efficacy of the proposed approach. Copyright © 2016 Elsevier Ltd. All rights reserved.

Benefits and assessment of annual budget requirements for pavement preservation.

DOT National Transportation Integrated Search

2012-01-01

This research identifies methods and best practices that can be used by the Indiana Department of Transportation (INDOT) in : performing various strategies for pavement preservation. It also identifies various methods of calculating the benefits of :...

77 FR 36550 - Advisory Committee on Training in Primary Care Medicine and Dentistry; Notice of Meeting

Federal Register 2010, 2011, 2012, 2013, 2014

2012-06-19

...-supported program is to train clinical educators on methods to teach and assess trainee competencies for...'s development of performance measures and methods of longitudinal evaluation for Public Health...

Low-dimensional dynamical characterization of human performance of cancer patients using motion data.

PubMed

Hasnain, Zaki; Li, Ming; Dorff, Tanya; Quinn, David; Ueno, Naoto T; Yennu, Sriram; Kolatkar, Anand; Shahabi, Cyrus; Nocera, Luciano; Nieva, Jorge; Kuhn, Peter; Newton, Paul K

2018-05-18

Biomechanical characterization of human performance with respect to fatigue and fitness is relevant in many settings, however is usually limited to either fully qualitative assessments or invasive methods which require a significant experimental setup consisting of numerous sensors, force plates, and motion detectors. Qualitative assessments are difficult to standardize due to their intrinsic subjective nature, on the other hand, invasive methods provide reliable metrics but are not feasible for large scale applications. Presented here is a dynamical toolset for detecting performance groups using a non-invasive system based on the Microsoft Kinect motion capture sensor, and a case study of 37 cancer patients performing two clinically monitored tasks before and after therapy regimens. Dynamical features are extracted from the motion time series data and evaluated based on their ability to i) cluster patients into coherent fitness groups using unsupervised learning algorithms and to ii) predict Eastern Cooperative Oncology Group performance status via supervised learning. The unsupervised patient clustering is comparable to clustering based on physician assigned Eastern Cooperative Oncology Group status in that they both have similar concordance with change in weight before and after therapy as well as unexpected hospitalizations throughout the study. The extracted dynamical features can predict physician, coordinator, and patient Eastern Cooperative Oncology Group status with an accuracy of approximately 80%. The non-invasive Microsoft Kinect sensor and the proposed dynamical toolset comprised of data preprocessing, feature extraction, dimensionality reduction, and machine learning offers a low-cost and general method for performance segregation and can complement existing qualitative clinical assessments. Copyright © 2018 Elsevier Ltd. All rights reserved.

Multiscale nonlinear microscopy and widefield white light imaging enables rapid histological imaging of surgical specimen margins

PubMed Central

Giacomelli, Michael G.; Yoshitake, Tadayuki; Cahill, Lucas C.; Vardeh, Hilde; Quintana, Liza M.; Faulkner-Jones, Beverly E.; Brooker, Jeff; Connolly, James L.; Fujimoto, James G.

2018-01-01

The ability to histologically assess surgical specimens in real-time is a long-standing challenge in cancer surgery, including applications such as breast conserving therapy (BCT). Up to 40% of women treated with BCT for breast cancer require a repeat surgery due to postoperative histological findings of close or positive surgical margins using conventional formalin fixed paraffin embedded histology. Imaging technologies such as nonlinear microscopy (NLM), combined with exogenous fluorophores can rapidly provide virtual H&E imaging of surgical specimens without requiring microtome sectioning, facilitating intraoperative assessment of margin status. However, the large volume of typical surgical excisions combined with the need for rapid assessment, make comprehensive cellular resolution margin assessment during surgery challenging. To address this limitation, we developed a multiscale, real-time microscope with variable magnification NLM and real-time, co-registered position display using a widefield white light imaging system. Margin assessment can be performed rapidly under operator guidance to image specific regions of interest located using widefield imaging. Using simulated surgical margins dissected from human breast excisions, we demonstrate that multi-centimeter margins can be comprehensively imaged at cellular resolution, enabling intraoperative margin assessment. These methods are consistent with pathology assessment performed using frozen section analysis (FSA), however NLM enables faster and more comprehensive assessment of surgical specimens because imaging can be performed without freezing and cryo-sectioning. Therefore, NLM methods have the potential to be applied to a wide range of intra-operative applications. PMID:29761001

Comparison between two statistically based methods, and two physically based models developed to compute daily mean streamflow at ungaged locations in the Cedar River Basin, Iowa

USGS Publications Warehouse

Linhart, S. Mike; Nania, Jon F.; Christiansen, Daniel E.; Hutchinson, Kasey J.; Sanders, Curtis L.; Archfield, Stacey A.

2013-01-01

A variety of individuals from water resource managers to recreational users need streamflow information for planning and decisionmaking at locations where there are no streamgages. To address this problem, two statistically based methods, the Flow Duration Curve Transfer method and the Flow Anywhere method, were developed for statewide application and the two physically based models, the Precipitation Runoff Modeling-System and the Soil and Water Assessment Tool, were only developed for application for the Cedar River Basin. Observed and estimated streamflows for the two methods and models were compared for goodness of fit at 13 streamgages modeled in the Cedar River Basin by using the Nash-Sutcliffe and the percent-bias efficiency values. Based on median and mean Nash-Sutcliffe values for the 13 streamgages the Precipitation Runoff Modeling-System and Soil and Water Assessment Tool models appear to have performed similarly and better than Flow Duration Curve Transfer and Flow Anywhere methods. Based on median and mean percent bias values, the Soil and Water Assessment Tool model appears to have generally overestimated daily mean streamflows, whereas the Precipitation Runoff Modeling-System model and statistical methods appear to have underestimated daily mean streamflows. The Flow Duration Curve Transfer method produced the lowest median and mean percent bias values and appears to perform better than the other models.

A comparative analysis of multiple-choice and student performance-task assessment in the high school biology classroom

NASA Astrophysics Data System (ADS)

Cushing, Patrick Ryan

This study compared the performance of high school students on laboratory assessments. Thirty-four high school students who were enrolled in the second semester of a regular biology class or had completed the biology course the previous semester participated in this study. They were randomly assigned to examinations of two formats, performance-task and traditional multiple-choice, from two content areas, using a compound light microscope and diffusion. Students were directed to think-aloud as they performed the assessments. Additional verbal data were obtained during interviews following the assessment. The tape-recorded narrative data were analyzed for type and diversity of knowledge and skill categories, and percentage of in-depth processing demonstrated. While overall mean scores on the assessments were low, elicited statements provided additional insight into student cognition. Results indicated that a greater diversity of knowledge and skill categories was elicited by the two microscope assessments and by the two performance-task assessments. In addition, statements demonstrating in-depth processing were coded most frequently in narratives elicited during clinical interviews following the diffusion performance-task assessment. This study calls for individual teachers to design authentic assessment practices and apply them to daily classroom routines. Authentic assessment should be an integral part of the learning process and not merely an end result. In addition, teachers are encouraged to explicitly identify and model, through think-aloud methods, desired cognitive behaviors in the classroom.

Assessment and Verification of SLS Block 1-B Exploration Upper Stage and Stage Disposal Performance

NASA Technical Reports Server (NTRS)

Patrick, Sean; Oliver, T. Emerson; Anzalone, Evan J.

2018-01-01

Delta-v allocation to correct for insertion errors caused by state uncertainty is one of the key performance requirements imposed on the SLS Navigation System. Additionally, SLS mission requirements include the need for the Exploration Up-per Stage (EUS) to be disposed of successfully. To assess these requirements, the SLS navigation team has developed and implemented a series of analysis methods. Here the authors detail the Delta-Delta-V approach to assessing delta-v allocation as well as the EUS disposal optimization approach.

Physician performance assessment using a composite quality index.

PubMed

Liu, Kaibo; Jain, Shabnam; Shi, Jianjun

2013-07-10

Assessing physician performance is important for the purposes of measuring and improving quality of service and reducing healthcare delivery costs. In recent years, physician performance scorecards have been used to provide feedback on individual measures; however, one key challenge is how to develop a composite quality index that combines multiple measures for overall physician performance evaluation. A controversy arises over establishing appropriate weights to combine indicators in multiple dimensions, and cannot be easily resolved. In this study, we proposed a generic unsupervised learning approach to develop a single composite index for physician performance assessment by using non-negative principal component analysis. We developed a new algorithm named iterative quadratic programming to solve the numerical issue in the non-negative principal component analysis approach. We conducted real case studies to demonstrate the performance of the proposed method. We provided interpretations from both statistical and clinical perspectives to evaluate the developed composite ranking score in practice. In addition, we implemented the root cause assessment techniques to explain physician performance for improvement purposes. Copyright © 2012 John Wiley & Sons, Ltd.

Life Cycle Assessment of Domestic and Agricultural Rainwater Harvesting Systems

EPA Science Inventory

To further understanding of the environmental implications of rainwater harvesting and its water savings potential relative to conventional U.S. water delivery infrastructure, we present a method to perform life cycle assessment of domestic rainwater harvesting (DRWH) and agricul...

A collaborative comparison of objective structured clinical examination (OSCE) standard setting methods at Australian medical schools.

PubMed

Malau-Aduli, Bunmi Sherifat; Teague, Peta-Ann; D'Souza, Karen; Heal, Clare; Turner, Richard; Garne, David L; van der Vleuten, Cees

2017-12-01

A key issue underpinning the usefulness of the OSCE assessment to medical education is standard setting, but the majority of standard-setting methods remain challenging for performance assessment because they produce varying passing marks. Several studies have compared standard-setting methods; however, most of these studies are limited by their experimental scope, or use data on examinee performance at a single OSCE station or from a single medical school. This collaborative study between 10 Australian medical schools investigated the effect of standard-setting methods on OSCE cut scores and failure rates. This research used 5256 examinee scores from seven shared OSCE stations to calculate cut scores and failure rates using two different compromise standard-setting methods, namely the Borderline Regression and Cohen's methods. The results of this study indicate that Cohen's method yields similar outcomes to the Borderline Regression method, particularly for large examinee cohort sizes. However, with lower examinee numbers on a station, the Borderline Regression method resulted in higher cut scores and larger difference margins in the failure rates. Cohen's method yields similar outcomes as the Borderline Regression method and its application for benchmarking purposes and in resource-limited settings is justifiable, particularly with large examinee numbers.

Integration of classroom science performance assessment tasks by participants of the Wisconsin Performance Assessment Development Project (WPADP)

NASA Astrophysics Data System (ADS)

Tonnis, Dorothy Ann

The goals of this interpretive study were to examine selected Wisconsin science teachers' perceptions of teaching and learning science, to describe the scope of classroom performance assessment practices, and to gain an understanding of teachers' personal and professional experiences that influenced their belief systems of teaching, learning and assessment. The study was designed to answer the research questions: (1) How does the integration of performance assessment relate to the teachers' views of teaching and learning? (2) How are the selected teachers integrating performance assessment in their teaching? (3) What past personal and professional experiences have influenced teachers' attitudes and beliefs related to their classroom performance assessment practices? Purposeful sampling was used to select seven Wisconsin elementary, middle and high school science teachers who participated in the WPADP initiative from 1993-1995. Data collection methods included a Teaching Practices Inventory (TPI), semi-structured interviews, teacher developed portfolios, portfolio conferences, and classroom observations. Four themes and multiple categories emerged through data analysis to answer the research questions and to describe the results. Several conclusions were drawn from this research. First, science teachers who appeared to effectively integrate performance assessment, demonstrated transformational thinking in their attitudes and beliefs about teaching and learning science. In addition, these teachers viewed assessment and instructional practices as interdependent. Third, transformational teachers generally used well defined criteria to judge student work and made it public to the students. Transformational teachers provided students with real-world performance assessment tasks that were also learning events. Furthermore, student task responses informed the transformational teachers about effectiveness of instruction, students' complex thinking skills, quality of assessment instruments, students' creativity, and students' self-assessment skills. Finally, transformational teachers maintained integration of performance assessment practices through sustaining teacher support networks, engaging in professional development programs, and reflecting upon past personal and professional experiences related to teaching, learning and assessment. Salient conflicts overcome or minimized by transformational teachers include the conflict between assessment scoring and grading issues, validity and reliability concerns about the performance assessment tasks used, and the difficulty for teachers to consistently provide public criteria to students before task administration.

Impact of Hybrid Delivery of Education on Student Academic Performance and the Student Experience

PubMed Central

Nutter, Douglas A.; Charneski, Lisa; Butko, Peter

2009-01-01

Objectives To compare student academic performance and the student experience in the first-year doctor of pharmacy (PharmD) program between the main and newly opened satellite campuses of the University of Maryland. Methods Student performance indicators including graded assessments, course averages, cumulative first-year grade point average (GPA), and introductory pharmacy practice experience (IPPE) evaluations were analyzed retrospectively. Student experience indicators were obtained via an online survey instrument and included involvement in student organizations; time-budgeting practices; and stress levels and their perceived effect on performance. Results Graded assessments, course averages, GPA, and IPPE evaluations were indistinguishable between campuses. Students' time allocation was not different between campuses, except for time spent attending class and watching lecture videos. There was no difference between students' stress levels at each campus. Conclusions The implementation of a satellite campus to expand pharmacy education yielded academic performance and student engagement comparable to those from traditional delivery methods. PMID:19960080

Do team processes really have an effect on clinical performance? A systematic literature review.

PubMed

Schmutz, J; Manser, T

2013-04-01

There is a growing literature on the relationship between team processes and clinical performance. The purpose of this review is to summarize these articles and examine the impact of team process behaviours on clinical performance. We conducted a literature search in five major databases. Inclusion criteria were: English peer-reviewed papers published between January 2001 and May 2012, which showed or tried to show (i) a statistical relationship of a team process variable and clinical performance or (ii) an improvement of a performance variable through a team process intervention. Study quality was assessed using predefined quality indicators. For every study, we calculated the relevant effect sizes. We included 28 studies in the review, seven of which were intervention studies. Every study reported at least one significant relationship between team processes or an intervention and performance. Also, some non-significant effects were reported. Most of the reported effect sizes were large or medium. The study quality ranged from medium to high. The studies are highly diverse regarding the specific team process behaviours investigated and also regarding the methods used. However, they suggest that team process behaviours do influence clinical performance and that training results in increased performance. Future research should rely on existing theoretical frameworks, valid, and reliable methods to assess processes such as teamwork or coordination and focus on the development of adequate tools to assess process performance, linking them with outcomes in the clinical setting.

Proficiency program for real-time PCR diagnosis of Bordetella pertussis infections in French hospital laboratories and at the French National Reference Center for Whooping Cough and other Bordetelloses.

PubMed

Caro, Valérie; Guiso, Nicole; Alberti, Corinne; Liguori, Sandrine; Burucoa, Christophe; Couetdic, Gérard; Doucet-Populaire, Florence; Ferroni, Agnès; Papin-Gibaud, Sophie; Grattard, Florence; Réglier-Poupet, Hélène; Raymond, Josette; Soler, Catherine; Bouchet, Sylvie; Charreau, Sandrine; Couzon, Brigitte; Leymarie, Isabelle; Tavares, Nicole; Choux, Mathilde; Bingen, Edouard; Bonacorsi, Stéphane

2009-10-01

With the support of a ministerial program for innovative and expensive technologies, dedicated to the economic evaluation of laboratory diagnosis of pertussis by real-time PCR, external quality assessment for real-time IS481 PCR was carried out. Coordinated by the National Centre of Reference of Pertussis and other Bordetelloses (NCR), this study aimed to harmonize and to assess the performances of eight participating microbiology hospital laboratories throughout the French territory. Between January 2006 and February 2007, 10 proficiency panels were sent by the NCR (ascending proficiency program), representing a total of 49 samples and including eight panels to analyze and evaluate the global sensitivity and specificity of real-time PCR, one to assess the limit of detection, and one to evaluate nucleic acid extraction methods. As part of the descending proficiency program, extracted DNA from clinical samples was sent by the eight participating laboratories in different panels and analyzed by the NCR. In the ascending proficiency analysis, the sensitivity and specificity of the real-time PCR methods were 92.2% and 94.3%, respectively. The limit of detection of the different methods ranged between 0.1 and 1 fg/microl (0.2 to 2 CFU/microl). The nucleic acid extraction methods showed similar performances. During the descending proficiency analysis, performed with 126 samples, the result of the NCR for 15 samples (11.9%) was discordant with the result obtained by the source laboratory. Despite several initial differences, harmonization was easy and performances were homogeneous. However, the risk of false-positive results remains quite high, and we strongly recommend establishment of uniform quality control procedures performed regularly.

Reliability of widefield nailfold capillaroscopy and video capillaroscopy in the assessment of patients with Raynaud’s phenomenon.

PubMed

Sekiyama, Juliana Y; Camargo, Cintia Z; Eduardo, Luís; Andrade, C; Kayser, Cristiane

2013-11-01

To analyze the diagnostic performance and reliability of different parameters evaluated by widefield nailfold capillaroscopy (NFC) with those obtained by video capillaroscopy in patients with Raynaud’s phenomenon (RP). Two hundred fifty-two individuals were assessed, including 101 systemic sclerosis (SSc; scleroderma) patients,61 patients with undifferentiated connective tissue disease, 37 patients with primary RP, and 53 controls. Widefield NFC was performed using a stereomicroscope under 10–25 x magnification and direct measurement of all parameters. Video capillaroscopy was performed under 200 x magnification, with the acquirement of 32 images per individual (4 fields per finger in 8 fingers). The following parameters were analyzed in 8 fingers of the hands (excluding thumbs) by both methods: number of capillaries/mm, number of enlarged and giant capillaries, microhemorrhages, and avascular score.Intra- and interobserver reliability was evaluated by performing both examinations in 20 individuals on 2 different days and by 2 long-term experienced observers. There was a significant correlation (P < 0.000) between widefield NFC and video capillaroscopy in the comparison of all parameters. Kappa values and intraclass correlation coefficient analysis showed excellent intra- and interobserver reproducibility for all parameters evaluated by widefield NFC and video capillaroscopy. Bland-Altman analysis showed high agreement of all parameters evaluated in both methods. According to receiver operating characteristic curve analysis, both methods showed a similar performance in discriminating SSc patients from controls. Widefield NFC and video capillaroscopy are reliable and accurate methods and can be used equally for assessing peripheral microangiopathy in RP and SSc patients. Nonetheless, the high reliability obtained may not be similar for less experienced examiners.

Corrosion performance tests for reinforcing steel in concrete : test procedures.

DOT National Transportation Integrated Search

2009-09-01

The existing test method to assess the corrosion performance of reinforcing steel embedded in concrete, mainly : ASTM G109, is labor intensive, time consuming, slow to provide comparative results, and often expensive. : However, corrosion of reinforc...

Corrosion performance tests for reinforcing steel in concrete : technical report.

DOT National Transportation Integrated Search

2009-10-01

The existing test method used to assess the corrosion performance of reinforcing steel embedded in : concrete, mainly ASTM G 109, is labor intensive, time consuming, slow to provide comparative results, : and can be expensive. However, with corrosion...

The reliability of workplace-based assessment in postgraduate medical education and training: a national evaluation in general practice in the United Kingdom.

PubMed

Murphy, Douglas J; Bruce, David A; Mercer, Stewart W; Eva, Kevin W

2009-05-01

To investigate the reliability and feasibility of six potential workplace-based assessment methods in general practice training: criterion audit, multi-source feedback from clinical and non-clinical colleagues, patient feedback (the CARE Measure), referral letters, significant event analysis, and video analysis of consultations. Performance of GP registrars (trainees) was evaluated with each tool to assess the reliabilities of the tools and feasibility, given raters and number of assessments needed. Participant experience of process determined by questionnaire. 171 GP registrars and their trainers, drawn from nine deaneries (representing all four countries in the UK), participated. The ability of each tool to differentiate between doctors (reliability) was assessed using generalisability theory. Decision studies were then conducted to determine the number of observations required to achieve an acceptably high reliability for "high-stakes assessment" using each instrument. Finally, descriptive statistics were used to summarise participants' ratings of their experience using these tools. Multi-source feedback from colleagues and patient feedback on consultations emerged as the two methods most likely to offer a reliable and feasible opinion of workplace performance. Reliability co-efficients of 0.8 were attainable with 41 CARE Measure patient questionnaires and six clinical and/or five non-clinical colleagues per doctor when assessed on two occasions. For the other four methods tested, 10 or more assessors were required per doctor in order to achieve a reliable assessment, making the feasibility of their use in high-stakes assessment extremely low. Participant feedback did not raise any major concerns regarding the acceptability, feasibility, or educational impact of the tools. The combination of patient and colleague views of doctors' performance, coupled with reliable competence measures, may offer a suitable evidence-base on which to monitor progress and completion of doctors' training in general practice.

Assessing performance and validating finite element simulations using probabilistic knowledge

DOE Office of Scientific and Technical Information (OSTI.GOV)

Dolin, Ronald M.; Rodriguez, E. A.

Two probabilistic approaches for assessing performance are presented. The first approach assesses probability of failure by simultaneously modeling all likely events. The probability each event causes failure along with the event's likelihood of occurrence contribute to the overall probability of failure. The second assessment method is based on stochastic sampling using an influence diagram. Latin-hypercube sampling is used to stochastically assess events. The overall probability of failure is taken as the maximum probability of failure of all the events. The Likelihood of Occurrence simulation suggests failure does not occur while the Stochastic Sampling approach predicts failure. The Likelihood of Occurrencemore » results are used to validate finite element predictions.« less

Comparative study of joint analysis of microarray gene expression data in survival prediction and risk assessment of breast cancer patients

PubMed Central

2016-01-01

Abstract Microarray gene expression data sets are jointly analyzed to increase statistical power. They could either be merged together or analyzed by meta-analysis. For a given ensemble of data sets, it cannot be foreseen which of these paradigms, merging or meta-analysis, works better. In this article, three joint analysis methods, Z -score normalization, ComBat and the inverse normal method (meta-analysis) were selected for survival prognosis and risk assessment of breast cancer patients. The methods were applied to eight microarray gene expression data sets, totaling 1324 patients with two clinical endpoints, overall survival and relapse-free survival. The performance derived from the joint analysis methods was evaluated using Cox regression for survival analysis and independent validation used as bias estimation. Overall, Z -score normalization had a better performance than ComBat and meta-analysis. Higher Area Under the Receiver Operating Characteristic curve and hazard ratio were also obtained when independent validation was used as bias estimation. With a lower time and memory complexity, Z -score normalization is a simple method for joint analysis of microarray gene expression data sets. The derived findings suggest further assessment of this method in future survival prediction and cancer classification applications. PMID:26504096

Development of Flight-Test Performance Estimation Techniques for Small Unmanned Aerial Systems

NASA Astrophysics Data System (ADS)

McCrink, Matthew Henry

This dissertation provides a flight-testing framework for assessing the performance of fixed-wing, small-scale unmanned aerial systems (sUAS) by leveraging sub-system models of components unique to these vehicles. The development of the sub-system models, and their links to broader impacts on sUAS performance, is the key contribution of this work. The sub-system modeling and analysis focuses on the vehicle's propulsion, navigation and guidance, and airframe components. Quantification of the uncertainty in the vehicle's power available and control states is essential for assessing the validity of both the methods and results obtained from flight-tests. Therefore, detailed propulsion and navigation system analyses are presented to validate the flight testing methodology. Propulsion system analysis required the development of an analytic model of the propeller in order to predict the power available over a range of flight conditions. The model is based on the blade element momentum (BEM) method. Additional corrections are added to the basic model in order to capture the Reynolds-dependent scale effects unique to sUAS. The model was experimentally validated using a ground based testing apparatus. The BEM predictions and experimental analysis allow for a parameterized model relating the electrical power, measurable during flight, to the power available required for vehicle performance analysis. Navigation system details are presented with a specific focus on the sensors used for state estimation, and the resulting uncertainty in vehicle state. Uncertainty quantification is provided by detailed calibration techniques validated using quasi-static and hardware-in-the-loop (HIL) ground based testing. The HIL methods introduced use a soft real-time flight simulator to provide inertial quality data for assessing overall system performance. Using this tool, the uncertainty in vehicle state estimation based on a range of sensors, and vehicle operational environments is presented. The propulsion and navigation system models are used to evaluate flight-testing methods for evaluating fixed-wing sUAS performance. A brief airframe analysis is presented to provide a foundation for assessing the efficacy of the flight-test methods. The flight-testing presented in this work is focused on validating the aircraft drag polar, zero-lift drag coefficient, and span efficiency factor. Three methods are detailed and evaluated for estimating these design parameters. Specific focus is placed on the influence of propulsion and navigation system uncertainty on the resulting performance data. Performance estimates are used in conjunction with the propulsion model to estimate the impact sensor and measurement uncertainty on the endurance and range of a fixed-wing sUAS. Endurance and range results for a simplistic power available model are compared to the Reynolds-dependent model presented in this work. Additional parameter sensitivity analysis related to state estimation uncertainties encountered in flight-testing are presented. Results from these analyses indicate that the sub-system models introduced in this work are of first-order importance, on the order of 5-10% change in range and endurance, in assessing the performance of a fixed-wing sUAS.

Teaching and assessing procedural skills using simulation: metrics and methodology.

PubMed

Lammers, Richard L; Davenport, Moira; Korley, Frederick; Griswold-Theodorson, Sharon; Fitch, Michael T; Narang, Aneesh T; Evans, Leigh V; Gross, Amy; Rodriguez, Elliot; Dodge, Kelly L; Hamann, Cara J; Robey, Walter C

2008-11-01

Simulation allows educators to develop learner-focused training and outcomes-based assessments. However, the effectiveness and validity of simulation-based training in emergency medicine (EM) requires further investigation. Teaching and testing technical skills require methods and assessment instruments that are somewhat different than those used for cognitive or team skills. Drawing from work published by other medical disciplines as well as educational, behavioral, and human factors research, the authors developed six research themes: measurement of procedural skills; development of performance standards; assessment and validation of training methods, simulator models, and assessment tools; optimization of training methods; transfer of skills learned on simulator models to patients; and prevention of skill decay over time. The article reviews relevant and established educational research methodologies and identifies gaps in our knowledge of how physicians learn procedures. The authors present questions requiring further research that, once answered, will advance understanding of simulation-based procedural training and assessment in EM.

Pharmacoeconomics

PubMed Central

Hughes, Dyfrig A

2012-01-01

Pharmacoeconomics is an essential component of health technology assessment and the appraisal of medicines for use by UK National Health Service (NHS) patients. As a comparatively young discipline, its methods continue to evolve. Priority research areas for development include methods for synthesizing indirect comparisons when head-to-head trials have not been performed, synthesizing qualitative evidence (for example, stakeholder views), addressing the limitations of the EQ-5D tool for assessing quality of life, including benefits not captured in quality-adjusted life years (QALYs), ways of assessing valuation methods (for determining utility scores), extrapolation of costs and benefits beyond those observed in trials, early estimation of cost-effectiveness (including mechanism-based economic evaluation), methods for incorporating the impact of non-adherence and the role of behavioural economics in influencing patients and prescribers. PMID:22360714

Children's Understanding of Second-Order False Belief: Comparisons of Content and Method of Assessment

ERIC Educational Resources Information Center

Miller, Scott A.

2013-01-01

This research examined children's performance on second-order false belief tasks as a function of the content area for the belief and the method of assessing understanding. A total of 70 kindergarten and first-grade children responded to four second-order stories. On two stories, the task was to judge a belief about a belief, and on two, the…

Field evaluation of personal sampling methods for multiple bioaerosols.

PubMed

Wang, Chi-Hsun; Chen, Bean T; Han, Bor-Cheng; Liu, Andrew Chi-Yeu; Hung, Po-Chen; Chen, Chih-Yong; Chao, Hsing Jasmine

2015-01-01

Ambient bioaerosols are ubiquitous in the daily environment and can affect health in various ways. However, few studies have been conducted to comprehensively evaluate personal bioaerosol exposure in occupational and indoor environments because of the complex composition of bioaerosols and the lack of standardized sampling/analysis methods. We conducted a study to determine the most efficient collection/analysis method for the personal exposure assessment of multiple bioaerosols. The sampling efficiencies of three filters and four samplers were compared. According to our results, polycarbonate (PC) filters had the highest relative efficiency, particularly for bacteria. Side-by-side sampling was conducted to evaluate the three filter samplers (with PC filters) and the NIOSH Personal Bioaerosol Cyclone Sampler. According to the results, the Button Aerosol Sampler and the IOM Inhalable Dust Sampler had the highest relative efficiencies for fungi and bacteria, followed by the NIOSH sampler. Personal sampling was performed in a pig farm to assess occupational bioaerosol exposure and to evaluate the sampling/analysis methods. The Button and IOM samplers yielded a similar performance for personal bioaerosol sampling at the pig farm. However, the Button sampler is more likely to be clogged at high airborne dust concentrations because of its higher flow rate (4 L/min). Therefore, the IOM sampler is a more appropriate choice for performing personal sampling in environments with high dust levels. In summary, the Button and IOM samplers with PC filters are efficient sampling/analysis methods for the personal exposure assessment of multiple bioaerosols.

Evaluation of qPCR curve analysis methods for reliable biomarker discovery: bias, resolution, precision, and implications.

PubMed

Ruijter, Jan M; Pfaffl, Michael W; Zhao, Sheng; Spiess, Andrej N; Boggy, Gregory; Blom, Jochen; Rutledge, Robert G; Sisti, Davide; Lievens, Antoon; De Preter, Katleen; Derveaux, Stefaan; Hellemans, Jan; Vandesompele, Jo

2013-01-01

RNA transcripts such as mRNA or microRNA are frequently used as biomarkers to determine disease state or response to therapy. Reverse transcription (RT) in combination with quantitative PCR (qPCR) has become the method of choice to quantify small amounts of such RNA molecules. In parallel with the democratization of RT-qPCR and its increasing use in biomedical research or biomarker discovery, we witnessed a growth in the number of gene expression data analysis methods. Most of these methods are based on the principle that the position of the amplification curve with respect to the cycle-axis is a measure for the initial target quantity: the later the curve, the lower the target quantity. However, most methods differ in the mathematical algorithms used to determine this position, as well as in the way the efficiency of the PCR reaction (the fold increase of product per cycle) is determined and applied in the calculations. Moreover, there is dispute about whether the PCR efficiency is constant or continuously decreasing. Together this has lead to the development of different methods to analyze amplification curves. In published comparisons of these methods, available algorithms were typically applied in a restricted or outdated way, which does not do them justice. Therefore, we aimed at development of a framework for robust and unbiased assessment of curve analysis performance whereby various publicly available curve analysis methods were thoroughly compared using a previously published large clinical data set (Vermeulen et al., 2009) [11]. The original developers of these methods applied their algorithms and are co-author on this study. We assessed the curve analysis methods' impact on transcriptional biomarker identification in terms of expression level, statistical significance, and patient-classification accuracy. The concentration series per gene, together with data sets from unpublished technical performance experiments, were analyzed in order to assess the algorithms' precision, bias, and resolution. While large differences exist between methods when considering the technical performance experiments, most methods perform relatively well on the biomarker data. The data and the analysis results per method are made available to serve as benchmark for further development and evaluation of qPCR curve analysis methods (http://qPCRDataMethods.hfrc.nl). Copyright © 2012 Elsevier Inc. All rights reserved.

The assessment of eco-design with a comprehensive index incorporating environmental impact and economic profit

NASA Astrophysics Data System (ADS)

Yang, Shuo; Fu, Yun; Wang, Xiuteng; Xu, Bingsheng; Li, Zheng

2017-11-01

Eco-design is an advanced design approach which plays an important part in the national innovation project and serves as a key point for the successful transformation of the supply structure. However, the practical implementation of the pro-environmental designs and technologies always faces a dilemma situation, where some processes can effectively control their emissions to protect the environment at relatively high costs, while others pursue the individual interest in making profit by ignoring the possible adverse environmental impacts. Thus, the assessment on the eco-design process must be carried out based on the comprehensive consideration of the economic and environmental aspects. Presently, the assessment systems in China are unable to fully reflect the new environmental technologies regarding their innovative features or performance. Most of the assessment systems adopt scoring method based on the judgments of the experts, which are easy to use but somewhat subjective. The assessment method presented in this paper includes the environmental impact (EI) assessment based on LCA principal and willingness-to-pay theory, and economic profit (EP) assessment mainly based on market price. The results from the assessment are in the form of EI/EP, which evaluate the targeted process from a combined perspective of environmental and economic performance. A case study was carried out upon the utilization process of coal fly ash, which indicates the proposed method can compare different technical processes in an effective and objective manner, and provide explicit and insightful suggestions for decision making.

Methods used to address fidelity of receipt in health intervention research: a citation analysis and systematic review.

PubMed

Rixon, Lorna; Baron, Justine; McGale, Nadine; Lorencatto, Fabiana; Francis, Jill; Davies, Anna

2016-11-18

The American Behaviour Change Consortium (BCC) framework acknowledges patients as active participants and supports the need to investigate the fidelity with which they receive interventions, i.e. receipt. According to this framework, addressing receipt consists in using strategies to assess or enhance participants' understanding and/or performance of intervention skills. This systematic review aims to establish the frequency with which receipt is addressed as defined in the BCC framework in health research, and to describe the methods used in papers informed by the BCC framework and in the wider literature. A forward citation search on papers presenting the BCC framework was performed to determine the frequency with which receipt as defined in this framework was addressed. A second electronic database search, including search terms pertaining to fidelity, receipt, health and process evaluations was performed to identify papers reporting on receipt in the wider literature and irrespective of the framework used. These results were combined with forward citation search results to review methods to assess receipt. Eligibility criteria and data extraction forms were developed and applied to papers. Results are described in a narrative synthesis. 19.6% of 33 studies identified from the forward citation search to report on fidelity were found to address receipt. In 60.6% of these, receipt was assessed in relation to understanding and in 42.4% in relation to performance of skill. Strategies to enhance these were present in 12.1% and 21.1% of studies, respectively. Fifty-five studies were included in the review of the wider literature. Several frameworks and operationalisations of receipt were reported, but the latter were not always consistent with the guiding framework. Receipt was most frequently operationalised in relation to intervention content (16.4%), satisfaction (14.5%), engagement (14.5%), and attendance (14.5%). The majority of studies (90.0%) included subjective assessments of receipt. These relied on quantitative (76.0%) rather than qualitative (42.0%) methods and studies collected data on intervention recipients (50.0%), intervention deliverers (28.0%), or both (22.0%). Few studies (26.0%) reported on the reliability or validity of methods used. Receipt is infrequently addressed in health research and improvements to methods of assessment and reporting are required.

Manual materials handling: knowledge and practices among Portuguese health and safety practitioners.

PubMed

Arezes, Pedro M; Miguel, A Sérgio; Colim, Ana S

2011-01-01

There are several methodologies to assess the risk involved in Manual Materials Handling (MMH). The aim of this study was to identify the knowledge and use of risk assessment methods among Portuguese Health and Safety (H&S) practitioners. The study involved the participation of 331 H&S practitioners and other related prevention professionals. An e-mail invitation to complete an online survey was sent to all Portuguese registered H&S practitioners. The previously developed and validated questionnaire included three different sections: (1) company characteristics; (2) description of types of MMH tasks performed; and (3) the respondents' use of and knowledge about risk assessment methods for MMH tasks. The answers obtained were collected from almost 350 companies. The characteristics of the companies showed that there is a predominance of external and internal H&S services for Small and Medium sized Enterprises (SMEs) and large companies, respectively. The NIOSH equation, Key Indicator Method (KIM) and Manual Assessment Chart (MAC) were identified as the most used and recognised risk assessment methods. Questionnaire results show that an important number of Portuguese H&S practitioners recognise some methods but have difficulty applying them correctly. Some practitioners reported that they had never used any type of risk assessment method.

Goal-oriented evaluation of binarization algorithms for historical document images

NASA Astrophysics Data System (ADS)

Obafemi-Ajayi, Tayo; Agam, Gady

2013-01-01

Binarization is of significant importance in document analysis systems. It is an essential first step, prior to further stages such as Optical Character Recognition (OCR), document segmentation, or enhancement of readability of the document after some restoration stages. Hence, proper evaluation of binarization methods to verify their effectiveness is of great value to the document analysis community. In this work, we perform a detailed goal-oriented evaluation of image quality assessment of the 18 binarization methods that participated in the DIBCO 2011 competition using the 16 historical document test images used in the contest. We are interested in the image quality assessment of the outputs generated by the different binarization algorithms as well as the OCR performance, where possible. We compare our evaluation of the algorithms based on human perception of quality to the DIBCO evaluation metrics. The results obtained provide an insight into the effectiveness of these methods with respect to human perception of image quality as well as OCR performance.

Comparative effectiveness of instructional methods: oral and pharyngeal cancer examination.

PubMed

Clark, Nereyda P; Marks, John G; Sandow, Pamela R; Seleski, Christine E; Logan, Henrietta L

2014-04-01

This study compared the effectiveness of different methods of instruction for the oral and pharyngeal cancer examination. A group of thirty sophomore students at the University of Florida College of Dentistry were randomly assigned to three training groups: video instruction, a faculty-led hands-on instruction, or both video and hands-on instruction. The training intervention involved attending two sessions spaced two weeks apart. The first session used a pretest to assess students' baseline didactic knowledge and clinical examination technique. The second session utilized two posttests to assess the comparative effectiveness of the training methods on didactic knowledge and clinical technique. The key findings were that students performed the clinical examination significantly better with the combination of video and faculty-led hands-on instruction (p<0.01). All students improved their clinical exam skills, knowledge, and confidence in performing the oral and pharyngeal cancer examination independent of which training group they were assigned. Utilizing both video and interactive practice promoted greater performance of the clinical technique on the oral and pharyngeal cancer examination.

Nutritional risk assessment in critically ill cancer patients: systematic review

PubMed Central

Fruchtenicht, Ana Valéria Gonçalves; Poziomyck, Aline Kirjner; Kabke, Geórgia Brum; Loss, Sérgio Henrique; Antoniazzi, Jorge Luiz; Steemburgo, Thais; Moreira, Luis Fernando

2015-01-01

Objective To systematically review the main methods for nutritional risk assessment used in critically ill cancer patients and present the methods that better assess risks and predict relevant clinical outcomes in this group of patients, as well as to discuss the pros and cons of these methods according to the current literature. Methods The study consisted of a systematic review based on analysis of manuscripts retrieved from the PubMed, LILACS and SciELO databases by searching for the key words “nutritional risk assessment”, “critically ill” and “cancer”. Results Only 6 (17.7%) of 34 initially retrieved papers met the inclusion criteria and were selected for the review. The main outcomes of these studies were that resting energy expenditure was associated with undernourishment and overfeeding. The high Patient-Generated Subjective Global Assessment score was significantly associated with low food intake, weight loss and malnutrition. In terms of biochemical markers, higher levels of creatinine, albumin and urea were significantly associated with lower mortality. The worst survival was found for patients with worse Eastern Cooperative Oncologic Group - performance status, high Glasgow Prognostic Score, low albumin, high Patient-Generated Subjective Global Assessment score and high alkaline phosphatase levels. Geriatric Nutritional Risk Index values < 87 were significantly associated with mortality. A high Prognostic Inflammatory and Nutritional Index score was associated with abnormal nutritional status in critically ill cancer patients. Among the reviewed studies that examined weight and body mass index alone, no significant clinical outcome was found. Conclusion None of the methods reviewed helped to define risk among these patients. Therefore, assessment by a combination of weight loss and serum measurements, preferably in combination with other methods using scores such as Eastern Cooperative Oncologic Group - performance status, Glasgow Prognostic Score and Patient-Generated Subjective Global Assessment, is suggested given that their use is simple, feasible and useful in such cases. PMID:26270855

24 CFR 985.3 - Indicators, HUD verification methods and ratings.

Code of Federal Regulations, 2010 CFR

2010-04-01

... 24 Housing and Urban Development 4 2010-04-01 2010-04-01 false Indicators, HUD verification..., HUD verification methods and ratings. This section states the performance indicators that are used to assess PHA Section 8 management. HUD will use the verification method identified for each indicator in...

Methods and dimensions of electronic health record data quality assessment: enabling reuse for clinical research

PubMed Central

Weng, Chunhua

2013-01-01

Objective To review the methods and dimensions of data quality assessment in the context of electronic health record (EHR) data reuse for research. Materials and methods A review of the clinical research literature discussing data quality assessment methodology for EHR data was performed. Using an iterative process, the aspects of data quality being measured were abstracted and categorized, as well as the methods of assessment used. Results Five dimensions of data quality were identified, which are completeness, correctness, concordance, plausibility, and currency, and seven broad categories of data quality assessment methods: comparison with gold standards, data element agreement, data source agreement, distribution comparison, validity checks, log review, and element presence. Discussion Examination of the methods by which clinical researchers have investigated the quality and suitability of EHR data for research shows that there are fundamental features of data quality, which may be difficult to measure, as well as proxy dimensions. Researchers interested in the reuse of EHR data for clinical research are recommended to consider the adoption of a consistent taxonomy of EHR data quality, to remain aware of the task-dependence of data quality, to integrate work on data quality assessment from other fields, and to adopt systematic, empirically driven, statistically based methods of data quality assessment. Conclusion There is currently little consistency or potential generalizability in the methods used to assess EHR data quality. If the reuse of EHR data for clinical research is to become accepted, researchers should adopt validated, systematic methods of EHR data quality assessment. PMID:22733976

The assessment of function: How is it measured? A clinical perspective

PubMed Central

Reiman, Michael P; Manske, Robert C

2011-01-01

Testing for outcome or performance can take many forms; including multiple iterations of self-reported measures of function (an assessment of the individual’s perceived dysfunction) and/or clinical special tests (which are primarily assessments of impairments). Typically absent within these testing mechanisms is whether or not one can perform a specific task associated with function. The paper will operationally define function, discuss the construct of function within the disablement model, will overview the multi-dimensional nature of ‘function’ as a concept, will examine the current evidence for functional testing methods, and will propose a functional testing continuum. Limitations of functional performance testing will be discussed including recommendations for future research. PMID:22547919

The importance of quality control in validating concentrations of contaminants of emerging concern in source and treated drinking water samples.

PubMed

Batt, Angela L; Furlong, Edward T; Mash, Heath E; Glassmeyer, Susan T; Kolpin, Dana W

2017-02-01

A national-scale survey of 247 contaminants of emerging concern (CECs), including organic and inorganic chemical compounds, and microbial contaminants, was conducted in source and treated drinking water samples from 25 treatment plants across the United States. Multiple methods were used to determine these CECs, including six analytical methods to measure 174 pharmaceuticals, personal care products, and pesticides. A three-component quality assurance/quality control (QA/QC) program was designed for the subset of 174 CECs which allowed us to assess and compare performances of the methods used. The three components included: 1) a common field QA/QC protocol and sample design, 2) individual investigator-developed method-specific QA/QC protocols, and 3) a suite of 46 method comparison analytes that were determined in two or more analytical methods. Overall method performance for the 174 organic chemical CECs was assessed by comparing spiked recoveries in reagent, source, and treated water over a two-year period. In addition to the 247 CECs reported in the larger drinking water study, another 48 pharmaceutical compounds measured did not consistently meet predetermined quality standards. Methodologies that did not seem suitable for these analytes are overviewed. The need to exclude analytes based on method performance demonstrates the importance of additional QA/QC protocols. Published by Elsevier B.V.

Experimental Validation of Normalized Uniform Load Surface Curvature Method for Damage Localization

PubMed Central

Jung, Ho-Yeon; Sung, Seung-Hoon; Jung, Hyung-Jo

2015-01-01

In this study, we experimentally validated the normalized uniform load surface (NULS) curvature method, which has been developed recently to assess damage localization in beam-type structures. The normalization technique allows for the accurate assessment of damage localization with greater sensitivity irrespective of the damage location. In this study, damage to a simply supported beam was numerically and experimentally investigated on the basis of the changes in the NULS curvatures, which were estimated from the modal flexibility matrices obtained from the acceleration responses under an ambient excitation. Two damage scenarios were considered for the single damage case as well as the multiple damages case by reducing the bending stiffness (EI) of the affected element(s). Numerical simulations were performed using MATLAB as a preliminary step. During the validation experiments, a series of tests were performed. It was found that the damage locations could be identified successfully without any false-positive or false-negative detections using the proposed method. For comparison, the damage detection performances were compared with those of two other well-known methods based on the modal flexibility matrix, namely, the uniform load surface (ULS) method and the ULS curvature method. It was confirmed that the proposed method is more effective for investigating the damage locations of simply supported beams than the two conventional methods in terms of sensitivity to damage under measurement noise. PMID:26501286

Working postures of dental students: ergonomic analysis using the Ovako Working Analysis System and rapid upper limb assessment.

PubMed

Petromilli Nordi Sasso Garcia, Patrícia; Polli, Gabriela Scatimburgo; Campos, Juliana Alvares Duarte Bonini

2013-01-01

As dentistry is a profession that demands a manipulative precision of hand movements, musculoskeletal disorders are among the most common occupational diseases. This study estimated the risk of musculoskeletal disorders developing in dental students using the Ovako Working Analysis System (OWAS) and Rapid Upper Limb Assessment (RULA) methods, and estimated the diagnostic agreement between the 2 methods. Students (n = 75), enrolled in the final undergraduate year at the Araraquara School of Dentistry--UNESP--were studied. Photographs were taken of students while performing diverse clinical procedures (n = 283) using a digital camera, which were assessed using OWAS and RULA. A risk score was attributed following each procedure performed by the student. The prevalence of the risk of musculoskeletal disorders was estimated per point and for a 95% CI. To assess the agreement between the 2 methods, Kappa statistics with linear weighting were used. The level of significance adopted was 5%. There was a high prevalence of the mean score for risk of musculoskeletal disorders in the dental students evaluated according to the OWAS method (p = 97.88%; 95% CI: 96.20-99.56%), and a high prevalence of the high score (p = 40.6; 95% CI: 34.9-46.4%) and extremely high risk (p = 59.4%; 95% CI: 53.6-65.1%) according to RULA method Null agreement was verified (k = 0) in the risk di agnosis of the tested methods. The risk of musculoskeletal disorders in dental students estimated by the OWAS method was medium, whereas the same risk by the RULA method was extremely high. There was no diagnostic agreement between the OWAS and RULA methods.

[The methods of assessment of health risk from exposure to radon and radon daughters].

PubMed

Demin, V F; Zhukovskiy, M V; Kiselev, S M

2014-01-01

The critical analysis of existing models of the relationship dose-effect (RDE) for radon exposure on human health has been performed. Conclusion about the necessity and possibility of improving these models has been made. A new improved version ofthe RDE has been developed. A technique for assessing the human health risk of exposure to radon, including the method for estimating of exposure doses of radon, an improved model of RDE, proper methodology risk assessment has been described. Methodology is proposed for the use in the territory of Russia.

Bearing performance degradation assessment based on time-frequency code features and SOM network

NASA Astrophysics Data System (ADS)

Zhang, Yan; Tang, Baoping; Han, Yan; Deng, Lei

2017-04-01

Bearing performance degradation assessment and prognostics are extremely important in supporting maintenance decision and guaranteeing the system’s reliability. To achieve this goal, this paper proposes a novel feature extraction method for the degradation assessment and prognostics of bearings. Features of time-frequency codes (TFCs) are extracted from the time-frequency distribution using a hybrid procedure based on short-time Fourier transform (STFT) and non-negative matrix factorization (NMF) theory. An alternative way to design the health indicator is investigated by quantifying the similarity between feature vectors using a self-organizing map (SOM) network. On the basis of this idea, a new health indicator called time-frequency code quantification error (TFCQE) is proposed to assess the performance degradation of the bearing. This indicator is constructed based on the bearing real-time behavior and the SOM model that is previously trained with only the TFC vectors under the normal condition. Vibration signals collected from the bearing run-to-failure tests are used to validate the developed method. The comparison results demonstrate the superiority of the proposed TFCQE indicator over many other traditional features in terms of feature quality metrics, incipient degradation identification and achieving accurate prediction. Highlights • Time-frequency codes are extracted to reflect the signals’ characteristics. • SOM network served as a tool to quantify the similarity between feature vectors. • A new health indicator is proposed to demonstrate the whole stage of degradation development. • The method is useful for extracting the degradation features and detecting the incipient degradation. • The superiority of the proposed method is verified using experimental data.

Tracking of Indels by DEcomposition is a Simple and Effective Method to Assess Efficiency of Guide RNAs in Zebrafish.

PubMed

Etard, Christelle; Joshi, Swarnima; Stegmaier, Johannes; Mikut, Ralf; Strähle, Uwe

2017-12-01

A bottleneck in CRISPR/Cas9 genome editing is variable efficiencies of in silico-designed gRNAs. We evaluated the sensitivity of the TIDE method (Tracking of Indels by DEcomposition) introduced by Brinkman et al. in 2014 for assessing the cutting efficiencies of gRNAs in zebrafish. We show that this simple method, which involves bulk polymerase chain reaction amplification and Sanger sequencing, is highly effective in tracking well-performing gRNAs in pools of genomic DNA derived from injected embryos. The method is equally effective for tracing INDELs in heterozygotes.

[Regression on order statistics and its application in estimating nondetects for food exposure assessment].

PubMed

Yu, Xiaojin; Liu, Pei; Min, Jie; Chen, Qiguang

2009-01-01

To explore the application of regression on order statistics (ROS) in estimating nondetects for food exposure assessment. Regression on order statistics was adopted in analysis of cadmium residual data set from global food contaminant monitoring, the mean residual was estimated basing SAS programming and compared with the results from substitution methods. The results show that ROS method performs better obviously than substitution methods for being robust and convenient for posterior analysis. Regression on order statistics is worth to adopt,but more efforts should be make for details of application of this method.

Research on Holographic Evaluation of Service Quality in Power Data Network

NASA Astrophysics Data System (ADS)

Wei, Chen; Jing, Tao; Ji, Yutong

2018-01-01

With the rapid development of power data network, the continuous development of the Power data application service system, more and more service systems are being put into operation. Following this, the higher requirements for network quality and service quality are raised, in the actual process for the network operation and maintenance. This paper describes the electricity network and data network services status. A holographic assessment model was presented to achieve a comprehensive intelligence assessment on the power data network and quality of service in the operation and maintenance on the power data network. This evaluation method avoids the problems caused by traditional means which performs a single assessment of network performance quality. This intelligent Evaluation method can improve the efficiency of network operation and maintenance guarantee the quality of real-time service in the power data network..

Optical Assessment of Caries Lesion Structure and Activity

NASA Astrophysics Data System (ADS)

Lee, Robert Chulsung

New, more sophisticated diagnostic tools are needed for the detection and characterization of caries lesions in the early stages of development. It is not sufficient to simply detect caries lesions, methods are needed to assess the activity of the lesion and determine if chemical or surgical intervention is needed. Previous studies have demonstrated that polarization sensitive optical coherence tomography (PS-OCT) can be used to nondestructively image the subsurface lesion structure and measure the thickness of the highly mineralized surface zone. Other studies have demonstrated that the rate of dehydration can be correlated with the lesion activity and that the rate can be measured using optical methods. The main objective of this work was to test the hypothesis that optical methods can be used to assess lesion activity on tooth coronal and root surfaces. Simulated caries models were used to develop and validate an algorithm for detecting and measuring the highly mineralized surface layer using PS-OCT. This work confirmed that the algorithm was capable of estimating the thickness of the highly mineralized surface layer with high accuracy. Near-infrared (NIR) reflectance and thermal imaging methods were used to assess activity of caries lesions by measuring the state of lesion hydration. NIR reflectance imaging performed the best for artificial enamel and natural coronal caries lesion samples, particularly at wavelengths coincident with the water absorption band at 1460-nm. However, thermal imaging performed the best for artificial dentin and natural root caries lesion samples. These novel optical methods outperformed the conventional methods (ICDAS II) in accurately assessing lesion activity of natural coronal and root caries lesions. Infrared-based imaging methods have shown potential for in-vivo applications to objectively assess caries lesion activity in a single examination. It is likely that if future clinical trials are a success, this novel imaging technology will be employed for the detection and monitoring of early carious lesions without the use of ionizing radiation, thereby enabling conservative non-surgical intervention and the preservation of healthy tissue structure.

Facilitation Standards: A Mixed Methods Study

ERIC Educational Resources Information Center

Hunter, Jennifer

2017-01-01

Online education is increasing as a solution to manage ever increasing enrollment numbers at higher education institutions. Intentionally and thoughtfully constructed courses allow students to improve performance through practice and self-assessment and instructors benefit from improving consistency in providing content and assessing process,…

PRELIMINARY EXPOSURE ASSESSMENT FINDINGS FROM THE TAMPA ASTHMATIC CHILDREN'S STUDY

EPA Science Inventory

The Tampa Asthmatic Children's Study (TACS) was a pilot study that focused on developing and evaluating air pollution exposure assessment methods and participant recruiting tools. The four-week study was performed in October and November, 2003. The study involved repeated daily...

EXPOSURE ASSESSMENT FINDINGS FROM THE TAMPA ASTHMATIC CHILDREN'S STUDY (TACS)

EPA Science Inventory

The Tampa Asthmatic Children's Study (TACS) was a pilot study that focused on developing and evaluating air pollution exposure assessment methods and participant recruiting tools. The four-week study was performed in October and November, 2003. The study involved repeated daily...

Getting Real: Implementing Assessment Alternatives in Mathematics.

ERIC Educational Resources Information Center

Hopkins, Martha H.

1997-01-01

Recounts experiences of a university professor who returned to the elementary classroom and attempted to implement the National Council of Teachers of Mathematics Standards and appropriate assessment methods, including nontraditional paper-and-pencil tasks, journal-like writing assignments, focused observations, and performance-based assessments…

Assessing aspects of creativity in deaf and hearing high school students.

PubMed

Stanzione, Christopher M; Perez, Susan M; Lederberg, Amy R

2013-04-01

To address the paucity of current research on the development of creativity in deaf students, and to extend existing research to adolescents, the present study investigated divergent thinking, a method of assessing creativity, in both deaf and hearing adolescents. We assessed divergent thinking in two domains, figural and verbal, while also adjusting the instructional method in written format, sign language, or spoken English. Deaf students' performance was equal to, or more creative than, hearing students on the figural assessment of divergent thinking, but less creative on the verbal assessment. Additional studies should be conducted to determine whether this was an anomalous finding or one that might contribute to hypotheses yielding effective interventions.

A comparative study of biodegradability of a carcinogenic aromatic amine (4,4'-diaminodiphenylmethane) with OECD 301 test methods.

PubMed

Mei, Cheng-Fang; Liu, Yan-Zhen; Long, Wei-Nian; Sun, Guo-Ping; Zeng, Guo-Qu; Xu, Mei-Ying; Luan, Tian-Gang

2015-01-01

4,4'-Diaminodiphenylmethane (MDA) is a widely used compound in industries. Studies on the biodegradability of MDA are necessary for environmental hazard identification and risk assessment. Previous studies have suggested that MDA was not readily biodegradable. In the present study, three batches of biodegradation tests (OECD 301A, B, D and F tests) were performed on MDA in June, August and December of 2012. MDA was found to be readily biodegradable and produced colored intermediates in the 301A, B and F test systems. MDA biodegradation measurements were consistent among the three batches of tests. Differences in the extent of biodegradation determined in different methods originated from different test conditions and assessment endpoints. The 301D test has stringent test conditions and is usually performed on chemicals that are toxic to microorganisms, so the test results obtained from 301D tests are less meaningful for evaluating the biodegradability of MDA. The low MDA biodegradation measurements in the 301B tests compared to the 301A and F tests were due to the assessment method, which did not account for MDA incorporation into biomass in its calculation of CO2 formation rate. The differences in the biodegradation rates, as measured by the different OECD 301 test systems, could also be related to the structure and properties of the chemical. For test substances that can be assessed by all OECD 301 test methods, the highest biodegradation values may be obtained from the 301A and F test methods. This study provides new information to assess the environmental fate in the risk assessment of MDA. Copyright © 2014 Elsevier Inc. All rights reserved.

Assessment of masticatory performance by means of a color-changeable chewing gum.

PubMed

Tarkowska, Agnieszka; Katzer, Lukasz; Ahlers, Marcus Oliver

2017-01-01

Previous research determined the relevance of masticatory performance with regard to nutritional status, cognitive functions, or stress management. In addition, the measurement of masticatory efficiency contributes to the evaluation of therapeutic successes within the stomatognathic system. However, the question remains unanswered as to what extent modern techniques are able to reproduce the subtle differences in masticatory efficiency within various patient groups. The purpose of this review is to provide an extensive summary of the evaluation of masticatory performance by means of a color-changeable chewing gum with regard to its clinical relevance and applicability. A general overview describing the various methods available for this task has already been published. This review focuses in depth on the research findings available on the technique of measuring masticatory performance by means of color-changeable chewing gum. Described are the mechanism and the differentiability of the color change and methods to evaluate the color changes. Subsequently, research on masticatory performance is conducted with regard to patient age groups, the impact of general diseases and the effect of prosthetic and surgical treatment. The studies indicate that color-changeable chewing gum is a valid and reliable method for the evaluation of masticatory function. Apart from other methods, in clinical practice this technique can enhance dental diagnostics as well as the assessment of therapy outcomes. Copyright © 2016 Japan Prosthodontic Society. Published by Elsevier Ltd. All rights reserved.

A novel test method to determine the filter material service life of decentralized systems treating runoff from traffic areas.

PubMed

Huber, Maximilian; Welker, Antje; Dierschke, Martina; Drewes, Jörg E; Helmreich, Brigitte

2016-09-01

In recent years, there has been a significant increase in the development and application of technical decentralized filter systems for the treatment of runoff from traffic areas. However, there are still many uncertainties regarding the service life and the performance of filter materials that are employed in decentralized treatment systems. These filter media are designed to prevent the transport of pollutants into the environment. A novel pilot-scale test method was developed to determine - within a few days - the service lives and long-term removal efficiencies for dissolved heavy metals in stormwater treatment systems. The proposed method consists of several steps including preloading the filter media in a pilot-scale model with copper and zinc by a load of n-1 years of the estimated service life (n). Subsequently, three representative rain events are simulated to evaluate the long-term performance by dissolved copper and zinc during the last year of application. The presented results, which verified the applicability of this method, were obtained for three filter channel systems and six filter shaft systems. The performance of the evaluated systems varied largely for both tested heavy metals and during all three simulated rain events. A validation of the pilot-scale assessment method with field measurements was also performed for two systems. Findings of this study suggest that this novel method does provide a standardized and accurate estimation of service intervals of decentralized treatment systems employing various filter materials. The method also provides regulatory authorities, designers, and operators with an objective basis for performance assessment and supports stormwater managers to make decisions for the installation of such decentralized treatment systems. Copyright © 2016 Elsevier Ltd. All rights reserved.

Standardization for Ki-67 Assessment in Moderately Differentiated Breast Cancer. A Retrospective Analysis of the SAKK 28/12 Study

PubMed Central

Varga, Zsuzsanna; Cassoly, Estelle; Li, Qiyu; Oehlschlegel, Christian; Tapia, Coya; Lehr, Hans Anton; Klingbiel, Dirk; Thürlimann, Beat; Ruhstaller, Thomas

2015-01-01

Background Proliferative activity (Ki-67 Labelling Index) in breast cancer increasingly serves as an additional tool in the decision for or against adjuvant chemotherapy in midrange hormone receptor positive breast cancer. Ki-67 Index has been previously shown to suffer from high inter-observer variability especially in midrange (G2) breast carcinomas. In this study we conducted a systematic approach using different Ki-67 assessments on large tissue sections in order to identify the method with the highest reliability and the lowest variability. Materials and Methods Five breast pathologists retrospectively analyzed proliferative activity of 50 G2 invasive breast carcinomas using large tissue sections by assessing Ki-67 immunohistochemistry. Ki-67-assessments were done on light microscopy and on digital images following these methods: 1) assessing five regions, 2) assessing only darkly stained nuclei and 3) considering only condensed proliferative areas (‘hotspots’). An individual review (the first described assessment from 2008) was also performed. The assessments on light microscopy were done by estimating. All measurements were performed three times. Inter-observer and intra-observer reliabilities were calculated using the approach proposed by Eliasziw et al. Clinical cutoffs (14% and 20%) were tested using Fleiss’ Kappa. Results There was a good intra-observer reliability in 5 of 7 methods (ICC: 0.76–0.89). The two highest inter-observer reliability was fair to moderate (ICC: 0.71 and 0.74) in 2 methods (region-analysis and individual-review) on light microscopy. Fleiss’-kappa-values (14% cut-off) were the highest (moderate) using the original recommendation on light-microscope (Kappa 0.58). Fleiss’ kappa values (20% cut-off) were the highest (Kappa 0.48 each) in analyzing hotspots on light-microscopy and digital-analysis. No methodologies using digital-analysis were superior to the methods on light microscope. Conclusion Our results show that all methods on light-microscopy for Ki-67 assessment in large tissue sections resulted in a good intra-observer reliability. Region analysis and individual review (the original recommendation) on light-microscopy yielded the highest inter-observer reliability. These results show slight improvement to previously published data on poor-reproducibility and thus might be a practical-pragmatic way for routine assessment of Ki-67 Index in G2 breast carcinomas. PMID:25885288

The Influence of Rater Effects in Training Sets on the Psychometric Quality of Automated Scoring for Writing Assessments

ERIC Educational Resources Information Center

Wind, Stefanie A.; Wolfe, Edward W.; Engelhard, George, Jr.; Foltz, Peter; Rosenstein, Mark

2018-01-01

Automated essay scoring engines (AESEs) are becoming increasingly popular as an efficient method for performance assessments in writing, including many language assessments that are used worldwide. Before they can be used operationally, AESEs must be "trained" using machine-learning techniques that incorporate human ratings. However, the…

Measuring Student Performance: Assessment in the Social Studies. Theme Issue.

ERIC Educational Resources Information Center

Kiernan, Henry, Ed.; Pyne, John, Ed.

1993-01-01

The four articles in this theme issue provide an overview of assessment in the social studies and the rationale behind the movement for a more authentic assessment of learning outcomes. In the first article, "Thinking as an Unnatural Act," William T. Daly offers a clear rationale for social studies teachers to re-examine the methods of assessing…

Benefits of Music Training in Mandarin-Speaking Pediatric Cochlear Implant Users

ERIC Educational Resources Information Center

Fu, Qian-Jie; Galvin, John J., III; Wang, Xiaosong; Wu, Jiunn-Liang

2015-01-01

Purpose: The aims of this study were to assess young (5- to 10-year-old) Mandarin-speaking cochlear implant (CI) users' musical pitch perception and to assess the benefits of computer-based home training on performance. Method: Melodic contour identification (MCI) was used to assess musical pitch perception in 14 Mandarin-speaking pediatric CI…

Predicting Academic Achievement Growth among Low-Income Mexican American Learners Using Dynamic and Static Assessments

ERIC Educational Resources Information Center

Matthews, Michael S.; Farmer, Jennie

2017-01-01

Dynamic assessment methods, initially developed by Feuerstein in the 1970s, have been recommended as being more equitable for identifying the academic abilities of students who may not perform well on traditional assessments due to these learners' cultural, linguistic, or economic differences from the population for whom the traditional measures…

Standardized Uptake Value Ratio-Independent Evaluation of Brain Amyloidosis.

PubMed

Chincarini, Andrea; Sensi, Francesco; Rei, Luca; Bossert, Irene; Morbelli, Silvia; Guerra, Ugo Paolo; Frisoni, Giovanni; Padovani, Alessandro; Nobili, Flavio

2016-10-18

The assessment of in vivo18F images targeting amyloid deposition is currently carried on by visual rating with an optional quantification based on standardized uptake value ratio (SUVr) measurements. We target the difficulties of image reading and possible shortcomings of the SUVr methods by validating a new semi-quantitative approach named ELBA. ELBA involves a minimal image preprocessing and does not rely on small, specific regions of interest (ROIs). It evaluates the whole brain and delivers a geometrical/intensity score to be used for ranking and dichotomic assessment. The method was applied to adniimages 18F-florbetapir images from the ADNI database. Five expert readers provided visual assessment in blind and open sessions. The longitudinal trend and the comparison to SUVr measurements were also evaluated. ELBA performed with area under the roc curve (AUC) = 0.997 versus the visual assessment. The score was significantly correlated to the SUVr values (r = 0.86, p < 10-4). The longitudinal analysis estimated a test/retest error of ≃2.3%. Cohort and longitudinal analysis suggests that the ELBA method accurately ranks the brain amyloid burden. The expert readers confirmed its relevance in aiding the visual assessment in a significant number (85) of difficult cases. Despite the good performance, poor and uneven image quality constitutes the major limitation.

Detection of fatigue cracks by nondestructive testing methods

NASA Technical Reports Server (NTRS)

Anderson, R. T.; Delacy, T. J.; Stewart, R. C.

1973-01-01

The effectiveness was assessed of various NDT methods to detect small tight cracks by randomly introducing fatigue cracks into aluminum sheets. The study included optimizing NDT methods calibrating NDT equipment with fatigue cracked standards, and evaluating a number of cracked specimens by the optimized NDT methods. The evaluations were conducted by highly trained personnel, provided with detailed procedures, in order to minimize the effects of human variability. These personnel performed the NDT on the test specimens without knowledge of the flaw locations and reported on the flaws detected. The performance of these tests was measured by comparing the flaws detected against the flaws present. The principal NDT methods utilized were radiographic, ultrasonic, penetrant, and eddy current. Holographic interferometry, acoustic emission monitoring, and replication methods were also applied on a reduced number of specimens. Generally, the best performance was shown by eddy current, ultrasonic, penetrant and holographic tests. Etching provided no measurable improvement, while proof loading improved flaw detectability. Data are shown that quantify the performances of the NDT methods applied.

Systematic behavioural observation of executive performance after brain injury.

PubMed

Lewis, Mark W; Babbage, Duncan R; Leathem, Janet M

2017-01-01

To develop an ecologically valid measure of executive functioning (i.e. Planning and Organization, Executive Memory, Initiation, Cognitive Shifting, Impulsivity, Sustained and Directed Attention, Error Detection, Error Correction and Time Management) during a functional chocolate brownie cooking task. In Study 1, the inter-rater reliability of a novel behavioural observation assessment method was assessed with 10 people with traumatic brain injury (TBI). In Study 2, 27 people with TBI and 16 healthy controls completed the functional task along with other measures of executive functioning to assess validity. Intraclass correlation coefficients for six of the nine aspects of executive functioning ranged from .54 to 1.00. Percentage agreements for the remaining aspects ranged from 70% to 90%. Significant and non-significant, moderate, correlations were found between the functional cooking task and standard neuropsychological measures. The healthy control group performed better than the TBI group in six areas (d = 0.56 to 1.23). In this initial trial of a novel assessment method, adequate inter-rater reliability was found. The measure was associated with standard neuropsychological measures, and our healthy control group performed better than the TBI group. The measure appears to be an ecologically valid measure of executive functioning.

Team Performance Assessment and Measurement: Theory, Methods, and Applications. Series in Applied Psychology.

ERIC Educational Resources Information Center

Brannick, Michael T., Ed.; Salas, Eduardo, Ed.; Prince, Carolyn, Ed.

This volume presents thoughts on measuring team performance written by experts currently working with teams in fields such as training, evaluation, and process consultation. The chapters are: (1) "An Overview of Team Performance Measurement" (Michael T. Brannick and Carolyn Prince); (2) "A Conceptual Framework for Teamwork Measurement" (Terry L.…

Effects of Warm-Up Stretching Exercises on Sprint Performance

ERIC Educational Resources Information Center

Makaruk, Hubert; Makaruk, Beata; Kedra, Stanislaw

2008-01-01

Study aim: To assess direct effects of warm-up consisting of static and dynamic stretching exercises on sprint results attained by students differing in sprint performance. Material and methods: A group of 24 male and 19 female physical education students, including 12 and 9 sprinters, respectively. They performed warm-ups consisting of dynamic…

A Quantitative Assessment of Classroom Teaching and Learning in Engineering Education

ERIC Educational Resources Information Center

Agrawal, D. K.; Khan, Q. M.

2008-01-01

All stakeholders are aware of the importance of measuring performance in higher education at the university/college level. Generally the performance indicators used for this purpose have focused on graduation rates and/or final examination scores, rather than the performance-enabling processes. Further, the most commonly used method for knowledge…

The Relationship between Emotional Intelligence and Student Teacher Performance

ERIC Educational Resources Information Center

Drew, Todd L.

2006-01-01

The purpose of this mixed methods study (N = 40) was to determine whether Student Teacher Performance (STP), as measured by a behavior-based performance evaluation process, is associated with Emotional Intelligence (EI), as measured by a personality assessment instrument. The study is an important contribution to the literature in that it appears…

Measurement of Energy Performances for General-Structured Servers

NASA Astrophysics Data System (ADS)

Liu, Ren; Chen, Lili; Li, Pengcheng; Liu, Meng; Chen, Haihong

2017-11-01

Energy consumption of servers in data centers increases rapidly along with the wide application of Internet and connected devices. To improve the energy efficiency of servers, voluntary or mandatory energy efficiency programs for servers, including voluntary label program or mandatory energy performance standards have been adopted or being prepared in the US, EU and China. However, the energy performance of servers and testing methods of servers are not well defined. This paper presents matrices to measure the energy performances of general-structured servers. The impacts of various components of servers on their energy performances are also analyzed. Based on a set of normalized workload, the author proposes a standard method for testing energy efficiency of servers. Pilot tests are conducted to assess the energy performance testing methods of servers. The findings of the tests are discussed in the paper.

Assessment of methodologies for analysis of the dungeness B accidental aircraft crash risk.

DOE Office of Scientific and Technical Information (OSTI.GOV)

LaChance, Jeffrey L.; Hansen, Clifford W.

2010-09-01

The Health and Safety Executive (HSE) has requested Sandia National Laboratories (SNL) to review the aircraft crash methodology for nuclear facilities that are being used in the United Kingdom (UK). The scope of the work included a review of one method utilized in the UK for assessing the potential for accidental airplane crashes into nuclear facilities (Task 1) and a comparison of the UK methodology against similar International Atomic Energy Agency (IAEA), United States (US) Department of Energy (DOE), and the US Nuclear Regulatory Commission (NRC) methods (Task 2). Based on the conclusions from Tasks 1 and 2, an additionalmore » Task 3 would provide an assessment of a site-specific crash frequency for the Dungeness B facility using one of the other methodologies. This report documents the results of Task 2. The comparison of the different methods was performed for the three primary contributors to aircraft crash risk at the Dungeness B site: airfield related crashes, crashes below airways, and background crashes. The methods and data specified in each methodology were compared for each of these risk contributors, differences in the methodologies were identified, and the importance of these differences was qualitatively and quantitatively assessed. The bases for each of the methods and the data used were considered in this assessment process. A comparison of the treatment of the consequences of the aircraft crashes was not included in this assessment because the frequency of crashes into critical structures is currently low based on the existing Dungeness B assessment. Although the comparison found substantial differences between the UK and the three alternative methodologies (IAEA, NRC, and DOE) this assessment concludes that use of any of these alternative methodologies would not change the conclusions reached for the Dungeness B site. Performance of Task 3 is thus not recommended.« less

Teaching and assessing technical proficiency in surgical subspecialty fellowships.

PubMed

Gearhart, Susan L; Wang, Ming-Hsien; Gilson, Marta M; Chen, Belinda; Kern, David E

2012-01-01

To determine how programs are teaching and assessing procedural skills, and their perceived success. Cross-sectional survey. Accreditation Council for Graduate Medical Education (ACGME) approved training programs in pediatric urology and colorectal surgery. Program directors and recent graduates (2007-2009). Thirty-nine program directors (60%), and 57 graduates (64%) responded; 89.5% of graduates and 94.9% of program directors felt training occurred successfully for the procedures that trainees were performing in their present practice. Nearly 90% of trainees and all program directors reported that there was no formal assessment of procedural competency at the beginning of training, although 66.7% of program directors reported that trainees were assessed "informally." Both program directors and trainees reported dialogue with faculty was the most frequent method used in preparing for operative procedures. Other methods (textbook/atlas, journals, web-based programs, videos) were used less frequently. Program directors with shorter tenure were more likely to use web-based and video methods; younger trainees were less likely to use textbooks/atlases. Faculty feedback on clinical decision-making and postprocedural review were perceived by both program directors and trainees as the most effective assessment methods for improving performance; however, trainees were more likely than program directors to report that postprocedure reviews were not included in their training (15.8% vs 9%, p = 0.045). Patient outcomes, written feedback from peers, and self-assessment were included in most programs, but valued less. Simulation was used in only about half the programs and was valued more highly by trainees than program directors (p = 0.011). Training in procedural proficiency was viewed as successful by both program directors and graduates. Dialogue with, assessment by, and feedback from faculty were frequently used and most valued; stressing the importance of the facilitator role of faculty in the education of the trainee. These findings provide guidance for the development of newer methods of teaching and assessment. Copyright © 2012 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

T59. VIRTUAL REALTY ASSESSMENT OF FUNCTIONAL CAPACITY IN EARLY SCHIZOPHRENIA: ASSOCIATIONS WITH NEUROCOGNITION, FUNCTIONAL CAPACITY PERFORMANCE, AND DAILY FUNCTIONING

PubMed Central

Ventura, Joseph; Welikson, Tamara; Subotnik, Kenneth L; Ered, Arielle; Keefe, Richard; Hellemann, Gerhard H; Nuechterlein, Keith H

2018-01-01

Abstract Background Research using virtual reality assessment of functional capacity has shown promise as a reliable and valid way to assess treatment response in patients with established schizophrenia. There has been little work on virtual reality based assessments of functional capacity for patients in the early phase of schizophrenia. We examined whether virtual reality based assessment methods reveal functional capacity deficits in young patients and relevant relationships with established measures of neurocognition, functional capacity performance, and daily functioning. Methods The sample consisted of UCLA Aftercare Research Program patients (n=42) who were diagnosed by trained raters administering the SCID and who met criteria for schizophrenia, schizoaffective disorder, or schizophreniform disorder, and screened normal control subjects (n=13). Patients were within 2 years of their first psychotic episode upon clinic entry, were an average of 23.2 years old, and had an average of 12.9 years of education. The Virtual Reality Functional Capacity Assessment Tool (VRFCAT) was the computer-based measure of functional capacity. We used the MATRICS Consensus Cognitive Battery (MCCB) as an objective measure of neurocognition and the UCSD Performance-Based Skills Assessment (UPSA) to assess functional capacity performance. The Global Functioning Scale: Role and Social, and the Role Functioning Scale were used to assess work and school performance, familial interactions, and social functioning. Results We were able to confirm that the deficit in functional capacity performance measured using VRFCAT is present in the early course of schizophrenia in that the patients were slower and committed more errors (M=830.41) as compared with normal controls (M=716.84; t=3.0, p<.01). Virtual reality based assessment of functional capacity was correlated with objective measures of neurocognition (MCCB Overall Composite), r=-.71, p=<.01, standard approaches to functional capacity assessment (UPSA), r=-.66, p=<.01, work and school functioning (r=-.52, p<.01), and level of social relationships (r=-.43, p=<.03), but not familial relationships (r=-.03, p=.87). Interestingly, neither neurocognition (MCCB) nor functional capacity performance (UPSA) were correlated with the level of familial relationships. Discussion We extend previous findings in that even patients in the early course of schizophrenia showed virtual reality based functional capacity performance deficits when compared with normal control subjects. Virtual reality based performance was correlated with neurocognition, suggesting that it may be sensitive to changes in cognition. Furthermore, correlations with everyday work/school and social functioning indicate promise as a co-primary measure to index change in functioning in response to treatment. Interestingly, none of our measures of functional capacity or neurocognition were correlated with familial relationships indicating that the determinates of family interactions might be driven by factors other than cognitive capacities.

Performance Assessment Method for a Forged Fingerprint Detection Algorithm

NASA Astrophysics Data System (ADS)

Shin, Yong Nyuo; Jun, In-Kyung; Kim, Hyun; Shin, Woochang

The threat of invasion of privacy and of the illegal appropriation of information both increase with the expansion of the biometrics service environment to open systems. However, while certificates or smart cards can easily be cancelled and reissued if found to be missing, there is no way to recover the unique biometric information of an individual following a security breach. With the recognition that this threat factor may disrupt the large-scale civil service operations approaching implementation, such as electronic ID cards and e-Government systems, many agencies and vendors around the world continue to develop forged fingerprint detection technology, but no objective performance assessment method has, to date, been reported. Therefore, in this paper, we propose a methodology designed to evaluate the objective performance of the forged fingerprint detection technology that is currently attracting a great deal of attention.

An analytical framework for estimating aquatic species density from environmental DNA

USGS Publications Warehouse

Chambert, Thierry; Pilliod, David S.; Goldberg, Caren S.; Doi, Hideyuki; Takahara, Teruhiko

2018-01-01

Environmental DNA (eDNA) analysis of water samples is on the brink of becoming a standard monitoring method for aquatic species. This method has improved detection rates over conventional survey methods and thus has demonstrated effectiveness for estimation of site occupancy and species distribution. The frontier of eDNA applications, however, is to infer species density. Building upon previous studies, we present and assess a modeling approach that aims at inferring animal density from eDNA. The modeling combines eDNA and animal count data from a subset of sites to estimate species density (and associated uncertainties) at other sites where only eDNA data are available. As a proof of concept, we first perform a cross-validation study using experimental data on carp in mesocosms. In these data, fish densities are known without error, which allows us to test the performance of the method with known data. We then evaluate the model using field data from a study on a stream salamander species to assess the potential of this method to work in natural settings, where density can never be known with absolute certainty. Two alternative distributions (Normal and Negative Binomial) to model variability in eDNA concentration data are assessed. Assessment based on the proof of concept data (carp) revealed that the Negative Binomial model provided much more accurate estimates than the model based on a Normal distribution, likely because eDNA data tend to be overdispersed. Greater imprecision was found when we applied the method to the field data, but the Negative Binomial model still provided useful density estimates. We call for further model development in this direction, as well as further research targeted at sampling design optimization. It will be important to assess these approaches on a broad range of study systems.

Assessment of Attention in Preschoolers

PubMed Central

Mahone, E.M.; Schneider, H.E.

2012-01-01

In the past two decades, there has been an increased interest in the assessment and treatment of preschool children presenting with concerns about attention problems. This article reviews the research and clinical literature involving assessment of attention and related skills in the preschool years. While inattention among preschoolers is common, symptoms alone do not necessarily indicate a disorder, and most often represent a normal variation in typical preschool child development. Thus, accurate identification of “disordered” attention in preschoolers can be challenging, and development of appropriate, norm-referenced tests of attention for preschoolers is also difficult. The current review suggests that comprehensive assessment of attention and related functions in the preschool child should include thorough review of the child’s history, planned observations, and formal psychometric testing. The three primary methods of psychometric assessment that have been used to characterize attentional functioning in preschool children include performance-based tests, structured caregiver interviews, and rating scales (parent, teacher, and clinician). Among performance-based methods for measurement of attention in the preschool years, tests have been developed to assess sustained attention, selective (focused) attention, span of attention (encoding/manipulation), and (top-down) controlled attention—including freedom from distractibility and set shifting. Many of these tests remain experimental in nature, and review of published methods yields relatively few commercially available, nationally normed tests of attention for preschoolers, and an overall dearth of reliability and validity studies on the available measures. PMID:23090646

Performance of in silico tools for the evaluation of p16INK4a (CDKN2A) variants in CAGI.

PubMed

Carraro, Marco; Minervini, Giovanni; Giollo, Manuel; Bromberg, Yana; Capriotti, Emidio; Casadio, Rita; Dunbrack, Roland; Elefanti, Lisa; Fariselli, Pietro; Ferrari, Carlo; Gough, Julian; Katsonis, Panagiotis; Leonardi, Emanuela; Lichtarge, Olivier; Menin, Chiara; Martelli, Pier Luigi; Niroula, Abhishek; Pal, Lipika R; Repo, Susanna; Scaini, Maria Chiara; Vihinen, Mauno; Wei, Qiong; Xu, Qifang; Yang, Yuedong; Yin, Yizhou; Zaucha, Jan; Zhao, Huiying; Zhou, Yaoqi; Brenner, Steven E; Moult, John; Tosatto, Silvio C E

2017-09-01

Correct phenotypic interpretation of variants of unknown significance for cancer-associated genes is a diagnostic challenge as genetic screenings gain in popularity in the next-generation sequencing era. The Critical Assessment of Genome Interpretation (CAGI) experiment aims to test and define the state of the art of genotype-phenotype interpretation. Here, we present the assessment of the CAGI p16INK4a challenge. Participants were asked to predict the effect on cellular proliferation of 10 variants for the p16INK4a tumor suppressor, a cyclin-dependent kinase inhibitor encoded by the CDKN2A gene. Twenty-two pathogenicity predictors were assessed with a variety of accuracy measures for reliability in a medical context. Different assessment measures were combined in an overall ranking to provide more robust results. The R scripts used for assessment are publicly available from a GitHub repository for future use in similar assessment exercises. Despite a limited test-set size, our findings show a variety of results, with some methods performing significantly better. Methods combining different strategies frequently outperform simpler approaches. The best predictor, Yang&Zhou lab, uses a machine learning method combining an empirical energy function measuring protein stability with an evolutionary conservation term. The p16INK4a challenge highlights how subtle structural effects can neutralize otherwise deleterious variants. © 2017 Wiley Periodicals, Inc.

Sarcopenia in daily practice: assessment and management.

PubMed

Beaudart, Charlotte; McCloskey, Eugène; Bruyère, Olivier; Cesari, Matteo; Rolland, Yves; Rizzoli, René; Araujo de Carvalho, Islène; Amuthavalli Thiyagarajan, Jotheeswaran; Bautmans, Ivan; Bertière, Marie-Claude; Brandi, Maria Luisa; Al-Daghri, Nasser M; Burlet, Nansa; Cavalier, Etienne; Cerreta, Francesca; Cherubini, Antonio; Fielding, Roger; Gielen, Evelien; Landi, Francesco; Petermans, Jean; Reginster, Jean-Yves; Visser, Marjolein; Kanis, John; Cooper, Cyrus

2016-10-05

Sarcopenia is increasingly recognized as a correlate of ageing and is associated with increased likelihood of adverse outcomes including falls, fractures, frailty and mortality. Several tools have been recommended to assess muscle mass, muscle strength and physical performance in clinical trials. Whilst these tools have proven to be accurate and reliable in investigational settings, many are not easily applied to daily practice. This paper is based on literature reviews performed by members of the European Society for Clinical and Economic Aspects of Osteoporosis and Osteoarthritis (ESCEO) working group on frailty and sarcopenia. Face-to-face meetings were afterwards organized for the whole group to make amendments and discuss further recommendations. This paper proposes some user-friendly and inexpensive methods that can be used to assess sarcopenia in real-life settings. Healthcare providers, particularly in primary care, should consider an assessment of sarcopenia in individuals at increased risk; suggested tools for assessing risk include the Red Flag Method, the SARC-F questionnaire, the SMI method or different prediction equations. Management of sarcopenia should primarily be patient centered and involve the combination of both resistance and endurance based activity programmes with or without dietary interventions. Development of a number of pharmacological interventions is also in progress. Assessment of sarcopenia in individuals with risk factors, symptoms and/or conditions exposing them to the risk of disability will become particularly important in the near future.

Assessing Continuous Operator Workload With a Hybrid Scaffolded Neuroergonomic Modeling Approach.

PubMed

Borghetti, Brett J; Giametta, Joseph J; Rusnock, Christina F

2017-02-01

We aimed to predict operator workload from neurological data using statistical learning methods to fit neurological-to-state-assessment models. Adaptive systems require real-time mental workload assessment to perform dynamic task allocations or operator augmentation as workload issues arise. Neuroergonomic measures have great potential for informing adaptive systems, and we combine these measures with models of task demand as well as information about critical events and performance to clarify the inherent ambiguity of interpretation. We use machine learning algorithms on electroencephalogram (EEG) input to infer operator workload based upon Improved Performance Research Integration Tool workload model estimates. Cross-participant models predict workload of other participants, statistically distinguishing between 62% of the workload changes. Machine learning models trained from Monte Carlo resampled workload profiles can be used in place of deterministic workload profiles for cross-participant modeling without incurring a significant decrease in machine learning model performance, suggesting that stochastic models can be used when limited training data are available. We employed a novel temporary scaffold of simulation-generated workload profile truth data during the model-fitting process. A continuous workload profile serves as the target to train our statistical machine learning models. Once trained, the workload profile scaffolding is removed and the trained model is used directly on neurophysiological data in future operator state assessments. These modeling techniques demonstrate how to use neuroergonomic methods to develop operator state assessments, which can be employed in adaptive systems.

Validation of selected analytical methods using accuracy profiles to assess the impact of a Tobacco Heating System on indoor air quality.

PubMed

Mottier, Nicolas; Tharin, Manuel; Cluse, Camille; Crudo, Jean-René; Lueso, María Gómez; Goujon-Ginglinger, Catherine G; Jaquier, Anne; Mitova, Maya I; Rouget, Emmanuel G R; Schaller, Mathieu; Solioz, Jennifer

2016-09-01

Studies in environmentally controlled rooms have been used over the years to assess the impact of environmental tobacco smoke on indoor air quality. As new tobacco products are developed, it is important to determine their impact on air quality when used indoors. Before such an assessment can take place it is essential that the analytical methods used to assess indoor air quality are validated and shown to be fit for their intended purpose. Consequently, for this assessment, an environmentally controlled room was built and seven analytical methods, representing eighteen analytes, were validated. The validations were carried out with smoking machines using a matrix-based approach applying the accuracy profile procedure. The performances of the methods were compared for all three matrices under investigation: background air samples, the environmental aerosol of Tobacco Heating System THS 2.2, a heat-not-burn tobacco product developed by Philip Morris International, and the environmental tobacco smoke of a cigarette. The environmental aerosol generated by the THS 2.2 device did not have any appreciable impact on the performances of the methods. The comparison between the background and THS 2.2 environmental aerosol samples generated by smoking machines showed that only five compounds were higher when THS 2.2 was used in the environmentally controlled room. Regarding environmental tobacco smoke from cigarettes, the yields of all analytes were clearly above those obtained with the other two air sample types. Copyright © 2016 The Authors. Published by Elsevier B.V. All rights reserved.

Breast volume assessment: comparing five different techniques.

PubMed

Bulstrode, N; Bellamy, E; Shrotria, S

2001-04-01

Breast volume assessment is not routinely performed pre-operatively because as yet there is no accepted technique. There have been a variety of methods published, but this is the first study to compare these techniques. We compared volume measurements obtained from mammograms (previously compared to mastectomy specimens) with estimates of volume obtained from four other techniques: thermoplastic moulding, magnetic resonance imaging, Archimedes principle and anatomical measurements. We also assessed the acceptability of each method to the patient. Measurements were performed on 10 women, which produced results for 20 breasts. We were able to calculate regression lines between volume measurements obtained from mammography to the other four methods: (1) magnetic resonance imaging (MRI), 379+(0.75 MRI) [r=0.48], (2) Thermoplastic moulding, 132+(1.46 Thermoplastic moulding) [r=0.82], (3) Anatomical measurements, 168+(1.55 Anatomical measurements) [r=0.83]. (4) Archimedes principle, 359+(0.6 Archimedes principle) [r=0.61] all units in cc. The regression curves for the different techniques are variable and it is difficult to reliably compare results. A standard method of volume measurement should be used when comparing volumes before and after intervention or between individual patients, and it is unreliable to compare volume measurements using different methods. Calculating the breast volume from mammography has previously been compared to mastectomy samples and shown to be reasonably accurate. However we feel thermoplastic moulding shows promise and should be further investigated as it gives not only a volume assessment but a three-dimensional impression of the breast shape, which may be valuable in assessing cosmesis following breast-conserving-surgery.

DeepQA: improving the estimation of single protein model quality with deep belief networks.

PubMed

Cao, Renzhi; Bhattacharya, Debswapna; Hou, Jie; Cheng, Jianlin

2016-12-05

Protein quality assessment (QA) useful for ranking and selecting protein models has long been viewed as one of the major challenges for protein tertiary structure prediction. Especially, estimating the quality of a single protein model, which is important for selecting a few good models out of a large model pool consisting of mostly low-quality models, is still a largely unsolved problem. We introduce a novel single-model quality assessment method DeepQA based on deep belief network that utilizes a number of selected features describing the quality of a model from different perspectives, such as energy, physio-chemical characteristics, and structural information. The deep belief network is trained on several large datasets consisting of models from the Critical Assessment of Protein Structure Prediction (CASP) experiments, several publicly available datasets, and models generated by our in-house ab initio method. Our experiments demonstrate that deep belief network has better performance compared to Support Vector Machines and Neural Networks on the protein model quality assessment problem, and our method DeepQA achieves the state-of-the-art performance on CASP11 dataset. It also outperformed two well-established methods in selecting good outlier models from a large set of models of mostly low quality generated by ab initio modeling methods. DeepQA is a useful deep learning tool for protein single model quality assessment and protein structure prediction. The source code, executable, document and training/test datasets of DeepQA for Linux is freely available to non-commercial users at http://cactus.rnet.missouri.edu/DeepQA/ .

Prognostic score–based balance measures for propensity score methods in comparative effectiveness research

PubMed Central

Stuart, Elizabeth A.; Lee, Brian K.; Leacy, Finbarr P.

2013-01-01

Objective Examining covariate balance is the prescribed method for determining when propensity score methods are successful at reducing bias. This study assessed the performance of various balance measures, including a proposed balance measure based on the prognostic score (also known as the disease-risk score), to determine which balance measures best correlate with bias in the treatment effect estimate. Study Design and Setting The correlations of multiple common balance measures with bias in the treatment effect estimate produced by weighting by the odds, subclassification on the propensity score, and full matching on the propensity score were calculated. Simulated data were used, based on realistic data settings. Settings included both continuous and binary covariates and continuous covariates only. Results The standardized mean difference in prognostic scores, the mean standardized mean difference, and the mean t-statistic all had high correlations with bias in the effect estimate. Overall, prognostic scores displayed the highest correlations of all the balance measures considered. Prognostic score measure performance was generally not affected by model misspecification and performed well under a variety of scenarios. Conclusion Researchers should consider using prognostic score–based balance measures for assessing the performance of propensity score methods for reducing bias in non-experimental studies. PMID:23849158

Simulation-based assessment to identify critical gaps in safe anesthesia resident performance.

PubMed

Blum, Richard H; Boulet, John R; Cooper, Jeffrey B; Muret-Wagstaff, Sharon L

2014-01-01

Valid methods are needed to identify anesthesia resident performance gaps early in training. However, many assessment tools in medicine have not been properly validated. The authors designed and tested use of a behaviorally anchored scale, as part of a multiscenario simulation-based assessment system, to identify high- and low-performing residents with regard to domains of greatest concern to expert anesthesiology faculty. An expert faculty panel derived five key behavioral domains of interest by using a Delphi process (1) Synthesizes information to formulate a clear anesthetic plan; (2) Implements a plan based on changing conditions; (3) Demonstrates effective interpersonal and communication skills with patients and staff; (4) Identifies ways to improve performance; and (5) Recognizes own limits. Seven simulation scenarios spanning pre-to-postoperative encounters were used to assess performances of 22 first-year residents and 8 fellows from two institutions. Two of 10 trained faculty raters blinded to trainee program and training level scored each performance independently by using a behaviorally anchored rating scale. Residents, fellows, facilitators, and raters completed surveys. Evidence supporting the reliability and validity of the assessment scores was procured, including a high generalizability coefficient (ρ = 0.81) and expected performance differences between first-year resident and fellow participants. A majority of trainees, facilitators, and raters judged the assessment to be useful, realistic, and representative of critical skills required for safe practice. The study provides initial evidence to support the validity of a simulation-based performance assessment system for identifying critical gaps in safe anesthesia resident performance early in training.

A method to assess social sustainability of capture fisheries: An application to a Norwegian trawler

DOE Office of Scientific and Technical Information (OSTI.GOV)

Veldhuizen, L.J.L., E-mail: linda.veldhuizen@wur.nl; Berentsen, P.B.M.; Bokkers, E.A.M.

Social sustainability assessment of capture fisheries is, both in terms of method development and measurement, not well developed. The objective of this study, therefore, was to develop a method consisting of indicators and rubrics (i.e. categories that articulate levels of performance) to assess social sustainability of capture fisheries. This method was applied to a Norwegian trawler that targets cod and haddock in the northeast Atlantic. Based on previous research, 13 social sustainability issues were selected. To measure the state of these issues, 17 process and outcome indicators were determined. To interpret indicator values, rubrics were developed for each indicator, usingmore » standards set by international conventions or data retrieved from national statistics, industry agreements or scientific publications that explore rubric scales. The indicators and rubrics were subsequently used in a social sustainability assessment of a Norwegian trawler. This assessment indicated that overall, social sustainability of this trawler is relatively high, with high rubric scores, for example, for worker safety, provisions aboard for the crew and companies' salary levels. The assessment also indicated that the trawler could improve on healthy working environment, product freshness and fish welfare during capture. This application demonstrated that our method provides insight into social sustainability at the level of the vessel and can be used to identify potential room for improvement. This method is also promising for social sustainability assessment of other capture fisheries. - Highlights: • A method was developed for social sustainability assessment of capture fisheries. • This method entailed determining outcome and process indicators for important issues. • To interpret indicator values, a rubric was developed for each indicator. • Use of this method gives insight into social sustainability and improvement options. • This method is promising for social sustainability assessment of capture fisheries.« less

Automated image quality assessment for chest CT scans.

PubMed

Reeves, Anthony P; Xie, Yiting; Liu, Shuang

2018-02-01

Medical image quality needs to be maintained at standards sufficient for effective clinical reading. Automated computer analytic methods may be applied to medical images for quality assessment. For chest CT scans in a lung cancer screening context, an automated quality assessment method is presented that characterizes image noise and image intensity calibration. This is achieved by image measurements in three automatically segmented homogeneous regions of the scan: external air, trachea lumen air, and descending aorta blood. Profiles of CT scanner behavior are also computed. The method has been evaluated on both phantom and real low-dose chest CT scans and results show that repeatable noise and calibration measures may be realized by automated computer algorithms. Noise and calibration profiles show relevant differences between different scanners and protocols. Automated image quality assessment may be useful for quality control for lung cancer screening and may enable performance improvements to automated computer analysis methods. © 2017 American Association of Physicists in Medicine.

A Prototype Tool to Enable Farmers to Measure and Improve the Welfare Performance of the Farm Animal Enterprise: The Unified Field Index

PubMed Central

Colditz, Ian G.; Ferguson, Drewe M.; Collins, Teresa; Matthews, Lindsay; Hemsworth, Paul H.

2014-01-01

Simple Summary Benchmarking is a tool widely used in agricultural industries that harnesses the experience of farmers to generate knowledge of practices that lead to better on-farm productivity and performance. We propose, by analogy with production performance, a method for measuring the animal welfare performance of an enterprise and describe a tool for farmers to monitor and improve the animal welfare performance of their business. A general framework is outlined for assessing and monitoring risks to animal welfare based on measures of animals, the environment they are kept in and how they are managed. The tool would enable farmers to continually improve animal welfare. Abstract Schemes for the assessment of farm animal welfare and assurance of welfare standards have proliferated in recent years. An acknowledged short-coming has been the lack of impact of these schemes on the welfare standards achieved on farm due in part to sociological factors concerning their implementation. Here we propose the concept of welfare performance based on a broad set of performance attributes of an enterprise and describe a tool based on risk assessment and benchmarking methods for measuring and managing welfare performance. The tool termed the Unified Field Index is presented in a general form comprising three modules addressing animal, resource, and management factors. Domains within these modules accommodate the principle conceptual perspectives for welfare assessment: biological functioning; emotional states; and naturalness. Pan-enterprise analysis in any livestock sector could be used to benchmark welfare performance of individual enterprises and also provide statistics of welfare performance for the livestock sector. An advantage of this concept of welfare performance is its use of continuous scales of measurement rather than traditional pass/fail measures. Through the feedback provided via benchmarking, the tool should help farmers better engage in on-going improvement of farm practices that affect animal welfare. PMID:26480317

Sustainability performance evaluation: Literature review and future directions.

PubMed

Büyüközkan, Gülçin; Karabulut, Yağmur

2018-07-01

Current global economic activities are increasingly being perceived as unsustainable. Despite the high number of publications, sustainability science remains highly dispersed over diverse approaches and topics. This article aims to provide a structured overview of sustainability performance evaluation related publications and to document the current state of literature, categorize publications, analyze and link trends, as well as highlight gaps and provide research recommendations. 128 articles between 2007 and 2018 are identified. The results suggest that sustainability performance evaluation models shall be more balanced, suitable criteria and their interrelations shall be well defined and subjectivity of qualitative criteria inherent to sustainability indicators shall be considered. To address this subjectivity, group decision-making techniques and other analytical methods that can deal with uncertainty, conflicting indicators, and linguistic evaluations can be used in future works. By presenting research gaps, this review stimulates researchers to establish practically applicable sustainability performance evaluation frameworks to help assess and compare the degree of sustainability, leading to more sustainable business practices. The review is unique in defining corporate sustainability performance evaluation for the first time, exploring the gap between sustainability accounting and sustainability assessment, and coming up with a structured overview of innovative research recommendations about integrating analytical assessment methods into conceptual sustainability frameworks. Copyright © 2018 Elsevier Ltd. All rights reserved.

Clustering Scientific Publications Based on Citation Relations: A Systematic Comparison of Different Methods.

PubMed

Šubelj, Lovro; van Eck, Nees Jan; Waltman, Ludo

2016-01-01

Clustering methods are applied regularly in the bibliometric literature to identify research areas or scientific fields. These methods are for instance used to group publications into clusters based on their relations in a citation network. In the network science literature, many clustering methods, often referred to as graph partitioning or community detection techniques, have been developed. Focusing on the problem of clustering the publications in a citation network, we present a systematic comparison of the performance of a large number of these clustering methods. Using a number of different citation networks, some of them relatively small and others very large, we extensively study the statistical properties of the results provided by different methods. In addition, we also carry out an expert-based assessment of the results produced by different methods. The expert-based assessment focuses on publications in the field of scientometrics. Our findings seem to indicate that there is a trade-off between different properties that may be considered desirable for a good clustering of publications. Overall, map equation methods appear to perform best in our analysis, suggesting that these methods deserve more attention from the bibliometric community.

Clustering Scientific Publications Based on Citation Relations: A Systematic Comparison of Different Methods

PubMed Central

Šubelj, Lovro; van Eck, Nees Jan; Waltman, Ludo

2016-01-01

Clustering methods are applied regularly in the bibliometric literature to identify research areas or scientific fields. These methods are for instance used to group publications into clusters based on their relations in a citation network. In the network science literature, many clustering methods, often referred to as graph partitioning or community detection techniques, have been developed. Focusing on the problem of clustering the publications in a citation network, we present a systematic comparison of the performance of a large number of these clustering methods. Using a number of different citation networks, some of them relatively small and others very large, we extensively study the statistical properties of the results provided by different methods. In addition, we also carry out an expert-based assessment of the results produced by different methods. The expert-based assessment focuses on publications in the field of scientometrics. Our findings seem to indicate that there is a trade-off between different properties that may be considered desirable for a good clustering of publications. Overall, map equation methods appear to perform best in our analysis, suggesting that these methods deserve more attention from the bibliometric community. PMID:27124610

The Biological Effects of Quadripolar Radiofrequency Sequential Application: A Human Experimental Study

PubMed Central

Cornaglia, Antonia Icaro; Faga, Angela; Scevola, Silvia

2014-01-01

Abstract Objective: An experimental study was conducted to assess the effectiveness and safety of an innovative quadripolar variable electrode configuration radiofrequency device with objective measurements in an ex vivo and in vivo human experimental model. Background data: Nonablative radiofrequency applications are well-established anti-ageing procedures for cosmetic skin tightening. Methods: The study was performed in two steps: ex vivo and in vivo assessments. In the ex vivo assessments the radiofrequency applications were performed on human full-thickness skin and subcutaneous tissue specimens harvested during surgery for body contouring. In the in vivo assessments the applications were performed on two volunteer patients scheduled for body contouring surgery at the end of the study. The assessment methods were: clinical examination and medical photography, temperature measurement with thermal imaging scan, and light microscopy histological examination. Results: The ex vivo assessments allowed for identification of the effective safety range for human application. The in vivo assessments allowed for demonstration of the biological effects of sequential radiofrequency applications. After a course of radiofrequency applications, the collagen fibers underwent an immediate heat-induced rearrangement and were partially denaturated and progressively metabolized by the macrophages. An overall thickening and spatial rearrangement was appreciated both in the collagen and elastic fibers, the latter displaying a juvenile reticular pattern. A late onset in the macrophage activation after sequential radiofrequency applications was appreciated. Conclusions: Our data confirm the effectiveness of sequential radiofrequency applications in obtaining attenuation of the skin wrinkles by an overall skin tightening. PMID:25244081

Detection methods and performance criteria for genetically modified organisms.

PubMed

Bertheau, Yves; Diolez, Annick; Kobilinsky, André; Magin, Kimberly

2002-01-01

Detection methods for genetically modified organisms (GMOs) are necessary for many applications, from seed purity assessment to compliance of food labeling in several countries. Numerous analytical methods are currently used or under development to support these needs. The currently used methods are bioassays and protein- and DNA-based detection protocols. To avoid discrepancy of results between such largely different methods and, for instance, the potential resulting legal actions, compatibility of the methods is urgently needed. Performance criteria of methods allow evaluation against a common standard. The more-common performance criteria for detection methods are precision, accuracy, sensitivity, and specificity, which together specifically address other terms used to describe the performance of a method, such as applicability, selectivity, calibration, trueness, precision, recovery, operating range, limit of quantitation, limit of detection, and ruggedness. Performance criteria should provide objective tools to accept or reject specific methods, to validate them, to ensure compatibility between validated methods, and be used on a routine basis to reject data outside an acceptable range of variability. When selecting a method of detection, it is also important to consider its applicability, its field of applications, and its limitations, by including factors such as its ability to detect the target analyte in a given matrix, the duration of the analyses, its cost effectiveness, and the necessary sample sizes for testing. Thus, the current GMO detection methods should be evaluated against a common set of performance criteria.

Technology Alignment and Portfolio Prioritization (TAPP): Advanced Methods in Strategic Analysis, Technology Forecasting and Long Term Planning for Human Exploration and Operations, Advanced Exploration Systems and Advanced Concepts

NASA Technical Reports Server (NTRS)

Funaro, Gregory V.; Alexander, Reginald A.

2015-01-01

The Advanced Concepts Office (ACO) at NASA, Marshall Space Flight Center is expanding its current technology assessment methodologies. ACO is developing a framework called TAPP that uses a variety of methods, such as association mining and rule learning from data mining, structure development using a Technological Innovation System (TIS), and social network modeling to measure structural relationships. The role of ACO is to 1) produce a broad spectrum of ideas and alternatives for a variety of NASA's missions, 2) determine mission architecture feasibility and appropriateness to NASA's strategic plans, and 3) define a project in enough detail to establish an initial baseline capable of meeting mission objectives ACO's role supports the decision­-making process associated with the maturation of concepts for traveling through, living in, and understanding space. ACO performs concept studies and technology assessments to determine the degree of alignment between mission objectives and new technologies. The first step in technology assessment is to identify the current technology maturity in terms of a technology readiness level (TRL). The second step is to determine the difficulty associated with advancing a technology from one state to the next state. NASA has used TRLs since 1970 and ACO formalized them in 1995. The DoD, ESA, Oil & Gas, and DoE have adopted TRLs as a means to assess technology maturity. However, "with the emergence of more complex systems and system of systems, it has been increasingly recognized that TRL assessments have limitations, especially when considering [the] integration of complex systems." When performing the second step in a technology assessment, NASA requires that an Advancement Degree of Difficulty (AD2) method be utilized. NASA has used and developed or used a variety of methods to perform this step: Expert Opinion or Delphi Approach, Value Engineering or Value Stream, Analytical Hierarchy Process (AHP), Technique for the Order of Prioritization by Similarity to Ideal Solution (TOPSIS), and other multi­-criteria decision-making methods. These methods can be labor-intensive, often contain cognitive or parochial bias, and do not consider the competing prioritization between mission architectures. Strategic Decision-Making (SDM) processes cannot be properly understood unless the context of the technology is understood. This makes assessing technological change particularly challenging due to the relationships "between incumbent technology and the incumbent (innovation) system in relation to the emerging technology and the emerging innovation system." The central idea in technology dynamics is to consider all activities that contribute to the development, diffusion, and use of innovations as system functions. Bergek defines system functions within a TIS to address what is actually happening and has a direct influence on the ultimate performance of the system and technology development. ACO uses similar metrics and is expanding these metrics to account for the structure and context of the technology. At NASA technology and strategy is strongly interrelated. NASA's Strategic Space Technology Investment Plan (SSTIP) prioritizes those technologies essential to the pursuit of NASA's missions and national interests. The SSTIP is strongly coupled with NASA's Technology Roadmaps to provide investment guidance during the next four years, within a twenty-year horizon. This paper discusses the methods ACO is currently developing to better perform technology assessments while taking into consideration Strategic Alignment, Technology Forecasting, and Long Term Planning.

Cost analysis of objective resident cataract surgery assessments.

PubMed

Nandigam, Kiran; Soh, Jonathan; Gensheimer, William G; Ghazi, Ahmed; Khalifa, Yousuf M

2015-05-01

To compare 8 ophthalmology resident surgical training tools to determine which is most cost effective. University of Rochester Medical Center, Rochester, New York, USA. Retrospective evaluation of technology. A cost-analysis model was created to compile all relevant costs in running each tool in a medium-sized ophthalmology program. Quantitative cost estimates were obtained based on cost of tools, cost of time in evaluations, and supply and maintenance costs. For wet laboratory simulation, Eyesi was the least expensive cataract surgery simulation method; however, it is only capable of evaluating simulated cataract surgery rehearsal and requires supplementation with other evaluative methods for operating room performance and for noncataract wet lab training and evaluation. The most expensive training tool was the Eye Surgical Skills Assessment Test (ESSAT). The 2 most affordable methods for resident evaluation in operating room performance were the Objective Assessment of Skills in Intraocular Surgery (OASIS) and Global Rating Assessment of Skills in Intraocular Surgery (GRASIS). Cost-based analysis of ophthalmology resident surgical training tools are needed so residency programs can implement tools that are valid, reliable, objective, and cost effective. There is no perfect training system at this time. Copyright © 2015 ASCRS and ESCRS. Published by Elsevier Inc. All rights reserved.

Characterization of controlled bone defects using 2D and 3D ultrasound imaging techniques.

PubMed

Parmar, Biren J; Longsine, Whitney; Sabonghy, Eric P; Han, Arum; Tasciotti, Ennio; Weiner, Bradley K; Ferrari, Mauro; Righetti, Raffaella

2010-08-21

Ultrasound is emerging as an attractive alternative modality to standard x-ray and CT methods for bone assessment applications. As of today, however, there is a lack of systematic studies that investigate the performance of diagnostic ultrasound techniques in bone imaging applications. This study aims at understanding the performance limitations of new ultrasound techniques for imaging bones in controlled experiments in vitro. Experiments are performed on samples of mammalian and non-mammalian bones with controlled defects with size ranging from 400 microm to 5 mm. Ultrasound findings are statistically compared with those obtained from the same samples using standard x-ray imaging modalities and optical microscopy. The results of this study demonstrate that it is feasible to use diagnostic ultrasound imaging techniques to assess sub-millimeter bone defects in real time and with high accuracy and precision. These results also demonstrate that ultrasound imaging techniques perform comparably better than x-ray imaging and optical imaging methods, in the assessment of a wide range of controlled defects both in mammalian and non-mammalian bones. In the future, ultrasound imaging techniques might provide a cost-effective, real-time, safe and portable diagnostic tool for bone imaging applications.

Modeling and Quantification of Team Performance in Human Reliability Analysis for Probabilistic Risk Assessment

DOE Office of Scientific and Technical Information (OSTI.GOV)

Jeffrey C. JOe; Ronald L. Boring

Probabilistic Risk Assessment (PRA) and Human Reliability Assessment (HRA) are important technical contributors to the United States (U.S.) Nuclear Regulatory Commission’s (NRC) risk-informed and performance based approach to regulating U.S. commercial nuclear activities. Furthermore, all currently operating commercial NPPs in the U.S. are required by federal regulation to be staffed with crews of operators. Yet, aspects of team performance are underspecified in most HRA methods that are widely used in the nuclear industry. There are a variety of "emergent" team cognition and teamwork errors (e.g., communication errors) that are 1) distinct from individual human errors, and 2) important to understandmore » from a PRA perspective. The lack of robust models or quantification of team performance is an issue that affects the accuracy and validity of HRA methods and models, leading to significant uncertainty in estimating HEPs. This paper describes research that has the objective to model and quantify team dynamics and teamwork within NPP control room crews for risk informed applications, thereby improving the technical basis of HRA, which improves the risk-informed approach the NRC uses to regulate the U.S. commercial nuclear industry.« less

Performance of patients with frontotemporal lobar degeneration on artistic tasks: A pilot study

PubMed Central

Anauate, Maria Cristina; Bahia, Valéria Santoro; Nitrini, Ricardo; Radanovic, Marcia

2014-01-01

Several studies have addressed visuospatial and executive skills in artistic activities in Frontotemporal Lobar Degeneration (FTLD) and Alzheimer's disease (AD). Objective To investigate the performance of FTLD patients compared to controls on two artistic tasks. Methods Four FTLD patients with mean age of 57 (8.7) years and schooling of 12.2 (4.5) years plus 10 controls with mean age of 62.9 (8.6) years and schooling of 12.3 (4.6) years, were assessed using the Lowenstein Occupational Therapy Cognitive Assessment (LOTCA) and by a three-stage artistic protocol including visual observation, copying and collage, based on a Sisley painting. Results FTLD patients had lower scores than controls on Visuospatial Perception, Copy, Collage, Examiner's Observation, and Total, showing distinct patterns of performance according to FTLD sub-type: semantic PPA, nonfluent PPA and bvFTD. Conclusion FTLD patients presented impairment in the visuospatial and executive skills required to perform artistic tasks. We demonstrated that the application of the instrument as a complimentary method for assessing cognitive skills in this group of patients is possible. Further studies addressing larger and more homogeneous samples of FTLD patients as well as other dementias are warranted. PMID:29213882

Ignitability test method

NASA Technical Reports Server (NTRS)

Bement, Laurence J.; Schimmel, Morry L.

1989-01-01

To overcome serious weaknesses in determining the performance of initiating devices, a novel 'ignitability test method', representing actual design interfaces and ignition materials, has been developed. Ignition device output consists of heat, light, gas an burning particles. Past research methods have evaluated these parameters individually. This paper describes the development and demonstration of an ignitability test method combining all these parameters, and the quantitative assessment of the ignition performance of two widely used percussion primers, the M42C1-PA101 and the M42C2-793. The ignition materials used for this evaluation were several powder, granule and pellet sizes of black powder and boron-potassium nitrate. This test method should be useful for performance evaluation of all initiator types, quality assurance, evaluation of ignition interfaces, and service life studies of initiators and ignition materials.

Assessment of the effectiveness of wrong way driving countermeasures and mitigation methods.

DOT National Transportation Integrated Search

2014-12-01

This report describes the methodology and results of tasks performed to evaluate the effectiveness of : wrong way driving countermeasures and mitigation methods. Researchers reviewed the state of the practice : regarding wrong way driving in the Unit...

Assessing performance of Botswana’s public hospital system: the use of the World Health Organization Health System Performance Assessment Framework

PubMed Central

Seitio-Kgokgwe, Onalenna; Gauld, Robin DC; Hill, Philip C; Barnett, Pauline

2014-01-01

Background: Very few studies have assessed performance of Botswana public hospitals. We draw from a large research study assessing performance of the Botswana Ministry of Health (MoH) to evaluate the performance of public hospital system using the World Health Organization Health Systems Performance Assessment Framework (WHO HSPAF). We aimed to evaluate performance of Botswana public hospital system; relate findings of the assessment to the potential for improvements in hospital performance; and determine the usefulness of the WHO HSPAF in assessing performance of hospital systems in a developing country. Methods: This article is based on data collected from document analysis, 54 key informants comprising senior managers and staff of the MoH (N= 40) and senior officers from stakeholder organizations (N= 14), and surveys of 42 hospital managers and 389 health workers. Data from documents and transcripts were analyzed using content and thematic analysis while data analysis for surveys was descriptive determining proportions and percentages. Results: The organizational structure of the Botswana’s public hospital system, authority and decision-making are highly centralized. Overall physical access to health services is high. However, challenges in the distribution of facilities and inpatient beds create inequities and inefficiencies. Capacity of the hospitals to deliver services is limited by inadequate resources. There are significant challenges with the quality of care. Conclusion: While Botswana invested considerably in building hospitals around the country resulting in high physical access to services, the organization and governance of the hospital system, and inadequate resources limit service delivery. The ongoing efforts to decentralize management of hospitals to district level entities should be expedited. The WHO HSPAF enabled us to conduct a comprehensive assessment of the public hospital system. Though relatively new, this approach proved useful in this study. PMID:25279380

Construct Validity and Scoring Methods of the World Health Organization: Health and Work Performance Questionnaire Among Workers With Arthritis and Rheumatological Conditions.

PubMed

AlHeresh, Rawan; LaValley, Michael P; Coster, Wendy; Keysor, Julie J

2017-06-01

To evaluate construct validity and scoring methods of the world health organization-health and work performance questionnaire (HPQ) for people with arthritis. Construct validity was examined through hypothesis testing using the recommended guidelines of the consensus-based standards for the selection of health measurement instruments (COSMIN). The HPQ using the absolute scoring method showed moderate construct validity as four of the seven hypotheses were met. The HPQ using the relative scoring method had weak construct validity as only one of the seven hypotheses were met. The absolute scoring method for the HPQ is superior in construct validity to the relative scoring method in assessing work performance among people with arthritis and related rheumatic conditions; however, more research is needed to further explore other psychometric properties of the HPQ.

Predicting "Hot" and "Warm" Spots for Fragment Binding.

PubMed

Rathi, Prakash Chandra; Ludlow, R Frederick; Hall, Richard J; Murray, Christopher W; Mortenson, Paul N; Verdonk, Marcel L

2017-05-11

Computational fragment mapping methods aim to predict hotspots on protein surfaces where small fragments will bind. Such methods are popular for druggability assessment as well as structure-based design. However, to date researchers developing or using such tools have had no clear way of assessing the performance of these methods. Here, we introduce the first diverse, high quality validation set for computational fragment mapping. The set contains 52 diverse examples of fragment binding "hot" and "warm" spots from the Protein Data Bank (PDB). Additionally, we describe PLImap, a novel protocol for fragment mapping based on the Protein-Ligand Informatics force field (PLIff). We evaluate PLImap against the new fragment mapping test set, and compare its performance to that of simple shape-based algorithms and fragment docking using GOLD. PLImap is made publicly available from https://bitbucket.org/AstexUK/pli .

Effects of two educational method of lecturing and role playing on knowledge and performance of high school students in first aid at emergency scene

PubMed Central

Hassanzadeh, Akbar; Vasili, Arezu; Zare, Zahra

2010-01-01

BACKGROUND: This study aimed to investigate the effects of two educational methods on students' knowledge and performance regarding first aid at emergency scenes. METHODS: In this semi-experimental study, the sample was selected randomly among male and female public high school students of Isfahan. Each group included 60 students. At first the knowledge and performance of students in first aid at emergency scene was assessed using a researcher-made questionnaire. Then necessary education was provided to the students within 10 sessions of two hours by lecturing and role playing. The students' knowledge and performance was as-sessed again and the results were compared. RESULTS: It was no significant relationship between the frequency distribution of students' age, major and knowledge and performance before the educational course in the two groups. The score of knowledge in performing CPR, using proper way to bandage, immobilizing the injured area, and proper ways of carrying injured person after the education was significantly increased in both groups. Moreover, the performance in proper way to bandage, immobilizing injured area and proper ways of carrying injured person after educational course was significantly higher in playing role group compared to lecturing group after education. CONCLUSIONS: Iran is a developing country with a young generation and it is a country with high risk of natural disasters; so, providing necessary education with more effective methods can be effective in reducing mortality and morbidity due to lack of first aid care in crucial moments. Training with playing role is suggested for this purpose. PMID:21589743

Assessment of mixed-layer height estimation from single-wavelength ceilometer profiles

EPA Science Inventory

Differing boundary/mixed-layer height measurement methods were assessed in moderately polluted and clean environments, with a focus on the Vaisala CL51 ceilometer. This intercomparison was performed as part of ongoing measurements at the Chemistry And Physics of the Atmospheric B...

Trail resource impacts and an examination of alternative assessment techniques

USGS Publications Warehouse

Marion, J.L.; Leung, Y.-F.

2001-01-01

Trails are a primary recreation resource facility on which recreation activities are performed. They provide safe access to non-roaded areas, support recreational opportunities such as hiking, biking, and wildlife observation, and protect natural resources by concentrating visitor traffic on resistant treads. However, increasing recreational use, coupled with poorly designed and/or maintained trails, has led to a variety of resource impacts. Trail managers require objective information on trails and their conditions to monitor trends, direct trail maintenance efforts, and evaluate the need for visitor management and resource protection actions. This paper reviews trail impacts and different types of trail assessments, including inventory, maintenance, and condition assessment approaches. Two assessment methods, point sampling and problem assessment, are compared empirically from separate assessments of a 15-mile segment of the Appalachian Trail in Great Smoky Mountains National Park. Results indicate that point sampling and problem assessment methods yield distinctly different types of quantitative information. The point sampling method provides more accurate and precise measures of trail characteristics that are continuous or frequent (e.g., tread width or exposed soil). The problem assessment method is a preferred approach for monitoring trail characteristics that can be easily predefined or are infrequent (e.g., excessive width or secondary treads), particularly when information on the location of specific trail impact problems is needed. The advantages and limitations of these two assessment methods are examined in relation to various management and research information needs. The choice and utility of these assessment methods are also discussed.