Examining Teacher Evaluation Validity and Leadership Decision Making within a Standards-Based Evaluation System

ERIC Educational Resources Information Center

Kimball, Steven M.; Milanowski, Anthony

2009-01-01

Purpose: The article reports on a study of school leader decision making that examined variation in the validity of teacher evaluation ratings in a school district that has implemented a standards-based teacher evaluation system. Research Methods: Applying mixed methods, the study used teacher evaluation ratings and value-added student achievement…

The evaluator as technical assistant: A model for systemic reform support

NASA Astrophysics Data System (ADS)

Century, Jeanne Rose

This study explored evaluation of systemic reform. Specifically, it focused on the evaluation of a systemic effort to improve K-8 science, mathematics and technology education. The evaluation was of particular interest because it used both technical assistance and evaluation strategies. Through studying the combination of these roles, this investigation set out to increase understanding of potentially new evaluator roles, distinguish important characteristics of the evaluator/project participant relationship, and identify how these roles and characteristics contribute to effective evaluation of systemic science education reform. This qualitative study used interview, document analysis, and participant observation as methods of data collection. Interviews were conducted with project leaders, project participants, and evaluators and focused on the evaluation strategies and process, the use of the evaluation, and technical assistance. Documents analyzed included transcripts of evaluation team meetings and reports, memoranda and other print materials generated by the project leaders and the evaluators. Data analysis consisted of analytic and interpretive procedures consistent with the qualitative data collected and entailed a combined process of coding transcripts of interviews and meetings, field notes, and other documents; analyzing and organizing findings; writing of reflective and analytic memos; and designing and diagramming conceptual relationships. The data analysis resulted in the development of the Multi-Function Model for Systemic Reform Support. This model organizes systemic reform support into three functions: evaluation, technical assistance, and a third, named here as "systemic perspective." These functions work together to support the project's educational goals as well as a larger goal--building capacity in project participants. This model can now serve as an informed starting point or "blueprint" for strategically supporting systemic reform.

LOX/hydrocarbon auxiliary propulsion system study

NASA Technical Reports Server (NTRS)

Orton, G. F.; Mark, T. D.; Weber, D. D.

1982-01-01

Liquid oxygen/hydrocarbon propulsion systems applicable to a second generation orbiter OMS/RCS were compared, and major system/component options were evaluated. A large number of propellant combinations and system concepts were evaluated. The ground rules were defined in terms of candidate propellants, system/component design options, and design requirements. System and engine component math models were incorporated into existing computer codes for system evaluations. The detailed system evaluations and comparisons were performed to identify the recommended propellant combination and system approach.

Promoting evaluation capacity building in a complex adaptive system.

PubMed

Lawrenz, Frances; Kollmann, Elizabeth Kunz; King, Jean A; Bequette, Marjorie; Pattison, Scott; Nelson, Amy Grack; Cohn, Sarah; Cardiel, Christopher L B; Iacovelli, Stephanie; Eliou, Gayra Ostgaard; Goss, Juli; Causey, Lauren; Sinkey, Anne; Beyer, Marta; Francisco, Melanie

2018-04-10

This study provides results from an NSF funded, four year, case study about evaluation capacity building in a complex adaptive system, the Nanoscale Informal Science Education Network (NISE Net). The results of the Complex Adaptive Systems as a Model for Network Evaluations (CASNET) project indicate that complex adaptive system concepts help to explain evaluation capacity building in a network. The NISE Network was found to be a complex learning system that was supportive of evaluation capacity building through feedback loops that provided for information sharing and interaction. Participants in the system had different levels of and sources of evaluation knowledge. To be successful at building capacity, the system needed to have a balance between both centralized and decentralized control, coherence, redundancy, and diversity. Embeddedness of individuals within the system also provided support and moved the capacity of the system forward. Finally, success depended on attention being paid to the control of resources. Implications of these findings are discussed. Copyright © 2018 Elsevier Ltd. All rights reserved.

A Qualitative Approach to the Evaluation of Expert Systems Shells.

ERIC Educational Resources Information Center

Slawson, Dean A.; And Others

This study explores an approach to the evaluation of expert system shells using case studies. The methodology and some of the results of an evaluation of the prototype development of an expert system using the shell "M1" are detailed, including a description of the participants and the project, the data collection process and materials,…

An urban energy performance evaluation system and its computer implementation.

PubMed

Wang, Lei; Yuan, Guan; Long, Ruyin; Chen, Hong

2017-12-15

To improve the urban environment and effectively reflect and promote urban energy performance, an urban energy performance evaluation system was constructed, thereby strengthening urban environmental management capabilities. From the perspectives of internalization and externalization, a framework of evaluation indicators and key factors that determine urban energy performance and explore the reasons for differences in performance was proposed according to established theory and previous studies. Using the improved stochastic frontier analysis method, an urban energy performance evaluation and factor analysis model was built that brings performance evaluation and factor analysis into the same stage for study. According to data obtained for the Chinese provincial capitals from 2004 to 2013, the coefficients of the evaluation indicators and key factors were calculated by the urban energy performance evaluation and factor analysis model. These coefficients were then used to compile the program file. The urban energy performance evaluation system developed in this study was designed in three parts: a database, a distributed component server, and a human-machine interface. Its functions were designed as login, addition, edit, input, calculation, analysis, comparison, inquiry, and export. On the basis of these contents, an urban energy performance evaluation system was developed using Microsoft Visual Studio .NET 2015. The system can effectively reflect the status of and any changes in urban energy performance. Beijing was considered as an example to conduct an empirical study, which further verified the applicability and convenience of this evaluation system. Copyright © 2017 Elsevier Ltd. All rights reserved.

An evaluation framework for Health Information Systems: human, organization and technology-fit factors (HOT-fit).

PubMed

Yusof, Maryati Mohd; Kuljis, Jasna; Papazafeiropoulou, Anastasia; Stergioulas, Lampros K

2008-06-01

The realization of Health Information Systems (HIS) requires rigorous evaluation that addresses technology, human and organization issues. Our review indicates that current evaluation methods evaluate different aspects of HIS and they can be improved upon. A new evaluation framework, human, organization and technology-fit (HOT-fit) was developed after having conducted a critical appraisal of the findings of existing HIS evaluation studies. HOT-fit builds on previous models of IS evaluation--in particular, the IS Success Model and the IT-Organization Fit Model. This paper introduces the new framework for HIS evaluation that incorporates comprehensive dimensions and measures of HIS and provides a technological, human and organizational fit. Literature review on HIS and IS evaluation studies and pilot testing of developed framework. The framework was used to evaluate a Fundus Imaging System (FIS) of a primary care organization in the UK. The case study was conducted through observation, interview and document analysis. The main findings show that having the right user attitude and skills base together with good leadership, IT-friendly environment and good communication can have positive influence on the system adoption. Comprehensive, specific evaluation factors, dimensions and measures in the new framework (HOT-fit) are applicable in HIS evaluation. The use of such a framework is argued to be useful not only for comprehensive evaluation of the particular FIS system under investigation, but potentially also for any Health Information System in general.

Evaluation Criteria for the Educational Web-Information System

ERIC Educational Resources Information Center

Seok, Soonhwa; Meyen, Edward; Poggio, John C.; Semon, Sarah; Tillberg-Webb, Heather

2008-01-01

This article addresses how evaluation criteria improve educational Web-information system design, and the tangible and intangible benefits of using evaluation criteria, when implemented in an educational Web-information system design. The evaluation criteria were developed by the authors through a content validation study applicable to…

Development of Self-study and Student Evaluation Support System for HDL Design Education

NASA Astrophysics Data System (ADS)

Chiba, Shinji

In HDL design education, the students should study HDL description and usage of EDA tools to master HDL design technique and the teachers have to check a lot of HDL description files to evaluate students. This paper proposed a HDL design education system composed of WBT and LMS servers. The developed education system has been operated at an actual class. Results of the operation indicated that the proposal system helped effectively teachers to evaluate students. Questionnaire for students showed that a lot of students used the proposal system for self-study.

Reliability studies of Integrated Modular Engine system designs

NASA Technical Reports Server (NTRS)

Hardy, Terry L.; Rapp, Douglas C.

1993-01-01

A study was performed to evaluate the reliability of Integrated Modular Engine (IME) concepts. Comparisons were made between networked IME systems and non-networked discrete systems using expander cycle configurations. Both redundant and non-redundant systems were analyzed. Binomial approximation and Markov analysis techniques were employed to evaluate total system reliability. In addition, Failure Modes and Effects Analyses (FMEA), Preliminary Hazard Analyses (PHA), and Fault Tree Analysis (FTA) were performed to allow detailed evaluation of the IME concept. A discussion of these system reliability concepts is also presented.

Reliability studies of integrated modular engine system designs

NASA Technical Reports Server (NTRS)

Hardy, Terry L.; Rapp, Douglas C.

1993-01-01

A study was performed to evaluate the reliability of Integrated Modular Engine (IME) concepts. Comparisons were made between networked IME systems and non-networked discrete systems using expander cycle configurations. Both redundant and non-redundant systems were analyzed. Binomial approximation and Markov analysis techniques were employed to evaluate total system reliability. In addition, Failure Modes and Effects Analyses (FMEA), Preliminary Hazard Analyses (PHA), and Fault Tree Analysis (FTA) were performed to allow detailed evaluation of the IME concept. A discussion of these system reliability concepts is also presented.

Space shuttle auxiliary propulsion system design study. Phase C and E report: Storable propellants, RCS/OMS/APU integration study

NASA Technical Reports Server (NTRS)

Anglim, D. D.; Bruns, A. E.; Perryman, D. C.; Wieland, D. L.

1972-01-01

Auxiliary propulsion concepts for application to the space shuttle are compared. Both monopropellant and bipropellant earth storable reaction control systems were evaluated. The fundamental concepts evaluated were: (1) monopropellant and bipropellant systems installed integrally within the vehicle, (2) fuel systems installed modularly in nose and wing tip pods, and (3) fuel systems installed modularly in nose and fuselage pods. Numerous design variations within these three concepts were evaluated. The system design analysis and methods for implementing each of the concepts are reported.

Reliability studies of integrated modular engine system designs

NASA Astrophysics Data System (ADS)

Hardy, Terry L.; Rapp, Douglas C.

1993-06-01

A study was performed to evaluate the reliability of Integrated Modular Engine (IME) concepts. Comparisons were made between networked IME systems and non-networked discrete systems using expander cycle configurations. Both redundant and non-redundant systems were analyzed. Binomial approximation and Markov analysis techniques were employed to evaluate total system reliability. In addition, Failure Modes and Effects Analyses (FMEA), Preliminary Hazard Analyses (PHA), and Fault Tree Analysis (FTA) were performed to allow detailed evaluation of the IME concept. A discussion of these system reliability concepts is also presented.

Reliability studies of Integrated Modular Engine system designs

NASA Astrophysics Data System (ADS)

Hardy, Terry L.; Rapp, Douglas C.

1993-06-01

A study was performed to evaluate the reliability of Integrated Modular Engine (IME) concepts. Comparisons were made between networked IME systems and non-networked discrete systems using expander cycle configurations. Both redundant and non-redundant systems were analyzed. Binomial approximation and Markov analysis techniques were employed to evaluate total system reliability. In addition, Failure Modes and Effects Analyses (FMEA), Preliminary Hazard Analyses (PHA), and Fault Tree Analysis (FTA) were performed to allow detailed evaluation of the IME concept. A discussion of these system reliability concepts is also presented.

Analysis of space systems study for the space disposal of nuclear waste. Study report, volume 1: Executive summary

NASA Technical Reports Server (NTRS)

1981-01-01

Space systems concepts were identified and defined and evaluated as to their performance, risks, and technical viability in order to select the most attractive approach for disposal of high level nuclear wastes in space. Major study areas discussed include: (1) mission and operations analysis; (2) waste payload systems; (3) flight support system; (4) launch site systems; (5) launch vehicle systems; (6) orbit transfer system; (7) space disposal destinations; and (8) systems integration and evaluation.

Multilevel Evaluation Systems Project. Final Report.

ERIC Educational Resources Information Center

Herman, Joan L.

Several studies were conducted in 1987 by the Multilevel Evaluation Systems Project, which focuses on developing a model for a multi-purpose, multi-user evaluation system to facilitate educational decision making and evaluation. The project model emphasizes on-going integrated assessment of individuals, classes, and programs using a variety of…

Evaluation systems for clinical governance development: a comparative study.

PubMed

Hooshmand, Elaheh; Tourani, Sogand; Ravaghi, Hamid; Ebrahimipour, Hossein

2014-01-01

Lack of scientific and confirmed researches and expert knowledge about evaluation systems for clinical governance development in Iran have made studies on different evaluation systems for clinical governance development a necessity. These studies must provide applied strategies to design criteria of implementing clinical governance for hospital's accreditation. This is a descriptive and comparative study on development of clinical governance models all over the world. Data have been gathered by reviewing related articles. Models have been studied in comprehensive review method. The evaluated models of clinical governance development were Australian, NHS, SPOCK and OPTIGOV. The final aspects extracted from these models were Responsiveness, Policies and Strategies, Organizational Structure, Allocating Resources, Education and Occupational Development, Performance Evaluation, External Evaluation, Patient Oriented Approach, Risk Management, Personnel's Participation, Information Technology, Human Resources, Research and Development, Evidence Based Medicine, Clinical Audit, Health Technology Assessment and Quality. These results are applicable for completing the present criteria which evaluating clinical governance application and provide practical framework to evaluate country's hospital on the basis of clinical governance elements.

Wet Scrubber System Study. Volume II. Final Report and Bibliography.

ERIC Educational Resources Information Center

Calvert, Seymour; And Others

This report is the second volume of a two-part study on wet scrubber systems. The study was undertaken to achieve the following objectives: (1) evaluate current engineering technology, (2) evaluate existing scrubber systems, (3) investigate present usage problems, (4) determine potential new applications, and (5) develop specific research…

Measuring value for money: a scoping review on economic evaluation of health information systems.

PubMed

Bassi, Jesdeep; Lau, Francis

2013-01-01

To explore how key components of economic evaluations have been included in evaluations of health information systems (HIS), to determine the state of knowledge on value for money for HIS, and provide guidance for future evaluations. We searched databases, previously collected papers, and references for relevant papers published from January 2000 to June 2012. For selection, papers had to: be a primary study; involve a computerized system for health information processing, decision support, or management reporting; and include an economic evaluation. Data on study design and economic evaluation methods were extracted and analyzed. Forty-two papers were selected and 33 were deemed high quality (scores ≥ 8/10) for further analysis. These included 12 economic analyses, five input cost analyses, and 16 cost-related outcome analyses. For HIS types, there were seven primary care electronic medical records, six computerized provider order entry systems, five medication management systems, five immunization information systems, four institutional information systems, three disease management systems, two clinical documentation systems, and one health information exchange network. In terms of value for money, 23 papers reported positive findings, eight were inconclusive, and two were negative. We found a wide range of economic evaluation papers that were based on different assumptions, methods, and metrics. There is some evidence of value for money in selected healthcare organizations and HIS types. However, caution is needed when generalizing these findings. Better reporting of economic evaluation studies is needed to compare findings and build on the existing evidence base we identified.

A study of systems implementation languages for the POCCNET system

NASA Technical Reports Server (NTRS)

Basili, V. R.; Franklin, J. W.

1976-01-01

The results are presented of a study of systems implementation languages for the Payload Operations Control Center Network (POCCNET). Criteria are developed for evaluating the languages, and fifteen existing languages are evaluated on the basis of these criteria.

Redesigning Teacher Evaluation: Lessons Learned from a Pilot Implementation in New Hampshire

ERIC Educational Resources Information Center

Riordan, Julie; Lacireno-Paquet, Natalie; Shakman, Karen; Bocala, Candice

2016-01-01

Many studies have called attention to the limitations of current teacher evaluation systems and the need for reform nationwide. This study addresses three research questions: (1) What are the features of the new teacher evaluation systems in New Hampshire's districts with SIG schools?; (2) To what extent did schools implement the evaluation system…

Assessment of a Model for the Evaluation of Professional Non-Instruction Staff in Elementary Schools

ERIC Educational Resources Information Center

Hlavaty, Erica A.

2013-01-01

The purpose of this study was to help improve the evaluation system for school counselors and school psychologists, or non-instructional, certified staff (NICS). A mixed methodology approach was used to describe the existing evaluation system used to evaluate NICS; to develop a new system of evaluation based on recent research; and to determine…

Linear modulator

NASA Technical Reports Server (NTRS)

1972-01-01

A study of frequency division multiplexing (FDM) systems was made for the purpose of determining the system performance that can be obtained with available state of the art components. System performance was evaluated on the basis of past experience, system analysis, and component evaluation. The system study was specifically directed to the area of FDM systems using subcarrier channel frequencies from 4 kHz to 200 kHz and channel information bandwidths of dc to 1, 2, 4, 8, and 16 kHz. The evaluation also assumes that the demodulation will be from a tape recorder which produces frequency modulation of + or - 1% on the signal due to the tape recorder wow and flutter. For the modulation system it is assumed that the pilot and carrier channel frequencies are stable to within + or - .005% and that the FM on the channel carriers is negligible. The modulator system was evaluated for the temperature range of -20 degree to +85 degree while the demodulator system was evaluated for operation at room temperature.

Perceived Usability Evaluation of Learning Management Systems: Empirical Evaluation of the System Usability Scale

ERIC Educational Resources Information Center

Orfanou, Konstantina; Tselios, Nikolaos; Katsanos, Christos

2015-01-01

Perceived usability affects greatly student's learning effectiveness and overall learning experience, and thus is an important requirement of educational software. The System Usability Scale (SUS) is a well-researched and widely used questionnaire for perceived usability evaluation. However, surprisingly few studies have used SUS to evaluate the…

PACKAGE PLANTS FOR SMALL SYSTEMS: A FIELD STUDY

EPA Science Inventory

A joint field study was conducted by AWWA and the Drinking Water Research Division of USEPA to evaluate existing small community systems that use package plant technology. Forty-eight package plant systems representing a geographic and technological cross section were evaluated t...

The View of Principals on Standards Based Evaluation Systems and Their Role as Instructional Leaders

ERIC Educational Resources Information Center

Zoll, James Allen

2014-01-01

This study examined the implementation of standards based evaluation systems, specifically Georgia's Teacher Keys Effectiveness System, affects the principals' role of instructional leader. Using a modified Delphi study, principals from a large urban/suburban school system, gave feedback on three questions: how has their role changed; are they…

An approach to evaluating reactive airborne wind shear systems

NASA Technical Reports Server (NTRS)

Gibson, Joseph P., Jr.

1992-01-01

An approach to evaluating reactive airborne windshear detection systems was developed to support a deployment study for future FAA ground-based windshear detection systems. The deployment study methodology assesses potential future safety enhancements beyond planned capabilities. The reactive airborne systems will be an integral part of planned windshear safety enhancements. The approach to evaluating reactive airborne systems involves separate analyses for both landing and take-off scenario. The analysis estimates the probability of effective warning considering several factors including NASA energy height loss characteristics, reactive alert timing, and a probability distribution for microburst strength.

Evaluation of several ultrasonography scoring systems for synovitis and comparison to clinical examination: results from a prospective multicentre study of rheumatoid arthritis.

PubMed

Dougados, Maxime; Jousse-Joulin, Sandrine; Mistretta, Frederic; d'Agostino, Maria-Antonietta; Backhaus, Marina; Bentin, Jacques; Chalès, Gérard; Chary-Valckenaere, Isabelle; Conaghan, Philip; Etchepare, Fabien; Gaudin, Philippe; Grassi, Walter; van der Heijde, Désirée; Sellam, Jérémie; Naredo, Esperanza; Szkudlarek, Marcin; Wakefield, Richard; Saraux, Alain

2010-05-01

To evaluate different global ultrasonographic (US) synovitis scoring systems as potential outcome measures of rheumatoid arthritis (RA) according to the Outcome Measures in Rheumatoid Arthritis Clinical Trials (OMERACT) filter. To study selected global scoring systems, for the clinical, B mode and power Doppler techniques, the following joints were evaluated: 28 joints (28-joint Disease Activity Score (DAS28)), 20 joints (metacarpophalangeals (MCPs) + metatarsophalangeals (MTPs)) and 38 joints (28 joints + MTPs) using either a binary (yes/no) or a 0-3 grade. The study was a prospective, 4-month duration follow-up of 76 patients with RA requiring anti-tumour necrosis factor (TNF) therapy (complete follow-up data: 66 patients). Intraobserver reliability was evaluated using the intraclass correlation coefficient (ICC), construct validity was evaluated using the Cronbach alpha test and external validity was evaluated using level of correlation between scoring system and C reactive protein (CRP). Sensitivity to change was evaluated using the standardised response mean. Discriminating capacity was evaluated using the standardised mean differences in patients considered by the doctor as significantly improved or not at the end of the study. Different clinimetric properties of various US scoring systems were at least as good as the clinical scores with, for example, intraobserver reliability ranging from 0.61 to 0.97 versus from 0.53 to 0.82, construct validity ranging from 0.76 to 0.89 versus from 0.76 to 0.88, correlation with CRP ranging from 0.28 to 0.34 versus from 0.28 to 0.35 and sensitivity to change ranging from 0.60 to 1.21 versus from 0.96 to 1.36 for US versus clinical scoring systems, respectively. This study suggests that US evaluation of synovitis is an outcome measure at least as relevant as physical examination. Further studies are required in order to achieve optimal US scoring systems for monitoring patients with RA in clinical trials and in clinical practice.

Research on Comprehensive Evaluation Method for Heating Project Based on Analytic Hierarchy Processing

NASA Astrophysics Data System (ADS)

Han, Shenchao; Yang, Yanchun; Liu, Yude; Zhang, Peng; Li, Siwei

2018-01-01

It is effective to reduce haze in winter by changing the distributed heat supply system. Thus, the studies on comprehensive index system and scientific evaluation method of distributed heat supply project are essential. Firstly, research the influence factors of heating modes, and an index system with multiple dimension including economic, environmental, risk and flexibility was built and all indexes were quantified. Secondly, a comprehensive evaluation method based on AHP was put forward to analyze the proposed multiple and comprehensive index system. Lastly, the case study suggested that supplying heat with electricity has great advantage and promotional value. The comprehensive index system of distributed heating supply project and evaluation method in this paper can evaluate distributed heat supply project effectively and provide scientific support for choosing the distributed heating project.

Comparative Discussion on Psychophysiological Effect of Self-administered Facial Massage by Treatment Method

NASA Astrophysics Data System (ADS)

Nozawa, Akio; Takei, Yuya

The aim of study was to quantitatively evaluate the effects of self-administered facial massage, which was done by hand or facial roller. In this study, the psychophysiological effects of facial massage were evaluated. The central nerves system and the autonomic nervous system were administered to evaluate physiological system. The central nerves system was assessed by Electroencephalogram (EEG). The autonomic nervous system were assessed by peripheral skin temperature(PST) and heart rate variability (HRV) with spectral analysis. In the spectral analysis of HRV, the high-frequency components (HF) were evaluated. State-Trait Anxiety Inventory (STAI), Profile of Mood Status (POMS) and subjective sensory amount with Visual Analog Scale (VAS) were administered to evaluate psychological status. These results suggest that kept brain activity and had strong effects on stress alleviation.

Earth orbit navigation study. Volume 2: System evaluation

NASA Technical Reports Server (NTRS)

1972-01-01

An overall systems evaluation was made of five candidate navigation systems in support of earth orbit missions. The five systems were horizon sensor system, unkown landmark tracking system, ground transponder system, manned space flight network, and tracking and data relay satellite system. Two reference missions were chosen: a low earth orbit mission and a transfer trajectory mission from low earth orbit to geosynchronous orbit. The specific areas addressed in the evaluation were performance, multifunction utilization, system mechanization, and cost.

Measuring value for money: a scoping review on economic evaluation of health information systems

PubMed Central

Bassi, Jesdeep; Lau, Francis

2013-01-01

Objective To explore how key components of economic evaluations have been included in evaluations of health information systems (HIS), to determine the state of knowledge on value for money for HIS, and provide guidance for future evaluations. Materials and methods We searched databases, previously collected papers, and references for relevant papers published from January 2000 to June 2012. For selection, papers had to: be a primary study; involve a computerized system for health information processing, decision support, or management reporting; and include an economic evaluation. Data on study design and economic evaluation methods were extracted and analyzed. Results Forty-two papers were selected and 33 were deemed high quality (scores ≥8/10) for further analysis. These included 12 economic analyses, five input cost analyses, and 16 cost-related outcome analyses. For HIS types, there were seven primary care electronic medical records, six computerized provider order entry systems, five medication management systems, five immunization information systems, four institutional information systems, three disease management systems, two clinical documentation systems, and one health information exchange network. In terms of value for money, 23 papers reported positive findings, eight were inconclusive, and two were negative. Conclusions We found a wide range of economic evaluation papers that were based on different assumptions, methods, and metrics. There is some evidence of value for money in selected healthcare organizations and HIS types. However, caution is needed when generalizing these findings. Better reporting of economic evaluation studies is needed to compare findings and build on the existing evidence base we identified. PMID:23416247

Pilot study to examine use of transverse vibration nondestructive evaluation for assessing floor systems

Treesearch

Zhiyong Cai; Robert J. Ross; Michael O. Hunt; Lawrence A. Soltis

2002-01-01

Evaluation of existing timber structures requires procedures to evaluate in situ structural members and components. This report evaluates the transverse vibration response of laboratory-built floor systems with new and salvaged joists. The objectives were to 1) compare floor system response to individual member response; 2) examine response sensitivity to location of...

CRiSP: An Instrument for Assessing Student Perceptions of Classroom Response Systems

ERIC Educational Resources Information Center

Richardson, Alice M.; Dunn, Peter K.; McDonald, Christine; Oprescu, Florin

2015-01-01

This paper describes the development and validation of an instrument for evaluating classroom response systems (CRS). While a number of studies evaluating CRS have been published to date, no standardised instrument exists as a means of evaluating the impact of using the CRS. This means that comparing the different systems, or evaluating the…

Can You Increase Teacher Engagement with Evaluation Simply by Improving the Evaluation System?

ERIC Educational Resources Information Center

Moskal, Adon C. M.; Stein, Sarah J.; Golding, Clinton

2016-01-01

We know various factors can influence how teaching staff engage with student evaluation, such as institutional policies or staff beliefs. However, little research has investigated the influence of the technical processes of an evaluation system. In this article, we present a case study of the effects of changing the technical system for…

Making Sense of Alternative Assessment in a Qualitative Evaluation System

ERIC Educational Resources Information Center

Rojas Serrano, Javier

2017-01-01

In a Colombian private English institution, a qualitative evaluation system has been incorporated. This type of evaluation poses challenges to students who have never been evaluated through a system that eliminates exams or quizzes and, as a consequence, these students have to start making sense of it. This study explores the way students face the…

Effectiveness of nursing management information systems: a systematic review.

PubMed

Choi, Mona; Yang, You Lee; Lee, Sun-Mi

2014-10-01

The purpose of this study was to review evaluation studies of nursing management information systems (NMISs) and their outcome measures to examine system effectiveness. For the systematic review, a literature search of the PubMed, CINAHL, Embase, and Cochrane Library databases was conducted to retrieve original articles published between 1970 and 2014. Medical Subject Headings (MeSH) terms included informatics, medical informatics, nursing informatics, medical informatics application, and management information systems for information systems and evaluation studies and nursing evaluation research for evaluation research. Additionally, manag(*) and admin(*), and nurs(*) were combined. Title, abstract, and full-text reviews were completed by two reviewers. And then, year, author, type of management system, study purpose, study design, data source, system users, study subjects, and outcomes were extracted from the selected articles. The quality and risk of bias of the studies that were finally selected were assessed with the Risk of Bias Assessment Tool for Non-randomized Studies (RoBANS) criteria. Out of the 2,257 retrieved articles, a total of six articles were selected. These included two scheduling programs, two nursing cost-related programs, and two patient care management programs. For the outcome measurements, usefulness, time saving, satisfaction, cost, attitude, usability, data quality/completeness/accuracy, and personnel work patterns were included. User satisfaction, time saving, and usefulness mostly showed positive findings. The study results suggest that NMISs were effective in time saving and useful in nursing care. Because there was a lack of quality in the reviewed studies, well-designed research, such as randomized controlled trials, should be conducted to more objectively evaluate the effectiveness of NMISs.

Assessment and Evaluation of National Human Resource Development System Competitiveness in Emerging Countries

ERIC Educational Resources Information Center

Oh, HunSeok; Seo, DongIn; Kim, JuSeuk; Yoo, SangOk; Seong, HeeChang

2015-01-01

This study assessed and evaluated the competitiveness of national human resource development (NHRD) systems in emerging countries with potential for growth. The literature on emerging countries and NHRD systems was reviewed. The study developed a model mechanism with forty-one indices and nine sub-components for the NHRD system assessment in…

System and algorithm for evaluation of human auditory analyzer state

NASA Astrophysics Data System (ADS)

Bachynskiy, Mykhaylo V.; Azarkhov, Oleksandr Yu.; Shtofel, Dmytro Kh.; Horbatiuk, Svitlana M.; Ławicki, Tomasz; Kalizhanova, Aliya; Smailova, Saule; Askarova, Nursanat

2017-08-01

The paper discusses questions of human auditory state evaluation with technical means. It considers the disadvantages of existing clinical audiometry methods and systems. It is proposed to use method for evaluating of auditory analyzer state by means of pulsometry to get the medical study more objective and efficient. It provides for use of two optoelectronic sensors located on the carotid artery and ear lobe, Using this method the biotechnical system for evaluation and stimulation of human auditory analyzer stare wad developed. Its hardware and software were substantiated. Different modes of simulation in the designed system were tested and the influence of the procedure on a patient was studied.

A Tentative Study on the Evaluation of Community Health Service Quality*

NASA Astrophysics Data System (ADS)

Ma, Zhi-qiang; Zhu, Yong-yue

Community health service is the key point of health reform in China. Based on pertinent studies, this paper constructed an indicator system for the community health service quality evaluation from such five perspectives as visible image, reliability, responsiveness, assurance and sympathy, according to service quality evaluation scale designed by Parasuraman, Zeithaml and Berry. A multilevel fuzzy synthetical evaluation model was constructed to evaluate community health service by fuzzy mathematics theory. The applicability and maneuverability of the evaluation indicator system and evaluation model were verified by empirical analysis.

Teacher Leadership and Teacher Efficacy: A Correlational Study Comparing Teacher Perceptions of Leadership and Efficacy and Teacher Evaluation Scores from the North Carolina Educator Evaluation System

ERIC Educational Resources Information Center

Guenzler, April M.

2016-01-01

This study sought to identify correlations between constructs of teacher leadership, teacher efficacy, and teacher evaluation. Teacher perceptual data of support of teacher leadership, perceptual data on personal teacher efficacy, and teacher self-reported scores from the North Carolina Educator Evaluation System were gathered. The relationships…

Development of a School Leadership Evaluation System

ERIC Educational Resources Information Center

Orlando, Nik

2014-01-01

This action research study examined the effectiveness of the process implemented by Partnerships to Uplift Communities (PUC) Schools Charter Management Organization to develop their school leader evaluation system in collaboration with current PUC school leaders. The development of the leadership evaluation system included the collective voices of…

Summary of the recent short-haul systems studies

NASA Technical Reports Server (NTRS)

Savin, R. C.; Galloway, T. L.; Wilcox, D. E.; Kenyon, G. C.; Ardema, M. D.; Waters, M. H.

1975-01-01

The results of several NASA sponsored high density short haul air transportation systems studies are reported as well as analyzed. Included are the total STOL systems analysis approach, a companion STOL composites study conducted in conjunction with STOL systems studies, a STOL economic assessment study, an evaluation of STOL aircraft with and without externally blown flaps, an alternative STOL systems for the San Francisco Bay Area, and the quiet, clean experimental engine studies. Assumptions and results of these studies are summarized, their differences, analyzed, and the results compared with those in-house analyses performed by the Systems Studies Division of the NASA-Ames Research Center. Pertinent conclusions are developed and the more significant technology needs for the evaluation of a viable short haul transportation system are identified.

Strapdown system performance optimization test evaluations (SPOT), volume 1

NASA Technical Reports Server (NTRS)

Blaha, R. J.; Gilmore, J. P.

1973-01-01

A three axis inertial system was packaged in an Apollo gimbal fixture for fine grain evaluation of strapdown system performance in dynamic environments. These evaluations have provided information to assess the effectiveness of real-time compensation techniques and to study system performance tradeoffs to factors such as quantization and iteration rate. The strapdown performance and tradeoff studies conducted include: (1) Compensation models and techniques for the inertial instrument first-order error terms were developed and compensation effectivity was demonstrated in four basic environments; single and multi-axis slew, and single and multi-axis oscillatory. (2) The theoretical coning bandwidth for the first-order quaternion algorithm expansion was verified. (3) Gyro loop quantization was identified to affect proportionally the system attitude uncertainty. (4) Land navigation evaluations identified the requirement for accurate initialization alignment in order to pursue fine grain navigation evaluations.

COPES Report: System Reliability Study.

ERIC Educational Resources Information Center

Foothill-De Anza Community Coll. District, Los Altos Hills, CA.

The study examines the reliability of the Community College Occupational Programs Evaluation System (COPES). The COPES process is a system for evaluating program strengths and needs. A two-way test, college self-appraisal with third party validation of the self-appraisal, is utilized to assist community colleges in future institutional planning…

Feasibility Study of a Rotorcraft Health and Usage Monitoring System (HUMS): Results of Operator's Evaluation (MS Word file)

DOT National Transportation Integrated Search

1996-02-01

The objective of this study was to evaluate the feasibility of a state of the : art health and usage monitoring system (HUMS) to provide monitoring of critical : mechanical systems on the helicopter, including motors, drive train, engines : and life ...

How Can Visual Analytics Assist Investigative Analysis? Design Implications from an Evaluation.

PubMed

Youn-Ah Kang; Görg, Carsten; Stasko, John

2011-05-01

Despite the growing number of systems providing visual analytic support for investigative analysis, few empirical studies of the potential benefits of such systems have been conducted, particularly controlled, comparative evaluations. Determining how such systems foster insight and sensemaking is important for their continued growth and study, however. Furthermore, studies that identify how people use such systems and why they benefit (or not) can help inform the design of new systems in this area. We conducted an evaluation of the visual analytics system Jigsaw employed in a small investigative sensemaking exercise, and compared its use to three other more traditional methods of analysis. Sixteen participants performed a simulated intelligence analysis task under one of the four conditions. Experimental results suggest that Jigsaw assisted participants to analyze the data and identify an embedded threat. We describe different analysis strategies used by study participants and how computational support (or the lack thereof) influenced the strategies. We then illustrate several characteristics of the sensemaking process identified in the study and provide design implications for investigative analysis tools based thereon. We conclude with recommendations on metrics and techniques for evaluating visual analytics systems for investigative analysis.

Electrification Futures Study: A Technical Evaluation of the Impacts of an

Science.gov Websites

Technical Evaluation of the Impacts of an Electrified U.S. Energy System Electrification Futures Study: A Technical Evaluation of the Impacts of an Electrified U.S. Energy System Illustration showing various impacts of widespread electrification in the United States. In addition to NREL, the research team

Self-Study and Evaluation Guide. Section C-2: Accounting for Services and Finances.

ERIC Educational Resources Information Center

National Accreditation Council for Agencies Serving the Blind and Visually Handicapped, New York, NY.

The self study and evaluation guide, one of 16 documents for accreditation of agencies serving the blind and visually handicapped, focuses on accounting for services and finances. Standards address five areas: planning for accounting for services and finances, service accounting systems, financial accounting systems, evaluation, and public…

Pyrolysis system evaluation study

NASA Technical Reports Server (NTRS)

1974-01-01

An evaluation of two different pyrolysis concepts which recover energy from solid waste was conducted in order to determine the merits of each concept for integration into a Integrated Utility System (IUS). The two concepts evaluated were a Lead Bath Furnace Pyrolysis System and a Slagging Vertical Shaft, Partial Air Oxidation Pyrolysis System. Both concepts will produce a fuel gas from the IUS waste and sewage sludge which can be used to offset primary fuel consumption in addition to the sanitary disposal of the waste. The study evaluated the thermal integration of each concept as well as the economic impact on the IUS resulting from integrating each pyrolysis concepts. For reference, the pyrolysis concepts were also compared to incineration which was considered the baseline IUS solid waste disposal system.

Manipulator system man-machine interface evaluation program. [technology assessment

NASA Technical Reports Server (NTRS)

Malone, T. B.; Kirkpatrick, M.; Shields, N. L.

1974-01-01

Application and requirements for remote manipulator systems for future space missions were investigated. A manipulator evaluation program was established to study the effects of various systems parameters on operator performance of tasks necessary for remotely manned missions. The program and laboratory facilities are described. Evaluation criteria and philosophy are discussed.

Needs assessment for next generation computer-aided mammography reference image databases and evaluation studies.

PubMed

Horsch, Alexander; Hapfelmeier, Alexander; Elter, Matthias

2011-11-01

Breast cancer is globally a major threat for women's health. Screening and adequate follow-up can significantly reduce the mortality from breast cancer. Human second reading of screening mammograms can increase breast cancer detection rates, whereas this has not been proven for current computer-aided detection systems as "second reader". Critical factors include the detection accuracy of the systems and the screening experience and training of the radiologist with the system. When assessing the performance of systems and system components, the choice of evaluation methods is particularly critical. Core assets herein are reference image databases and statistical methods. We have analyzed characteristics and usage of the currently largest publicly available mammography database, the Digital Database for Screening Mammography (DDSM) from the University of South Florida, in literature indexed in Medline, IEEE Xplore, SpringerLink, and SPIE, with respect to type of computer-aided diagnosis (CAD) (detection, CADe, or diagnostics, CADx), selection of database subsets, choice of evaluation method, and quality of descriptions. 59 publications presenting 106 evaluation studies met our selection criteria. In 54 studies (50.9%), the selection of test items (cases, images, regions of interest) extracted from the DDSM was not reproducible. Only 2 CADx studies, not any CADe studies, used the entire DDSM. The number of test items varies from 100 to 6000. Different statistical evaluation methods are chosen. Most common are train/test (34.9% of the studies), leave-one-out (23.6%), and N-fold cross-validation (18.9%). Database-related terminology tends to be imprecise or ambiguous, especially regarding the term "case". Overall, both the use of the DDSM as data source for evaluation of mammography CAD systems, and the application of statistical evaluation methods were found highly diverse. Results reported from different studies are therefore hardly comparable. Drawbacks of the DDSM (e.g. varying quality of lesion annotations) may contribute to the reasons. But larger bias seems to be caused by authors' own decisions upon study design. RECOMMENDATIONS/CONCLUSION: For future evaluation studies, we derive a set of 13 recommendations concerning the construction and usage of a test database, as well as the application of statistical evaluation methods.

Usability study of a computer-based self-management system for older adults with chronic diseases.

PubMed

Or, Calvin; Tao, Da

2012-11-08

Usability can influence patients' acceptance and adoption of a health information technology. However, little research has been conducted to study the usability of a self-management health care system, especially one geared toward elderly patients. This usability study evaluated a new computer-based self-management system interface for older adults with chronic diseases, using a paper prototype approach. Fifty older adults with different chronic diseases participated. Two usability evaluation methods were involved: (1) a heuristics evaluation and (2) end-user testing with a think-aloud testing method, audio recording, videotaping, and interviewing. A set of usability metrics was employed to determine the overall system usability, including task incompletion rate, task completion time, frequency of error, frequency of help, satisfaction, perceived usefulness, and perceived ease of use. Interviews were used to elicit participants' comments on the system design. The quantitative data were analyzed using descriptive statistics and the qualitative data were analyzed for content. The participants were able to perform the predesigned self-management tasks with the current system design and they expressed mostly positive responses about the perceived usability measures regarding the system interface. However, the heuristics evaluation, performance measures, and interviews revealed a number of usability problems related to system navigation, information search and interpretation, information presentation, and readability. Design recommendations for further system interface modifications were discussed. This study verified the usability of the self-management system developed for older adults with chronic diseases. Also, we demonstrated that our usability evaluation approach could be used to quickly and effectively identify usability problems in a health care information system at an early stage of the system development process using a paper prototype. Conducting a usability evaluation is an essential step in system development to ensure that the system features match the users' true needs, expectations, and characteristics, and also to minimize the likelihood of the users committing user errors and having difficulties using the system.

Usability Study of a Computer-Based Self-Management System for Older Adults with Chronic Diseases

PubMed Central

Tao, Da

2012-01-01

Background Usability can influence patients’ acceptance and adoption of a health information technology. However, little research has been conducted to study the usability of a self-management health care system, especially one geared toward elderly patients. Objective This usability study evaluated a new computer-based self-management system interface for older adults with chronic diseases, using a paper prototype approach. Methods Fifty older adults with different chronic diseases participated. Two usability evaluation methods were involved: (1) a heuristics evaluation and (2) end-user testing with a think-aloud testing method, audio recording, videotaping, and interviewing. A set of usability metrics was employed to determine the overall system usability, including task incompletion rate, task completion time, frequency of error, frequency of help, satisfaction, perceived usefulness, and perceived ease of use. Interviews were used to elicit participants’ comments on the system design. The quantitative data were analyzed using descriptive statistics and the qualitative data were analyzed for content. Results The participants were able to perform the predesigned self-management tasks with the current system design and they expressed mostly positive responses about the perceived usability measures regarding the system interface. However, the heuristics evaluation, performance measures, and interviews revealed a number of usability problems related to system navigation, information search and interpretation, information presentation, and readability. Design recommendations for further system interface modifications were discussed. Conclusions This study verified the usability of the self-management system developed for older adults with chronic diseases. Also, we demonstrated that our usability evaluation approach could be used to quickly and effectively identify usability problems in a health care information system at an early stage of the system development process using a paper prototype. Conducting a usability evaluation is an essential step in system development to ensure that the system features match the users’ true needs, expectations, and characteristics, and also to minimize the likelihood of the users committing user errors and having difficulties using the system. PMID:23612015

Evaluation of Student Models on Current Socio-Scientific Topics Based on System Dynamics

ERIC Educational Resources Information Center

Nuhoglu, Hasret

2014-01-01

This study aims to 1) enable primary school students to develop models that will help them understand and analyze a system, through a learning process based on system dynamics approach, 2) examine and evaluate students' models related to socio-scientific issues using certain criteria. The research method used is a case study. The study sample…

A stochastic approach for automatic generation of urban drainage systems.

PubMed

Möderl, M; Butler, D; Rauch, W

2009-01-01

Typically, performance evaluation of new developed methodologies is based on one or more case studies. The investigation of multiple real world case studies is tedious and time consuming. Moreover extrapolating conclusions from individual investigations to a general basis is arguable and sometimes even wrong. In this article a stochastic approach is presented to evaluate new developed methodologies on a broader basis. For the approach the Matlab-tool "Case Study Generator" is developed which generates a variety of different virtual urban drainage systems automatically using boundary conditions e.g. length of urban drainage system, slope of catchment surface, etc. as input. The layout of the sewer system is based on an adapted Galton-Watson branching process. The sub catchments are allocated considering a digital terrain model. Sewer system components are designed according to standard values. In total, 10,000 different virtual case studies of urban drainage system are generated and simulated. Consequently, simulation results are evaluated using a performance indicator for surface flooding. Comparison between results of the virtual and two real world case studies indicates the promise of the method. The novelty of the approach is that it is possible to get more general conclusions in contrast to traditional evaluations with few case studies.

Development and Evaluation of a Systems Thinking Education Strategy for Baccalaureate Nursing Curriculum: A Pilot Study.

PubMed

Fura, Louise A; Wisser, Kathleen Z

Nurse educators are charged to develop and evaluate curricula on systems thinking to prepare future nurses to provide safe nursing care. The goal of this pilot study was to design and evaluate a four-hour educational strategy that prepares future professional nurses to use systems thinking approaches in the delivery of safe patient care. This study exposed prelicensure baccalaureate nursing students to systems thinking principles, which included didactic and experiential activities. A descriptive design was used to determine the effect of an on-campus educational strategy. A paired samples t-test revealed statistical significance from pretest to posttest.

System Study: Technology Assessment and Prioritizing Update

NASA Technical Reports Server (NTRS)

2008-01-01

For the Intelligent Engine System (Propulsion 21) study, each technology was evaluated to determine the impact to fuel burn, acoustics, and NOx emissions. The optimum combination of technologies and their overall benefits to the system were also evaluated, resulting in noise improvement potential of 1.89 EPNdB cumulative margin,-1.34 percent fuel burn, and 50 percent NOx reduction from the 2015 UEET-QAT baseline. All the technology evaluations, except T18-20D, were based on newengines, where the engine was resized to obtain the maximum system benefit while maintaining the same cycle parameters as the 2015 UEET-QAT baseline. The impact of turbine clearance control on deteriorated engines, T18-20D, was also evaluated. Recommendations for future system study work include, but were not limited to, validation of a university-developed engine deterioration model and customer value analysis as figures of merit beside fuel burn, emissions, and acoustics.

Review of health information technology usability study methodologies

PubMed Central

Bakken, Suzanne

2011-01-01

Usability factors are a major obstacle to health information technology (IT) adoption. The purpose of this paper is to review and categorize health IT usability study methods and to provide practical guidance on health IT usability evaluation. 2025 references were initially retrieved from the Medline database from 2003 to 2009 that evaluated health IT used by clinicians. Titles and abstracts were first reviewed for inclusion. Full-text articles were then examined to identify final eligibility studies. 629 studies were categorized into the five stages of an integrated usability specification and evaluation framework that was based on a usability model and the system development life cycle (SDLC)-associated stages of evaluation. Theoretical and methodological aspects of 319 studies were extracted in greater detail and studies that focused on system validation (SDLC stage 2) were not assessed further. The number of studies by stage was: stage 1, task-based or user–task interaction, n=42; stage 2, system–task interaction, n=310; stage 3, user–task–system interaction, n=69; stage 4, user–task–system–environment interaction, n=54; and stage 5, user–task–system–environment interaction in routine use, n=199. The studies applied a variety of quantitative and qualitative approaches. Methodological issues included lack of theoretical framework/model, lack of details regarding qualitative study approaches, single evaluation focus, environmental factors not evaluated in the early stages, and guideline adherence as the primary outcome for decision support system evaluations. Based on the findings, a three-level stratified view of health IT usability evaluation is proposed and methodological guidance is offered based upon the type of interaction that is of primary interest in the evaluation. PMID:21828224

Joint development of evidence-based medical record by doctors and patients through integrated Chinese and Western medicine on digestive system diseases.

PubMed

Li, Bo; Gao, Hong-yang; Gao, Rui; Zhao, Ying-pan; Li, Qing-na; Zhao, Yang; Tang, Xu-dong; Shang, Hong-cai

2016-02-01

Building the clinical therapeutic evaluation system by combing the evaluation given by doctors and patients can form a more comprehensive and objective evaluation system. A literature search on the practice of evidence-based evaluation was conducted in key biomedical databases, i.e. PubMed, Excerpt Medica Database, China Biology Medicine disc and China National Knowledge Infrastructure. However, no relevant study on the subjects of interest was identified. Therefore, drawing on the principles of narrative medicine and expert opinion from systems of Chinese medicine and Western medicine, we propose to develop and pilot-test a novel evidence-based medical record format that captures the perspectives of both patients and doctors in a clinical trial. Further, we seek to evaluate a strategic therapeutic approach that integrates the wisdom of Chinese medicine with the scientific basis of Western medicine in the treatment of digestive system disorders. Evaluation of therapeutic efficacy of remedies under the system of Chinese medicine is an imperative ongoing research. The present study intends to identify a novel approach to assess the synergistic benefits achievable from an integrated therapeutic approach combining Chinese and Western system of medicine to treat digestive system disorders.

Evaluation criteria for district health management information systems: lessons from the Ministry of Health, Kenya.

PubMed

Odhiambo-Otieno, George W

2005-01-01

There has been no comprehensive evaluation of the district health management information systems (DHMISs) since the establishment of these systems by the Ministry of Health (MoH), in Kenya. This is partly due to lack of defined criteria for evaluating the systems. The objective of this study is to design evaluation criteria for assessing the viability, sustainability and ultimate contribution of DHMIS in the management of the district health system (DHS) in Kenya. This descriptive cross-sectional study was undertaken in three DHSs in Kenya. Empirical evidence was collected through interviews, complemented by a comprehensive review of relevant literature, reports and operational manuals of various health information systems in Kenya. A set of evaluation criteria for DHMISs in Kenya was designed for each of the three phases of implementation: phase one-pre-implementation evaluation criteria (categorized as policy and objectives, technical feasibility, financial viability, political viability and administrative operability) to be applied at the design stage; phase two-concurrent (operational) implementation evaluation criteria to be applied during implementation of the new system; phase three-post-implementation evaluation criteria (classified as internal-quality of information; external-resources and managerial support; ultimate-systems impact) to be applied after operating the implemented system for at least 3 years. In designing a DHMIS model there is need to have built-in these three sets of evaluation criteria which should be used in a phased manner. Pre-implementation evaluation criteria should be used to evaluate the system's viability before more resources are committed to its implementation; concurrent (operational) implementation evaluation criteria should be used to ascertain the status of the on-going implementation with the view to either fine-tune or abandon it altogether before more resources are used on it; and post-implementation evaluation criteria should be used to assess its overall effectiveness (if it has achieved its hypothesized benefits) towards the management of DHS.

Effectiveness of Nursing Management Information Systems: A Systematic Review

PubMed Central

Choi, Mona; Yang, You Lee

2014-01-01

Objectives The purpose of this study was to review evaluation studies of nursing management information systems (NMISs) and their outcome measures to examine system effectiveness. Methods For the systematic review, a literature search of the PubMed, CINAHL, Embase, and Cochrane Library databases was conducted to retrieve original articles published between 1970 and 2014. Medical Subject Headings (MeSH) terms included informatics, medical informatics, nursing informatics, medical informatics application, and management information systems for information systems and evaluation studies and nursing evaluation research for evaluation research. Additionally, manag* and admin*, and nurs* were combined. Title, abstract, and full-text reviews were completed by two reviewers. And then, year, author, type of management system, study purpose, study design, data source, system users, study subjects, and outcomes were extracted from the selected articles. The quality and risk of bias of the studies that were finally selected were assessed with the Risk of Bias Assessment Tool for Non-randomized Studies (RoBANS) criteria. Results Out of the 2,257 retrieved articles, a total of six articles were selected. These included two scheduling programs, two nursing cost-related programs, and two patient care management programs. For the outcome measurements, usefulness, time saving, satisfaction, cost, attitude, usability, data quality/completeness/accuracy, and personnel work patterns were included. User satisfaction, time saving, and usefulness mostly showed positive findings. Conclusions The study results suggest that NMISs were effective in time saving and useful in nursing care. Because there was a lack of quality in the reviewed studies, well-designed research, such as randomized controlled trials, should be conducted to more objectively evaluate the effectiveness of NMISs. PMID:25405060

A Bayesian approach to multivariate measurement system assessment

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hamada, Michael Scott

This article considers system assessment for multivariate measurements and presents a Bayesian approach to analyzing gauge R&R study data. The evaluation of variances for univariate measurement becomes the evaluation of covariance matrices for multivariate measurements. The Bayesian approach ensures positive definite estimates of the covariance matrices and easily provides their uncertainty. Furthermore, various measurement system assessment criteria are easily evaluated. The approach is illustrated with data from a real gauge R&R study as well as simulated data.

A Bayesian approach to multivariate measurement system assessment

DOE PAGES

Hamada, Michael Scott

2016-07-01

This article considers system assessment for multivariate measurements and presents a Bayesian approach to analyzing gauge R&R study data. The evaluation of variances for univariate measurement becomes the evaluation of covariance matrices for multivariate measurements. The Bayesian approach ensures positive definite estimates of the covariance matrices and easily provides their uncertainty. Furthermore, various measurement system assessment criteria are easily evaluated. The approach is illustrated with data from a real gauge R&R study as well as simulated data.

Interim reliability-evaluation program: analysis of the Browns Ferry, Unit 1, nuclear plant. Appendix B - system descriptions and fault trees

DOE Office of Scientific and Technical Information (OSTI.GOV)

Mays, S.E.; Poloski, J.P.; Sullivan, W.H.

1982-07-01

This report describes a risk study of the Browns Ferry, Unit 1, nuclear plant. The study is one of four such studies sponsored by the NRC Office of Research, Division of Risk Assessment, as part of its Interim Reliability Evaluation Program (IREP), Phase II. This report is contained in four volumes: a main report and three appendixes. Appendix B provides a description of Browns Ferry, Unit 1, plant systems and the failure evaluation of those systems as they apply to accidents at Browns Ferry. Information is presented concerning front-line system fault analysis; support system fault analysis; human error models andmore » probabilities; and generic control circuit analyses.« less

Study on the evaluation index of active power reserve

NASA Astrophysics Data System (ADS)

Guo, Xiaorui; Liu, Jiantao; Wang, Ke; Min, Lu

2018-01-01

Based on the role of active reserve at different time scales, divides the evaluation dimension of active reserve. Analysis the calculation principle of traditional reliability index such as probability of system safety, lack of power shortage and electricity shortage expectancy, and studies the applicability of these indicators to evaluate the reserve capacity on different dimensions. Resolves the evaluation index of active reserve capacity from the dimensions of time dimension, spatial dimension, system state, risk degree and economy, then construct evaluation index of active reserve capacity.

Technology Evaluation Tools and Teacher Performance in Public Schools

ERIC Educational Resources Information Center

Stonehouse, Pauline; Keengwe, Jared

2013-01-01

The purpose of this study was, (a) to describe the introduction of mVAL software and Charlotte Danielson Rubrics (CDR) as teacher evaluation tools; (b) to compare the process and outcomes of the new initiative with traditional systems; and (c) to evaluate the software from the perspective of participants in the system. This study highlights the…

A Mandatory, High-Stakes National Teacher Evaluation System: Perceptions and Attributions of Teachers Who Actively Refuse to Participate

ERIC Educational Resources Information Center

Tornero, Bernardita; Taut, Sandy

2010-01-01

This study examines why some public elementary school teachers openly refuse participation in a mandatory national, standards-based teacher evaluation program. We describe the perceptions these "rebel" teachers have of the evaluation system, studying their open resistance based on the meanings they construct, and elaborated an…

FBI fingerprint identification automation study. AIDS 3 evaluation report. Volume 4: Economic feasibility

NASA Technical Reports Server (NTRS)

Mulhall, B. D. L.

1980-01-01

The results of the economic analysis of the AIDS 3 system design are presented. AIDS 3 evaluated a set of economic feasibility measures including life cycle cost, implementation cost, annual operating expenditures and annual capital expenditures. The economic feasibility of AIDS 3 was determined by comparing the evaluated measures with the same measures, where applicable, evaluated for the current system. A set of future work load scenarios was constructed using JPL's environmental evaluation study of the fingerprint identification system. AIDS 3 and the current system were evaluated for each of the economic feasibility measures for each of the work load scenarios. They were compared for a set of performance measures, including response time and accuracy, and for a set of cost/benefit ratios, including cost per transaction and cost per technical search. Benefit measures related to the economic feasibility of the system are also presented, including the required number of employees and the required employee skill mix.

Study on corporate social responsibility evaluation system based on stakeholder theory

NASA Astrophysics Data System (ADS)

Ma, J.; Deng, Liming

2011-10-01

The issue of Corporate Social Responsibility (CSR) has been attracting the attention from many disciplines such as economics, management, laws, sociality and philosophy since last century. The purpose of this study is to explore the impact of CSR on performance and develop a CSR evaluation system. Building on the definition of CSR and Stakeholder theory, this article built a path-relationship model of CSR and business operation performance. The paper also constructed CSR evaluation system based on KLD index, GRJ report, CSR accounting account, SA8000, ISO14000 etc. The research provides a basis for future studies about the relationship between CSR and business performance and shed some light on the evaluation of CSR practices.

The Effects of Word Processing Software on User Satisfaction: An Empirical Study of Micro, Mini, and Mainframe Computers Using an Interactive Artificial Intelligence Expert-System.

ERIC Educational Resources Information Center

Rushinek, Avi; Rushinek, Sara

1984-01-01

Describes results of a system rating study in which users responded to WPS (word processing software) questions. Study objectives were data collection and evaluation of variables; statistical quantification of WPS's contribution (along with other variables) to user satisfaction; design of an expert system to evaluate WPS; and database update and…

Evaluation of the precision agricultural landscape modeling system (PALMS) in the semiarid Texas southern high plains

USDA-ARS?s Scientific Manuscript database

Accurate models to simulate the soil water balance in semiarid cropping systems are needed to evaluate management practices for soil and water conservation in both irrigated and dryland production systems. The objective of this study was to evaluate the application of the Precision Agricultural Land...

Evaluation of the Precision Agricultural Landscape Modeling System (PALMS) in the Semiarid Texas Southern High Plains

USDA-ARS?s Scientific Manuscript database

Accurate models to simulate the soil water balance in semiarid cropping systems are needed to evaluate management practices for soil and water conservation in both irrigated and dryland production systems. The objective of this study was to evaluate the application of the Precision Agricultural Land...

Educator Evaluation: A Case Study of Massachusetts' Approach

ERIC Educational Resources Information Center

Brown, Catherine; Partelow, Lisette; Konoske-Graf, Annette

2016-01-01

There has been a sea change in teacher evaluation over the past eight years. Inspired in part by President Barack Obama's policies, schools have instituted teacher evaluation systems that include multiple measures of teacher impact. Model systems are aligned to systems of continuous improvement, helping teachers identify areas of weakness in their…

School Administrators' Perceptions of the James Stronge Teacher Evaluation System

ERIC Educational Resources Information Center

Schoenlank, Jean

2017-01-01

This qualitative study examined school administrators' perceptions of the James Stronge teacher evaluation system, one of five approved evaluation systems by the New Jersey Department of Education from the Teacher Effectiveness and Accountability for the Children of New Jersey Act (TEACHNJ) in 2012. Fourteen administrators from a suburban district…

Evaluating Combinations of Ranked Lists and Visualizations of Inter-Document Similarity.

ERIC Educational Resources Information Center

Allan, James; Leuski, Anton; Swan, Russell; Byrd, Donald

2001-01-01

Considers how ideas from document clustering can be used to improve retrieval accuracy of ranked lists in interactive systems and how to evaluate system effectiveness. Describes a TREC (Text Retrieval Conference) study that constructed and evaluated systems that present the user with ranked lists and a visualization of inter-document similarities.…

Evaluation of high temperature structural adhesives for extended service

NASA Technical Reports Server (NTRS)

Hendricks, C. L.; Hill, S. G.

1984-01-01

High temperature stable adhesive systems were evaluated for potential Supersonic Cruise Research (SCR) vehicle applications. The program was divided into two major phases: Phase I 'Adhesive Screening' evaluated eleven selected polyimide (PI) and polyphenylquinoxaline (PPQ) adhesive resins using eight different titanium (6Al-4V) adherend surface preparations; Phase II 'Adhesive Optimization and Characterization' extensively evaluated two adhesive systems, selected from Phase I studies, for chemical characterization and environmental durability. The adhesive systems which exhibited superior thermal and environmental bond properties were LARC-TPI polyimide and polyphenylquinoxaline both developed at NASA Langley. The latter adhesive system did develop bond failures at extended thermal aging due primarily to incompatibility between the surface preparation and the polymer. However, this study did demonstrate that suitable adhesive systems are available for extended supersonic cruise vehicle design applications.

Metal pipe coupling study : final report.

DOT National Transportation Integrated Search

1975-11-01

The specific aims of the study were: (1) to establish a standard design for the watertight coupling systems for the various kinds of metal culvert pipe and to evaluate the test method for determining watertight systems, (2) to evaluate seam connectio...

Electronic palliative care coordination systems: Devising and testing a methodology for evaluating documentation

PubMed Central

Allsop, Matthew J; Kite, Suzanne; McDermott, Sarah; Penn, Naomi; Millares-Martin, Pablo; Bennett, Michael I

2016-01-01

Background: The need to improve coordination of care at end of life has driven electronic palliative care coordination systems implementation across the United Kingdom and internationally. No approaches for evaluating electronic palliative care coordination systems use in practice have been developed. Aim: This study outlines and applies an evaluation framework for examining how and when electronic documentation of advance care planning is occurring in end of life care services. Design: A pragmatic, formative process evaluation approach was adopted. The evaluation drew on the Project Review and Objective Evaluation methodology to guide the evaluation framework design, focusing on clinical processes. Setting/participants: Data were extracted from electronic palliative care coordination systems for 82 of 108 general practices across a large UK city. All deaths (n = 1229) recorded on electronic palliative care coordination systems between April 2014 and March 2015 were included to determine the proportion of all deaths recorded, median number of days prior to death that key information was recorded and observations about routine data use. Results: The evaluation identified 26.8% of all deaths recorded on electronic palliative care coordination systems. The median number of days to death was calculated for initiation of an electronic palliative care coordination systems record (31 days), recording a patient’s preferred place of death (8 days) and entry of Do Not Attempt Cardiopulmonary Resuscitation decisions (34 days). Where preferred and actual place of death was documented, these were matching for 75% of patients. Anomalies were identified in coding used during data entry on electronic palliative care coordination systems. Conclusion: This study reports the first methodology for evaluating how and when electronic palliative care coordination systems documentation is occurring. It raises questions about what can be drawn from routine data collected through electronic palliative care coordination systems and outlines considerations for future evaluation. Future evaluations should consider work processes of health professionals using electronic palliative care coordination systems. PMID:27507636

Electronic palliative care coordination systems: Devising and testing a methodology for evaluating documentation.

PubMed

Allsop, Matthew J; Kite, Suzanne; McDermott, Sarah; Penn, Naomi; Millares-Martin, Pablo; Bennett, Michael I

2017-05-01

The need to improve coordination of care at end of life has driven electronic palliative care coordination systems implementation across the United Kingdom and internationally. No approaches for evaluating electronic palliative care coordination systems use in practice have been developed. This study outlines and applies an evaluation framework for examining how and when electronic documentation of advance care planning is occurring in end of life care services. A pragmatic, formative process evaluation approach was adopted. The evaluation drew on the Project Review and Objective Evaluation methodology to guide the evaluation framework design, focusing on clinical processes. Data were extracted from electronic palliative care coordination systems for 82 of 108 general practices across a large UK city. All deaths ( n = 1229) recorded on electronic palliative care coordination systems between April 2014 and March 2015 were included to determine the proportion of all deaths recorded, median number of days prior to death that key information was recorded and observations about routine data use. The evaluation identified 26.8% of all deaths recorded on electronic palliative care coordination systems. The median number of days to death was calculated for initiation of an electronic palliative care coordination systems record (31 days), recording a patient's preferred place of death (8 days) and entry of Do Not Attempt Cardiopulmonary Resuscitation decisions (34 days). Where preferred and actual place of death was documented, these were matching for 75% of patients. Anomalies were identified in coding used during data entry on electronic palliative care coordination systems. This study reports the first methodology for evaluating how and when electronic palliative care coordination systems documentation is occurring. It raises questions about what can be drawn from routine data collected through electronic palliative care coordination systems and outlines considerations for future evaluation. Future evaluations should consider work processes of health professionals using electronic palliative care coordination systems.

Challenges in evaluating clinical governance systems in iran: a qualitative study.

PubMed

Hooshmand, Elaheh; Tourani, Sogand; Ravaghi, Hamid; Ebrahimipour, Hossein

2014-04-01

In spite of the pivotal role of clinical governance in enhancing quality of services provided by hospitals across the country, a scientific framework with specific criteria for evaluating hospitals has not been developed so far. This study was conducted with the aim to identify the challenges involved in evaluating systems of clinical governance in Iran. For the purposes of this qualitative study, 15 semi-structured interviews with experts in the field were conducted in 2011 and the data were analyzed using framework analysis method. Five major challenges in evaluating clinical governance include managing human resources, improving clinical quality, managing development, organizing clinical governance, and providing patient-oriented healthcare system. Healthcare system in Iran requires a clinical governance program which has a patient-oriented approach in philosophy, operation, and effectiveness in order to meet the challenges ahead.

Health information systems evaluation frameworks: A systematic review.

PubMed

Eslami Andargoli, Amirhossein; Scheepers, Helana; Rajendran, Diana; Sohal, Amrik

2017-01-01

Evaluation of health information systems (HISs) is complicated because of the complex nature of the health care domain. Various studies have proposed different frameworks to reduce the complexity in the assessment of these systems. The aim of these frameworks is to provide a set of guidelines for the evaluation of the adequacy of health care information systems. This paper aims to analyse studies on the evaluation of HISs by applying a content, context and process (CCP) framework to address the 'who', 'what', 'how', 'when', and 'why' of the evaluation processes used. This will allow for a better understanding of the relative strengths and weaknesses of various HISs evaluation frameworks, and will pave the way for developing a more complete framework for HISs. A systematic literature review on HIS evaluation studies was undertaken to identify the currently available HIS evaluation frameworks. Five academic databases were selected to conduct this systematic literature review. Most of the studies only address some, but not all, of the five main questions, i.e. the who, what, how, when, why, and that there was a lack of consensus in the way these questions were addressed. The critical role of context was also largely neglected in these studies. Evaluation of HISs is complex. The health care domain is highly context sensitive and in order to have a complete assessment of HISs, consideration of contextual factors is necessary. Specifically, to have the right set of criteria to measure the 'what', the answer to the 'who' of the evaluation is necessary. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Evaluation of Models of the Reading Process.

ERIC Educational Resources Information Center

Balajthy, Ernest

A variety of reading process models have been proposed and evaluated in reading research. Traditional approaches to model evaluation specify the workings of a system in a simplified fashion to enable organized, systematic study of the system's components. Following are several statistical methods of model evaluation: (1) empirical research on…

Evaluating an Intelligent Tutoring System for Design Patterns: The DEPTHS Experience

ERIC Educational Resources Information Center

Jeremic, Zoran; Jovanovic, Jelena; Gasevic, Dragan

2009-01-01

The evaluation of intelligent tutoring systems (ITSs) is an important though often neglected stage of ITS development. There are many evaluation methods available but literature does not provide clear guidelines for the selection of evaluation method(s) to be used in a particular context. This paper describes the evaluation study of DEPTHS, an…

Isotope Brayton electric power system for the 500 to 2500 watt range.

NASA Technical Reports Server (NTRS)

Macosko, R. P.; Barna, G. J.; Block, H. B.; Ingle, B. D.

1972-01-01

An extensive study was conducted at the Lewis Research Center to evaluate an isotope Brayton electric power system for use in the 500 to 2500 W power range. The study emphasized overall system simplicity in order to reduce parasitic power losses and improve system reliability. The study included detailed parametric cycle analysis, conceptual component designs, and evaluation of system packaging. The study has resulted in the selection of a single-loop system (gas) with six major components including one rotating unit. Calculated net system efficiency varies from 23 to 28% over the power range. The use of the Pu-238 heat source being developed for the Multi-Hundred-Watt Radioisotope Thermoelectric Generator program was assumed.

Quality evaluation on an e-learning system in continuing professional education of nurses.

PubMed

Lin, I-Chun; Chien, Yu-Mei; Chang, I-Chiu

2006-01-01

Maintaining high quality in Web-based learning is a powerful means of increasing the overall efficiency and effectiveness of distance learning. Many studies have evaluated Web-based learning but seldom evaluate from the information systems (IS) perspective. This study applied the famous IS Success model in measuring the quality of a Web-based learning system using a Web-based questionnaire for data collection. One hundred and fifty four nurses participated in the survey. Based on confirmatory factor analysis, the variables of the research model fit for measuring the quality of a Web-based learning system. As Web-based education continues to grow worldwide, the results of this study may assist the system adopter (hospital executives), the learner (nurses), and the system designers in making reasonable and informed judgments with regard to the quality of Web-based learning system in continuing professional education.

Safety evaluation of intersection conflict warning system.

DOT National Transportation Integrated Search

2016-06-01

FHWA organized a pooled fund study of 40 States to evaluate low-cost safety strategies as part of its strategic highway safety effort. One of the strategies selected for evaluation was intersection conflict warning systems (ICWSs). This strategy is i...

Evaluating a federated medical search engine: tailoring the methodology and reporting the evaluation outcomes.

PubMed

Saparova, D; Belden, J; Williams, J; Richardson, B; Schuster, K

2014-01-01

Federated medical search engines are health information systems that provide a single access point to different types of information. Their efficiency as clinical decision support tools has been demonstrated through numerous evaluations. Despite their rigor, very few of these studies report holistic evaluations of medical search engines and even fewer base their evaluations on existing evaluation frameworks. To evaluate a federated medical search engine, MedSocket, for its potential net benefits in an established clinical setting. This study applied the Human, Organization, and Technology (HOT-fit) evaluation framework in order to evaluate MedSocket. The hierarchical structure of the HOT-factors allowed for identification of a combination of efficiency metrics. Human fit was evaluated through user satisfaction and patterns of system use; technology fit was evaluated through the measurements of time-on-task and the accuracy of the found answers; and organization fit was evaluated from the perspective of system fit to the existing organizational structure. Evaluations produced mixed results and suggested several opportunities for system improvement. On average, participants were satisfied with MedSocket searches and confident in the accuracy of retrieved answers. However, MedSocket did not meet participants' expectations in terms of download speed, access to information, and relevance of the search results. These mixed results made it necessary to conclude that in the case of MedSocket, technology fit had a significant influence on the human and organization fit. Hence, improving technological capabilities of the system is critical before its net benefits can become noticeable. The HOT-fit evaluation framework was instrumental in tailoring the methodology for conducting a comprehensive evaluation of the search engine. Such multidimensional evaluation of the search engine resulted in recommendations for system improvement.

A Management Study of the MCPS Accounting System and Certain Related Financial Services Functions. Final Report.

ERIC Educational Resources Information Center

Young (Arthur) and Co., Washington, DC.

Several years ago, Montgomery County Public Schools (MCPS) began a Management Operations Review and Evaluation (MORE) of the entire school system, excluding school-based instruction. This MORE study is an evaluation of MCPS's current accounting system and certain related financial services functions within the Department of Financial Services. In…

Proposed Framework for the Evaluation of Standalone Corpora Processing Systems: An Application to Arabic Corpora

PubMed Central

Al-Thubaity, Abdulmohsen; Alqifari, Reem

2014-01-01

Despite the accessibility of numerous online corpora, students and researchers engaged in the fields of Natural Language Processing (NLP), corpus linguistics, and language learning and teaching may encounter situations in which they need to develop their own corpora. Several commercial and free standalone corpora processing systems are available to process such corpora. In this study, we first propose a framework for the evaluation of standalone corpora processing systems and then use it to evaluate seven freely available systems. The proposed framework considers the usability, functionality, and performance of the evaluated systems while taking into consideration their suitability for Arabic corpora. While the results show that most of the evaluated systems exhibited comparable usability scores, the scores for functionality and performance were substantially different with respect to support for the Arabic language and N-grams profile generation. The results of our evaluation will help potential users of the evaluated systems to choose the system that best meets their needs. More importantly, the results will help the developers of the evaluated systems to enhance their systems and developers of new corpora processing systems by providing them with a reference framework. PMID:25610910

Proposed framework for the evaluation of standalone corpora processing systems: an application to Arabic corpora.

PubMed

Al-Thubaity, Abdulmohsen; Al-Khalifa, Hend; Alqifari, Reem; Almazrua, Manal

2014-01-01

Despite the accessibility of numerous online corpora, students and researchers engaged in the fields of Natural Language Processing (NLP), corpus linguistics, and language learning and teaching may encounter situations in which they need to develop their own corpora. Several commercial and free standalone corpora processing systems are available to process such corpora. In this study, we first propose a framework for the evaluation of standalone corpora processing systems and then use it to evaluate seven freely available systems. The proposed framework considers the usability, functionality, and performance of the evaluated systems while taking into consideration their suitability for Arabic corpora. While the results show that most of the evaluated systems exhibited comparable usability scores, the scores for functionality and performance were substantially different with respect to support for the Arabic language and N-grams profile generation. The results of our evaluation will help potential users of the evaluated systems to choose the system that best meets their needs. More importantly, the results will help the developers of the evaluated systems to enhance their systems and developers of new corpora processing systems by providing them with a reference framework.

Integrated mass transportation system study/definition/implementation program definition

NASA Technical Reports Server (NTRS)

Ransone, R. K.; Deptula, D. A.; Yorke, G. G.

1975-01-01

Specific actions needed to plan and effect transportation system improvements are identified within the constraints of limited financial, energy and land use resources, and diverse community requirements. A specific program is described which would develop the necessary generalized methodology for devising improved transportation systems and evaluate them against specific criteria for intermodal and intramodal optimization. A consistent, generalized method is provided for study and evaluation of transportation system improvements.

Some Applications of Holography to Study Strongly Correlated Systems

NASA Astrophysics Data System (ADS)

Bhatnagar, Neha

2018-04-01

In this work, we study the transport coefficients of strongly coupled condensed matter systems using gauge/gravity duality (holography). We consider examples from the real world and evaluate the conductivities from their gravity duals. Adopting the bottom-up approach of holography, we obtain the frequency response of the conductivity for (1+1)-dimensional systems. We also evaluate the DC conductivities for non-relativistic condensed matter systems with hyperscaling violating geometry.

FBI fingerprint identification automation study. AIDS 3 evaluation report. Volume 1: Compendium

NASA Technical Reports Server (NTRS)

Mulhall, B. D. L.

1980-01-01

The primary features of the overall study are encompassed and an evaluation of an automation system is presented. Objectives of the study are described, methods of evaluation are summarized and conclusions about the system's feasibility are presented. Also included is a brief history of fingerprint automation activities within the FBI, the organization of the FBI, a bibliography of documents and records, a data dictionary and a reference set of all of the transparencies presented throughout the study.

Study protocol for evaluating the implementation and effectiveness of an emergency department longitudinal patient monitoring system using a mixed-methods approach.

PubMed

Ward, Marie; McAuliffe, Eilish; Wakai, Abel; Geary, Una; Browne, John; Deasy, Conor; Schull, Michael; Boland, Fiona; McDaid, Fiona; Coughlan, Eoin; O'Sullivan, Ronan

2017-01-23

Early detection of patient deterioration is a key element of patient safety as it allows timely clinical intervention and potential rescue, thus reducing the risks of serious patient safety incidents. Longitudinal patient monitoring systems have been widely recommended for use to detect clinical deterioration. However, there is conflicting evidence on whether they improve patient outcomes. This may in part be related to variation in the rigour with which they are implemented and evaluated. This study aims to evaluate the implementation and effectiveness of a longitudinal patient monitoring system designed for adult patients in the unique environment of the Emergency Department (ED). A novel participatory action research (PAR) approach is taken where socio-technical systems (STS) theory and analysis informs the implementation through the improvement methodology of 'Plan Do Study Act' (PDSA) cycles. We hypothesise that conducting an STS analysis of the ED before beginning the PDSA cycles will provide for a much richer understanding of the current situation and possible challenges to implementing the ED-specific longitudinal patient monitoring system. This methodology will enable both a process and an outcome evaluation of implementing the ED-specific longitudinal patient monitoring system. Process evaluations can help distinguish between interventions that have inherent faults and those that are badly executed. Over 1.2 million patients attend EDs annually in Ireland; the successful implementation of an ED-specific longitudinal patient monitoring system has the potential to affect the care of a significant number of such patients. To the best of our knowledge, this is the first study combining PAR, STS and multiple PDSA cycles to evaluate the implementation of an ED-specific longitudinal patient monitoring system and to determine (through process and outcome evaluation) whether this system can significantly improve patient outcomes by early detection and appropriate intervention for patients at risk of clinical deterioration.

Expert Systems In Medical Studies - A New Twist

NASA Astrophysics Data System (ADS)

Slagle, James R.; Long, John M.; Wick, Michael R.; Matts, John P.; Leon, Arthur S.

1986-03-01

The use of experts to evaluate large amounts of trial data results in increasingly expensive and time consuming research. We are investigating the role expert systems can play in reducing the time and expense of research projects. Current methods in large clinical studies for evaluating data are often crude and superficial. We have developed, for a large clinical trial, an expert system for analysis of treadmill exercise ECG test results. In the cases we are studying, a patient is given a treadmill exercise ECG test once a year for five years. Pairs of these exercise tests are then evaluated by cardiologists to determine the condition of the patient's heart. The results of our system show great promise for the use of expert systems in reducing the time and expense of large clinical trials.

Improving Professional Development Systems: Recommendations from the Pennsylvania Adult Basic and Literacy Education Professional Development System Evaluation

ERIC Educational Resources Information Center

Belzer, Alisa

2005-01-01

The recommendations from a two-part, formative evaluation of Pennsylvania's Bureau of Adult Basic and Literacy Education professional development system are reported here. The first phase of the evaluation studied the relationships between the vision for professional development held by planners and facilitators and the ways in which participants…

Orbital Spacecraft Consumables Resupply System (OSCRS). Volume 4: Extended study results Part 1: Executive Summary

NASA Technical Reports Server (NTRS)

1987-01-01

The objectives consisted of three major tasks. The first was to establish the definition of Space Station and Orbital Maneuvering Vehicle (OMV) user requirements and interfaces and to evaluate system requirements of a water tanker to be used at the station. The second task is to conduct trade studies of system requirements, hardware/software, and operations to evaluate the effect of automatic operation at the station or remote from the station in consonance with the OMV. The last task is to evaluate automatic refueling concepts and to evaluate the impact to Orbital Spacecraft Consumable Resupply System (OSCRS) concept/design to use expendable launch vehicles (ELV) to place the tank into orbit. Progress in each area is discussed.

Evaluating a Federated Medical Search Engine

PubMed Central

Belden, J.; Williams, J.; Richardson, B.; Schuster, K.

2014-01-01

Summary Background Federated medical search engines are health information systems that provide a single access point to different types of information. Their efficiency as clinical decision support tools has been demonstrated through numerous evaluations. Despite their rigor, very few of these studies report holistic evaluations of medical search engines and even fewer base their evaluations on existing evaluation frameworks. Objectives To evaluate a federated medical search engine, MedSocket, for its potential net benefits in an established clinical setting. Methods This study applied the Human, Organization, and Technology (HOT-fit) evaluation framework in order to evaluate MedSocket. The hierarchical structure of the HOT-factors allowed for identification of a combination of efficiency metrics. Human fit was evaluated through user satisfaction and patterns of system use; technology fit was evaluated through the measurements of time-on-task and the accuracy of the found answers; and organization fit was evaluated from the perspective of system fit to the existing organizational structure. Results Evaluations produced mixed results and suggested several opportunities for system improvement. On average, participants were satisfied with MedSocket searches and confident in the accuracy of retrieved answers. However, MedSocket did not meet participants’ expectations in terms of download speed, access to information, and relevance of the search results. These mixed results made it necessary to conclude that in the case of MedSocket, technology fit had a significant influence on the human and organization fit. Hence, improving technological capabilities of the system is critical before its net benefits can become noticeable. Conclusions The HOT-fit evaluation framework was instrumental in tailoring the methodology for conducting a comprehensive evaluation of the search engine. Such multidimensional evaluation of the search engine resulted in recommendations for system improvement. PMID:25298813

SENTRE and TREND attenuating systems

DOT National Transportation Integrated Search

1991-07-01

The objective of this study was to construct SENTRE and TREND attenuator systems and evaluate their in-service performance as set forth in NCHRP-230 for a period of two years. The evaluation was conducted as part of ADOTs New Product Evaluation Progr...

Evaluation of expert systems - An approach and case study. [of determining software functional requirements for command management of satellites

NASA Technical Reports Server (NTRS)

Liebowitz, J.

1985-01-01

Techniques that were applied in defining an expert system prototype for first-cut evaluations of the software functional requirements of NASA satellite command management activities are described. The prototype was developed using the Knowledge Engineering System. Criteria were selected for evaluating the satellite software before defining the expert system prototype. Application of the prototype system is illustrated in terms of the evaluation procedures used with the COBE satellite to be launched in 1988. The limited number of options which can be considered by the program mandates that biases in the system output must be well understood by the users.

Web-Based Evaluation System for Learning Management Systems

ERIC Educational Resources Information Center

Momani, Alaa

2010-01-01

E-learning systems have become an issue in recent years. A learning management system (LMS) is an electronic environment helps the educational society to communicate, exchange information, manage, and schedule the learning process. This study has provided a web-based evaluation system that may help the users to choose the convenient system…

Chemical systems for improved oil recovery: Phase behavior, oil recovery, and mobility control studies

DOE Office of Scientific and Technical Information (OSTI.GOV)

Llave, F.; Gall, B.; Gao, H., Scott, L., Cook, I.

Selected surfactant systems containing a series of ethoxylated nonionic surfactants in combination with an anionic surfactant system have been studied to evaluate phase behavior as well as oil recovery potential. These experiments were conducted to evaluate possible improved phase behavior and overall oil recovery potential of mixed surfactant systems over a broad range of conditions. Both polyacrylamide polymers and Xanthan biopolymers were evaluated. Studies were initiated to use a chemical flooding simulation program, UTCHEM, to simulate oil recovery for laboratory and field applications and evaluate its use to simulate oil saturation distributions obtained in CT-monitoring of oil recovery experiments. Themore » phase behavior studies focused on evaluating the effect of anionic-nonionic surfactant proportion on overall phase behavior. Two distinct transition behaviors were observed, depending on the dominant surfactant in the overall system. The first type of transition corresponded to more conventional behavior attributed to nonionic-dominant surfactant systems. This behavior is manifested by an oil-water-surfactant system that inverts from a water-external (highly conducting) microemulsion to an oil-external (nonconducting) one, as a function of temperature. The latter type which inverts in an opposite manner can be attributed to the separation of the anionic-nonionic mixtures into water- and oil-soluble surfactants. Both types of transition behavior can still be used to identify relative proximity to optimal areas. Determining these transition ranges provided more insight on how the behavior of these surfactant mixtures was affected by altering component proportions. Efforts to optimize the chemical system for oil displacement experiments were also undertaken. Phase behavior studies with systems formulated with biopolymer in solution were conducted.« less

Evolution and Evaluation of ECG Interpretation Systems-An Illustration of the Validation of Decision Support Systems

PubMed Central

van Bemmel, Jan H.; Kors, Jan A.; Willems, Jos L.; van Herpen, Gerard

1990-01-01

The last decade has shown a growing interest in medical decision making, strongly stimulated by the advent of artificial intelligence. This wave of interest is not the first one; it was preceded by other models and approaches to medical decision support. However, not all developments have resulted in equally successful decision support systems. Positive exceptions are the interpretation systems for ECGs that evolved all the way from very primitive attempts to well-accepted and highly-computerized clinical systems for which a major evaluation study (CSE, Common Standards for Quantitative Electrocardiography) is finalized in 1990. The evolution and the evaluation of the systems that took part in this study, is the subject of this paper.

Review of existing experimental approaches for the clinical evaluation of the benefits of plant food supplements on cardiovascular function.

PubMed

Meoni, Paolo; Restani, Patrizia; Mancama, Dalu T

2013-06-01

We conducted a survey of the National Centre for Biotechnology Information (NCBI) PubMed database to identify methods most commonly used for the evaluation of the effect of plant food supplements on the cardiovascular system and their relevance to the regulatory status of these products. Particularly, our search strategy was aimed at the selection of studies concerning the clinical evaluation of the beneficial effects of the most commonly studied plant food supplements acting on the cardiovascular system. Following the screening of 3839 papers for inclusion criteria, 48 published reports were retained for this review. Most studies included in this review used a double blind controlled design, and evaluated the effect of plant food supplements on individuals affected by a disease of the cardiovascular system. The majority of the studies were found to be of low methodological quality on the Jadad scale, mainly because of inadequate reporting of adverse events and of patient withdrawals. In comparison, measures used for the evaluation of benefits included mostly cardiovascular risk factors as recommended in international guidelines and in accordance with principles laid down for the evaluation of health claims in food. The risk factors most frequently evaluated belonged to the category of "lipid function and levels", "heart function" and "blood pressure". For the absolute majority of the studies, the study period did not exceed one month. This review highlights critical factors to be considered in the design of studies evaluating the health effects of plant food supplements on the cardiovascular system. Between others, the inclusion of healthy individuals, better reporting and description of the characteristics of the product used could improve the quality and relevance of these studies.

Review: evaluating information systems in nursing.

PubMed

Oroviogoicoechea, Cristina; Elliott, Barbara; Watson, Roger

2008-03-01

To review existing nursing research on inpatient hospitals' information technology (IT) systems in order to explore new approaches for evaluation research on nursing informatics to guide further design and implementation of effective IT systems. There has been an increase in the use of IT and information systems in nursing in recent years. However, there has been little evaluation of these systems and little guidance on how they might be evaluated. A literature review was conducted between 1995 and 2005 inclusive using CINAHL and Medline and the search terms 'nursing information systems', 'clinical information systems', 'hospital information systems', 'documentation', 'nursing records', 'charting'. Research in nursing information systems was analysed and some deficiencies and contradictory results were identified which impede a comprehensive understanding of effective implementation. There is a need for IT systems to be understood from a wider perspective that includes aspects related to the context where they are implemented. Social and organizational aspects need to be considered in evaluation studies and realistic evaluation can provide a framework for the evaluation of information systems in nursing. The rapid introduction of IT systems for clinical practice urges evaluation of already implemented systems examining how and in what circumstances they work to guide effective further development and implementation of IT systems to enhance clinical practice. Evaluation involves more factors than just involving technologies such as changing attitudes, cultures and healthcare practices. Realistic evaluation could provide configurations of context-mechanism-outcomes that explain the underlying relationships to understand why and how a programme or intervention works.

What Do We Know About Teaching and Learning in Urban Schools? Volume 9: New Perspectives on School District Research and Evaluation.

ERIC Educational Resources Information Center

Lyon, Catherine

The Center for the Study of Evaluation's project, Evaluation and School Districts, used questionnaires to survey the heads of evaluation offices in metropolitan public school systems. This paper presents the preliminary findings of the survey. Most school systems have established a centralized program evaluation unit organized around three…

Long life reliability thermal control systems study

NASA Technical Reports Server (NTRS)

Scollon, T. R., Jr.; Killen, R. E.

1972-01-01

The results of a program undertaken to conceptually design and evaluate a passive, high reliability, long life thermal control system for space station application are presented. The program consisted of four steps: (1) investigate and select potential thermal system elements; (2) conceive, evaluate and select a thermal control system using these elements; (3) conduct a verification test of a prototype segment of the selected system; and (4) evaluate the utilization of waste heat from the power supply. The result of this project is a conceptual thermal control system design which employs heat pipes as primary components, both for heat transport and temperature control. The system, its evaluation, and the test results are described.

Peer Evaluation: A Case Study.

ERIC Educational Resources Information Center

Weaver, Richard L., II

Acknowledging the value of peer evaluation in the classroom, this paper describes the peer evaluation system used in a basic speech communication course at an Ohio university. The first section of the paper defines peer evaluation and describes the situation at the university to provide some understanding of the context in which the system was…

An Evaluation Framework and Instrument for Evaluating e-Assessment Tools

ERIC Educational Resources Information Center

Singh, Upasana Gitanjali; de Villiers, Mary Ruth

2017-01-01

e-Assessment, in the form of tools and systems that deliver and administer multiple choice questions (MCQs), is used increasingly, raising the need for evaluation and validation of such systems. This research uses literature and a series of six empirical action research studies to develop an evaluation framework of categories and criteria called…

Feasibility Assessment of ITS Deployment Analysis System (IDAS) for ITS Evaluation

DOT National Transportation Integrated Search

2003-12-01

This study investigated the feasibility of utilizing the ITS Deployment Analysis System (IDAS) program version 2.2 as a tool for evaluating Intelligent Transportation Systems (ITS) deployment plans. Firstly, an online survey was conducted among metro...

Field evaluations of waterproof membrane systems for bridge decks, 1972-1974.

DOT National Transportation Integrated Search

1975-01-01

Waterproof membrane systems are being studied by many agencies from the standpoint of their effectiveness in protecting the reinforcing steel in concrete bridge decks against corrosion. Trial applications and evaluations of six such systems, includin...

Field Artillery Ammunition Processing System (FAAPS) concept evaluation study

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kring, C.T.; Babcock, S.M.; Watkin, D.C.

1992-06-01

The Field Artillery Ammunition Processing System (FAAPS) is an initiative to introduce a palletized load system (PLS) that is transportable with an automated ammunition processing and storage system for use on the battlefield. System proponents have targeted a 20% increase in the ammunition processing rate over the current operation while simultaneously reducing the total number of assigned field artillery battalion personnel by 30. The overall objective of the FAAPS Project is the development and demonstration of an improved process to accomplish these goals. The initial phase of the FAAPS Project and the subject of this study is the FAAPS conceptmore » evaluation. The concept evaluation consists of (1) identifying assumptions and requirements, (2) documenting the process flow, (3) identifying and evaluating technologies available to accomplish the necessary ammunition processing and storage operations, and (4) presenting alternative concepts with associated costs, processing rates, and manpower requirements for accomplishing the operation. This study provides insight into the achievability of the desired objectives.« less

Field Artillery Ammunition Processing System (FAAPS) concept evaluation study. Ammunition Logistics Program

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kring, C.T.; Babcock, S.M.; Watkin, D.C.

1992-06-01

The Field Artillery Ammunition Processing System (FAAPS) is an initiative to introduce a palletized load system (PLS) that is transportable with an automated ammunition processing and storage system for use on the battlefield. System proponents have targeted a 20% increase in the ammunition processing rate over the current operation while simultaneously reducing the total number of assigned field artillery battalion personnel by 30. The overall objective of the FAAPS Project is the development and demonstration of an improved process to accomplish these goals. The initial phase of the FAAPS Project and the subject of this study is the FAAPS conceptmore » evaluation. The concept evaluation consists of (1) identifying assumptions and requirements, (2) documenting the process flow, (3) identifying and evaluating technologies available to accomplish the necessary ammunition processing and storage operations, and (4) presenting alternative concepts with associated costs, processing rates, and manpower requirements for accomplishing the operation. This study provides insight into the achievability of the desired objectives.« less

How healthcare systems evaluate their advance care planning initiatives: Results from a systematic review.

PubMed

Biondo, Patricia D; Lee, Lydia D; Davison, Sara N; Simon, Jessica E

2016-09-01

Advance care planning initiatives are being implemented across healthcare systems around the world, but how best to evaluate their implementation is unknown. To identify gaps and/or redundancies in current evaluative strategies to help healthcare systems develop future evaluative frameworks for ACP. Systematic review. Peer-reviewed and gray literature searches were conducted till February 2015 to answer: "What methods have healthcare systems used to evaluate implementation of advance care planning initiatives?" A PICOS framework was developed to identify articles describing the implementation and evaluation of a health system-level advance care planning initiative. Outcome measures were mapped onto a conceptual quality indicator framework based on the Institute of Medicine and Donabedian models of healthcare quality. A total of 46 studies met inclusion criteria for analysis. Most articles reported on single parts of a healthcare system (e.g. continuing care). The most common outcome measures pertained to document completion, followed by healthcare resource use. Patient-, family-, or healthcare provider-reported outcomes were less commonly measured. Concordance measures (e.g. dying in place of choice) were reported by only 26% of studies. The conceptual quality indicator framework identified gaps and redundancies in measurement and is presented as a potential foundation from which to develop a comprehensive advance care planning evaluation framework. Document completion is frequently used to evaluate advance care planning program implementation; capturing the quality of care appears to be more difficult. This systematic review provides health system administrators with a comprehensive summary of measures used to evaluate advance care planning and may identify gaps in evaluation within their local context. © The Author(s) 2016.

Challenges in Evaluating Clinical Governance Systems in Iran: A Qualitative Study

PubMed Central

Hooshmand, Elaheh; Tourani, Sogand; Ravaghi, Hamid; Ebrahimipour, Hossein

2014-01-01

Background: In spite of the pivotal role of clinical governance in enhancing quality of services provided by hospitals across the country, a scientific framework with specific criteria for evaluating hospitals has not been developed so far. Objectives: This study was conducted with the aim to identify the challenges involved in evaluating systems of clinical governance in Iran. Materials and Methods: For the purposes of this qualitative study, 15 semi-structured interviews with experts in the field were conducted in 2011 and the data were analyzed using framework analysis method. Results: Five major challenges in evaluating clinical governance include managing human resources, improving clinical quality, managing development, organizing clinical governance, and providing patient-oriented healthcare system. Conclusions: Healthcare system in Iran requires a clinical governance program which has a patient-oriented approach in philosophy, operation, and effectiveness in order to meet the challenges ahead. PMID:24910799

User Experience Evaluations in Rehabilitation Video Games for Children: A Systematic Mapping of the Literature.

PubMed

Rico-Olarte, Carolina; López, Diego M; Blobel, Bernd; Kepplinger, Sara

2017-01-01

In recent years, the interest in user experience (UX) evaluation methods for assessing technology solutions, especially in health systems for children with special needs like cognitive disabilities, has increased. Conduct a systematic mapping study to provide an overview in the field of UX evaluations in rehabilitation video games for children. The definition of research questions, the search for primary studies and the extraction of those studies by inclusion and exclusion criteria lead to the mapping of primary papers according to a classification scheme. Main findings from this study include the detection of the target population of the selected studies, the recognition of two different ways of evaluating UX: (i) user evaluation and (ii) system evaluation, and UX measurements and devices used. This systematic mapping specifies the research gaps identified for future research works in the area.

Evaluating a Bilingual Text-Mining System with a Taxonomy of Key Words and Hierarchical Visualization for Understanding Learner-Generated Text

ERIC Educational Resources Information Center

Kong, Siu Cheung; Li, Ping; Song, Yanjie

2018-01-01

This study evaluated a bilingual text-mining system, which incorporated a bilingual taxonomy of key words and provided hierarchical visualization, for understanding learner-generated text in the learning management systems through automatic identification and counting of matching key words. A class of 27 in-service teachers studied a course…

Self-Evaluated Effects of Web-Based Portfolio Assessment System for Various Student Motivation Levels

ERIC Educational Resources Information Center

Chang, Chi-Cheng

2009-01-01

The purpose of this study was to explore the self-evaluated effects of a web-based portfolio assessment system on various categories of students of motivation. The subjects for this study were the students of two computer classes in a Junior High School. The experimental group used the web-based portfolio assessment system whereas the control…

Development and Evaluation of an Interactive WebQuest Environment: "Web Macerasi"

ERIC Educational Resources Information Center

Gulbahar, Yasemin; Madran, R. Orcun; Kalelioglu, Filiz

2010-01-01

This study was conducted to develop a web-based interactive system, Web Macerasi, for teaching-learning and evaluation purposes, and to find out the possible effects of this system. The study has two stages. In the first stage, a WebQuest site was designed as an interactive system in which various Internet and web technologies were used for…

RESULTS OF A PILOT FIELD STUDY TO EVALUATE THE EFFECTIVENESS OF CLEANING RESIDENTIAL HEATING AND AIR-CONDITIONING SYSTEMS AND THE IMPACT ON INDOOR AIR QUALITY AND SYSTEM PERFORMANCE

EPA Science Inventory

The report discusses and gives results of a pilot field study to evaluate the effectiveness of air duct cleaning (ADC) as a source removal technique in residential heating and air-conditioning (HAC) systems and its impact on airborne particle, fiber, and bioaerosol concentrations...

Shuttle cryogenic supply system optimization study. Volume 1: Management supply, sections 1 - 3

NASA Technical Reports Server (NTRS)

1973-01-01

An analysis of the cryogenic supply system for use on space shuttle vehicles was conducted. The major outputs of the analysis are: (1) evaluations of subsystem and integrated system concepts, (2) selection of representative designs, (3) parametric data and sensitivity studies, (4) evaluation of cryogenic cooling in environmental control subsystems, and (5) development of mathematical model.

Evaluating true BCI communication rate through mutual information and language models.

PubMed

Speier, William; Arnold, Corey; Pouratian, Nader

2013-01-01

Brain-computer interface (BCI) systems are a promising means for restoring communication to patients suffering from "locked-in" syndrome. Research to improve system performance primarily focuses on means to overcome the low signal to noise ratio of electroencephalogric (EEG) recordings. However, the literature and methods are difficult to compare due to the array of evaluation metrics and assumptions underlying them, including that: 1) all characters are equally probable, 2) character selection is memoryless, and 3) errors occur completely at random. The standardization of evaluation metrics that more accurately reflect the amount of information contained in BCI language output is critical to make progress. We present a mutual information-based metric that incorporates prior information and a model of systematic errors. The parameters of a system used in one study were re-optimized, showing that the metric used in optimization significantly affects the parameter values chosen and the resulting system performance. The results of 11 BCI communication studies were then evaluated using different metrics, including those previously used in BCI literature and the newly advocated metric. Six studies' results varied based on the metric used for evaluation and the proposed metric produced results that differed from those originally published in two of the studies. Standardizing metrics to accurately reflect the rate of information transmission is critical to properly evaluate and compare BCI communication systems and advance the field in an unbiased manner.

Task-oriented evaluation of electronic medical records systems: development and validation of a questionnaire for physicians

PubMed Central

2004-01-01

Background Evaluation is a challenging but necessary part of the development cycle of clinical information systems like the electronic medical records (EMR) system. It is believed that such evaluations should include multiple perspectives, be comparative and employ both qualitative and quantitative methods. Self-administered questionnaires are frequently used as a quantitative evaluation method in medical informatics, but very few validated questionnaires address clinical use of EMR systems. Methods We have developed a task-oriented questionnaire for evaluating EMR systems from the clinician's perspective. The key feature of the questionnaire is a list of 24 general clinical tasks. It is applicable to physicians of most specialties and covers essential parts of their information-oriented work. The task list appears in two separate sections, about EMR use and task performance using the EMR, respectively. By combining these sections, the evaluator may estimate the potential impact of the EMR system on health care delivery. The results may also be compared across time, site or vendor. This paper describes the development, performance and validation of the questionnaire. Its performance is shown in two demonstration studies (n = 219 and 80). Its content is validated in an interview study (n = 10), and its reliability is investigated in a test-retest study (n = 37) and a scaling study (n = 31). Results In the interviews, the physicians found the general clinical tasks in the questionnaire relevant and comprehensible. The tasks were interpreted concordant to their definitions. However, the physicians found questions about tasks not explicitly or only partially supported by the EMR systems difficult to answer. The two demonstration studies provided unambiguous results and low percentages of missing responses. In addition, criterion validity was demonstrated for a majority of task-oriented questions. Their test-retest reliability was generally high, and the non-standard scale was found symmetric and ordinal. Conclusion This questionnaire is relevant for clinical work and EMR systems, provides reliable and interpretable results, and may be used as part of any evaluation effort involving the clinician's perspective of an EMR system. PMID:15018620

Task-oriented evaluation of electronic medical records systems: development and validation of a questionnaire for physicians.

PubMed

Laerum, Hallvard; Faxvaag, Arild

2004-02-09

Evaluation is a challenging but necessary part of the development cycle of clinical information systems like the electronic medical records (EMR) system. It is believed that such evaluations should include multiple perspectives, be comparative and employ both qualitative and quantitative methods. Self-administered questionnaires are frequently used as a quantitative evaluation method in medical informatics, but very few validated questionnaires address clinical use of EMR systems. We have developed a task-oriented questionnaire for evaluating EMR systems from the clinician's perspective. The key feature of the questionnaire is a list of 24 general clinical tasks. It is applicable to physicians of most specialties and covers essential parts of their information-oriented work. The task list appears in two separate sections, about EMR use and task performance using the EMR, respectively. By combining these sections, the evaluator may estimate the potential impact of the EMR system on health care delivery. The results may also be compared across time, site or vendor. This paper describes the development, performance and validation of the questionnaire. Its performance is shown in two demonstration studies (n = 219 and 80). Its content is validated in an interview study (n = 10), and its reliability is investigated in a test-retest study (n = 37) and a scaling study (n = 31). In the interviews, the physicians found the general clinical tasks in the questionnaire relevant and comprehensible. The tasks were interpreted concordant to their definitions. However, the physicians found questions about tasks not explicitly or only partially supported by the EMR systems difficult to answer. The two demonstration studies provided unambiguous results and low percentages of missing responses. In addition, criterion validity was demonstrated for a majority of task-oriented questions. Their test-retest reliability was generally high, and the non-standard scale was found symmetric and ordinal. This questionnaire is relevant for clinical work and EMR systems, provides reliable and interpretable results, and may be used as part of any evaluation effort involving the clinician's perspective of an EMR system.

Final Report on the Study of the Impact of the Statewide Systemic Initiatives. Lessons Learned about Designing, Implementing, and Evaluating Statewide Systemic Reform. WCER Working Paper No. 2003-12

ERIC Educational Resources Information Center

Heck, Daniel J.; Weiss, Iris R.; Boyd, Sally E.; Howard, Michael N.; Supovitz, Jonathan A.

2003-01-01

This document represents the first of two volumes presented in "Study of the Impact of the Statewide Systemic Initiatives Program" (Norman L. Webb and Iris R. Weiss). In an effort to evaluate the impact of the Statewide Systemic Initiatives (SSIs) on student achievement and the lessons that could be learned from the National Science…

An Evaluation of Online Help for the NOTIS OPAC.

ERIC Educational Resources Information Center

White, Frank

1994-01-01

Discussion of online help systems in online public access catalogs (OPACs) focuses on a study that evaluated the online help system for the NOTIS (Northwestern Online Total Integrated System) OPAC. Features of the system reviewed include online functions; training features; general interface features; access points; and message content and display…

Evaluation of installed solar systems at Navy, Army, and Air Force Bases. Final report, October 1984-September 1985

DOE Office of Scientific and Technical Information (OSTI.GOV)

Durlak, E.R.

1986-05-01

This report presents a summary of the results of site-evaluation inspection conducted at Navy, Army, and Air Force base. The solar systems evaluated included space heating, space cooling, and domestic hot water system. The systems range in size from small two-collector systems to large arrays installed on barracks, mess halls, office buildings, etc. These operational results are presented so that future designs will benefit from the lesson learned in this study.

Design of a Competency Evaluation Model for Clinical Nursing Practicum, Based on Standardized Language Systems: Psychometric Validation Study.

PubMed

Iglesias-Parra, Maria Rosa; García-Guerrero, Alfonso; García-Mayor, Silvia; Kaknani-Uttumchandani, Shakira; León-Campos, Álvaro; Morales-Asencio, José Miguel

2015-07-01

To develop an evaluation system of clinical competencies for the practicum of nursing students based on the Nursing Interventions Classification (NIC). Psychometric validation study: the first two phases addressed definition and content validation, and the third phase consisted of a cross-sectional study for analyzing reliability. The study population was undergraduate nursing students and clinical tutors. Through the Delphi technique, 26 competencies and 91 interventions were isolated. Cronbach's α was 0.96. Factor analysis yielded 18 factors that explained 68.82% of the variance. Overall inter-item correlation was 0.26, and total-item correlation ranged between 0.66 and 0.19. A competency system for the nursing practicum, structured on the NIC, is a reliable method for assessing and evaluating clinical competencies. Further evaluations in other contexts are needed. The availability of standardized language systems in the nursing discipline supposes an ideal framework to develop the nursing curricula. © 2015 Sigma Theta Tau International.

Balanced scorecard-based performance evaluation of Chinese county hospitals in underdeveloped areas.

PubMed

Gao, Hongda; Chen, He; Feng, Jun; Qin, Xianjing; Wang, Xuan; Liang, Shenglin; Zhao, Jinmin; Feng, Qiming

2018-05-01

Objective Since the Guangxi government implemented public county hospital reform in 2009, there have been no studies of county hospitals in this underdeveloped area of China. This study aimed to establish an evaluation indicator system for Guangxi county hospitals and to generate recommendations for hospital development and policymaking. Methods A performance evaluation indicator system was developed based on balanced scorecard theory. Opinions were elicited from 25 experts from administrative units, universities and hospitals and the Delphi method was used to modify the performance indicators. The indicator system and the Topsis method were used to evaluate the performance of five county hospitals randomly selected from the same batch of 2015 Guangxi reform pilots. Results There were 4 first-level indicators, 9 second-level indicators and 36 third-level indicators in the final performance evaluation indicator system that showed good consistency, validity and reliability. The performance rank of the hospitals was B > E > A > C > D. Conclusions The performance evaluation indicator system established using the balanced scorecard is practical and scientific. Analysis of the results based on this indicator system identified several factors affecting hospital performance, such as resource utilisation efficiency, medical service price, personnel structure and doctor-patient relationships.

Combining usability evaluations to highlight the chain that leads from usability flaws to usage problems and then negative outcomes.

PubMed

Watbled, Ludivine; Marcilly, Romaric; Guerlinger, Sandra; Bastien, J-M Christian; Beuscart-Zéphir, Marie-Catherine; Beuscart, Régis

2018-02-01

Poor usability of health technology is thought to diminish work system performance, increase error rates and, potentially, harm patients. The present study (i) used a combination of usability evaluation methods to highlight the chain that leads from usability flaws to usage problems experienced by users and, ultimately, to negative patient outcomes, and (ii) validated this approach by studying two different discharge summary production systems. To comply with quality guidelines, the process of drafting and sending discharge summaries is increasingly being automated. However, the usability of these systems may modify their impact (or the absence thereof) in terms of production times and quality, and must therefore be evaluated. Here, we applied three successive techniques for usability evaluation (heuristic evaluation, user testing and field observation) to two discharge summary production systems (underpinned by different technologies). The systems' main usability flaws led respectively to an increase in the time need to produce a discharge summary and the risk of patient misidentification. Our results are discussed with regard to the possibility of linking the usability flaws, usage problems and the negative outcomes by successively applying three methods for evaluating usability (heuristic evaluation, user testing and in situ observations) throughout the system development life cycle. Copyright © 2018 Elsevier Inc. All rights reserved.

Implementing disability evaluation and welfare services based on the framework of the international classification of functioning, disability and health: experiences in Taiwan

PubMed Central

2013-01-01

Background Before 2007, the disability evaluation was based on the medical model in Taiwan. According to the People with Disabilities Rights Protection Act, from 2012 the assessment of a person’s eligibility for disability benefits has to be determined based on the International Classification of Functioning, Disability, and Health (ICF) framework nationwide. The purposes of this study were to: 1) design the evaluation tools for disability eligibility system based on the ICF/ICF-Children and Youth; 2) compare the differences of grades of disability between the old and new evaluation systems; 3) analyse the outcome of the new disability evaluation system. Methods To develop evaluation tools and procedure for disability determination, we formed an implementation taskforce, including 199 professional experts, and conducted a small-scale field trial to examine the feasibility of evaluation tools in Phase I. To refine the evaluation tools and process and to compare the difference of the grades of disability between new and old systems, 7,329 persons with disabilities were randomly recruited in a national population-based study in Phase II. To implement the new system smoothly and understand the impact of the new system, the collaboration mechanism was established and data of 168,052 persons who applied for the disability benefits was extracted from the information system and analysed in Phase III. Results The measures of the 43 categories for body function/structure components, the Functioning Scale of Disability Evaluation System for activities/participation components, and the needs assessment have been developed and used in the field after several revisions. In Phase II, there was 49.7% agreement of disability grades between the old and new systems. In Phase III, 110,667 persons with a disability received their welfare services through the new system. Among them, 77% received basic social welfare support, 89% financial support, 24% allowance for assistive technology, 7% caregiver support, 8% nursing care and rehabilitation services at home, and 47% were issued parking permits for persons with disability. Conclusion This study demonstrated that disability evaluation system based on the ICF could provide a common language between disability assessment, needs assessment and welfare services. However, the proposed assessment protocol and tools require additional testing and validation. PMID:24125482

Learning from Action Evaluation of the Use of Multimedia Case Studies in Management Information Systems Courses

ERIC Educational Resources Information Center

Kawulich, Barbara B.

2011-01-01

This manuscript shares lessons learned from conducting an action evaluation of the use of multimedia case studies in Management Information Systems (MIS) courses. Three undergraduate MIS classes took part in the study. The purpose for using case studies in these classes was to teach students about the role of MIS in business. An action evaluation…

An Evaluation of Geographic Information Systems in Social Studies Lessons: Teachers' Views

ERIC Educational Resources Information Center

Aladag, Elif

2014-01-01

The aim of this study is to evaluate the applicability of Geographic Information Systems (GIS), used increasingly in primary and secondary education across the world, in social studies lessons in Turkey. In line with this aim, 14 social studies teachers working in the province of Aydin, Turkey received a 6-hour training course about GIS during the…

Food System Trade Study for a Near-Term Mars Mission

NASA Technical Reports Server (NTRS)

Levri, Julie; Luna, Bernadette (Technical Monitor)

2000-01-01

This paper evaluates several food system options for a near-term Mars mission, based on plans for the 120-day BIO-Plex test. Food systems considered in the study are based on the International Space Station (ISS) Assembly Phase and Assembly Complete food systems. The four systems considered are: 1) ISS assembly phase food system (US portion) with individual packaging without salad production; 2) ISS assembly phase food system (US portion) with individual packaging, with salad production; 3) ISS assembly phase food system (US portion) with bulk packaging, with salad production; 4) ISS assembly complete food system (US portion) with bulk packaging with salad and refrigeration/freezing. The food system options are assessed using equivalent system mass (ESM), which evaluates each option based upon the mass, volume, power, cooling and crewtime requirements that are associated with each food system option. However, since ESM is unable to elucidate the differences in psychological benefits between the food systems, a qualitative evaluation of each option is also presented.

Fish biodiversity sampling in stream ecosystems: a process for evaluating the appropriate types and amount of gear

USGS Publications Warehouse

Smith, Joseph M.; Wells, Sarah P.; Mather, Martha E.; Muth, Robert M.

2014-01-01

When researchers and managers initiate sampling on a new stream or river system, they do not know how effective each gear type is and whether their sampling effort is adequate. Although the types and amount of gear may be different for other studies, systems, and research questions, the five-step process described here for making sampling decisions and evaluating sampling efficiency can be applied widely to any system to restore, manage, and conserve aquatic ecosystems. It is believed that incorporating this gear-evaluation process into a wide variety of studies and ecosystems will increase rigour within and across aquatic biodiversity studies.

Ultrasonic frequency selection for aqueous fine cleaning

NASA Technical Reports Server (NTRS)

Becker, Joann F.

1995-01-01

A study was conducted to evaluate ultrasonic cleaning systems for precision cleaning effectiveness for oxygen service hardware. This evaluation was specific for Rocketdyne Division of Rockwell Aerospace alloys and machining soils. Machining lubricants and hydraulic fluid were applied as soils to standardized complex test specimens designed to simulate typical hardware. The study consisted of tests which included 20, 25, 30, 40, 50, and 65 kHz ultrasonic cleaning systems. Two size categories of cleaning systems were evaluated, 3- to 10-gal laboratory size tanks and 35- to 320-gal industrial size tanks. The system properties of cavitation, frequency vs. cleaning effectiveness, the two types of transducers, and the power level of the system vs. size of the cleaning tank were investigated. The data obtained from this study was used to select the ultrasonic tanks for the aqueous fine clean facility installed at Rocketdyne.

Ultrasonic frequency selection for aqueous fine cleaning

NASA Technical Reports Server (NTRS)

Becker, Joann F.

1994-01-01

A study was conducted to evaluate ultrasonic cleaning systems for precision cleaning effectiveness for oxygen service hardware. This evaluation was specific for Rocketdyne Div. of Rockwell Aerospace alloys and machining soils. Machining lubricants and hydraulic fluid were applied as soils to standardized complex test specimens designed to simulate typical hardware. The study consisted of tests which included 20, 25, 30, 40, 50, and 65 kHz ultrasonic cleaning systems. Two size categories of cleaning systems were evaluated, 3- to 10-gal laboratory size tanks and 35- to 320-gal industrial size tanks. The system properties of cavitation; frequency vs. cleaning effectiveness; the two types of transducers; and the power level of the system vs. size of the cleaning tank were investigated. The data obtained from this study was used to select the ultrasonic tanks for the aqueous fine clean facility installed at Rocketdyne.

Multispectral scanner data applications evaluation. Volume 1: User applications study

NASA Technical Reports Server (NTRS)

Thomson, F. J.; Erickson, J. D.; Nalepka, R. F.; Weber, J. D.

1974-01-01

A six-month systems study of earth resource surveys from satellites was conducted and is reported. SKYLAB S-192 multispectral scanner (MSS) data were used as a baseline to aid in evaluating the characteristics of future systems using satellite MSS sensors. The study took the viewpoint that overall system (sensor and processing) characteristics and parameter values should be determined largely by user requirements for automatic information extraction performance in quasi-operational earth resources surveys, the other major factor being hardware limitations imposed by state-of-the-art technology and cost. The objective was to use actual aircraft and spacecraft MSS data to outline parametrically the trade-offs between user performance requirements and hardware performance and limitations so as to allow subsequent evaluation of compromises which must be made in deciding what system(s) to build.

Expert system verification and validation study. Delivery 1: Survey and interview questions

NASA Technical Reports Server (NTRS)

1990-01-01

The NASA funded questionnaire is presented to help define the state-of-the-practice in the formal evaluation of Expert Systems on current NASA and industry applications. The answers to this questionnaire, together with follow-up interviews, will provide realistic answers to the following questions: (1) How much evaluation is being performed; (2) What evaluation techniques are in use; and (3) What, if any, are the unique issues in evaluating Expert Systems.

[Valences of self-evaluation and approach-avoidance tendencies: research based on regulatory focus theory].

PubMed

Ozaki, Yuka; Karasawa, Kaori

2011-12-01

Four studies were conducted to investigate the relationship between valences of self-evaluation and approach-avoidance tendencies. Based on regulatory focus theory (Higgins, 1997, 1998), we predicted that positivity of self-evaluation is related to the tendency to approach gains, while negativity of self-evaluation is related to the tendency to avoid losses. In Study 1, a self-report measure of behavioral tendencies for approaching gains and avoiding losses was developed. In Studies 2 to 4, correlations between these approach/avoidance tendencies and various kinds of self-evaluations were examined. Overall, the authors' predictions were supported. The results suggest that the self-evaluation system and the self-regulation system work in close cooperation with each other in controlling human behavior.

Evaluation of EIT system performance.

PubMed

Yasin, Mamatjan; Böhm, Stephan; Gaggero, Pascal O; Adler, Andy

2011-07-01

An electrical impedance tomography (EIT) system images internal conductivity from surface electrical stimulation and measurement. Such systems necessarily comprise multiple design choices from cables and hardware design to calibration and image reconstruction. In order to compare EIT systems and study the consequences of changes in system performance, this paper describes a systematic approach to evaluate the performance of the EIT systems. The system to be tested is connected to a saline phantom in which calibrated contrasting test objects are systematically positioned using a position controller. A set of evaluation parameters are proposed which characterize (i) data and image noise, (ii) data accuracy, (iii) detectability of single contrasts and distinguishability of multiple contrasts, and (iv) accuracy of reconstructed image (amplitude, resolution, position and ringing). Using this approach, we evaluate three different EIT systems and illustrate the use of these tools to evaluate and compare performance. In order to facilitate the use of this approach, all details of the phantom, test objects and position controller design are made publicly available including the source code of the evaluation and reporting software.

Evaluation of user perceptions and behaviors of Fast-Trac : pilot study results

DOT National Transportation Integrated Search

1996-01-01

The purpose of the User Perceptions and Behaviors evaluation component of FAST-TRAC is to understand how users perceive and value the in-vehicle navigation system, ALI-SCOUT, and to determine how the system is used in the Oakland County study area. S...

Solair heater program: solair applications study. Final report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

1977-12-01

General Electric has designed and tested a low-cost solar system using a vacuum tube solar air heater under ERDA Contract E(11-1)-2705. This contract extension has been provided to evaluate various applications of this solar collector. The evaluation identified attractive applications, evaluated corresponding control procedures, estimated system performance, compared economically insolation and insulation, and evaluated the repackaging of off-the-shelf equipment for improved cost effectiveness. The results of this study prompted General Electric's marketing group to do a detailed commercialization study of a residential domestic water heating system using the Solair concept which has been selected as the most attractive application. Othermore » attractive applications are space/domestic water heating and a heat pump assisted solar system/domestic water heating where the heat pump and the solar system function in parallel. A prime advantage of heated air solar systems over liquid systems is cost and longer life which results in higher BTU's/dollar. Other air system advantages are no liquid leakage problems, no toxicity of freezing problems, and less complicated equipment. A hybrid solar system has been identified that can improve the market penetration of solar energy. This system would use the existing mass of the house for energy storage thereby reducing solar cost and complexity. Adequate performance can be obtained with house temperature swings comparable to those used in nighttime setback of the thermostat. Details of this system are provided.« less

Methods for comparative evaluation of propulsion system designs for supersonic aircraft

NASA Technical Reports Server (NTRS)

Tyson, R. M.; Mairs, R. Y.; Halferty, F. D., Jr.; Moore, B. E.; Chaloff, D.; Knudsen, A. W.

1976-01-01

The propulsion system comparative evaluation study was conducted to define a rapid, approximate method for evaluating the effects of propulsion system changes for an advanced supersonic cruise airplane, and to verify the approximate method by comparing its mission performance results with those from a more detailed analysis. A table look up computer program was developed to determine nacelle drag increments for a range of parametric nacelle shapes and sizes. Aircraft sensitivities to propulsion parameters were defined. Nacelle shapes, installed weights, and installed performance was determined for four study engines selected from the NASA supersonic cruise aircraft research (SCAR) engine studies program. Both rapid evaluation method (using sensitivities) and traditional preliminary design methods were then used to assess the four engines. The method was found to compare well with the more detailed analyses.

A multi-method pilot evaluation of an online diabetes exercise system.

PubMed

Schaarup, Clara; Hejlesen, Ole K

2015-01-01

The American Diabetes Association and The European Association of The Study of Diabetes recommend people with Type 2 diabetes to do moderate to vigorous aerobic exercise for 150 min per week to avoid late diabetic complications. However, most people with diabetes do not follow the recommendation. Consumer health information technology (CHIT) might play a role in supporting behavior changes that promote health and well-being. A CHIT prototype of an online diabetes exercise system, which contained the newest research of low volume high-intensity interval training (HIT), was developed. To test the system we used a multi-method pilot evaluation that includes; interviews, paper prototyping, heuristic evaluation, and test with patients. The patients expressed satisfaction with HIT and appreciated that the system was web-based. The findings from this pilot study inspire to further development and evaluation of online CHIT systems to diabetics.

Scientific evaluation of the ArmorGuard mobile barrier system.

DOT National Transportation Integrated Search

2011-06-17

"Accidents and injuries occur during maintenance activities that could be protected by the ArmorGuard or BalsiBeam mobile barrier systems. The main purpose of this study is to perform a scientific evaluation of the utility of the ArmorGuard system in...

A Mixed Method Exploration of the Efficacy of the Teacher Evaluation System in Southwestern Pennsylvania

ERIC Educational Resources Information Center

Johns, Caroline

2017-01-01

This mixed method study was a practitioner inquiry into the teacher evaluation system that was enacted as a result of Pennsylvania House Bill 1901 (Act 82 of 2012). The study was an effort to gain an in-depth understanding of (a) factors that led to the passage of the Act 82 teacher evaluation policy, (b) what the policy was intended to do, and…

Evaluation: Two Studies of SCSD Schools. Building Systems Information Clearinghouse Research Report Number Two.

ERIC Educational Resources Information Center

Building Systems Information Clearinghouse, Menlo Park, CA.

The first evaluative study is a survey of user -- student and teacher -- response to the School Construction Systems Development (SCSD) schools and to elements of the SCSD building system. Results of the 3,000 person survey are presented both as comparative findings for the 11 SCSD schools involved and as response profiles for each of the schools.…

Independent Evaluation of California's Race to the Top: Early Learning Challenge Quality Rating and Improvement System. Half-Term Report

ERIC Educational Resources Information Center

Hawkinson, Laura E.; Quick, Heather E.; Muenchow, Susan; Anthony, Jennifer; Weinberg, Emily; Holod, Aleksandra; Parrish, Deborah; Meakin, John; Lee, Dong Hoon; Tarrant, Kate; Cannon, Jill S.; Zellman, Gail L.; Karoly, Lynn A.

2015-01-01

The first step in the Validity and Reliability Study summarizes the history and purpose of California's quality rating and improvement system (QRIS), reviews findings from other QRIS evaluation studies, and describes the approach to validating the system in California. The majority of this report focuses on providing context for the California…

Vulnerability Analysis and Evaluation of Urban Road System in Tianjin

NASA Astrophysics Data System (ADS)

Liu, Y. Q.; Wu, X.

In recent years, with the development of economy, the road construction of our country has entered into a period of rapid growth. The road transportation network has been expanding and the risk of disasters is increasing. In this paper we study the vulnerability of urban road system in Tianjin. After analyzed many risk factors of the urban road system security, including road construction, road traffic and the natural environment, we proposed an evaluation index of vulnerability of urban road system and established the corresponding evaluation index system. Based on the results of analysis and comprehensive evaluation, appropriate improvement measures and suggestions which may reduce the vulnerability of the road system and improve the safety and reliability of the road system are proposed.

An Analysis of State and Local Alignment of Teacher Evaluation in Maryland

ERIC Educational Resources Information Center

Peterson, Serene N.

2014-01-01

This study explored the components of Maryland's newly-implemented teacher evaluation framework and compared state requirements with evaluations to three local school systems' evaluation procedures. The study sought to investigate the relationship between three evaluation protocols in comparison to the state requirements. Three local school…

77 FR 46748 - Notice of Proposed Information Collection Requests; Institute of Education Sciences; Impact...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-08-06

... DEPARTMENT OF EDUCATION Notice of Proposed Information Collection Requests; Institute of Education Sciences; Impact Evaluation of Teacher and Leader Evaluation Systems SUMMARY: This study provides important implementation and impact information on the kinds of performance evaluation systems currently discussed in...

Building America Case Study: Side-by-Side Testing of Water Heating Systems: Results from 2013-2014 Evaluation Final Report, Cocoa, FL

DOE Office of Scientific and Technical Information (OSTI.GOV)

Rothgeb, Stacey K; Colon, C.; Martin, E.

The Florida Solar Energy Center (FSEC) has completed a fourth year-long evaluation on residential hot water heating systems in a laboratory environment (east central Florida, hot-humid climate). This report contains a summary of research activities regarding the evaluation of two residential electric heat pump water heaters (HPWHs), a solar thermal system utilizing a polymer glazed absorber and a high efficiency natural gas system.

Building America Case Study: Side-by-Side Testing of Water Heating Systems: Results from the 2013–2014 Evaluation Final Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

C. Colon and E. Martin

The Florida Solar Energy Center (FSEC) has completed a fourth year-long evaluation on residential hot water heating systems in a laboratory environment (east central Florida, hot-humid climate). This report contains a summary of research activities regarding the evaluation of two residential electric heat pump water heaters (HPWHs), a solar thermal system utilizing a polymer glazed absorber and a high efficiency natural gas system.

Management System for EMR Work Study Program.

ERIC Educational Resources Information Center

Columbia County Board of Public Instruction, Lake City, FL. Exceptional Child Education Dept.

A computerized information management system involving the specification of objectives, the coding of teacher evaluations of students, and a variety of possible outputs has been used in a work study program for educable mentally retarded adolescents. Instructional objectives are specified and coded by number and category. Evaluation is by means of…

Testing of state roadside safety systems. Volume XI, Appendix J -- Crash testing and evaluation of existing guardrail systems

DOT National Transportation Integrated Search

1999-04-01

The purpose of this study is to crash test and evaluate new or modified roadside safety hardware and, where necessary, redesign the devices to improve their impact performance. The three major areas addressed in this study are the impact performance ...

Complex Teacher Evaluation Systems Can Produce Negative Perceptions

ERIC Educational Resources Information Center

Schumacher, Gary

2010-01-01

The purpose of this study was to determine teacher perceptions of the impact on instructional practice when using a complex, standards-based performance evaluation system. The study used expectancy theory to investigate teacher expectancy (did they believe they could enhance their practice to the identified program standards?), instrumentality…

Styrene vapor control systems in FRP yacht plants.

PubMed

Todd, W F

1985-01-01

The production of large (greater than 25-ft) fiber-reinforced plastic (FRP) yachts has presented problems of styrene exposure in excess of the Occupational Safety and Health Administration permissible exposure level (OSHA PEL) of 100 ppm. Also, the National Institute for Occupational Safety and Health (NIOSH) is currently recommending a 10-hour workshift, 40-hour workweek time weighted average (TWA) of 50 ppm for styrene. Meeting this challenge will require a system of engineering, work practice, personal protective equipment, and monitoring control measures. NIOSH has performed a study of the engineering controls in three FRP yacht plants. Work practices and the use of personal protective equipment (PPE) were also considered in the evaluation. The three systems evaluated included a dilution system, a local ventilation system, and a push-pull ventilation system. The cost of constructing and operating these systems was not evaluated in this study. Study results indicated that each type of ventilation system can meet the present PEL of 100 ppm styrene; however, it is not certain that these systems can meet a lower PEL of 50 ppm styrene.

Information data systems for a global change technology initiative architecture trade study

NASA Technical Reports Server (NTRS)

Murray, Nicholas D.

1991-01-01

The Global Change Technology Initiative (GCTI) was established to develop technology which will enable use of satellite systems of Earth observations on a global scale, enable use of the observations to predictively model Earth's changes, and provide scientists, government, business, and industry with quick access to the resulting information. At LaRC, a GCTI Architecture Trade Study was undertaken to develop and evaluate the architectural implications to meet the requirements of the global change studies and the eventual implementation of a global change system. The output of the trade study are recommended technologies for the GCTI. That portion of the study concerned with the information data system is documented. The information data system for an earth global change modeling system can be very extensive and beyond affordability in terms of today's costs. Therefore, an incremental approach to gaining a system is most likely. An options approach to levels of capability versus needed technologies was developed. The primary drivers of the requirements for the information data system evaluation were the needed science products, the science measurements, the spacecraft orbits, the instruments configurations, and the spacecraft configurations and their attendant architectures. The science products requirements were not studied here; however, some consideration of the product needs were included in the evaluation results. The information data system technology items were identified from the viewpoint of the desirable overall information system characteristics.

Evaluation of median barrier safety issues.

DOT National Transportation Integrated Search

2008-01-01

The objective of this study was to evaluate the effectiveness of the Brifen TL-4 and Trinity CASS median cable barrier systems in preventing cross-median collisions on sections of I-64, I-71, and I-265 (Brifen system) and I-265 (Trinity system) in Je...

School Planning, Evaluation and Communication System (SPECS).

ERIC Educational Resources Information Center

Flocco, Edward C.

A comprehensive school planning tool is available from General Learning Corporation and the Center for the Advanced Study of Educational Administration at the University of Oregon. This School Planning, Evaluation and Communication System (SPECS) provides a deliverable system of training, implementation strategies and materials and technical…

Study of guidance techniques for aerial application of agricultural compounds

NASA Technical Reports Server (NTRS)

Caldwell, J. D.; Dimmock, P. B. A.; Watkins, R. H.

1980-01-01

Candidate systems were identified for evaluation of suitability in meeting specified accuracy requirements for a swath guidance system in an agriculture aircraft. Further examination reduced the list of potential candidates to a single category, i.e., transponder type systems, for detailed evaluation. Within this category three systems were found which met the basic accuracy requirements of the work statement. The Flying Flagman, the Electronic Flagging and the Raydist Director System. In addition to evaluating the systems against the specified requirements, each system was compared with the other two systems on a relative basis. The conclusions supported by the analyses show the Flying Flagman system to be the most suitable system currently available to meet the requirements.

Evaluation of intratympanic formulations for inner ear delivery: methodology and sustained release formulation testing

PubMed Central

Liu, Hongzhuo; Feng, Liang; Tolia, Gaurav; Liddell, Mark R.; Hao, Jinsong; Li, S. Kevin

2013-01-01

A convenient and efficient in vitro diffusion cell method to evaluate formulations for inner ear delivery via the intratympanic route is currently not available. The existing in vitro diffusion cell systems commonly used to evaluate drug formulations do not resemble the physical dimensions of the middle ear and round window membrane. The objectives of this study were to examine a modified in vitro diffusion cell system of a small diffusion area for studying sustained release formulations in inner ear drug delivery and to identify a formulation for sustained drug delivery to the inner ear. Four formulations and a control were examined in this study using cidofovir as the model drug. Drug release from the formulations in the modified diffusion cell system was slower than that in the conventional diffusion cell system due to the decrease in the diffusion surface area of the modified diffusion cell system. The modified diffusion cell system was able to show different drug release behaviors among the formulations and allowed formulation evaluation better than the conventional diffusion cell system. Among the formulations investigated, poly(lactic-co-glycolic acid)–poly(ethylene glycol)–poly(lactic-co-glycolic acid) triblock copolymer systems provided the longest sustained drug delivery, probably due to their rigid gel structures and/or polymer-to-cidofovir interactions. PMID:23631539

Flight Evaluation of an Aircraft with Side and Center Stick Controllers and Rate-Limited Ailerons

NASA Technical Reports Server (NTRS)

Deppe, P. R.; Chalk, C. R.; Shafer, M. F.

1996-01-01

As part of an ongoing government and industry effort to study the flying qualities of aircraft with rate-limited control surface actuators, two studies were previously flown to examine an algorithm developed to reduce the tendency for pilot-induced oscillation when rate limiting occurs. This algorithm, when working properly, greatly improved the performance of the aircraft in the first study. In the second study, however, the algorithm did not initially offer as much improvement. The differences between the two studies caused concern. The study detailed in this paper was performed to determine whether the performance of the algorithm was affected by the characteristics of the cockpit controllers. Time delay and flight control system noise were also briefly evaluated. An in-flight simulator, the Calspan Learjet 25, was programmed with a low roll actuator rate limit, and the algorithm was programmed into the flight control system. Side- and center-stick controllers, force and position command signals, a rate-limited feel system, a low-frequency feel system, and a feel system damper were evaluated. The flight program consisted of four flights and 38 evaluations of test configurations. Performance of the algorithm was determined to be unaffected by using side- or center-stick controllers or force or position command signals. The rate-limited feel system performed as well as the rate-limiting algorithm but was disliked by the pilots. The low-frequency feel system and the feel system damper were ineffective. Time delay and noise were determined to degrade the performance of the algorithm.

Reliability Evaluation and Improvement Approach of Chemical Production Man - Machine - Environment System

NASA Astrophysics Data System (ADS)

Miao, Yongchun; Kang, Rongxue; Chen, Xuefeng

2017-12-01

In recent years, with the gradual extension of reliability research, the study of production system reliability has become the hot topic in various industries. Man-machine-environment system is a complex system composed of human factors, machinery equipment and environment. The reliability of individual factor must be analyzed in order to gradually transit to the research of three-factor reliability. Meanwhile, the dynamic relationship among man-machine-environment should be considered to establish an effective blurry evaluation mechanism to truly and effectively analyze the reliability of such systems. In this paper, based on the system engineering, fuzzy theory, reliability theory, human error, environmental impact and machinery equipment failure theory, the reliabilities of human factor, machinery equipment and environment of some chemical production system were studied by the method of fuzzy evaluation. At last, the reliability of man-machine-environment system was calculated to obtain the weighted result, which indicated that the reliability value of this chemical production system was 86.29. Through the given evaluation domain it can be seen that the reliability of man-machine-environment integrated system is in a good status, and the effective measures for further improvement were proposed according to the fuzzy calculation results.

Energy efficient engine flight propulsion system: Aircraft/engine integration evaluation

NASA Technical Reports Server (NTRS)

Patt, R. F.

1980-01-01

Results of aircraft/engine integration studies conducted on an advanced flight propulsion system are reported. Economic evaluations of the preliminary design are included and indicate that program goals will be met. Installed sfc, DOC, noise, and emissions were evaluated. Aircraft installation considerations and growth were reviewed.

Energy efficient engine flight propulsion system: Aircraft/engine integration evaluation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Patt, R.F.

Results of aircraft/engine integration studies conducted on an advanced flight propulsion system are reported. Economic evaluations of the preliminary design are included and indicate that program goals will be met. Installed sfc, DOC, noise, and emissions were evaluated. Aircraft installation considerations and growth were reviewed.

Experimental Evaluation of the Training Structure of the Picture Exchange Communication System (PECS)

ERIC Educational Resources Information Center

Cummings, Anne R.; Carr, James E.; LeBlanc, Linda A.

2012-01-01

The Picture Exchange Communication System (PECS) is a picture-based alternative communication method that is widely accepted and utilized with individuals with disabilities. Although prior studies have examined the clinical efficacy of PECS, none have experimentally evaluated its manualized training structure. We experimentally evaluated the…

Organizational Evaluation Systems and Student Disengagement in Secondary Schools.

ERIC Educational Resources Information Center

Natriello, Gary

This paper reports on a study intended to examine problems in student evaluation systems that may lead to manifestations of student disengagement from secondary school such as absenteeism, low effort, violence, or vandalism. A theoretical framework is provided by Dornbusch and Scott's theory of evaluation and authority in organizations, which…

Evaluating Progress: State Education Agencies and the Implementation of New Teacher Evaluation Systems. WP #2015-09

ERIC Educational Resources Information Center

McGuinn, Patrick

2015-01-01

In a 2012 paper for the Center for American Progress, "The State of Evaluation Reform," Patrick McGuinn (Drew University) identified the opportunities and challenges facing education agencies in Race to the Top (RTTT) grant-winning states as they prepared for the implementation of new teacher evaluation systems. The 2012 study undertook…

Development and user evaluation of a virtual rehabilitation system for wobble board balance training.

PubMed

Fitzgerald, Diarmaid; Trakarnratanakul, Nanthana; Dunne, Lucy; Smyth, Barry; Caulfield, Brian

2008-01-01

We have developed a prototype virtual reality-based balance training system using a single inertial orientation sensor attached to the upper surface of a wobble board. This input device has been interfaced with Neverball, an open source computer game to create the balance training platform. Users can exercise with the system by standing on the wobble board and tilting it in different directions to control an on-screen environment. We have also developed a customized instruction manual to use when setting up the system. To evaluate the usability our prototype system we undertook a user evaluation study with twelve healthy novice participants. Participants were required to assemble the system using an instruction manual and then perform balance exercises with the system. Following this period of exercise VRUSE, a usability evaluation questionnaire, was completed by participants. Results indicated a high level of usability in all categories evaluated.

Escalator Design Features Evaluation

DOT National Transportation Integrated Search

1982-05-01

This study provides an evaluation of the effectiveness of several special design features associated with escalators in rail transit systems. The objective of the study was to evaluate the effectiveness of three escalator design features: (1) mat ope...

Identification of Balance Deficits in People with Parkinson Disease; is the Sensory Organization Test Enough?

PubMed

Gera, G; Freeman, D L; Blackinton, M T; Horak, F B; King, L

2016-02-01

Balance deficits in people with Parkinson's disease can affect any of the multiple systems encompassing balance control. Thus, identification of the specific deficit is crucial in customizing balance rehabilitation. The sensory organization test, a test of sensory integration for balance control, is sometimes used in isolation to identify balance deficits in people with Parkinson's disease. More recently, the Mini-Balance Evaluations Systems Test, a clinical scale that tests multiple domains of balance control, has begun to be used to assess balance in patients with Parkinson's disease. The purpose of our study was to compare the use of Sensory Organization Test and Mini-Balance Evaluations Systems Test in identifying balance deficits in people with Parkinson's disease. 45 participants (27M, 18F; 65.2 ± 8.2 years) with idiopathic Parkinson's disease participated in the cross-sectional study. Balance assessment was performed using the Sensory Organization Test and the Mini-Balance Evaluations Systems Test. People were classified into normal and abnormal balance based on the established cutoff scores (normal balance: Sensory Organization Test >69; Mini-Balance Evaluations Systems Test >73). More subjects were classified as having abnormal balance with the Mini-Balance Evaluations Systems Test (71% abnormal) than with the Sensory Organization Test (24% abnormal) in our cohort of people with Parkinson's disease. There were no subjects with a normal Mini-Balance Evaluations Systems Test score but abnormal Sensory Organization Test score. In contrast, there were 21 subjects who had an abnormal Mini-Balance Evaluations Systems Test score but normal Sensory Organization Test scores. Findings from this study suggest that investigation of sensory integration deficits, alone, may not be able to identify all types of balance deficits found in patients with Parkinson's disease. Thus, a comprehensive approach should be used to test of multiple balance systems to provide customized rehabilitation.

Field evaluation of Fourier transform infrared continuous emissions monitoring (FTIR CEM) systems

NASA Astrophysics Data System (ADS)

Dunder, Thomas A.; Geyer, Thomas J.; Kinner, Laura L.; Plummer, Grant M.

1995-02-01

Recent environmental regulations, including the Clean Air Act and the Enhanced Monitoring Regulations, may require continuous emissions monitoring (CEM) of hazardous air pollutants (HAPs). A promising technique for this application is Fourier transform infrared spectroscopy (FTIR). FTIR spectroscopy can, in principle, be used to monitor virtually any gas phase species. Two evaluations of FTIR CEM systems are discussed. The first study, performed in 1993 - 94, compared two FTIR CEM systems on a side-by-side basis in an extended field test at two coal-fired electric power plants. The FTIR CEM systems monitored the legally mandated criteria pollutants and diluents (CO, CO2, NO, NO2, and SO2) as well as H2O. In addition, one system monitored two HAPs (HCl and HF) and NH3. The FTIR CEM measurements were compared with those from the compliance CEM systems at the facilities. Several relative accuracy test audits were also performed to verify the FTIR CEM accuracy. The second evaluation was recently commenced on behalf of the Environmental Protection Agency. In this study, FTIR CEM systems are evaluated specifically for the monitoring of HAP species by conducting laboratory and field tests. The evaluation culminates in the development of proposed performance specifications and protocols for FTIR CEM systems.

A health literacy and usability heuristic evaluation of a mobile consumer health application.

PubMed

Monkman, Helen; Kushniruk, Andre

2013-01-01

Usability and health literacy are two critical factors in the design and evaluation of consumer health information systems. However, methods for evaluating these two factors in conjunction remain limited. This study adapted a set of existing guidelines for the design of consumer health Web sites into evidence-based evaluation heuristics tailored specifically for mobile consumer health applications. In order to test the approach, a mobile consumer health application (app) was then evaluated using these heuristics. In addition to revealing ways to improve the usability of the system, this analysis identified opportunities to augment the content to make it more understandable by users with limited health literacy. This study successfully demonstrated the utility of converting existing design guidelines into heuristics for the evaluation of usability and health literacy. The heuristics generated could be applied for assessing and revising other existing consumer health information systems.

Evaluation of Communication Alternatives for Intelligent Transportation Systems

DOT National Transportation Integrated Search

2010-08-31

The primary focus of this study involved developing a process for the evaluation of wireless technologies : for intelligent transportation systems, and for conducting experiments of potential wireless technologies : and topologies. Two wireless techn...

A study on reliability of power customer in distribution network

NASA Astrophysics Data System (ADS)

Liu, Liyuan; Ouyang, Sen; Chen, Danling; Ma, Shaohua; Wang, Xin

2017-05-01

The existing power supply reliability index system is oriented to power system without considering actual electricity availability in customer side. In addition, it is unable to reflect outage or customer’s equipment shutdown caused by instantaneous interruption and power quality problem. This paper thus makes a systematic study on reliability of power customer. By comparing with power supply reliability, reliability of power customer is defined and extracted its evaluation requirements. An indexes system, consisting of seven customer indexes and two contrast indexes, are designed to describe reliability of power customer from continuity and availability. In order to comprehensively and quantitatively evaluate reliability of power customer in distribution networks, reliability evaluation method is proposed based on improved entropy method and the punishment weighting principle. Practical application has proved that reliability index system and evaluation method for power customer is reasonable and effective.

A flight-test evaluation of a go-around control system for a twin engine powered-lift STOL airplane

NASA Technical Reports Server (NTRS)

Watson, D. M.; Hardy, G. H.

1983-01-01

An automatic go-around control system was evaluated on the Augmentor Wing Jet Short Takeoff and Landing (STOL) Research Airplane (AWJSRA) as part of a study of an automatic landing system for a powered-lift STOL airplane. The results of the evaluation indicate that the go-around control system can successfully transition the airplane to a climb configuration from any initiation point during the glide-slope track or the flare maneuver prior to touchdown.

Evaluation of the SAVI SCOUT Surgical Guidance System for Localization and Excision of Nonpalpable Breast Lesions: A Feasibility Study.

PubMed

Mango, Victoria; Ha, Richard; Gomberawalla, Ameer; Wynn, Ralph; Feldman, Sheldon

2016-06-15

The purpose of this study is to evaluate the feasibility of the SAVI SCOUT surgical guidance system, which uses a nonradioactive infrared-activated electromagnetic wave reflector, to localize and excise nonpalpable breast lesions. We evaluated the system's use in 15 nonpalpable breast lesions in 13 patients. Image-guided placement was successful for 15 of 15 (100%) reflectors. The final pathologic analysis found that lesion excision was successful, including five malignancies with negative margins. No patients required reexcision or experienced complications. SAVI SCOUT is a feasible method for breast lesion localization and excision.

Evaluation of laminar flow control system concepts for subsonic commercial transport aircraft

NASA Technical Reports Server (NTRS)

1979-01-01

Results of a 2-year study are reported which were carried out to extend the development of laminar flow control (LFC) technology and evaluate LFC systems concepts. The overall objective of the LFC program is to provide a sound basis for industry decisions on the application of LFC to future commercial transports. The study was organized into major tasks to support the stated objectives through application of LFC systems concepts to a baseline LFC transport initially generated for the study. Based on competitive evaluation of these concepts, a final selection was made for incorporation into the final design of an LFC transport which also included other advanced technology elements appropriate to the 1990 time period.

Extended System Operations Studies for Automated Guideway Transit Systems

DOT National Transportation Integrated Search

1982-02-01

The objectives of the System Operations Studies (SOS) of the Automated Guideway Transit Technology (AGTT) program was to develop models for the analysis of system operations, to evaluate AGT system performance and cost, and to establish guidelines fo...

A Computer Support System for the Entry and Analysis of Questionnaire Data.

ERIC Educational Resources Information Center

Shale, Douglas G.; Milinusic, Tomislav O.

This paper describes a computer support system that eliminated many of the problems associated with the usual methods of transcribing and analyzing questionnaire data. The system was created to support the course evaluation system at Athabasca University, a distance education university in Canada. The courses evaluated were all home study courses,…

Evaluation of two round baling systems for harvesting understory biomass

Treesearch

J.L. do Canto; John Klepac; Robert Rummer; P. Savoie; F. Seixas

2011-01-01

The objective of this study was to evaluate the performance and to estimate costs of two round baling systems for harvesting understory biomass. One system was a cutter-shredderbaler prototype (Bio-baler). The other system required two successive operations. The first operation was cutting and shredding with a Supertrak tractor equipped with a Fecon mulcher head. The...

Features of computerized clinical decision support systems supportive of nursing practice: a literature review.

PubMed

Lee, Seonah

2013-10-01

This study aimed to organize the system features of decision support technologies targeted at nursing practice into assessment, problem identification, care plans, implementation, and outcome evaluation. It also aimed to identify the range of the five stage-related sequential decision supports that computerized clinical decision support systems provided. MEDLINE, CINAHL, and EMBASE were searched. A total of 27 studies were reviewed. The system features collected represented the characteristics of each category from patient assessment to outcome evaluation. Several features were common across the reviewed systems. For the sequential decision support, all of the reviewed systems provided decision support in sequence for patient assessment and care plans. Fewer than half of the systems included problem identification. There were only three systems operating in an implementation stage and four systems in outcome evaluation. Consequently, the key steps for sequential decision support functions were initial patient assessment, problem identification, care plan, and outcome evaluation. Providing decision support in such a full scope will effectively help nurses' clinical decision making. By organizing the system features, a comprehensive picture of nursing practice-oriented computerized decision support systems was obtained; however, the development of a guideline for better systems should go beyond the scope of a literature review.

Can Principals Promote Teacher Development as Evaluators? A Case Study of Principals' Views and Experiences.

PubMed

Kraft, Matthew A; Gilmour, Allison

2016-12-01

New teacher evaluation systems have expanded the role of principals as instructional leaders, but little is known about principals' ability to promote teacher development through the evaluation process. We conducted a case study of principals' perspectives on evaluation and their experiences implementing observation and feedback cycles to better understand whether principals feel as though they are able to promote teacher development as evaluators. We conducted interviews with a stratified random sample of 24 principals in an urban district that recently implemented major reforms to its teacher evaluation system. We analyzed these interviews by drafting thematic summaries, coding interview transcripts, creating data-analytic matrices, and writing analytic memos. We found that the evaluation reforms provided a common framework and language that helped facilitate principals' feedback conversations with teachers. However, we also found that tasking principals with primary responsibility for conducting evaluations resulted in a variety of unintended consequences which undercut the quality of evaluation feedback they provided. We analyze five broad solutions to these challenges: strategically targeting evaluations, reducing operational responsibilities, providing principal training, hiring instructional coaches, and developing peer evaluation systems. The quality of feedback teachers receive through the evaluation process depends critically on the time and training evaluators have to provide individualized and actionable feedback. Districts that task principals with primary responsibility for conducting observation and feedback cycles must attend to the many implementation challenges associated with this approach in order for next-generation evaluation systems to successfully promote teacher development.

[Design and development of an online system of parasite's images for training and evaluation].

PubMed

Yuan-Chun, Mao; Sui, Xu; Jie, Wang; Hua-Yun, Zhou; Jun, Cao

2017-08-08

To design and develop an online training and evaluation system for parasitic pathogen recognition. The system was based on a Parasitic Diseases Specimen Image Digitization Construction Database by using MYSQL 5.0 as the system of database development software, and PHP 5 as the interface development language. It was mainly used for online training and evaluation of parasitic pathology diagnostic techniques. The system interface was designed simple, flexible, and easy to operate for medical staff. It enabled full day and 24 hours accessible to online training study and evaluation. Thus, the system broke the time and space constraints of the traditional training models. The system provides a shared platform for the professional training of parasitic diseases, and a reference for other training tasks.

Organizational determinants of evaluation practice in Australian prevention agencies.

PubMed

Schwarzman, J; Bauman, A; Gabbe, B; Rissel, C; Shilton, T; Smith, B J

2018-06-01

Program evaluation is essential to inform decision making, contribute to the evidence base for strategies, and facilitate learning in health promotion and disease prevention organizations. Theoretical frameworks of organizational learning, and studies of evaluation capacity building describe the organization as central to evaluation capacity. Australian prevention organizations recognize limitations to current evaluation effectiveness and are seeking guidance to build evaluation capacity. This qualitative study identifies organizational facilitators and barriers to evaluation practice, and explores their interactions in Australian prevention organizations. We conducted semi-structured interviews with 40 experienced practitioners from government and non-government organizations. Using thematic analysis, we identified seven key themes that influence evaluation practice: leadership, organizational culture, organizational systems and structures, partnerships, resources, workforce development and training and recruitment and skills mix. We found organizational determinants of evaluation to have multi-level interactions. Leadership and organizational culture influenced organizational systems, resource allocation and support of staff. Partnerships were important to overcome resource deficits, and systems were critical to embed evaluation within the organization. Organizational factors also influenced the opportunities for staff to develop skills and confidence. We argue that investment to improve these factors would allow organizations to address evaluation capacity at multiple levels, and ultimately facilitate effective evaluation practice.

WE-E-217A-02: Methodologies for Evaluation of Standalone CAD System Performance.

PubMed

Sahiner, B

2012-06-01

Standalone performance evaluation of a CAD system provides information about the abnormality detection or classification performance of the computerized system alone. Although the performance of the reader with CAD is the final step in CAD system assessment, standalone performance evaluation is an important component for several reasons: First, standalone evaluation informs the reader about the performance level of the CAD system and may have an impact on how the reader uses the system. Second, it provides essential information to the system designer for algorithm optimization during system development. Third, standalone evaluation can provide a detailed description of algorithm performance (e.g., on subgroups of the population) because a larger data set with more samples from different subgroups can be included in standalone studies compared to reader studies. Proper standalone evaluation of a CAD system involves a number of key components, some of which are shared with the assessment of reader performance with CAD. These include (1) selection of a test data set that allows performance assessment with little or no bias and acceptable uncertainty; (2) a reference standard that indicates disease status as well as the location and extent of disease; (3) a clearly defined method for labeling each CAD mark as a true-positive or false-positive; and (4) a properly selected set of metrics to summarize the accuracy of the computer marks and their corresponding scores. In this lecture, we will discuss various approaches for the key components of standalone CAD performance evaluation listed above, and present some of the recommendations and opinions from the AAPM CAD subcommittee on these issues. Learning Objectives 1. Identify basic components and metrics in the assessment of standalone CAD systems 2. Understand how each component may affect the assessed performance 3. Learn about AAPM CAD subcommittee's opinions and recommendations on factors and metrics related to the evaluation of standalone CAD system performance. © 2012 American Association of Physicists in Medicine.

ICCE/ICCAI 2000 Full & Short Papers (Evaluation of Learning and Systems).

ERIC Educational Resources Information Center

2000

This document contains the full and short papers on evaluation of learning and systems from ICCE/ICCAI 2000 (International Conference on Computers in Education/International Conference on Computer-Assisted Instruction) covering the following topics: a new method for efficient study of Kanji using mnemonics and software; a study on the relation…

Effectiveness of the Revised Ontario School Record System.

ERIC Educational Resources Information Center

Humphreys, Edward H.; Elwood, Bryan C.

Results of a study conducted for the Ministry of Education (Ontario) and designed to evaluate the effectiveness of the Ontario School Record System (OSR) as revised in 1973 are reported in this paper. In order to evaluate the OSR's effectiveness, the study team examined educators', parents and students' perceived needs for student information,…

STP Position Paper: Recommended Best Practices for Sampling, Processing and Analysis of the Peripheral Nervous System (Nerves and Somatic and Autonomic Ganglia) during Nonclinical Toxicity Studies

EPA Science Inventory

These Society of Toxicologic Pathology “best” practice recommendations should ensure consistent sampling, processing, and evaluation of the peripheral nervous system (PNS). For toxicity studies where neurotoxicity is not anticipated (Situation 1), PNS evaluation may be limited...

Exploring Differential Attrition Rates among System of Care Evaluation Participants

ERIC Educational Resources Information Center

Rogers, Kelly N.; Fernandez, Maria; Thurber, Lori; Smitley, Andy

2004-01-01

The purpose of the present study is to investigate differential attrition rates in terms of both demographic characteristics and initial levels of child functioning of participants in North Carolina's system of care evaluation. Participants included 303 families (78 dropped out of the study, a 26% attrition rate). Families dropped out of the…

Satellite power system concept development and evaluation program system definition technical assessment report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

1980-12-01

The results of the system definition studies conducted by NASA as a part of the Department of Energy/National Aeronautics and Space Administration SPS Concept Development and Evaluation Program are summarized. The purpose of the system definition efforts was to identify and define candidate SPS concepts and to evaluate the concepts in terms of technical and cost factors. Although the system definition efforts consisted primarily of evaluation and assessment of alternative technical approaches, a reference system was also defined to facilitate economic, environmental, and societal assessments by the Department of Energy. This reference system was designed to deliver 5 GW ofmore » electrical power to the utility grid. Topics covered include system definition; energy conversion and power management; power transmission and reception; structures, controls, and materials; construction and operations; and space transportation.« less

Principals' Experiences of Being Evaluated: A Phenomenological Study

ERIC Educational Resources Information Center

Parylo, Oksana; Zepeda, Sally J.; Bengtson, Ed

2012-01-01

This phenomenological study sought to understand principals' lived experiences of being evaluated with reliance on the principles of developmental supervision and adult learning theory. Analysis of interview data from 16 principals revealed 3 major constructs in principal evaluation: evaluation is a complex, constantly changing system; principal…

Kinect-based virtual rehabilitation and evaluation system for upper limb disorders: A case study.

PubMed

Ding, W L; Zheng, Y Z; Su, Y P; Li, X L

2018-04-19

To help patients with disabilities of the arm and shoulder recover the accuracy and stability of movements, a novel and simple virtual rehabilitation and evaluation system called the Kine-VRES system was developed using Microsoft Kinect. First, several movements and virtual tasks were designed to increase the coordination, control and speed of the arm movements. The movements of the patients were then captured using the Kinect sensor, and kinematics-based interaction and real-time feedback were integrated into the system to enhance the motivation and self-confidence of the patient. Finally, a quantitative evaluation method of upper limb movements was provided using the recorded kinematics during hand-to-hand movement. A preliminary study of this rehabilitation system indicates that the shoulder movements of two participants with ataxia became smoother after three weeks of training (one hour per day). This case study demonstrated the effectiveness of the designed system, which could be promising for the rehabilitation of patients with upper limb disorders.

Applying usability heuristics to radiotherapy systems.

PubMed

Chan, Alvita J; Islam, Mohammad K; Rosewall, Tara; Jaffray, David A; Easty, Anthony C; Cafazzo, Joseph A

2012-01-01

Heuristic evaluations have been used to evaluate safety of medical devices by identifying and assessing usability issues. Since radiotherapy treatment delivery systems often consist of multiple complex user-interfaces, a heuristic evaluation was conducted to assess the potential safety issues of such a system. A heuristic evaluation was conducted to evaluate the treatment delivery system at Princess Margaret Hospital (Toronto, Canada). Two independent evaluators identified usability issues with the user-interfaces and rated the severity of each issue. The evaluators identified 75 usability issues in total. Eighteen of them were rated as high severity, indicating the potential to have a major impact on patient safety. A majority of issues were found on the record and verify system, and many were associated with the patient setup process. While the hospital has processes in place to ensure patient safety, recommendations were developed to further mitigate the risks of potential consequences. Heuristic evaluation is an efficient and inexpensive method that can be successfully applied to radiotherapy delivery systems to identify usability issues and improve patient safety. Although this study was conducted only at one site, the findings may have broad implications for the design of these systems. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Dual-energy in mammography: feasibility study

NASA Astrophysics Data System (ADS)

Jafroudi, Hamid; Lo, Shih-Chung B.; Li, Huai; Steller Artz, Dorothy E.; Freedman, Matthew T.; Mun, Seong K.

1996-04-01

The purpose of this work is to examine the feasibility of dual-energy techniques to enhance the detection of microcalcifications in digital mammography. The digital mammography system used in this study consists of two different mammography systems; one is the conventional mammography system with molybdenum target and Mo filtration and the other is the clinical version of a low dose x-ray system with tungsten target and aluminum filtration. The low dose system is optimized for screen-film mammography with a highly efficient scatter rejection device built by Fischer Imaging Systems for evaluation at NIH. The system was designed by the University of Southern California based on multiparameter optimization techniques. Prototypes of this system have been constructed and evaluated at the Center for Devices and Radiological Health. The digital radiography system is based on the Fuji 9000 computed radiography (CR) system which uses a storage phosphor imaging plate as the receptor. High resolution plates (HR-V) are used in this study. Dual-energy is one technique to reduce the structured noise associated with the complexity of the background of normal anatomy surrounding a lesion. This can be done by taking the advantage of the x-ray attenuation characteristics of two different structures such as soft tissue and bone in chest radiography. We have applied this technique to the detection of microcalcifications in mammography. The overall system performance based on this technique is evaluated. Results presented are based on the evaluation of phantom images.

Strategy for Instructional Systems Design and Formative Evaluation.

DTIC Science & Technology

1976-07-01

The overall purpose of the study was to deal with the elements of a systems model for designing patient education modules in eight areas...staff evaluation. Examples are given for each of the eight patient education areas, in addition to the enlisted health educator’s functions, system

Design and Evaluation of a Dynamic Dilemma Zone System for a High Speed Rural Intersection

DOT National Transportation Integrated Search

2012-08-01

The goal of this research was to develop a system that utilizes the dynamic detection technology and : to evaluate the performance of this system. The first step of this study was to select an intersection : experiencing a high frequency of crashes t...

Evaluation of Filtration and UV Disinfection for Inactivation of Viruses in Non-Community Water Systems in Minnesota

EPA Science Inventory

This study evaluated filtration and disinfection processes for removal and inactivation of pathogens in non-community water systems (NCWS) in two surface water supplies. Pretreatment systems included 1) pressure sand filtration, and 2) granular activated carbon adsorption, and 3...

COST EVALUATION OF AUTOMATED AND MANUAL POST- CONSUMER PLASTIC BOTTLE SORTING SYSTEMS

EPA Science Inventory

This project evaluates, on the basis of performance and cost, two Automated BottleSort® sorting systems for post-consumer commingled plastic containers developed by Magnetic Separation Systems. This study compares the costs to sort mixed bales of post-consumer plastic at these t...

Microscope-Integrated OCT Feasibility and Utility With the EnFocus System in the DISCOVER Study.

PubMed

Runkle, Anne; Srivastava, Sunil K; Ehlers, Justis P

2017-03-01

To evaluate the feasibility and utility of a novel microscope-integrated intraoperative optical coherence tomography (OCT) system. The DISCOVER study is an investigational device study evaluating microscope-integrated intraoperative OCT systems for ophthalmic surgery. This report focuses on subjects imaged with the EnFocus prototype system (Leica Microsystems/Bioptigen, Morrisville, NC). OCT was performed at surgeon-directed milestones. Surgeons completed a questionnaire after each case to evaluate the impact of OCT on intraoperative management. Fifty eyes underwent imaging with the EnFocus system. Successful imaging was obtained in 46 of 50 eyes (92%). In eight cases (16%), surgical management was changed based on intraoperative OCT findings. In membrane peeling procedures, intraoperative OCT findings were discordant from the surgeon's initial impression in seven of 20 cases (35%). This study demonstrates the feasibility of microscope-integrated intraoperative OCT using the Bioptigen EnFocus system. Intraoperative OCT may provide surgeons with additional information that may influence surgical decision-making. [Ophthalmic Surg Lasers Imaging Retina. 2017;48:216-222.]. Copyright 2017, SLACK Incorporated.

The Crash Outcome Data Evaluation System (CODES)

DOT National Transportation Integrated Search

1996-01-01

The CODES Technical Report presents state-specific results from the Crash : Outcome Data Evaluation System project. These results confirm previous NHTSA : studies and show that safety belts and motorcycle helmets are effective in : reducing fatalitie...

Qualitative and quantitative evaluation of solvent systems for countercurrent separation.

PubMed

Friesen, J Brent; Ahmed, Sana; Pauli, Guido F

2015-01-16

Rational solvent system selection for countercurrent chromatography and centrifugal partition chromatography technology (collectively known as countercurrent separation) studies continues to be a scientific challenge as the fundamental questions of comparing polarity range and selectivity within a solvent system family and between putative orthogonal solvent systems remain unanswered. The current emphasis on metabolomic investigations and analysis of complex mixtures necessitates the use of successive orthogonal countercurrent separation (CS) steps as part of complex fractionation protocols. Addressing the broad range of metabolite polarities demands development of new CS solvent systems with appropriate composition, polarity (π), selectivity (σ), and suitability. In this study, a mixture of twenty commercially available natural products, called the GUESSmix, was utilized to evaluate both solvent system polarity and selectively characteristics. Comparisons of GUESSmix analyte partition coefficient (K) values give rise to a measure of solvent system polarity range called the GUESSmix polarity index (GUPI). Solvatochromic dye and electrical permittivity measurements were also evaluated in quantitatively assessing solvent system polarity. The relative selectivity of solvent systems were evaluated with the GUESSmix by calculating the pairwise resolution (αip), the number of analytes found in the sweet spot (Nsw), and the pairwise resolution of those sweet spot analytes (αsw). The combination of these parameters allowed for both intra- and inter-family comparison of solvent system selectivity. Finally, 2-dimensional reciprocal shifted symmetry plots (ReSS(2)) were created to visually compare both the polarities and selectivities of solvent system pairs. This study helps to pave the way to the development of new solvent systems that are amenable to successive orthogonal CS protocols employed in metabolomic studies. Copyright © 2014 Elsevier B.V. All rights reserved.

The evaluation of a web-based incident reporting system.

PubMed

Kuo, Ya-Hui; Lee, Ting-Ting; Mills, Mary Etta; Lin, Kuan-Chia

2012-07-01

A Web-based reporting system is essential to report incident events anonymously and confidentially. The purpose of this study was to evaluate a Web-based reporting system in Taiwan. User satisfaction and impact of system use were evaluated through a survey answered by 249 nurses. Incident events reported in paper and electronic systems were collected for comparison purposes. Study variables included system user satisfaction, willingness to report, number of reports, severity of the events, and efficiency of the reporting process. Results revealed that senior nurses were less willing to report events, nurses on internal medicine units had higher satisfaction than others, and lowest satisfaction was related to the time it took to file a report. In addition, the Web-based reporting system was used more often than the paper system. The percentages of events reported were significantly higher in the Web-based system in laboratory, environment/device, and incidents occurring in other units, whereas the proportions of reports involving bedsores and dislocation of endotracheal tubes were decreased. Finally, moderate injury event reporting decreased, whereas minor or minimal injury event reporting increased. The study recommends that the data entry process be simplified and the network system be improved to increase user satisfaction and reporting rates.

Filmless radiology: The design, integration, implementation, and evaluation of a digital imaging network. Potential investigations to be conducted in conjunction with the Digital-Imaging Network System (DINS) evaluation project. Revision 1. Annual report, 1 March 1987-28 February 1988

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kerlin, B.D.; Cerva, J.R.; Glenn, M.E.

This document describes evaluation studies and technical investigations proposed for the three-year Digital Imaging Network System (DINS) prototype project, sponsored by the U.S. Army Medical Research and Development Command, Ft. Detrick, Maryland. The project has three overall goals. The first is to install and operate a prototype DINS at each of two University-based hospitals for test purposes. The second is to evaluate key aspects of each prototype system once it is in full operation. The third is to develop guidelines and specifications for an operational DINS suitable for use by the military and others developing systems of the future. Thismore » document defines twelve overall evaluative questions for use in meeting the second and third objectives of the project and proposes studies that will answer these questions.« less

Evaluation of laminar flow control system concepts for subsonic commercial transport aircraft

NASA Technical Reports Server (NTRS)

1980-01-01

A study was conducted to evaluate alternatives in the design of laminar flow control (LFC) subsonic commercial transport aircraft for operation in the 1980's period. Analyses were conducted to select mission parameters and define optimum aircraft configurational parameters for the selected mission, defined by a passenger payload of 400 and a design range of 12,038 km (6500 n mi). The baseline aircraft developed for this mission was used as a vehicle for the evaluation and development of alternative LFC system concepts. Alternatives were evaluated in the areas of aerodynamics structures, materials, LFC systems, leading-edge region cleaning and integration of auxiliary systems. Based on these evaluations, concept in each area were selected for further development and testing and ultimate incorporation in the final study aircraft. Relative to a similarly-optimized advanced technology turbulent transport, the final LFC configuration is approximately equal in direct operating cost but provides decreases of 8.2% in gross weight and 21.7% in fuel consumption.

Stakes Matter: Student Motivation and the Validity of Student Assessments for Teacher Evaluation

ERIC Educational Resources Information Center

Rutkowski, David; Wild, Justin

2015-01-01

In 2011, Indiana lawmakers established a system to evaluate teachers using existing standardized assessments as an indicator of student learning. In this study we examined one component of Indiana's evaluation system to determine whether student knowledge of the test's consequences is predictive of test performance. Using an experimental design,…

U1108 performance model

NASA Technical Reports Server (NTRS)

Trachta, G.

1976-01-01

A model of Univac 1108 work flow has been developed to assist in performance evaluation studies and configuration planning. Workload profiles and system configurations are parameterized for ease of experimental modification. Outputs include capacity estimates and performance evaluation functions. The U1108 system is conceptualized as a service network; classical queueing theory is used to evaluate network dynamics.

Field evaluations of residual pesticide applications and misting system on militarily relevant materials against medically important mosquitoes in Thailand

USDA-ARS?s Scientific Manuscript database

A key strategy to reduce insect-borne disease is to reduce contact between disease vectors and hosts. In the current study, residual pesticide application and misting system were applied on militarily relevant materials and evaluated against medically important mosquitoes. Field evaluations were car...

Satellite power system: Concept development and evaluation program. Volume 3: Power transmission and reception. Technical summary and assessment

NASA Technical Reports Server (NTRS)

Dietz, R. H.; Arndt, G. D.; Seyl, J. W.; Leopold, L.; Kelley, J. S.

1981-01-01

Efforts in the DOE/NASA concept development and evaluation program are discussed for the solar power satellite power transmission and reception system. A technical summary is provided together with a summary of system assessment activities. System options and system definition drivers are described. Major system assessment activities were in support of the reference system definition, solid state system studies, critical technology supporting investigations, and various system and subsystem tradeoffs. These activities are described together with reference system updates and alternative concepts for each of the subsystem areas. Conclusions reached as a result of the numerous analytical and experimental evaluations are presented. Remaining issues for a possible follow-on program are identified.

Systems Study of Precast Concrete Tunnel Liners

DOT National Transportation Integrated Search

1975-03-01

The study addresses precast concrete lining systems. Existing precast concrete systems designed or constructed in Europe, Japan, and the United States are evaluated. With these as a point of departure, designs for lining systems applicable to the spe...

A dynamic systems engineering methodology research study. Phase 2: Evaluating methodologies, tools, and techniques for applicability to NASA's systems projects

NASA Technical Reports Server (NTRS)

Paul, Arthur S.; Gill, Tepper L.; Maclin, Arlene P.

1989-01-01

A study of NASA's Systems Management Policy (SMP) concluded that the primary methodology being used by the Mission Operations and Data Systems Directorate and its subordinate, the Networks Division, is very effective. Still some unmet needs were identified. This study involved evaluating methodologies, tools, and techniques with the potential for resolving the previously identified deficiencies. Six preselected methodologies being used by other organizations with similar development problems were studied. The study revealed a wide range of significant differences in structure. Each system had some strengths but none will satisfy all of the needs of the Networks Division. Areas for improvement of the methodology being used by the Networks Division are listed with recommendations for specific action.

Economic evaluation: Concepts, selected studies, system costs, and a proposed program

NASA Technical Reports Server (NTRS)

Osterhoudt, F. H. (Principal Investigator)

1979-01-01

The more usual approaches to valuing crop information are reviewed and an integrated approach is recommended. Problems associated with implementation are examined. What has already been accomplished in the economic evaluation of LACIE-type information is reported including various studies of benefits. The costs of the existing and proposed systems are considered. A method and approach is proposed for further studies.

A Documentation System to Save Time and Ensure Proper Application of the Fiberoptic Endoscopic Evaluation of Swallowing (FEES®)

PubMed Central

Hey, Christiane; Pluschinski, Petra; Stanschus, Soenke; Euler, Harald A.; Sader, Robert A.; Langmore, Susan; Neumann, Katrin

2011-01-01

A properly performed fiberoptic endoscopic evaluation of swallowing (FEES®) is comprehensive and time-consuming. Editing times of FEES protocols and attempts for efficiency maximization are unknown. Here, the protocol editing times of completed FEES examinations were determined. The present study reports the time savings and quality gains of a newly developed documentation system tailored to the FEES standard of Langmore. Four independent examiners analyzed twelve videos of FEES procedures, six without and six with the documentation system. Effectiveness of the documentation system was evaluated according to the times for total evaluation, interpretation, documentation, report writing, and for report completeness. The documentation system reduced editing times and increased report completeness with large effect sizes. Averaged total evaluation time decreased from 42 to 27 min, report completeness increased from 55 to 80%. The use of the documentation system facilitates and improves the assessment of the swallowing process. PMID:20938202

Addressing Enterprise-Level Information System Deficiencies

DTIC Science & Technology

2015-03-26

goals and effectiveness. This case study evaluates the Depot Source of Repair (DSOR) team and how it has addressed the USAF’s enterprise- level IS...deficiencies. A framework created from the literature review is used to evaluate the DSOR team’s IS called DSOR II. The case study evaluation ...7 IS Design Evaluation

Teacher Evaluation Reform: Focus, Feedback, and Fear

ERIC Educational Resources Information Center

Donaldson, Morgaen L.

2016-01-01

How are teachers experiencing the more rigorous teacher evaluation systems that many states have mandated in recent years? Donaldson, who has studied teacher evaluation reform over the past eight years, shares insights from a study of 14 Connecticut districts that have implemented the state's 2012 teacher evaluation reforms. In surveys and…

Crescent Evaluation : appendix B : state case study evaluation report

DOT National Transportation Integrated Search

1994-02-01

The state case study evaluation approach uniquely captured an understanding of the potential of such a system by documenting the experiences, issues, and opportunities of selected key state government personnel from a cross-section of involved agenci...

A Portable Environment Test System: A Field Assessment of Organotin Leachates--Test and Evaluation.

DTIC Science & Technology

1987-11-01

Environmental Test System (PETS) was evaluated with tributyltin ( TBT ) anti oling leachates in Sin Diego Bay over a 7-month period. Overall mean test...EXECUTIVE SUMMARY A Portable Environmental Test System (PETS) was evaluated with tributyltin ( TBT ) antifouling leachates in San Diego Bay for 7...of organotin-based antifouling (AF) coatings, NOSC researchers used this facility to study the effects of tributyltin ( TBT ), the primary toxic

Technology efficacy in active prosthetic knees for transfemoral amputees: a quantitative evaluation.

PubMed

El-Sayed, Amr M; Hamzaid, Nur Azah; Abu Osman, Noor Azuan

2014-01-01

Several studies have presented technological ensembles of active knee systems for transfemoral prosthesis. Other studies have examined the amputees' gait performance while wearing a specific active prosthesis. This paper combined both insights, that is, a technical examination of the components used, with an evaluation of how these improved the gait of respective users. This study aims to offer a quantitative understanding of the potential enhancement derived from strategic integration of core elements in developing an effective device. The study systematically discussed the current technology in active transfemoral prosthesis with respect to its functional walking performance amongst above-knee amputee users, to evaluate the system's efficacy in producing close-to-normal user performance. The performances of its actuator, sensory system, and control technique that are incorporated in each reported system were evaluated separately and numerical comparisons were conducted based on the percentage of amputees' gait deviation from normal gait profile points. The results identified particular components that contributed closest to normal gait parameters. However, the conclusion is limitedly extendable due to the small number of studies. Thus, more clinical validation of the active prosthetic knee technology is needed to better understand the extent of contribution of each component to the most functional development.

Evaluation of the association of sleep apnea-related systemic inflammation with CRP, ESR, and neutrophil-to-lymphocyte ratio.

PubMed

Korkmaz, Mukadder; Korkmaz, Hakan; Küçüker, Fatma; Ayyıldız, Sema Nur; Çankaya, Soner

2015-02-13

Obstructive sleep apnea syndrome (OSAS) is characterized by cyclic episodes of hypoxemia and reoxygenation. It has been suggested that OSAS is associated with chronic inflammation within the microvasculature. This low-grade inflammation may play a role in the pathophysiology of OSAS-related comorbidities. Evaluation of the inflammatory markers may predict the degree of the systemic inflammation and this may be a prognostic factor for future adverse events such as cardiovascular risks. Proinflammatory cytokines have been extensively studied in sleep-disordered breathing. Neutrophil-to-lymphocyte ratio is a recently described indicator of systemic inflammation, but it has not been studied in OSAS patients. In this study we aimed to evaluate the easily measurable parameters of systemic inflammation in these patients. We conducted this study to examine the association among OSAS and C- reactive protein, erythrocyte sedimentation rate, and neutrophil-to-lymphocyte ratio. OSAS patients who underwent overnight polysomnography were studied retrospectively. They were divided into 4 groups: control, mild, moderate, and severe OSAS patients. Blood test results and inflammatory markers were compared between the groups. One-way ANOVA and Kruskall-Wallis H test were used for statistical analysis. A total of 147 patients were included in the study. No differences in evaluated inflammatory markers were observed among the 4 groups. Evaluation of the OSAS-related systemic inflammation is not likely to be possible by CRP, ESR, or neutrophil-to-lymphocyte ratio measurements. These markers do not seem to be associated with the degree of the upper airway obstruction.

Evaluation criteria for the district health management information systems: lessons from the Ministry of Health, Kenya.

PubMed

Odhiambo-Otieno, George W; Odero, Wilson W O

2005-03-01

The District Health Management Information Systems (DHMISs) were established by the Ministry of Health (MoH) in Kenya more than two decades ago. Since then, no comprehensive evaluation has been undertaken. This can partly be attributed to lack of defined criteria for evaluating them. To propose evaluation criteria for assessing the design, implementation and impact of DHMIS in the management of the District Health System (DHS) in Kenya. A descriptive cross-sectional study conducted in three DHSs in Kenya: Bungoma, Murang'a and Uasin Gishu districts. Data was collected through focus group discussions, key informant interviews, and documents' review. The respondents, purposely selected from the Ministry of Health headquarters and the three DHS districts, included designers, managers and end-users of the systems. A set of evaluation criteria for DHMISs was identified for each of the three phases of implementation: pre-implementation evaluation criteria (categorised as policy and objectives, technical feasibility, financial viability, political viability and administrative operability) to be applied at the design stage; concurrent implementation evaluation criteria to be applied during implementation of the new system; and post-implementation evaluation criteria (classified as internal - quality of information; external - resources and managerial support; ultimate - systems impact) to be applied after implementation of the system for at least three years. In designing a DHMIS model there is need to have built-in these three sets of evaluation criteria which should be used in a phased manner. Pre-implementation evaluation criteria should be used to evaluate the system's viability before more resources are committed to it; concurrent (operational) - implementation evaluation criteria should be used to monitor the process; and post-implementation evaluation criteria should be applied to assess the system's effectiveness.

Computer-aided detection (CAD) of breast cancer on full field digital and screening film mammograms

NASA Astrophysics Data System (ADS)

Sun, Xuejun; Qian, Wei; Song, Xiaoshan; Qian, Yuyan; Song, Dansheng; Clark, Robert A.

2003-05-01

Full-field digital mammography (FFDM) as a new breast imaging modality has potential to detect more breast cancers or to detect them at smaller sizes and earlier stages compared with screening film mammography (SFM). However, its performance needs verification, and it would pose new problems for the development of CAD methods for breast cancer detection and diagnosis. Performance evaluation of CAD systems on FFDM and SFM has been conducted in this study, respectively. First, an adaptive CAD system employing a series of advanced modules has been developed on FFDM. Second, a standardization approach has been developed to make the CAD system independent of characteristics of digitizer or imaging modalities for mammography. CAD systems developed previously for SFM and developed in this study for FFDM have been evaluated on FFDM and SFM images without and with standardization, respectively, to examine the performance improvement of the CAD system developed in this study. Computerized free-response receiver operating characteristic (FROC) analysis has been adopted as performance evaluation method. Compared with previous one, the CAD system developed in this study demonstrated significantly performance improvements. However, the comparison results have shown that the performances of final CAD system in this study are not significantly different on FFDM and on SFM after standardization. It needs further study on the assessment of CAD system performance on FFDM and SFM modalities.

Automatic safety belt usage in 1981 Toyotas

DOT National Transportation Integrated Search

1982-02-01

The objectives of the study were to evaluate the effectiveness of automatic restraint systems provided in Toyota Cressidas in increasing use of seat belts, and to evaluate attitude of owners toward those systems. Data were collected through telephone...

Randomized pilot study and qualitative evaluation of a clinical decision support system for brain tumour diagnosis based on SV ¹H MRS: evaluation as an additional information procedure for novice radiologists.

PubMed

Sáez, Carlos; Martí-Bonmatí, Luis; Alberich-Bayarri, Angel; Robles, Montserrat; García-Gómez, Juan M

2014-02-01

The results of a randomized pilot study and qualitative evaluation of the clinical decision support system Curiam BT are reported. We evaluated the system's feasibility and potential value as a radiological information procedure complementary to magnetic resonance (MR) imaging to assist novice radiologists in diagnosing brain tumours using MR spectroscopy (1.5 and 3.0T). Fifty-five cases were analysed at three hospitals according to four non-exclusive diagnostic questions. Our results show that Curiam BT improved the diagnostic accuracy in all the four questions. Additionally, we discuss the findings of the users' feedback about the system, and the further work to optimize it for real environments and to conduct a large clinical trial. © 2013 Published by Elsevier Ltd.

Use of Disposable Micro Tissue Culture Plates for Antiviral and Interferon Induction Studies

PubMed Central

Sidwell, Robert W.; Huffman, John H.

1971-01-01

A reproducible test system requiring small amounts of test compound was developed for evaluating antiviral and interferon-inducing activity. In the antiviral experiments, KB cells were grown in disposable polystyrene microplates covered with a standard domestic plastic wrap. Viruses used in the system were types 1 and 2 herpes simplex virus, vaccinia virus, type 3 adenovirus, myxoma virus, pseudorabies virus, type 3 parainfluenza virus, types 1A and 13 rhinovirus, vesicular stomatitis virus, coxsackievirus B, and type 2 poliovirus. Inhibition of viral cytopathogenic effect was the primary criterion of evaluation of antiviral activity. Reduction in cell and supernatant fluid virus titers was used as a secondary means of evaluation. The microplate system was adaptable for determining prophylactic, therapeutic, and inactivating effects against viruses. Mouse L-929 cells were used for the interferon induction studies, with vesicular stomatitis virus utilized as the indicator of interferon activity. Known active compounds evaluated in this microplate system had activity similar to that seen in macro in vitro systems. PMID:4332040

Building China's municipal healthcare performance evaluation system: a Tuscan perspective.

PubMed

Li, Hao; Barsanti, Sara; Bonini, Anna

2012-08-01

Regional healthcare performance evaluation systems can help optimize healthcare resources on regional basis and improve the performance of healthcare services provided. The Tuscany region in Italy is a good example of an institution which meets these requirements. China has yet to build such a system based on international experience. In this paper, based on comparative studies between Tuscany and China, we propose that the managing institutions in China's experimental cities can select and commission a third-party agency to, respectively, evaluate the performance of their affiliated hospitals and community health service centers. Following some features of the Tuscan experience, the Chinese municipal healthcare performance evaluation system can be built by focusing on the selection of an appropriate performance evaluation agency, the design of an adequate performance evaluation mechanism and the formulation of a complete set of laws, rules and regulations. When a performance evaluation system at city level is formed, the provincial government can extend the successful experience to other cities.

An evaluation method of the sustainability of water resource in karst region: a case study of Zunyi, China

NASA Astrophysics Data System (ADS)

Li, Bo; Wang, Ganlu; Ding, Hanghang; Chen, Yulong

2017-06-01

Water resource is of great significance to the survival and development of human. However, the water resource system in karst regions is sensitive to external interference owing to the special geological processes which cause soil impoverishment, severe rocky desertification and large topographic height difference. Therefore, evaluating the sustainability of the water resource in karst regions is beneficial to reasonably use and protect water resource. This paper puts forward to evaluate the water resource from four aspects, including water resources system, water requirement system, ecosystem and social economic system. Moreover, on this basis, 18 evaluation indexes were selected to construct the sustainability evaluation index system and method. This method was used to evaluate the sustainability of the water resource in the typical karst region—Zunyi, Guizhou province, China, and was verified according to the actual situation in the research area. All these provide reference for the evaluation of the sustainability of the water resource in similar regions.

Factors influencing the results of faculty evaluation in Isfahan University of Medical Sciences.

PubMed

Kamali, Farahnaz; Yamani, Nikoo; Changiz, Tahereh; Zoubin, Fatemeh

2018-01-01

This study aimed to explore factors influencing the results of faculty member evaluation from the viewpoints of faculty members affiliated with Isfahan University of Medical Sciences, Isfahan, Iran. This qualitative study was done using a conventional content analysis method. Participants were faculty members of Isfahan University of Medical Sciences who, considering maximum variation in sampling, were chosen with a purposive sampling method. Semi-structured interviews were held with 11 faculty members until data saturation was reached. The interviews were transcribed verbatim and analyzed with conventional content analysis method for theme development. Further, the MAXQDA software was used for data management. The data analysis led to the development of two main themes, namely, "characteristics of the educational system" and "characteristics of the faculty member evaluation system." The first main theme consists of three categories, i.e. "characteristics of influential people in evaluation," "features of the courses," and "background characteristics." The other theme has the following as its categories: "evaluation methods," "evaluation tools," "evaluation process," and "application of evaluation results." Each category will have its subcategories. Many factors affect the evaluation of faculty members that should be taken into account by educational policymakers for improving the quality of the educational process. In addition to the factors that directly influence the educational system, methodological problems in the evaluation system need special attention.

Rural land mobile radio market assessment and satellite and terrestrial system concepts

NASA Technical Reports Server (NTRS)

Stevenson, S.; Provencher, C.

1984-01-01

The market for satellite-based mobile radio in the rural U.S. is evaluated, summarizing the results of two NASA-funded studies reported by Anderson et al. and Hornstein. The study aims are listed, and the results are presented in tables, graphs, and maps and discussed. Space systems are found to be competitive with land-based systems, providing superior service at lower subscriber charges, but having limited compatibility with urban cellular mobile-radio systems. Of the three system concepts evaluated from a technological standpoint (direct-to-mobile, mobile-translator, and hybrid), the mobile-translator concept is considered most cost effective, at least within the constraints assumed in the study.

Assessment of the impact of dipped guideways on urban rail transit systems: Ventilation and safety requirements

NASA Technical Reports Server (NTRS)

1982-01-01

The ventilation and fire safety requirements for subway tunnels with dipped profiles between stations as compared to subway tunnels with level profiles were evaluated. This evaluation is based upon computer simulations of a train fire emergency condition. Each of the tunnel configurations evaluated was developed from characteristics that are representative of modern transit systems. The results of the study indicate that: (1) The level tunnel system required about 10% more station cooling than dipped tunnel systems in order to meet design requirements; and (2) The emergency ventilation requirements are greater with dipped tunnel systems than with level tunnel systems.

Developing Guidelines for Assessing Visual Analytics Environments

DOE Office of Scientific and Technical Information (OSTI.GOV)

Scholtz, Jean

2011-07-01

In this paper, we develop guidelines for evaluating visual analytic environments based on a synthesis of reviews for the entries to the 2009 Visual Analytics Science and Technology (VAST) Symposium Challenge and from a user study with professional intelligence analysts. By analyzing the 2009 VAST Challenge reviews we gained a better understanding of what is important to our reviewers, both visualization researchers and professional analysts. We also report on a small user study with professional analysts to determine the important factors that they use in evaluating visual analysis systems. We then looked at guidelines developed by researchers in various domainsmore » and synthesized these into an initial set for use by others in the community. In a second part of the user study, we looked at guidelines for a new aspect of visual analytic systems – the generation of reports. Future visual analytic systems have been challenged to help analysts generate their reports. In our study we worked with analysts to understand the criteria they used to evaluate the quality of analytic reports. We propose that this knowledge will be useful as researchers look at systems to automate some of the report generation.1 Based on these efforts, we produced some initial guidelines for evaluating visual analytic environment and for evaluation of analytic reports. It is important to understand that these guidelines are initial drafts and are limited in scope because of the type of tasks for which the visual analytic systems used in the studies in this paper were designed. More research and refinement is needed by the Visual Analytics Community to provide additional evaluation guidelines for different types of visual analytic environments.« less

Measurement and evaluation of percolation drainage systems capacity in real conditions

NASA Astrophysics Data System (ADS)

Markovic, G.; Zelenakova, M.

2017-10-01

The drainage system must ensure a safe disposal of the surface water without endangering the buildings and safety of people. Despite the common use of rainwater infiltration facilities, there is still only limited data available evaluating the long-term capacity of such systems especially for underground infiltration facilities. This study presents experimental measurements and evaluation of long-term infiltration efficiency in real conditions and emphasizes the importance of hydrogeological survey. The measurements of infiltration efficiency were applied to an existing percolation drainage system - infiltration shafts. Infiltration shafts were made in year 2007 so that its drainage operation takes more than 8 years. This study was started in 2011 and still continues and presents 5 years measurements of infiltration efficiency for this infiltration facility.

Regulatory considerations on new adjuvants and delivery systems.

PubMed

Sesardic, D

2006-04-12

New and improved vaccines and delivery systems are increasingly being developed for prevention, treatment and diagnosis of human diseases. Prior to their use in humans, all new biological products must undergo pre-clinical evaluation. These pre-clinical studies are important not only to establish the biological properties of the material and to evaluate its possible risk to the public, but also to plan protocols for subsequent clinical trials from which safety and efficacy can be evaluated. For vaccines, evaluation in pre-clinical studies is particularly important as information gained may also contribute to identifying the optimum composition and formulation process and provide an opportunity to develop suitable indicator tests for quality control. Data from pre-clinical and laboratory evaluation studies, which continue during clinical studies, is used to support an application for marketing authorisation. Addition of a new adjuvant and exploration of new delivery systems for vaccines presents challenges to both manufacturers and regulatory authorities. Because no adjuvant is licensed as a medicinal product in its own right, but only as a component of a particular vaccine, pre-clinical and appropriate toxicology studies need to be designed on a case-by-case basis to evaluate the safety profile of the adjuvant and adjuvant/vaccine combination. Current regulatory requirements for the pharmaceutical and pre-clinical safety assessment of vaccines are insufficient and initiatives are in place to develop more specific guidelines for evaluation of adjuvants in vaccines.

Capturing system level activities and impacts of mental health consumer-run organizations.

PubMed

Janzen, Rich; Nelson, Geoffrey; Hausfather, Nadia; Ochocka, Joanna

2007-06-01

Since the 1970s mental health consumer-run organizations have come to offer not only mutual support, but they have also adopted agendas for broader social change. Despite an awareness of the need for system level efforts that create supportive environments for their members, there has been limited research demonstrating how their system level activities can be documented or their impacts evaluated. The purpose of this paper is to feature a method of evaluating systems change activities and impacts. The paper is based on a longitudinal study evaluating four mental health consumer-run organizations in Ontario, Canada. The study tracked system level activities and impacts using both qualitative and quantitative methodologies. The article begins by describing the development and implementation of these methods. Next it offers a critical analysis of the methods used. It concludes by reflecting on three lessons learned about capturing system level activities and impacts of mental health consumer-run organizations.

Engine system assessment study using Martian propellants

NASA Technical Reports Server (NTRS)

Pelaccio, Dennis; Jacobs, Mark; Scheil, Christine; Collins, John

1992-01-01

A top-level feasibility study was conducted that identified and characterized promising chemical propulsion system designs which use two or more of the following propellant combinations: LOX/H2, LOX/CH4, and LOX/CO. The engine systems examined emphasized the usage of common subsystem/component hardware where possible. In support of this study, numerous mission scenarios were characterized that used various combinations of Earth, lunar, and Mars propellants to establish engine system requirements to assess the promising engine system design concept examined, and to determine overall exploration leverage of such systems compared to state-of-the-art cryogenic (LOX/H2) propulsion systems. Initially in the study, critical propulsion system technologies were assessed. Candidate expander and gas generator cycle LOX/H2/CO, LOX/H2/CH4, and LOX/CO/CH4 engine system designs were parametrically evaluated. From this evaluation baseline, tripropellant Mars Transfer Vehicle (MTV) LOX cooled and bipropellant Lunar Excursion Vehicle (LEV) and Mars Excursion Vehicle (MEV) engine systems were identified. Representative tankage designs for a MTV were also investigated. Re-evaluation of the missions using the baseline engine design showed that in general the slightly lower performance, smaller, lower weight gas generator cycle-based engines required less overall mission Mars and in situ propellant production (ISPP) infrastructure support compared to the larger, heavier, higher performing expander cycle engine systems.

Implementation Issues of a Standards-Based Teacher Evaluation System: Perceptions of Campus Administrators

ERIC Educational Resources Information Center

Nixon, Lisa

2013-01-01

The purpose of this mixed methods study was to determine the key implementation issues of a standards-based teacher evaluation system as perceived by campus administrators. The 80 campus administrators that participated in this study were from six public school districts located in southeastern Texas that serve students in grades Kindergarten…

Distance Learning Students' Evaluation of E-Learning System in University of Tabuk, Saudi Arabia

ERIC Educational Resources Information Center

Al-Juda, Mefleh Qublan B.

2017-01-01

This study evaluates the experiences and perceptions of students regarding e-learning systems and their preparedness for e-learning. It also investigates the overall perceptions of students regarding e-learning and the factors influencing students' attitudes towards e-learning. The study uses convenience sampling in which students of the Education…

A CIS (Clinical Information System) Quality Evaluation Tool for Nursing Care Services

ERIC Educational Resources Information Center

Lee, Seon Ah

2010-01-01

The purpose of this study was to develop a tool to evaluate the quality of a clinical information system (CIS) conceived by nurses and conduct a pilot test with the developed tool as an initial assessment. CIS quality is required for successful implementation in information technology (IT) environments. The study started with the realization that…

Using vs. Being Used by School Information Systems.

ERIC Educational Resources Information Center

Sirotnik, Kenneth A.

This is one of a series of reports based on an ongoing reality test of systemic evaluation for instructional decision making. This feasibility study is being carried out by the Center for the Study of Evaluation with the Laboratory in School and Community Relations at a suburban Los Angeles high school (called Site A). Viewing a school as a…

Evaluating Language Environment Analysis System Performance for Chinese: A Pilot Study in Shanghai

ERIC Educational Resources Information Center

Gilkerson, Jill; Zhang, Yiwen; Xu, Dongxin; Richards, Jeffrey A.; Xu, Xiaojuan; Jiang, Fan; Harnsberger, James; Topping, Keith

2015-01-01

Purpose: The purpose of this study was to evaluate performance of the Language Environment Analysis (LENA) automated language-analysis system for the Chinese Shanghai dialect and Mandarin (SDM) languages. Method: Volunteer parents of 22 children aged 3-23 months were recruited in Shanghai. Families provided daylong in-home audio recordings using…

Effectiveness of an Online Automated Evaluation and Feedback System in an Introductory Computer Literacy Course

ERIC Educational Resources Information Center

Varank, Ilhan; Erkoç, M. Fatih; Büyükimdat, Meryem Köskeroglu; Aktas, Mehmet; Yeni, Sabiha; Adigüzel, Tufan; Cömert, Zafer; Esgin, Esad

2014-01-01

The purpose of this study was to investigate the effectiveness of an online automated evaluation and feedback system that assessed students' word processing assignments prepared with Microsoft Office Word. The participants of the study were 119 undergraduate teacher education students, 86 of whom were female and 32 were male, enrolled in different…

Methodological Considerations in Evaluating Long-Term Systems Change: A Case Study From Eastern Nepal

ERIC Educational Resources Information Center

Koleros, Andrew; Jupp, Dee; Kirwan, Sean; Pradhan, Meeta S.; Pradhan, Pushkar K.; Seddon, David; Tumbahangfe, Ansu

2016-01-01

This article presents discussion and recommendations on approaches to retrospectively evaluating development interventions in the long term through a systems lens. It is based on experiences from the implementation of an 18-month study to investigate the impact of development interventions on economic and social change over a 40-year period in the…

Evaluating Business Intelligence/Business Analytics Software for Use in the Information Systems Curriculum

ERIC Educational Resources Information Center

Davis, Gary Alan; Woratschek, Charles R.

2015-01-01

Business Intelligence (BI) and Business Analytics (BA) Software has been included in many Information Systems (IS) curricula. This study surveyed current and past undergraduate and graduate students to evaluate various BI/BA tools. Specifically, this study compared several software tools from two of the major software providers in the BI/BA field.…

Advanced life support study

NASA Technical Reports Server (NTRS)

1991-01-01

Summary reports on each of the eight tasks undertaken by this contract are given. Discussed here is an evaluation of a Closed Ecological Life Support System (CELSS), including modeling and analysis of Physical/Chemical Closed Loop Life Support (P/C CLLS); the Environmental Control and Life Support Systems (ECLSS) evolution - Intermodule Ventilation study; advanced technologies interface requirements relative to ECLSS; an ECLSS resupply analysis; the ECLSS module addition relocation systems engineering analysis; an ECLSS cost/benefit analysis to identify rack-level interface requirements of the alternate technologies evaluated in the ventilation study, with a comparison of these with the rack level interface requirements for the baseline technologies; advanced instrumentation - technology database enhancement; and a clean room survey and assessment of various ECLSS evaluation options for different growth scenarios.

Evaluated community fire safety interventions in the United States: a review of current literature.

PubMed

Ta, Van M; Frattaroli, Shannon; Bergen, Gwendolyn; Gielen, Andrea Carlson

2006-06-01

The purpose of the study was to assess the state of fire prevention research, provide an updated synthesis of evaluated fire prevention programs, and discuss the role of fire fighters and data systems in prevention efforts. The review included all evaluations of U.S. based fire prevention interventions published between January 1998 and September 2004 and any earlier articles about U.S. fire prevention interventions not included in two prior review articles. We retrieved information from each identified study including evaluation findings, involvement of fire service personnel and use of existing data systems. We identified twelve articles: seven reported on smoke alarm interventions, three on multi-faceted programs, and two other programs. Five programs involved fire service personnel in the design, implementation, and/or evaluation, and three used existing data systems. Studies reviewed suggest that canvassing and smoke alarm installations are the most effective means of distributing alarms and increasing the functional status of distributed alarms. The functionality of smoke alarms, an issue noted in earlier reviews, remains a problem. Programs involving partnerships with fire departments have indicated success in preventing fires and deaths, improving smoke alarm ownership and functional status, and improving children's fire safety knowledge. Using existing data systems to target and to evaluate interventions was effective. In the years since prior reviews, some improvements in the rigor of evaluation designs have been made, but there is still a need for high quality evaluations that will inform fire injury prevention efforts.

Evaluation of in-vehicle HMI using occlusion techniques: experimental results and practical implications.

PubMed

Baumann, Martin; Keinath, Andreas; Krems, Josef F; Bengler, Klaus

2004-05-01

Despite the usefulness of new on-board information systems one has to be concerned about the potential distraction effects that they impose on the driver. Therefore, methods and procedures are necessary to assess the visual demand that is connected to the usage of an on-board system. The occlusion-method is considered a strong candidate as a procedure for evaluating display designs with regard to their visual demand. This paper reports results from two experimental studies conducted to further evaluate this method. In the first study, performance in using an in-car navigation system was measured under three conditions: static (parking lot), occlusion (shutter glasses), and driving. The results show that the occlusion-procedure can be used to simulate visual requirements of real traffic conditions. In a second study the occlusion method was compared to a global evaluation criterion based on the total task time. It can be demonstrated that the occlusion method can identify tasks which meet this criterion, but are yet irresolvable under driving conditions. It is concluded that the occlusion technique seems to be a reliable and valid method for evaluating visual and dialogue aspects of in-car information systems.

NAS-Wide Fast-Time Simulation Study for Evaluating Performance of UAS Detect-and-Avoid Alerting and Guidance Systems

NASA Technical Reports Server (NTRS)

Lee, Seung Man; Park, Chunki; Cone, Andrew Clayton; Thipphavong, David P.; Santiago, Confesor

2016-01-01

This presentation contains the analysis results of NAS-wide fast-time simulations with UAS and VFR traffic for a single day for evaluating the performance of Detect-and-Avoid (DAA) alerting and guidance systems. This purpose of this study was to help refine and validate MOPS alerting and guidance requirements. In this study, we generated plots of all performance metrics that are specified by RTCA SC-228 Minimum Operational Performance Standards (MOPS): 1) to evaluate the sensitivity of alerting parameters on the performance metrics of each DAA alert type: Preventive, Corrective, and Warning alerts and 2) to evaluate the effect of sensor uncertainty on DAA alerting and guidance performance.

Doppler lidar power, aperture diameter, and FFT size trade-off study

NASA Astrophysics Data System (ADS)

Chester, David B.; Budge, Scott E.

2017-05-01

In the design or selection of a Doppler lidar instrument for a spacecraft landing system, it is important to evaluate the balance between performance requirements and cost, weight, and power consumption. Leveraging the capability of LadarSIM, a trade-off study was performed to evaluate the interaction between the laser transmission power, aperture diameter, and FFT size in a Doppler lidar system. For this study the probabilities of detection and false alarm were calculated using LadarSIM to simulate FMCW lidar systems with varying power, aperture diameter, and FFT size. This paper reports the results of this trade-off study.

Methods for evaluating information in managing the enterprise on the basis of a hybrid three-tier system

NASA Astrophysics Data System (ADS)

Vasil'ev, V. A.; Dobrynina, N. V.

2017-01-01

The article presents data on the influence of information upon the functioning of complex systems in the process of ensuring their effective management. Ways and methods for evaluating multidimensional information that reduce time and resources, improve the validity of the studied system management decisions, were proposed.

Design and operational energy studies in a new high-rise office building. Volume 4. Building automation analysis

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

1984-03-01

The objectives of the analysis are to evaluate the application of a number of building automation system capabilities using the Park Plaza Building as a case study. The study looks at the energy and cost effectiveness of some energy management strategies of the building automation system as well as some energy management strategies that are not currently a part of the building automation system. The strategies are also evaluated in terms of their reliability and usefulness in this building.

Sustainable healthcare: how to assess and improve healthcare structures' sustainability.

PubMed

Buffoli, M; Capolongo, S; Bottero, M; Cavagliato, E; Speranza, S; Volpatti, L

2013-01-01

Sustainability is a broad and debated subject, often difficult to be defined and applied into real projects, especially when dealing with a complex scenario as the one of healthcare. Many research studies and evaluation systems have handled this topic from different perspectives, but many limits and criticalities still have to be overcome to properly cope with actual needs. The Sustainable Healthcare project has been developed through three main phases: a deep study of the state of the art, unraveling pros and cons of available sustainability scoring systems; an accurate analysis of the stakeholders network and their needs; the realization of an objective evaluation framework, through scientific methods, as the ANP. The newly developed evaluation system takes into consideration all the three pillars of sustainability, analyzing social, environmental and economic sustainability through a set of criteria, specified by measurable indicators. So the system identifies both global sustainability and specific critical areas, pointing out possible strategic solutions to improve sustainability. The evaluation is achieved through technical analyses and qualitative surveys, which eventually allow to quantitatively assess sustainability, through a sound scoring method. This study proposes an innovative evaluation method to determine the sustainability of a hospital, already existing or in the design phase, within the European context. The Sustainable Healthcare system overcomes some of the current evaluation systems' limits by establishing a multidisciplinary approach and being an easy-to-use tool. This protocol is intended to be of support in the identification of the main hospital's weaknesses and in setting priorities for implementation of the solutions.

Advanced propulsion for LEO-Moon transport. 1: A method for evaluating advanced propulsion performance

NASA Technical Reports Server (NTRS)

Stern, Martin O.

1992-01-01

This report describes a study to evaluate the benefits of advanced propulsion technologies for transporting materials between low Earth orbit and the Moon. A relatively conventional reference transportation system, and several other systems, each of which includes one advanced technology component, are compared in terms of how well they perform a chosen mission objective. The evaluation method is based on a pairwise life-cycle cost comparison of each of the advanced systems with the reference system. Somewhat novel and economically important features of the procedure are the inclusion not only of mass payback ratios based on Earth launch costs, but also of repair and capital acquisition costs, and of adjustments in the latter to reflect the technological maturity of the advanced technologies. The required input information is developed by panels of experts. The overall scope and approach of the study are presented in the introduction. The bulk of the paper describes the evaluation method; the reference system and an advanced transportation system, including a spinning tether in an eccentric Earth orbit, are used to illustrate it.

Portable handheld diffuse reflectance spectroscopy system for clinical evaluation of skin: a pilot study in psoriasis patients

PubMed Central

Tzeng, Shih-Yu; Guo, Jean-Yan; Yang, Chao-Chun; Hsu, Chao-Kai; Huang, Hung Ji; Chou, Shih-Jie; Hwang, Chi-Hung; Tseng, Sheng-Hao

2016-01-01

Diffuse reflectance spectroscopy (DRS) has been utilized to study biological tissues for a variety of applications. However, many DRS systems are not designed for handheld use and/or relatively expensive which limit the extensive clinical use of this technique. In this paper, we report a handheld, low-cost DRS system consisting of a light source, optical switch, and a spectrometer, that can precisely quantify the optical properties of tissue samples in the clinical setting. The handheld DRS system was employed to determine the skin chromophore concentrations, absorption and scattering properties of 11 patients with psoriasis. The measurement results were compared to the clinical severity of psoriasis as evaluated by dermatologist using PASI (Psoriasis Area and Severity Index) scores. Our statistical analyses indicated that the handheld DRS system could be a useful non-invasive tool for objective evaluation of the severity of psoriasis. It is expected that the handheld system can be used for the objective evaluation and monitoring of various skin diseases such as keloid and psoriasis. PMID:26977366

Vestibular models for design and evaluation of flight simulator motion

NASA Technical Reports Server (NTRS)

Bussolari, S. R.; Sullivan, R. B.; Young, L. R.

1986-01-01

The use of spatial orientation models in the design and evaluation of control systems for motion-base flight simulators is investigated experimentally. The development of a high-fidelity motion drive controller using an optimal control approach based on human vestibular models is described. The formulation and implementation of the optimal washout system are discussed. The effectiveness of the motion washout system was evaluated by studying the response of six motion washout systems to the NASA/AMES Vertical Motion Simulator for a single dash-quick-stop maneuver. The effects of the motion washout system on pilot performance and simulator acceptability are examined. The data reveal that human spatial orientation models are useful for the design and evaluation of flight simulator motion fidelity.

Evaluating a Web-Based Interface for Internet Telemedicine

NASA Technical Reports Server (NTRS)

Lathan, Corinna E.; Newman, Dava J.; Sebrechts, Marc M.; Doarn, Charles R.

1997-01-01

The objective is to introduce the usability engineering methodology, heuristic evaluation, to the design and development of a web-based telemedicine system. Using a set of usability criteria, or heuristics, one evaluator examined the Spacebridge to Russia web-site for usability problems. Thirty-four usability problems were found in this preliminary study and all were assigned a severity rating. The value of heuristic analysis in the iterative design of a system is shown because the problems can be fixed before deployment of a system and the problems are of a different nature than those found by actual users of the system. It was therefore determined that there is potential value of heuristic evaluation paired with user testing as a strategy for optimal system performance design.

Space Station communications and tracking systems modeling and RF link simulation

NASA Technical Reports Server (NTRS)

Tsang, Chit-Sang; Chie, Chak M.; Lindsey, William C.

1986-01-01

In this final report, the effort spent on Space Station Communications and Tracking System Modeling and RF Link Simulation is described in detail. The effort is mainly divided into three parts: frequency division multiple access (FDMA) system simulation modeling and software implementation; a study on design and evaluation of a functional computerized RF link simulation/analysis system for Space Station; and a study on design and evaluation of simulation system architecture. This report documents the results of these studies. In addition, a separate User's Manual on Space Communications Simulation System (SCSS) (Version 1) documents the software developed for the Space Station FDMA communications system simulation. The final report, SCSS user's manual, and the software located in the NASA JSC system analysis division's VAX 750 computer together serve as the deliverables from LinCom for this project effort.

Cooperative Conflict Avoidance Sensor Trade Study Report, Version 2

NASA Technical Reports Server (NTRS)

2004-01-01

This study develops evaluation criteria for systems and technologies against the Cooperative Conflict Avoidance (CCA) requirements for unmanned flight at and above FL430 as part of Step 1 of the Access-5 program. These evaluation criteria are then applied to both current and future technologies to identify those which might be used to provide an Equivalent Level of Safety (ELOS) for CCA. This document provides the results of this analysis of various systems and technologies intended for evaluation as part of the CCA work package.

Manned space flight nuclear system safety. Volume 7: Literature review. Part 1: Literature search and evaluation

NASA Technical Reports Server (NTRS)

1972-01-01

A review of the literature used in conducting the manned space flight nuclear system safety study is presented. The objectives of the presentation are to identify and evaluate for potential application to study the existing related literature and to provide the information required to include the related literature in the NASA Aerospace Safety Research and Data Institute. More than 15,000 documents were evaluated and identification forms were prepared for 850 reports.

Can Principals Promote Teacher Development as Evaluators? A Case Study of Principals’ Views and Experiences

PubMed Central

Kraft, Matthew A.; Gilmour, Allison

2017-01-01

Purpose New teacher evaluation systems have expanded the role of principals as instructional leaders, but little is known about principals’ ability to promote teacher development through the evaluation process. We conducted a case study of principals’ perspectives on evaluation and their experiences implementing observation and feedback cycles to better understand whether principals feel as though they are able to promote teacher development as evaluators. Research Methods We conducted interviews with a stratified random sample of 24 principals in an urban district that recently implemented major reforms to its teacher evaluation system. We analyzed these interviews by drafting thematic summaries, coding interview transcripts, creating data-analytic matrices, and writing analytic memos. Findings We found that the evaluation reforms provided a common framework and language that helped facilitate principals’ feedback conversations with teachers. However, we also found that tasking principals with primary responsibility for conducting evaluations resulted in a variety of unintended consequences which undercut the quality of evaluation feedback they provided. We analyze five broad solutions to these challenges: strategically targeting evaluations, reducing operational responsibilities, providing principal training, hiring instructional coaches, and developing peer evaluation systems. Implications The quality of feedback teachers receive through the evaluation process depends critically on the time and training evaluators have to provide individualized and actionable feedback. Districts that task principals with primary responsibility for conducting observation and feedback cycles must attend to the many implementation challenges associated with this approach in order for next-generation evaluation systems to successfully promote teacher development. PMID:28729742

Systems of attitudes towards production in the pork industry. A cross-national study.

PubMed

Sørensen, Bjarne Taulo; Barcellos, Marcia Dutra de; Olsen, Nina Veflen; Verbeke, Wim; Scholderer, Joachim

2012-12-01

Existing research on public attitudes towards agricultural production systems is largely descriptive, abstracting from the processes through which members of the general public generate their evaluations of such systems. The present paper adopts a systems perspective on such evaluations, understanding them as embedded into a wider attitude system that consists of attitudes towards objects of different abstraction levels, ranging from personal value orientations over general socio-political attitudes to evaluations of specific characteristics of agricultural production systems. It is assumed that evaluative affect propagates through the system in such a way that the system becomes evaluatively consistent and operates as a schema for the generation of evaluative judgments. In the empirical part of the paper, the causal structure of an attitude system from which people derive their evaluations of pork production systems was modelled. The analysis was based on data from a cross-national survey involving 1931 participants from Belgium, Denmark, Germany and Poland. The survey questionnaire contained measures of personal value orientations and attitudes towards environment and nature, industrial food production, food and the environment, technological progress, animal welfare, local employment and local economy. In addition, the survey included a conjoint task by which participants' evaluations of the importance of production system attributes were measured. The data were analysed by means of causal search algorithms and structural equation models. The results suggest that evaluative judgments of the importance of pork production system attributes are generated in a schematic manner, driven by personal value orientations. The effect of personal value orientations was strong and largely unmediated by attitudes of an intermediate level of generality, suggesting that the dependent variables in the particular attitude system that was modelled here can be understood as value judgments in a literal sense. Copyright © 2012. Published by Elsevier Ltd.

Controlled ecological life support system: Transportation analysis

NASA Technical Reports Server (NTRS)

Gustan, E.; Vinopal, T.

1982-01-01

This report discusses a study utilizing a systems analysis approach to determine which NASA missions would benefit from controlled ecological life support system (CELSS) technology. The study focuses on manned missions selected from NASA planning forecasts covering the next half century. Comparison of various life support scenarios for the selected missions and characteristics of projected transportation systems provided data for cost evaluations. This approach identified missions that derived benefits from a CELSS, showed the magnitude of the potential cost savings, and indicated which system or combination of systems would apply. This report outlines the analytical approach used in the evaluation, describes the missions and systems considered, and sets forth the benefits derived from CELSS when applicable.

Part-Time Faculty Evaluation: A Campus Case Study.

ERIC Educational Resources Information Center

Williams, James P.

For the past 13 years, the Verde Valley Campus of Yavapai College, in Arizona, has used the same system to evaluate part-time faculty in an effort to both maintain quality control and provide feedback to part-time faculty and address their concerns. The system utilizes two instruments to gather evaluative data. The first is used to determine…

Integrating Program Theory and Systems-Based Procedures in Program Evaluation: A Dynamic Approach to Evaluate Educational Programs

ERIC Educational Resources Information Center

Grammatikopoulos, Vasilis

2012-01-01

The current study attempts to integrate parts of program theory and systems-based procedures in educational program evaluation. The educational program that was implemented, called the "Early Steps" project, proposed that physical education can contribute to various educational goals apart from the usual motor skills improvement. Basic…

Will Courts Shape Value-Added Methods for Teacher Evaluation? ACT Working Paper Series. WP-2014-2

ERIC Educational Resources Information Center

Croft, Michelle; Buddin, Richard

2014-01-01

As more states begin to adopt teacher evaluation systems based on value-added measures, legal challenges have been filed both seeking to limit the use of value-added measures ("Cook v. Stewart") and others seeking to require more robust evaluation systems ("Vergara v. California"). This study reviews existing teacher evaluation…

Safety and efficacy of the predictive low glucose management system in the prevention of hypoglycaemia: protocol for randomised controlled home trial to evaluate the Suspend before low function

PubMed Central

Abraham, M B; Nicholas, J A; Ly, T T; Roby, H C; Paramalingam, N; Fairchild, J; King, B R; Ambler, G R; Cameron, F; Davis, E A; Jones, T W

2016-01-01

Introduction Innovations with sensor-augmented pump therapy (SAPT) to reduce hypoglycaemia in patients with type 1 diabetes are an ongoing area of research. The predictive low glucose management (PLGM) system incorporates continuous glucose sensor data into an algorithm and suspends basal insulin before the occurrence of hypoglycaemia. The system was evaluated in in-clinic studies, and has informed the parameters of a larger home trial to study its efficacy and safety in real life. Methods and analysis The aim of this report is to describe the study design and outcome measures for the trial. This is a 6-month, multicentre, randomised controlled home trial to test the PLGM system in children and adolescents with type 1 diabetes. The system is available in the Medtronic MiniMed 640G pump as the ‘Suspend before low’ feature. Following a run-in period, participants are randomised to either the control arm with SAPT alone or the intervention arm with SAPT and Suspend before low. The primary aim of this study is to evaluate the time spent hypoglycaemic (sensor glucose <3.5 mmol/L) with and without the system. The secondary aims are to determine the number of hypoglycaemic events, the time spent hyperglycaemic, and to evaluate safety with ketosis and changes in glycated haemoglobin. The study also aims to assess the changes in counter-regulatory hormone responses to hypoglycaemia evaluated by a hyperinsulinaemic hypoglycaemic clamp in a subgroup of patients with impaired awareness. Validated questionnaires are used to measure the fear of hypoglycaemia and the impact on the quality of life to assess burden of the disease. Ethics and dissemination Ethics committee permissions were gained from respective Institutional Review boards. The findings of the study will provide high quality evidence of the ability of the system in the prevention of hypoglycaemia in real life. Trial registration number ACTRN12614000510640, Pre-results. PMID:27084290

Quality Attribute-Guided Evaluation of NoSQL Databases: A Case Study

DTIC Science & Technology

2015-01-16

evaluations of NoSQL databases specifically, and big data systems in general, that have become apparent during our study. Keywords—NoSQL, distributed...technology, namely that of big data , software systems [1]. At the heart of big data systems are a collection of database technologies that are more...born organizations such as Google and Amazon [3][4], along with those of numerous other big data innovators, have created a variety of open source and

Comparison of heuristic and cognitive walkthrough usability evaluation methods for evaluating health information systems.

PubMed

Khajouei, Reza; Zahiri Esfahani, Misagh; Jahani, Yunes

2017-04-01

There are several user-based and expert-based usability evaluation methods that may perform differently according to the context in which they are used. The objective of this study was to compare 2 expert-based methods, heuristic evaluation (HE) and cognitive walkthrough (CW), for evaluating usability of health care information systems. Five evaluators independently evaluated a medical office management system using HE and CW. We compared the 2 methods in terms of the number of identified usability problems, their severity, and the coverage of each method. In total, 156 problems were identified using the 2 methods. HE identified a significantly higher number of problems related to the "satisfaction" attribute ( P  = .002). The number of problems identified using CW concerning the "learnability" attribute was significantly higher than those identified using HE ( P  = .005). There was no significant difference between the number of problems identified by HE, based on different usability attributes ( P  = .232). Results of CW showed a significant difference between the number of problems related to usability attributes ( P  < .0001). The average severity of problems identified using CW was significantly higher than that of HE ( P  < .0001). This study showed that HE and CW do not differ significantly in terms of the number of usability problems identified, but they differ based on the severity of problems and the coverage of some usability attributes. The results suggest that CW would be the preferred method for evaluating systems intended for novice users and HE for users who have experience with similar systems. However, more studies are needed to support this finding. © The Author 2016. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com

Highway Air Pollution Dispersion Modeling : Preliminary Evaluation of Thirteen Models

DOT National Transportation Integrated Search

1978-06-01

Thirteen highway air pollution dispersion models have been tested, using a portion of the Airedale air quality data base. The Transportation Air Pollution Studies (TAPS) System, a data base management system specifically designed for evaluating dispe...

Highway Air Pollution Dispersion Modeling : Preliminary Evaluation of Thirteen Models

DOT National Transportation Integrated Search

1977-01-01

Thirteen highway air pollution dispersion models have been tested, using a portion of the Airedale air quality data base. The Transportation Air Pollution Studies (TAPS) System, a data base management system specifically designed for evaluating dispe...

A data fusion framework for meta-evaluation of intelligent transportation system effectiveness

DOT National Transportation Integrated Search

This study presents a framework for the meta-evaluation of Intelligent Transportation System effectiveness. The framework is based on data fusion approaches that adjust for data biases and violations of other standard statistical assumptions. Operati...

PRACA Enhancement Pilot Study Report: Engineering for Complex Systems Program (formerly Design for Safety), DFS-IC-0006

NASA Technical Reports Server (NTRS)

Korsmeyer, David; Schreiner, John

2002-01-01

This technology evaluation report documents the findings and recommendations of the Engineering for Complex Systems Program (formerly Design for Safety) PRACA Enhancement Pilot Study of the Space Shuttle Program's (SSP's) Problem Reporting and Corrective Action (PRACA) System. A team at NASA Ames Research Center (ARC) performed this Study. This Study was initiated as a follow-on to the NASA chartered Shuttle Independent Assessment Team (SIAT) review (performed in the Fall of 1999) which identified deficiencies in the current PRACA implementation. The Pilot Study was launched with an initial qualitative assessment and technical review performed during January 2000 with the quantitative formal Study (the subject of this report) started in March 2000. The goal of the PRACA Enhancement Pilot Study is to evaluate and quantify the technical aspects of the SSP PRACA systems and recommend enhancements to address deficiencies and in preparation for future system upgrades.

Performance of an Automated-Mixed-Traffic-Vehicle /AMTV/ System. [urban people mover

NASA Technical Reports Server (NTRS)

Peng, T. K. C.; Chon, K.

1978-01-01

This study analyzes the operation and evaluates the expected performance of a proposed automatic guideway transit system which uses low-speed Automated Mixed Traffic Vehicles (AMTV's). Vehicle scheduling and headway control policies are evaluated with a transit system simulation model. The effect of mixed-traffic interference on the average vehicle speed is examined with a vehicle-pedestrian interface model. Control parameters regulating vehicle speed are evaluated for safe stopping and passenger comfort.

Towards a Clinical Trial Protocol to Evaluate Health Information Systems: Evaluation of a Computerized System for Monitoring Tuberculosis from a Patient Perspective in Brazil.

PubMed

Crepaldi, Nathalia Yukie; de Lima, Inacia Bezerra; Vicentine, Fernanda Bergamini; Rodrigues, Lídia Maria Lourençon; Sanches, Tiago Lara Michelin; Ruffino-Netto, Antonio; Alves, Domingos; Rijo, Rui Pedro Charters Lopes

2018-05-08

Assessment of health information systems consider different aspects of the system itself. They focus or on the professional who will use the software or on its usability or on the software engineering metrics or on financial and managerial issues. The existent approaches are very resources consuming, disconnected, and not standardized. As the software becomes more critical in the health organizations and in patients, becoming used as a medical device or a medicine, there is an urgency to identify tools and methods that can be applied in the development process. The present work is one of the steps of a broader study to identify standardized protocols to evaluate the health information systems as medicines and medical devices are evaluated by clinical trials. The goal of the present work was to evaluate the effect of the introduction of an information system for monitoring tuberculosis treatment (SISTB) in a Brazilian municipality from the patients' perspective. The Patient Satisfaction Questionnaire and the Hospital Consumer Assessment of Healthcare Providers and Systems were answered by the patients before and after the SISTB introduction, for comparison. Patients from an outpatient clinic, formed the control group, that is, at this site was not implanted the SISTB. Descriptive statistics and mixed effects model were used for data analysis. Eighty-eight interviews were conducted in the study. The questionnaire's results presented better averages after the system introduction but were not considered statistically significant. Therefore, it was not possible to associate system implantation with improved patient satisfaction. The HIS evaluation need be complete, the technical and managerial evaluation, the safety, the impact on the professionals and direct and/or indirect impact on patients are important. Developing the right tools and methods that can evaluate the software in its entirety, from the beginning of the development cycle with a normalized scale, are needed.

User-oriented evaluation of a medical image retrieval system for radiologists.

PubMed

Markonis, Dimitrios; Holzer, Markus; Baroz, Frederic; De Castaneda, Rafael Luis Ruiz; Boyer, Célia; Langs, Georg; Müller, Henning

2015-10-01

This article reports the user-oriented evaluation of a text- and content-based medical image retrieval system. User tests with radiologists using a search system for images in the medical literature are presented. The goal of the tests is to assess the usability of the system, identify system and interface aspects that need improvement and useful additions. Another objective is to investigate the system's added value to radiology information retrieval. The study provides an insight into required specifications and potential shortcomings of medical image retrieval systems through a concrete methodology for conducting user tests. User tests with a working image retrieval system of images from the biomedical literature were performed in an iterative manner, where each iteration had the participants perform radiology information seeking tasks and then refining the system as well as the user study design itself. During these tasks the interaction of the users with the system was monitored, usability aspects were measured, retrieval success rates recorded and feedback was collected through survey forms. In total, 16 radiologists participated in the user tests. The success rates in finding relevant information were on average 87% and 78% for image and case retrieval tasks, respectively. The average time for a successful search was below 3 min in both cases. Users felt quickly comfortable with the novel techniques and tools (after 5 to 15 min), such as content-based image retrieval and relevance feedback. User satisfaction measures show a very positive attitude toward the system's functionalities while the user feedback helped identifying the system's weak points. The participants proposed several potentially useful new functionalities, such as filtering by imaging modality and search for articles using image examples. The iterative character of the evaluation helped to obtain diverse and detailed feedback on all system aspects. Radiologists are quickly familiar with the functionalities but have several comments on desired functionalities. The analysis of the results can potentially assist system refinement for future medical information retrieval systems. Moreover, the methodology presented as well as the discussion on the limitations and challenges of such studies can be useful for user-oriented medical image retrieval evaluation, as user-oriented evaluation of interactive system is still only rarely performed. Such interactive evaluations can be limited in effort if done iteratively and can give many insights for developing better systems. Copyright © 2015. Published by Elsevier Ireland Ltd.

Can Principals Promote Teacher Development as Evaluators? A Case Study of Principals' Views and Experiences

ERIC Educational Resources Information Center

Kraft, Matthew A.; Gilmour, Allison F.

2016-01-01

Purpose: New teacher evaluation systems have expanded the role of principals as instructional leaders, but little is known about principals' ability to promote teacher development through the evaluation process. We conducted a case study of principals' perspectives on evaluation and their experiences implementing observation and feedback cycles to…

Decision analysis for a data collection system of patient-controlled analgesia with a multi-attribute utility model.

PubMed

Lee, I-Jung; Huang, Shih-Yu; Tsou, Mei-Yung; Chan, Kwok-Hon; Chang, Kuang-Yi

2010-10-01

Data collection systems are very important for the practice of patient-controlled analgesia (PCA). This study aimed to evaluate 3 PCA data collection systems and selected the most favorable system with the aid of multiattribute utility (MAU) theory. We developed a questionnaire with 10 items to evaluate the PCA data collection system and 1 item for overall satisfaction based on MAU theory. Three systems were compared in the questionnaire, including a paper record, optic card reader and personal digital assistant (PDA). A pilot study demonstrated a good internal and test-retest reliability of the questionnaire. A weighted utility score combining the relative importance of individual items assigned by each participant and their responses to each question was calculated for each system. Sensitivity analyses with distinct weighting protocols were conducted to evaluate the stability of the final results. Thirty potential users of a PCA data collection system were recruited in the study. The item "easy to use" had the highest median rank and received the heaviest mean weight among all items. MAU analysis showed that the PDA system had a higher utility score than that in the other 2 systems. Sensitivity analyses revealed that both inverse and reciprocal weighting processes favored the PDA system. High correlations between overall satisfaction and MAU scores from miscellaneous weighting protocols suggested a good predictive validity of our MAU-based questionnaire. The PDA system was selected as the most favorable PCA data collection system by the MAU analysis. The item "easy to use" was the most important attribute of the PCA data collection system. MAU theory can evaluate alternatives by taking into account individual preferences of stakeholders and aid in better decision-making. Copyright © 2010 Elsevier. Published by Elsevier B.V. All rights reserved.

Study on index system of GPS interference effect evaluation

NASA Astrophysics Data System (ADS)

Zhang, Kun; Zeng, Fangling; Zhao, Yuan; Zeng, Ruiqi

2018-05-01

Satellite navigation interference effect evaluation is the key technology to break through the research of Navigation countermeasure. To evaluate accurately the interference degree and Anti-jamming ability of GPS receiver, this text based on the existing research results of Navigation interference effect evaluation, build the index system of GPS receiver effectiveness evaluation from four levels of signal acquisition, tracking, demodulation and positioning/timing and establish the model for each index. These indexes can accurately and quantitatively describe the interference effect at all levels.

Performance evaluation of thermophotovoltaic GaSb cell technology in high temperature waste heat

NASA Astrophysics Data System (ADS)

Utlu, Z.; Önal, B. S.

2018-02-01

In this study, waste heat was evaluated and examined by means of thermophotovoltaic systems with the application of energy production potential GaSb cells. The aim of our study is to examine GaSb cell technology at high temperature waste heat. The evaluation of the waste heat to be used in the system is designed to be used in the electricity, industry and iron and steel industry. Our work is research. Graphic analysis is done with Matlab program. The high temperature waste heat graphs applied on the GaSb cell are in the results section. Our study aims to provide a source for future studies.

Wavelet-based compression of pathological images for telemedicine applications

NASA Astrophysics Data System (ADS)

Chen, Chang W.; Jiang, Jianfei; Zheng, Zhiyong; Wu, Xue G.; Yu, Lun

2000-05-01

In this paper, we present the performance evaluation of wavelet-based coding techniques as applied to the compression of pathological images for application in an Internet-based telemedicine system. We first study how well suited the wavelet-based coding is as it applies to the compression of pathological images, since these images often contain fine textures that are often critical to the diagnosis of potential diseases. We compare the wavelet-based compression with the DCT-based JPEG compression in the DICOM standard for medical imaging applications. Both objective and subjective measures have been studied in the evaluation of compression performance. These studies are performed in close collaboration with expert pathologists who have conducted the evaluation of the compressed pathological images and communication engineers and information scientists who designed the proposed telemedicine system. These performance evaluations have shown that the wavelet-based coding is suitable for the compression of various pathological images and can be integrated well with the Internet-based telemedicine systems. A prototype of the proposed telemedicine system has been developed in which the wavelet-based coding is adopted for the compression to achieve bandwidth efficient transmission and therefore speed up the communications between the remote terminal and the central server of the telemedicine system.

Applicability evaluation of Deep Eutectic Solvents-Cellulase system for lignocellulose hydrolysis.

PubMed

Gunny, Ahmad Anas Nagoor; Arbain, Dachyar; Nashef, Enas Muen; Jamal, Parveen

2015-04-01

Deep Eutectic Solvents (DESs) have recently emerged as a new generation of ionic liquids for lignocellulose pretreatment. However, DESs contain salt components which tend to inactivate cellulase in the subsequent saccharification process. To alleviate this problem, it is necessary to evaluate the applicability of the DESs-Cellulase system. This was accomplished in the present study by first studying the stability of cellulase in the presence of selected DESs followed by applicability evaluation based on glucose production, energy consumption and kinetic performance. Results showed that the cellulase was able to retain more than 90% of its original activity in the presence of 10% (v/v) for glycerol based DES (GLY) and ethylene glycol based DES (EG). Furthermore, both DESs system exhibited higher glucose percentage enhancement and lower energy consumption as compared to diluted alkali system. Among the two DESs studied, EG showed comparatively better kinetic performance. Copyright © 2015 Elsevier Ltd. All rights reserved.

Integrating Soft Set Theory and Fuzzy Linguistic Model to Evaluate the Performance of Training Simulation Systems

PubMed Central

Chang, Kuei-Hu; Chang, Yung-Chia; Chain, Kai; Chung, Hsiang-Yu

2016-01-01

The advancement of high technologies and the arrival of the information age have caused changes to the modern warfare. The military forces of many countries have replaced partially real training drills with training simulation systems to achieve combat readiness. However, considerable types of training simulation systems are used in military settings. In addition, differences in system set up time, functions, the environment, and the competency of system operators, as well as incomplete information have made it difficult to evaluate the performance of training simulation systems. To address the aforementioned problems, this study integrated analytic hierarchy process, soft set theory, and the fuzzy linguistic representation model to evaluate the performance of various training simulation systems. Furthermore, importance–performance analysis was adopted to examine the influence of saving costs and training safety of training simulation systems. The findings of this study are expected to facilitate applying military training simulation systems, avoiding wasting of resources (e.g., low utility and idle time), and providing data for subsequent applications and analysis. To verify the method proposed in this study, the numerical examples of the performance evaluation of training simulation systems were adopted and compared with the numerical results of an AHP and a novel AHP-based ranking technique. The results verified that not only could expert-provided questionnaire information be fully considered to lower the repetition rate of performance ranking, but a two-dimensional graph could also be used to help administrators allocate limited resources, thereby enhancing the investment benefits and training effectiveness of a training simulation system. PMID:27598390

Integrating Soft Set Theory and Fuzzy Linguistic Model to Evaluate the Performance of Training Simulation Systems.

PubMed

Chang, Kuei-Hu; Chang, Yung-Chia; Chain, Kai; Chung, Hsiang-Yu

2016-01-01

The advancement of high technologies and the arrival of the information age have caused changes to the modern warfare. The military forces of many countries have replaced partially real training drills with training simulation systems to achieve combat readiness. However, considerable types of training simulation systems are used in military settings. In addition, differences in system set up time, functions, the environment, and the competency of system operators, as well as incomplete information have made it difficult to evaluate the performance of training simulation systems. To address the aforementioned problems, this study integrated analytic hierarchy process, soft set theory, and the fuzzy linguistic representation model to evaluate the performance of various training simulation systems. Furthermore, importance-performance analysis was adopted to examine the influence of saving costs and training safety of training simulation systems. The findings of this study are expected to facilitate applying military training simulation systems, avoiding wasting of resources (e.g., low utility and idle time), and providing data for subsequent applications and analysis. To verify the method proposed in this study, the numerical examples of the performance evaluation of training simulation systems were adopted and compared with the numerical results of an AHP and a novel AHP-based ranking technique. The results verified that not only could expert-provided questionnaire information be fully considered to lower the repetition rate of performance ranking, but a two-dimensional graph could also be used to help administrators allocate limited resources, thereby enhancing the investment benefits and training effectiveness of a training simulation system.

Evaluation of the Effect of Silicone Contamination on Various Bond Systems and the Feasibility of Removing the Contamination

NASA Technical Reports Server (NTRS)

Stanley, Stephanie D.

2008-01-01

Silicone is a contaminant that can cause catastrophic failure of a bond system depending on the materials and processes used to fabricate the bond system, Unfortunately, more and more materials are fabricated using silicone. The purpose of this testing was to evaluate which bond systems are sensitive to silicone contamination and whether or not a cleaning process could be utilized to remove the silicone to bring the bond system performance back to baseline. Due to the extensive nature of the testing attempts will be made to generalize the understanding within classes of substrates, bond systems, and surface preparation and cleaning methods. This study was done by contaminating various meta! (steel, inconel, and aluminum), phenolic (carbon cloth phenolic and glass cloth phenolic), and rubber (natural rubber, asbestos-silicone dioxide filled natural butyldiene rubber, silica-filled ethylene propylenediene monomer, and carbon-filled ethylene propylenediene monomer) substrates which were then bonded using various adhesives and coatings (epoxy-based adhesives, paints, ablative compounds, and Chemlok adhesives) to determine the effect silicone contamination has on a given bond system's performance. The test configurations depended on the bond system being evaluated. The study also evaluated the feasibility of removing the silicone contamination by cleaning the contaminated substrate prior to bonding. The cleaning processes also varied depending on bond system.

Evaluation of Contaminant-Promoted Ignition in Scuba Equipment and Breathing Gas Delivery Systems

NASA Technical Reports Server (NTRS)

Forsyth, Elliott T.; Durkin, Robert; Beeson, Harold D.

2000-01-01

As the underwater diving industry continues to use greater concentrations of oxygen in their scuba systems, ignition of contaminants in these systems becomes a greater concern. Breathing gas makeup and distribution systems typically combine pure oxygen with various diluents to supply high-pressure cylinders for scuba applications. The hazards associated with these applications of oxygen and NITROX (oxygen and nitrogen mixture) gases require an evaluation of inherent contaminant levels and their associated promoted-ignition thresholds in these environments. In this study, several scuba component assemblies were tested after one year of use at the NASA Johnson Space Center Neutral Buoyancy Lab. The components were rapidly impacted with 50% NITROX gas to demonstrate their ignition resistance, then disassembled to evaluate their cleanliness. A follow-up study was then performed on the ignition thresholds of hydrocarbon-bascd oil films in oxygen and NITROX environments in an attempt to define the cleaning requirements for these systems. Stainless steel tubes were contaminated and verified to known levels and placed in a pneumatic impact test system where they were rapidly pressurized with the test gas. Ignitions were determined using a photodiode connected to the end of the contaminated tube. The results of the scuba component tests, cleanliness evaluation, and contaminant ignition study are discussed and compared for 50% NITROX and 100% oxygen environments.

Evaluation of Filtration and UV Disinfection for Inactivation of ...

EPA Pesticide Factsheets

This study evaluated filtration and disinfection processes for removal and inactivation of pathogens in non-community water systems (NCWS) in two surface water supplies. Pretreatment systems included 1) pressure sand filtration, and 2) granular activated carbon adsorption, and 3) cartridge filtration. Two types of low-pressure UV systems were evaluated with and without pretreatment systems. The presentation will provide results for removal of particles and inactivation of MS2 bacteriophage (a viral surrogate) on two surface waters in northeastern Minnesota. Several studies, including a recent study conducted by Minnesota Department of Health (MDH), show that viruses occur in groundwater at a higher rate than expected. Based on preliminary results in Minnesota, virus occurrence appears to be correlated with recharge events such as heavy rainfall and snowmelt. These recharge events are predicted to become more extreme due to climate change impacts. Filtration, ultraviolet (UV) disinfection, and chlorination, can provide a multi-barrier approach for removal or inactivation of pathogens and DBP precursors in both groundwater and surface water systems.

Asynchronous Cooperative e-Learning System and Its Evaluation

NASA Astrophysics Data System (ADS)

Eto, Kazuhiro; Miyoshi, Takumi

Much attention has been attracted to collaborative learning on an e-learning system. However, it is difficult to implement the collaborative environment to an asynchronous e-learning system since collaboration would be realized only when learners join the system at the same time. On the other hand, cooperative learning has been proposed. In this method, learners can study on their own pace without making mutual agreement but with receiving cognitive information from others. In this paper, the authors have developed the asynchronous cooperative e-learning system that provides learners' attendance and studying progress as the cognitive information. The subjective evaluation experiments show that our system is slightly inferior to the synchronous collaborative e-learning system, but it can motivate the learners more than the conventional system.

Systems Operations Studies for Automated Guideway Transit Systems : Quantitative Analysis of Alternative AGT Operational Control Strategies

DOT National Transportation Integrated Search

1981-10-01

The objectives of the Systems Operation Studies (SOS) for automated guideway transit (AGT) systems are to develop models for the analysis of system operations, to evaluate performance and cost, and to establish guidelines for the design and operation...

Development and application of course-embedded assessment system for program outcome evaluation in the Korean nursing education: A pilot study.

PubMed

Park, Jee Won; Seo, Eun Ji; You, Mi-Ae; Song, Ju-Eun

2016-03-01

Program outcome evaluation is important because it is an indicator for good quality of education. Course-embedded assessment is one of the program outcome evaluation methods. However, it is rarely used in Korean nursing education. The study purpose was to develop and apply preliminarily a course-embedded assessment system to evaluate one program outcome and to share our experiences. This was a methodological study to develop and apply the course-embedded assessment system based on the theoretical framework in one nursing program in South Korea. Scores for 77 students generated from the three practicum courses were used. The course-embedded assessment system was developed following the six steps suggested by Han's model as follows. 1) One program outcome in the undergraduate program, "nursing process application ability", was selected and 2) the three clinical practicum courses related to the selected program outcome were identified. 3) Evaluation tools including rubric and items were selected for outcome measurement and 4) performance criterion, the educational goal level for the program, was established. 5) Program outcome was actually evaluated using the rubric and evaluation items in the three practicum courses and 6) the obtained scores were analyzed to identify the achievement rate, which was compared with the performance criterion. Achievement rates for the selected program outcome in adult, maternity, and pediatric nursing practicum were 98.7%, 100%, and 66.2% in the case report and 100% for all three in the clinical practice, and 100%, 100%, and 87% respectively for the conference. These are considered as satisfactory levels when compared with the performance criterion of "at least 60% or more". Course-embedded assessment can be used as an effective and economic method to evaluate the program outcome without running an integrative course additionally. Further studies to develop course-embedded assessment systems for other program outcomes in nursing education are needed. Copyright © 2016 Elsevier Ltd. All rights reserved.

Building-integrated photovoltaics: A case study

NASA Astrophysics Data System (ADS)

Kiss, G.; Kinkead, J.; Raman, M.

1995-03-01

In 1992, Kiss Cathcart Anders Architects performed a study for NREL on Building-Integrated Photovoltaics (BIPV) issues as seen from the perspective of the building community. In general, the purpose of the study was to list major issues and potential applications; by it's nature it asked more questions than it answered. This second phase study was to produce quantitative data on the performance of specific BIPV systems. Only roof systems are evaluated. The energy performance, construction cost and simple payback for five different BIPV roof options are evaluated in six different locations: Oakland, New York, Miami, Phoenix, Chicago, and Cincinnati. The roof options evaluated include the following: single-glazed PV roof using glass-substrate PVs; double-glazed PV roof with insulating PV modules; ballasted roof-mounted system; sawtooth light monitor roof with indirect north daylighting; sawtooth roof with north light and active heat recovery.

Evaluation of the intelligent cruise control system : volume 1 : study results

DOT National Transportation Integrated Search

1999-10-01

The Intelligent Cruise Control (ICC) system evaluation was based on an ICC Field Operational Test (FOT) performed in Michigan. The FOT involved 108 volunteers recruited to drive ten ICC-equipped Chrysler Concordes. Testing was initiated in July 1996 ...

SU-E-T-433: Field-In-Field Irradiation for Breast Cancer with VERO-4DRT System: A Feasibility Study

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hayashi, N; Mizuno, T; Takada, Y

2015-06-15

Purpose: The Vero-4DRT system is a dedicated system for high precision radiation therapy. However, the field size is limited at 15 cm x 15 cm and shapes by using multi-leaf collimator (MLC) without X-Jaw and Y-Jaw. Therefore VERO-4DRT system is not available to simple wedged irradiation for breast cancer. In this study, we suppose FIF with ring and/or tilt/pan angles whole breast irradiation (FIFWBI). The purpose of this study is to verify the feasibility of FIFWBI with VERO-4DRT system. Methods: As fundamental evaluation, we performed commissioning test with phantom. The absorbed dose evaluation at several reference points and dose distributionmore » including split area were performed. We planned 10 demonstrative shapes in phantom for measuring these contents with i-plan workstation (BrainLAB). As clinical evaluation, the dose distribution and dose indexes were evaluated with actual patient data. Five patients with breast cancer were designed FIFWBI radiotherapy plan with split fields. Then, the dose distribution and dose indexes (including Dmax, Dmin, D95, D5 and Homogeneity index) were evaluated in these plans. Results: As the results of fundamental evaluation, all absorbed dose errors between calculated and measured doses were within 2%. The gamma passing rates with 2 mm/3% criteria in all cases were 96±2%. As the results of clinical evaluation, the values of Dmax, D95, D50, D5, and Homogeneity Index were 41.7±0.90 Gy, 49.4±0.34 Gy, 52.26±0.24 Gy, and 1.39±0.03, respectively. For Japanese breast cancer patients, this technique was feasible. However, the large split region was happened in FIFWBI in case of patient with large breast. Conclusion: We evaluated the FIFWBI technique with VERO-4DRT system. This technique is feasible for Japanese patients, but the patient with large breast should be disagreed with this technique.« less

Teacher Evaluation and Local Control in the US: An Investigation into the Degree of Local Control Afforded to Districts in Defining Evaluation Procedures for Teachers in Non-Tested Subjects and Grades

ERIC Educational Resources Information Center

Gagnon, Douglas J.; Hall, Erika L.; Marion, Scott

2017-01-01

Many states only recently incorporated indicators of student achievement into teacher evaluation systems for Non-Tested Subjects and Grades (NTSG). This study examines how practices related to the inclusion of student achievement measures vary across states as to the discretion left to districts in defining and implementing evaluation systems for…

An experimental maintenance management system.

DOT National Transportation Integrated Search

1979-01-01

The purpose of this study was to evaluate Virginia's maintenance management system and to recommend modifications directed at improving it. The study revealed that (1) the current system of allocating maintenance monies is based upon centerline milea...

A toolbox for safety instrumented system evaluation based on improved continuous-time Markov chain

NASA Astrophysics Data System (ADS)

Wardana, Awang N. I.; Kurniady, Rahman; Pambudi, Galih; Purnama, Jaka; Suryopratomo, Kutut

2017-08-01

Safety instrumented system (SIS) is designed to restore a plant into a safe condition when pre-hazardous event is occur. It has a vital role especially in process industries. A SIS shall be meet with safety requirement specifications. To confirm it, SIS shall be evaluated. Typically, the evaluation is calculated by hand. This paper presents a toolbox for SIS evaluation. It is developed based on improved continuous-time Markov chain. The toolbox supports to detailed approach of evaluation. This paper also illustrates an industrial application of the toolbox to evaluate arch burner safety system of primary reformer. The results of the case study demonstrates that the toolbox can be used to evaluate industrial SIS in detail and to plan the maintenance strategy.

An Investigation of the Potential for a Computer-based Tutorial Program Covering the Cardiovascular System to Replace Traditional Lectures.

ERIC Educational Resources Information Center

Dewhurst, D. G.; Williams, A. D.

1998-01-01

Presents the results of a comparative study to evaluate the effectiveness of two interactive computer-based learning (CBL) programs, covering the cardiovascular system, as an alternative to lectures for first year undergraduate students at a United Kingdom University. Discusses results in relation to the design of evaluative studies and the future…

Financial Audit: Guaranteed Student Loan Program's Internal Controls and Structure Need Improvement. Report to the Congress.

ERIC Educational Resources Information Center

Wurtz, Donald R.; And Others

An evaluative study was done of the Department of Education's system of internal accounting controls over the Federal Family Education Loan Program, known as the guaranteed student loan program. The study evaluated internal control systems, the structure of the program with respect to the role of guaranty agencies, and the Department's ability to…

Contextual Influences in Developing a School-Based Comprehensive Information System.

ERIC Educational Resources Information Center

Dorr-Bremme, Donald W.

This is one of a series of reports based on an ongoing reality test of systemic evaluation for instructional decision making. This feasibility study is being carried out by the Center for the Study of Evaluation with the Laboratory in School and Community Relations at a suburban Los Angeles high school (called Site A). Viewing a school as a…

Is "Effective" the New "Ineffective"? A Crisis with the New York State Teacher Evaluation System

ERIC Educational Resources Information Center

Forman, Kenneth; Markson, Craig

2015-01-01

The purpose of this study was to examine the relationship among New York State's APPR teacher evaluation system, poverty, attendance rates, per pupil spending, and academic achievement. The data from this study included reports on 110 school districts, over 30,000 educators and over 60,000 students from Nassau and Suffolk counties posted on the…

A Pilot Evaluation Study of the Picture Exchange Communication System (PECS) for Children with Autistic Spectrum Disorders.

ERIC Educational Resources Information Center

Magiati, Iliana; Howlin, Patricia

2003-01-01

A study evaluated the effects of training 47 teachers of children with autism in the use of the Picture Exchange Communication System (PECS). Following training, significant, rapid increases were recorded in the level of PECS attained by the students (n=34), in students' PECS vocabulary, and in students' use of PECS. (Contains references.) (CR)

Building Assessment Survey and Evaluation Study Summarized Data - HVAC Characteristics

EPA Pesticide Factsheets

In the Building Assessment Survey and Evaluation (BASE) Study Information on the characteristics of the heating, ventilation, and air conditioning (HVAC) system(s) in the entire BASE building including types of ventilation, equipment configurations, and operation and maintenance issues was acquired by examining the building plans, conducting a building walk-through, and speaking with the building owner, manager, and/or operator.

Evaluating and Measuring the Return on Investment of an Emergency Center Health Care Professional Picture Archiving and Communication Systems Training Program

ERIC Educational Resources Information Center

Roelandt, James P.

2012-01-01

Picture archiving and communication system (PACS) workflow directly affects the quality of emergency patient care through radiology exam turn-around times and the speed of delivery of diagnostic radiology results. This study was a mixed methods training and performance improvement study that evaluated the effectiveness and value of a hospital…

Improvement of the Performance of an Electrocoagulation Process System Using Fuzzy Control of pH.

PubMed

Demirci, Yavuz; Pekel, Lutfiye Canan; Altinten, Ayla; Alpbaz, Mustafa

2015-12-01

The removal efficiencies of electrocoagulation (EC) systems are highly dependent on the initial value of pH. If an EC system has an acidic influent, the pH of the effluent increases during the treatment process; conversely, if such a system has an alkaline influent, the pH of the effluent decreases during the treatment process. Thus, changes in the pH of the wastewater affect the efficiency of the EC process. In this study, we investigated the dynamic effects of pH. To evaluate approaches for preventing increases in the pH of the system, the MATLAB/Simulink program was used to develop and evaluate an on-line computer-based system for pH control. The aim of this work was to study Proportional-Integral-Derivative (PID) control and fuzzy control of the pH of a real textile wastewater purification process using EC. The performances and dynamic behaviors of these two control systems were evaluated based on determinations of COD, colour, and turbidity removal efficiencies.

Cross-System Evaluation of Clinical Trial Search Engines

PubMed Central

Jiang, Silis Y.; Weng, Chunhua

2014-01-01

Clinical trials are fundamental to the advancement of medicine but constantly face recruitment difficulties. Various clinical trial search engines have been designed to help health consumers identify trials for which they may be eligible. Unfortunately, knowledge of the usefulness and usability of their designs remains scarce. In this study, we used mixed methods, including time-motion analysis, think-aloud protocol, and survey, to evaluate five popular clinical trial search engines with 11 users. Differences in user preferences and time spent on each system were observed and correlated with user characteristics. In general, searching for applicable trials using these systems is a cognitively demanding task. Our results show that user perceptions of these systems are multifactorial. The survey indicated eTACTS being the generally preferred system, but this finding did not persist among all mixed methods. This study confirms the value of mixed-methods for a comprehensive system evaluation. Future system designers must be aware that different users groups expect different functionalities. PMID:25954590

Cross-system evaluation of clinical trial search engines.

PubMed

Jiang, Silis Y; Weng, Chunhua

2014-01-01

Clinical trials are fundamental to the advancement of medicine but constantly face recruitment difficulties. Various clinical trial search engines have been designed to help health consumers identify trials for which they may be eligible. Unfortunately, knowledge of the usefulness and usability of their designs remains scarce. In this study, we used mixed methods, including time-motion analysis, think-aloud protocol, and survey, to evaluate five popular clinical trial search engines with 11 users. Differences in user preferences and time spent on each system were observed and correlated with user characteristics. In general, searching for applicable trials using these systems is a cognitively demanding task. Our results show that user perceptions of these systems are multifactorial. The survey indicated eTACTS being the generally preferred system, but this finding did not persist among all mixed methods. This study confirms the value of mixed-methods for a comprehensive system evaluation. Future system designers must be aware that different users groups expect different functionalities.

Comparative performances of staging systems for early hepatocellular carcinoma.

PubMed

Nathan, Hari; Mentha, Gilles; Marques, Hugo P; Capussotti, Lorenzo; Majno, Pietro; Aldrighetti, Luca; Pulitano, Carlo; Rubbia-Brandt, Laura; Russolillo, Nadia; Philosophe, Benjamin; Barroso, Eduardo; Ferrero, Alessandro; Schulick, Richard D; Choti, Michael A; Pawlik, Timothy M

2009-08-01

Several staging systems for patients with hepatocellular carcinoma (HCC) have been proposed, but studies of their prognostic accuracy have yielded conflicting conclusions. Stratifying patients with early HCC is of particular interest because these patients may derive the greatest benefit from intervention, yet no studies have evaluated the comparative performances of staging systems in patients with early HCC. A retrospective cohort study was performed using data on 379 patients who underwent liver resection or liver transplantation for HCC at six major hepatobiliary centres in the USA and Europe. The staging systems evaluated were: the Okuda staging system, the International Hepato-Pancreato-Biliary Association (IHPBA) staging system, the Cancer of the Liver Italian Programme (CLIP) score, the Barcelona Clinic Liver Cancer (BCLC) staging system, the Japanese Integrated Staging (JIS) score and the American Joint Committee on Cancer/International Union Against Cancer (AJCC/UICC) staging system, 6th edition. A recently proposed early HCC prognostic score was also evaluated. The discriminative abilities of the staging systems were evaluated using Cox proportional hazards models and the bootstrap-corrected concordance index (c). Overall survival of the cohort was 74% at 3 years and 52% at 5 years, with a median survival of 62 months. Most systems demonstrated poor discriminatory ability (P > 0.05 on Cox proportional hazards analysis, c approximately 0.5). However, the AJCC/UICC system clearly stratified patients (P < 0.001, c = 0.59), albeit only into two groups. The early HCC prognostic score also clearly stratified patients (P < 0.001, c = 0.60) and identified three distinct prognostic groups. The early HCC prognostic score is superior to the AJCC/UICC staging system (6th edition) for predicting the survival of patients with early HCC after liver resection or liver transplantation. Other major HCC staging systems perform poorly in patients with early HCC.

Expert systems for space power supply - Design, analysis, and evaluation

NASA Technical Reports Server (NTRS)

Cooper, Ralph S.; Thomson, M. Kemer; Hoshor, Alan

1987-01-01

The feasibility of applying expert systems to the conceptual design, analysis, and evaluation of space power supplies in particular, and complex systems in general is evaluated. To do this, the space power supply design process and its associated knowledge base were analyzed and characterized in a form suitable for computer emulation of a human expert. The existing expert system tools and the results achieved with them were evaluated to assess their applicability to power system design. Some new concepts for combining program architectures (modular expert systems and algorithms) with information about the domain were applied to create a 'deep' system for handling the complex design problem. NOVICE, a code to solve a simplified version of a scoping study of a wide variety of power supply types for a broad range of missions, has been developed, programmed, and tested as a concrete feasibility demonstration.

IDEAS: A multidisciplinary computer-aided conceptual design system for spacecraft

NASA Technical Reports Server (NTRS)

Ferebee, M. J., Jr.

1984-01-01

During the conceptual development of advanced aerospace vehicles, many compromises must be considered to balance economy and performance of the total system. Subsystem tradeoffs may need to be made in order to satisfy system-sensitive attributes. Due to the increasingly complex nature of aerospace systems, these trade studies have become more difficult and time-consuming to complete and involve interactions of ever-larger numbers of subsystems, components, and performance parameters. The current advances of computer-aided synthesis, modeling and analysis techniques have greatly helped in the evaluation of competing design concepts. Langley Research Center's Space Systems Division is currently engaged in trade studies for a variety of systems which include advanced ground-launched space transportation systems, space-based orbital transfer vehicles, large space antenna concepts and space stations. The need for engineering analysis tools to aid in the rapid synthesis and evaluation of spacecraft has led to the development of the Interactive Design and Evaluation of Advanced Spacecraft (IDEAS) computer-aided design system. The ADEAS system has been used to perform trade studies of competing technologies and requirements in order to pinpoint possible beneficial areas for research and development. IDEAS is presented as a multidisciplinary tool for the analysis of advanced space systems. Capabilities range from model generation and structural and thermal analysis to subsystem synthesis and performance analysis.

Evaluation of average daily gain predictions by the integrated farm system model for forage-finished beef steers

USDA-ARS?s Scientific Manuscript database

Representing the performance of cattle finished on an all forage diet in process-based whole farm system models has presented a challenge. To address this challenge, a study was done to evaluate average daily gain (ADG) predictions of the Integrated Farm System Model (IFSM) for steers consuming all-...

Evaluation of 3M molecular detection system and ANSR pathogen detection system for rapid detection of salmonella from egg products

USDA-ARS?s Scientific Manuscript database

Loop-mediated isothermal amplification (LAMP) is a novel simple detection technology that amplifies DNA with high speed, efficiency, and specificity under isothermal conditions. The objective of this study was to evaluate the effectiveness of 3M Molecular Detection System (MDS) and ANSR Pathogen Det...

Genetics with Jean: The Design, Development and Evaluation of an Affective Tutoring System

ERIC Educational Resources Information Center

Thompson, Nik; McGill, Tanya Jane

2017-01-01

This paper details the design, development and evaluation of an affective tutoring system (ATS)--an e-learning system that detects and responds to the emotional states of the learner. Research into the development of ATS is an active and relatively new field, with many studies demonstrating promising results. However, there is often no practical…

An Evaluation of the Informedia Digital Video Library System at the Open University.

ERIC Educational Resources Information Center

Kukulska-Hulme, Agnes; Van der Zwan, Robert; DiPaolo, Terry; Evers, Vanessa; Clarke, Sarah

1999-01-01

Reports on an Open University evaluation study of the Informedia Digital Video Library System developed at Carnegie Mellon University (CMU). Findings indicate that there is definite potential for using the system, provided that certain modifications can be made. Results also confirm findings of the Informedia team at CMU that the content of video…

A fuelwood plantation site selection procedure using geographic information system technology: A case study in support of the NASA Global Habitability Program

NASA Technical Reports Server (NTRS)

Roller, N. E. G.; Colwell, J. E.; Sellman, A. N.

1985-01-01

A study undertaken in support of NASA's Global Habitability Program is described. A demonstration of geographic information system (GIS) technology for site evaluation and selection is given. The objective was to locate potential fuelwood plantations within a 50 km radius of Nairobi, Kenya. A model was developed to evaluate site potential based on capability and suitability criteria and implemented using the Environmental Research Institute of Michigan's geographic information system.

Pilot study on the effects of a computer-based medical image system.

PubMed Central

Wu, S. C.; Smith, J. W.; Swan, J. E.

1996-01-01

Current medical imaging systems are developed for the purpose of data management. Evaluations of these systems are usually done by assessing users' subjective appreciation rather than objectively gauging performance influence. The present report discusses the evaluation of a medical image presentation system prototype utilizing a cognitive approach. Experimental results showed hypothesized performance improvement attributed to advanced presentation techniques. However, this improvement was almost inadvertently masked by users' previous strategies and interactions with new technology. Overall these data demonstrate the potential benefit of implementing such a system in actual practice as well as provide an example of applying the cognitive approach in evaluating the usability of medical systems. Images Figure 1 PMID:8947750

Development and validation of a nursing professionalism evaluation model in a career ladder system.

PubMed

Kim, Yeon Hee; Jung, Young Sun; Min, Ja; Song, Eun Young; Ok, Jung Hui; Lim, Changwon; Kim, Kyunghee; Kim, Ji-Su

2017-01-01

The clinical ladder system categorizes the degree of nursing professionalism and rewards and is an important human resource tool for managing nursing. We developed a model to evaluate nursing professionalism, which determines the clinical ladder system levels, and verified its validity. Data were collected using a clinical competence tool developed in this study, and existing methods such as the nursing professionalism evaluation tool, peer reviews, and face-to-face interviews to evaluate promotions and verify the presented content in a medical institution. Reliability and convergent and discriminant validity of the clinical competence evaluation tool were verified using SmartPLS software. The validity of the model for evaluating overall nursing professionalism was also analyzed. Clinical competence was determined by five dimensions of nursing practice: scientific, technical, ethical, aesthetic, and existential. The structural model explained 66% of the variance. Clinical competence scales, peer reviews, and face-to-face interviews directly determined nursing professionalism levels. The evaluation system can be used for evaluating nurses' professionalism in actual medical institutions from a nursing practice perspective. A conceptual framework for establishing a human resources management system for nurses and a tool for evaluating nursing professionalism at medical institutions is provided.

Leveraging simulation to evaluate system performance in presence of fixed pattern noise

NASA Astrophysics Data System (ADS)

Teaney, Brian P.

2017-05-01

The development of image simulation techniques which map the effects of a notional, modeled sensor system onto an existing image can be used to evaluate the image quality of camera systems prior to the development of prototype systems. In addition, image simulation or `virtual prototyping' can be utilized to reduce the time and expense associated with conducting extensive field trials. In this paper we examine the development of a perception study designed to assess the performance of the NVESD imager performance metrics as a function of fixed pattern noise. This paper discusses the development of the model theory and the implementation and execution of the perception study. In addition, other applications of the image simulation component including the evaluation of limiting resolution and other test targets is provided.

A Systematic Case Study of the Course, Offshore Survival Systems Training, To Improve the Practice of Marine Survival Training.

ERIC Educational Resources Information Center

Zambon, Franco

A major applied research project evaluated the effectiveness of a novel course, Offshore Survival Systems Training. The major course outcome that was evaluated was the increase in frequency with which offshore personnel correctly launched the covered powered survival craft on offshore drilling rigs. The evaluation methodology included the 628…

Superintendents' Perceptions of Readiness in Regard to Transitioning to the Missouri Educator Evaluation System to Fulfill the Elementary and Secondary Education Act Flexibility Request

ERIC Educational Resources Information Center

Hollingsworth, Stacy

2013-01-01

The Missouri Department of Elementary and Secondary Education has begun the transition to the Missouri Educator Evaluation System devised of seven Essential Principles of Effective Evaluation. This study considered superintendents' perceptions of readiness levels for each essential principle in order to understand continued needs to assist the…

Evaluating the Effects of a Video Prompt in a System of Least Prompts Procedure

ERIC Educational Resources Information Center

Smith, Katie A.; Ayres, Kevin M.; Mechling, Linda C.; Alexander, Jennifer L.; Mataras, Theologia K.; Shepley, Sally B.

2015-01-01

The purpose of this study was to evaluate the effects of a system of least prompts procedure with a video prompt serving as the model in teaching office tasks to three high school students with moderate intellectual disability. A multiple probe across behaviors design replicated across participants was used to evaluate the intervention. The…

New Whole-House Solutions Case Study: Evaluating Through-Wall Air Transfer Fans, Pittsburgh, Pennsylvania

DOE Office of Scientific and Technical Information (OSTI.GOV)

None

2014-10-01

In this project, Building America team IBACOS performed field testing in a new construction unoccupied test house in Pittsburgh, Pennsylvania, to evaluate heating, ventilating, and air conditioning (HVAC) distribution systems during heating, cooling, and midseason conditions. The team evaluated a market-available through-wall air transfer fan system that provides air to the bedrooms.The relative ability of this system was considered with respect to relevant Air Conditioning Contractors of America and ASHRAE standards for house temperature uniformity and stability.

A plea for the development of an universally accepted modular tooth wear evaluation system.

PubMed

Wetselaar, P; Faris, A; Lobbezoo, F

2016-11-03

Tooth wear is considered an increasing oral health problem. Due to its multifactorial nature, recognizing and diagnosing of tooth wear is difficult but nevertheless important. Over the years, a wide variety of evaluation systems has been developed, yet none of them is universally accepted. This has implications for both research and clinical practice. This paper describes an in-depth analysis of four commonly used tooth wear evaluation systems, namely, the Eccles index, the Tooth Wear Index, the Lussi index, and the Basic Erosive Wear Examination. Comparing those systems revealed that despite several similarities, they differ considerably from each other. Notably, all four systems have their specific advantages and disadvantages. However, neither one of them meets all necessary characteristics of a hypothetical, broadly applicable tooth wear evaluation system. In fact, it is not realistic that a single system qualifies for all purposes (for example, diagnosing or monitoring individual patients, performing epidemiological studies, etc.). As a potentially feasible solution for this issue, the development of an evaluation system is recommended that consists of multiple, coherent modules, which cover different purposes.

Evaluation of new data processing algorithms for planar gated ventriculography (MUGA)

PubMed Central

Fair, Joanna R.; Telepak, Robert J.

2009-01-01

Before implementing one of two new LVEF radionuclide gated ventriculogram (MUGA) systems, the results from 312 consecutive parallel patient studies were evaluated. Each gamma‐camera acquisition was simultaneously processed by semi‐automatic Medasys Pinnacle and by fully automatic and semiautomatic Philips nuclear medicine computer systems. The Philips systems yielded LVEF results within ±5LVEF percentage points of the Medasys system in fewer than half of the studies. The remaining values were higher or lower than those from the long‐used Medasys system. These differences might have changed cancer patient chemotherapy clinical decisions. As a result, our institution elected not to implement either new system. PACS: 87.57.U‐ Nuclear medicine imaging

Usability and feasibility of health IT interventions to enhance Self-Care for Lymphedema Symptom Management in breast cancer survivors.

PubMed

Fu, Mei R; Axelrod, Deborah; Guth, Amber A; Wang, Yao; Scagliola, Joan; Hiotis, Karen; Rampertaap, Kavita; El-Shammaa, Nardin

2016-09-01

The-Optimal-Lymph-Flow health IT system (TOLF) is a patient-centered, web-and-mobile-based educational and behavioral health IT system focusing on safe, innovative, and pragmatic self-care strategies for lymphedema symptom management. The purpose of this study was to evaluate usability, feasibility, and acceptability of TOLF among the end-user of breast cancer survivors. Two types of usability testing were completed with 30 breast cancer survivors: heuristic evaluation and end-user testing. Each participant was asked to think aloud while completing a set of specified tasks designed to explicate and freely explore the system features. A heuristic evaluation checklist, the Perceived Ease of Use and Usefulness Questionnaire, and The Post Study System Usability Questionnaire were used to evaluate usability of the system. Open-ended questions were used to gather qualitative data. Quantitative data were analyzed using descriptive statistics and qualitative data were summarized thematically. Breast cancer survivors were very satisfied with the system: 90% (n = 27) rated the system having no usability problems; 10% (n = 3) noted minor cosmetic problems: spelling errors or text font size. The majority of participants 96.6% (n = 29) strongly agreed that the system was easy to use and effective in helping to learn about lymphedema, symptoms and self-care strategies. Themes from the qualitative data included empowerment, high quality information, loving avatar simulation videos, easy accessibility, and user-friendliness. This usability study provided evidence on breast cancer survivor's acceptance and highly positive evaluation of TOLF's usability as well as feasibility of using technologically-driven delivery model to enhance self-care strategies for lymphedema symptom management.

Satellite Power Systems /SPS/ - Overview of system studies and critical technology

NASA Technical Reports Server (NTRS)

Manson, S. V.

1980-01-01

Systems studies and critical technology issues for the development and evaluation of Satellite Power Systems (SPS) for the photovoltaic generation of electrical energy and its transmission to earth are reviewed. Initial concept studies completed in 1976 and system definition studies initiated in the same year have indicated the technical feasibility of SPS and identified challenging issues to be addressed as part of the SPS Concept Development and Evaluation Program. Systems considered in the study include photovoltaic and solar thermal power conversion configurations employing klystron or solid state microwave generators or lasers for power transmission, and power transmission options, system constructability and in-orbit and ground operations. Technology investigations are being performed in the areas of microwave power transmission, structure/controls interactions and the behavior of key materials in the space/SPS environment. Favorable results have been obtained in the areas of microwave phase distribution and phase control, dc-RF conversion, antenna radiating element, and no insurmountable problems have been discovered in any of the investigations to date.

The Use of ICTs in the Cameroonian School System: A Case Study of Some Primary and Secondary Schools in Yaoundé

ERIC Educational Resources Information Center

Ngoungouo, Abass

2017-01-01

This paper presents the results of a study carried out on some primary and secondary schools of Yaoundé, Republic of Cameroon. The said study aimed at analyzing and evaluating the use of ICTs by teachers in the Cameroonian school system. More precisely, it sought to identify the types of ICTs used by teachers, to evaluate the state of equipment of…

Comparative performance evaluation of advanced AC and DC EV propulsion systems

NASA Astrophysics Data System (ADS)

MacDowall, R. D.; Crumley, R. L.

Idaho National Engineering Laboratory (INEL) evaluates EV propulsion systems and components for the U.S. Department of Energy (DOE) Electric and Hybrid Vehicle (EHV) Program. In this study, experimental data were used to evaluate the relative performances of the benchmark Chrysler/GE ETV-1 DC and the Ford/GE First Generation Single-Shaft AC (ETX-I) propulsion systems. Tests were conducted on the INEL's chassis dynamometer using identical aerodynamic and rolling resistance road-load coefficients and vehicle test weights. The results allowed a direct comparison of selected efficiency and performance characteristics for the two propulsion system technologies. The ETX-I AC system exhibited slightly lower system efficiency during constant speed testing than the ETV-1 DC propulsion system.

The search for relevant outcome measures for cost-utility analysis of systemic family interventions in adolescents with substance use disorder and delinquent behavior: a systematic literature review.

PubMed

Schawo, S; Bouwmans, C; van der Schee, E; Hendriks, V; Brouwer, W; Hakkaart, L

2017-09-19

Systemic family interventions have shown to be effective in adolescents with substance use disorder and delinquent behavior. The interventions target interactions between the adolescent and involved systems (i.e. youth, family, peers, neighbors, school, work, and society). Next to effectiveness considerations, economic aspects have gained attention. However, conventional generic quality of life measures used in health economic evaluations may not be able to capture the broad effects of systemic interventions. This study aims to identify existing outcome measures, which capture the broad effects of systemic family interventions, and allow use in a health economic framework. We based our systematic review on clinical studies in the field. Our goal was to identify effectiveness studies of psychosocial interventions for adolescents with substance use disorder and delinquent behavior and to distill the instruments used in these studies to measure effects. Searched databases were PubMed, Education Resource Information Center (ERIC), Cochrane and Psychnet (PsycBOOKSc, PsycCRITIQUES, print). Identified instruments were ranked according to the number of systems covered (comprehensiveness). In addition, their use for health economic analyses was evaluated according to suitability characteristics such as brevity, accessibility, psychometric properties, etc. One thousand three hundred seventy-eight articles were found and screened for eligibility. Eighty articles were selected, 8 instruments were identified covering 5 or more systems. The systematic review identified instruments from the clinical field suitable to evaluate systemic family interventions in a health economic framework. None of them had preference-weights available. Hence, a next step could be to attach preference-weights to one of the identified instruments to allow health economic evaluations of systemic family interventions.

Evaluation of retroreflective markings to increase rail car conspicuity

DOT National Transportation Integrated Search

1998-10-01

The purpose of this study was to develop guidelines and recommendations for the design of retroreflective marking systems to enhance the conspicuity of rail cars at night. Three methods were used to generate and evaluate the marking systems for a sta...

Field evaluation of the myrtle creek advanced curve warning system : final report.

DOT National Transportation Integrated Search

2006-06-01

As part of a larger study focusing on determining optimum countermeasures for speed related crashes, this report presents the results of a quantitative and qualitative before and after evaluation of a dynamic curve warning system deployed at one site...

STUDIES ON CONTAMINANT BIODEGRADATION IN SLURRY, WAFER, AND COMPACTED SOIL TUBE REACTORS

EPA Science Inventory

A systematic experimental approach is presented to quantitatively evaluate biodegradation rates in intact soil systems. Knowledge of bioremediation rates in intact soil systems is important for evaluating the efficacy of in-situ biodegradation and approaches for enhancing degrad...

Evaluating healthcare priority setting at the meso level: A thematic review of empirical literature

PubMed Central

Waithaka, Dennis; Tsofa, Benjamin; Barasa, Edwine

2018-01-01

Background: Decentralization of health systems has made sub-national/regional healthcare systems the backbone of healthcare delivery. These regions are tasked with the difficult responsibility of determining healthcare priorities and resource allocation amidst scarce resources. We aimed to review empirical literature that evaluated priority setting practice at the meso (sub-national) level of health systems. Methods: We systematically searched PubMed, ScienceDirect and Google scholar databases and supplemented these with manual searching for relevant studies, based on the reference list of selected papers. We only included empirical studies that described and evaluated, or those that only evaluated priority setting practice at the meso-level. A total of 16 papers were identified from LMICs and HICs. We analyzed data from the selected papers by thematic review. Results: Few studies used systematic priority setting processes, and all but one were from HICs. Both formal and informal criteria are used in priority-setting, however, informal criteria appear to be more perverse in LMICs compared to HICs. The priority setting process at the meso-level is a top-down approach with minimal involvement of the community. Accountability for reasonableness was the most common evaluative framework as it was used in 12 of the 16 studies. Efficiency, reallocation of resources and options for service delivery redesign were the most common outcome measures used to evaluate priority setting. Limitations: Our study was limited by the fact that there are very few empirical studies that have evaluated priority setting at the meso-level and there is likelihood that we did not capture all the studies. Conclusions: Improving priority setting practices at the meso level is crucial to strengthening health systems. This can be achieved through incorporating and adapting systematic priority setting processes and frameworks to the context where used, and making considerations of both process and outcome measures during priority setting and resource allocation. PMID:29511741

Multiple performance measures are needed to evaluate triage systems in the emergency department.

PubMed

Zachariasse, Joany M; Nieboer, Daan; Oostenbrink, Rianne; Moll, Henriëtte A; Steyerberg, Ewout W

2018-02-01

Emergency department triage systems can be considered prediction rules with an ordinal outcome, where different directions of misclassification have different clinical consequences. We evaluated strategies to compare the performance of triage systems and aimed to propose a set of performance measures that should be used in future studies. We identified performance measures based on literature review and expert knowledge. Their properties are illustrated in a case study evaluating two triage modifications in a cohort of 14,485 pediatric emergency department visits. Strengths and weaknesses of the performance measures were systematically appraised. Commonly reported performance measures are measures of statistical association (34/60 studies) and diagnostic accuracy (17/60 studies). The case study illustrates that none of the performance measures fulfills all criteria for triage evaluation. Decision curves are the performance measures with the most attractive features but require dichotomization. In addition, paired diagnostic accuracy measures can be recommended for dichotomized analysis, and the triage-weighted kappa and Nagelkerke's R 2 for ordinal analyses. Other performance measures provide limited additional information. When comparing modifications of triage systems, decision curves and diagnostic accuracy measures should be used in a dichotomized analysis, and the triage-weighted kappa and Nagelkerke's R 2 in an ordinal approach. Copyright © 2017 Elsevier Inc. All rights reserved.

Technology Efficacy in Active Prosthetic Knees for Transfemoral Amputees: A Quantitative Evaluation

PubMed Central

El-Sayed, Amr M.; Abu Osman, Noor Azuan

2014-01-01

Several studies have presented technological ensembles of active knee systems for transfemoral prosthesis. Other studies have examined the amputees' gait performance while wearing a specific active prosthesis. This paper combined both insights, that is, a technical examination of the components used, with an evaluation of how these improved the gait of respective users. This study aims to offer a quantitative understanding of the potential enhancement derived from strategic integration of core elements in developing an effective device. The study systematically discussed the current technology in active transfemoral prosthesis with respect to its functional walking performance amongst above-knee amputee users, to evaluate the system's efficacy in producing close-to-normal user performance. The performances of its actuator, sensory system, and control technique that are incorporated in each reported system were evaluated separately and numerical comparisons were conducted based on the percentage of amputees' gait deviation from normal gait profile points. The results identified particular components that contributed closest to normal gait parameters. However, the conclusion is limitedly extendable due to the small number of studies. Thus, more clinical validation of the active prosthetic knee technology is needed to better understand the extent of contribution of each component to the most functional development. PMID:25110727

Satellite Power System: Concept development and evaluation program. Volume 7: Space transportation

NASA Technical Reports Server (NTRS)

1981-01-01

During the several phases of the satellite power system (SPS) concept definition study, various transportation system elements were synthesized and evaluated on the basis of their potential to satisfy overall SPS transportation requirements and their sensitivities, interfaces, and impact on the SPS. Additional analyses and investigations were conducted to further define transportation system concepts that will be needed for the developmental and operational phases of an SPS program. To accomplish these objectives, transportation systems such as the shuttle and its derivatives were identified; new heavy-lift launch vehicle (HLLV) concepts, cargo and personnel orbital transfer vehicles (COTV and POTV), and intra-orbit transfer vehicle (IOTV) concepts were evaluated; and, to a limited degree, the program implications of their operations and costs were assessed. The results of these analyses were integrated into other elements of the overall SPS concept definition studies.

Evaluation of water resources system vulnerability based on co-operative co-evolutionary genetic algorithm and projection pursuit model under the DPSIR framework

NASA Astrophysics Data System (ADS)

Zhao, Y.; Su, X. H.; Wang, M. H.; Li, Z. Y.; Li, E. K.; Xu, X.

2017-08-01

Water resources vulnerability control management is essential because it is related to the benign evolution of socio-economic, environmental and water resources system. Research on water resources system vulnerability is helpful to realization of water resources sustainable utilization. In this study, the DPSIR framework of driving forces-pressure-state-impact-response was adopted to construct the evaluation index system of water resources system vulnerability. Then the co-evolutionary genetic algorithm and projection pursuit were used to establish evaluation model of water resources system vulnerability. Tengzhou City in Shandong Province was selected as a study area. The system vulnerability was analyzed in terms of driving forces, pressure, state, impact and response on the basis of the projection value calculated by the model. The results show that the five components all belong to vulnerability Grade II, the vulnerability degree of impact and state were higher than other components due to the fierce imbalance in supply-demand and the unsatisfied condition of water resources utilization. It is indicated that the influence of high speed socio-economic development and the overuse of the pesticides have already disturbed the benign development of water environment to some extents. While the indexes in response represented lower vulnerability degree than the other components. The results of the evaluation model are coincident with the status of water resources system in the study area, which indicates that the model is feasible and effective.

Traffic Light System Can Increase Healthfulness Perception: Implications for Policy Making.

PubMed

Machín, Leandro; Aschemann-Witzel, Jessica; Curutchet, María Rosa; Giménez, Ana; Ares, Gastón

2018-04-04

To evaluate how information about low nutrient content included in the traffic light labeling system influences consumers' perception of the healthfulness of products with high content of 1 key nutrient, and to compare the traffic light system with warnings in terms of the perception of healthfulness. Images of front-of-pack (FOP) nutrition labels (the traffic light labeling system with different numbers of nutrients with low content, and warnings) were evaluated in study 1, whereas product labels featuring the different FOP nutrition labels were evaluated in study 2. Online studies conducted in Montevideo, Uruguay. A total of 1,228 Uruguayan Facebook users. Perception of healthfulness. The researchers used ANOVA to evaluate the influence of FOP nutrition labels on perceived healthfulness. The inclusion of information about low nutrient content in the traffic light system statistically significantly increased the perception of the healthfulness of products with high nutrient content. Nutritional warnings showed healthfulness ratings similar to those of the simplified version of the traffic light system. Information about low nutrient content in the traffic light system might be used to infer health, and thus could raise the perception of healthfulness and decrease the traffic light system's efficacy in discouraging the consumption of unhealthful products. A simplified version of the traffic light highlighting only high-nutrient content or nutritional warnings seems to overcome this problem. Copyright © 2018 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.

FBI fingerprint identification automation study. AIDS 3 evaluation report. Volume 3: Operational feasibility

NASA Technical Reports Server (NTRS)

Mulhall, B. D. L.

1980-01-01

An evaluation is presented which is defined as the adequacy of system design with known functional and performance requirements. The proposed Rockwell International AIDS 3 card, document and data flow are presented to summarize the concepts involved and the relationships between functions. The analysis and evaluation includes a study of system capability, processing rates, search requirements and response accuracy as well as a consideration of operational components and hardware integration. Results indicate that the AIDS 3 System concept is operationally feasible if production capacity is slightly enhanced but that operational complexity, hardware integration and a lack of conceptual data pertinent to some of the functions are areas of concern.

Satellite Power System (SPS) financial/management scenarios

NASA Technical Reports Server (NTRS)

Vajk, J. P.

1978-01-01

The possible benefits of a Satellite Power System (SPS) program, both domestically and internationally, justify detailed and imaginative investigation of the issues involved in financing and managing such a large-scale program. In this study, ten possible methods of financing a SPS program are identified ranging from pure government agency to private corporations. The following were analyzed and evaluated: (1) capital requirements for SPS; (2) ownership and control; (3) management principles; (4) organizational forms for SPS; (5) criteria for evaluation; (6) detailed description and preliminary evaluation of alternatives; (7) phased approaches; and (8) comparative evaluation. Key issues and observations and recommendations for further study are also presented.

Atmospheric Modeling And Sensor Simulation (AMASS) study

NASA Technical Reports Server (NTRS)

Parker, K. G.

1984-01-01

The capabilities of the atmospheric modeling and sensor simulation (AMASS) system were studied in order to enhance them. This system is used in processing atmospheric measurements which are utilized in the evaluation of sensor performance, conducting design-concept simulation studies, and also in the modeling of the physical and dynamical nature of atmospheric processes. The study tasks proposed in order to both enhance the AMASS system utilization and to integrate the AMASS system with other existing equipment to facilitate the analysis of data for modeling and image processing are enumerated. The following array processors were evaluated for anticipated effectiveness and/or improvements in throughput by attachment of the device to the P-e: (1) Floating Point Systems AP-120B; (2) Floating Point Systems 5000; (3) CSP, Inc. MAP-400; (4) Analogic AP500; (5) Numerix MARS-432; and (6) Star Technologies, Inc. ST-100.

A Comprehensive Evaluation System for Military Hospitals' Response Capability to Bio-terrorism.

PubMed

Wang, Hui; Jiang, Nan; Shao, Sicong; Zheng, Tao; Sun, Jianzhong

2015-05-01

The objective of this study is to establish a comprehensive evaluation system for military hospitals' response capacity to bio-terrorism. Literature research and Delphi method were utilized to establish the comprehensive evaluation system for military hospitals' response capacity to bio-terrorism. Questionnaires were designed and used to survey the status quo of 134 military hospitals' response capability to bio-terrorism. Survey indicated that factor analysis method was suitable to for analyzing the comprehensive evaluation system for military hospitals' response capacity to bio-terrorism. The constructed evaluation system was consisted of five first-class and 16 second-class indexes. Among them, medical response factor was considered as the most important factor with weight coefficient of 0.660, followed in turn by the emergency management factor with weight coefficient of 0.109, emergency management consciousness factor with weight coefficient of 0.093, hardware support factor with weight coefficient of 0.078, and improvement factor with weight coefficient of 0.059. The constructed comprehensive assessment model and system are scientific and practical.

A literature review about usability evaluation methods for e-learning platforms.

PubMed

Freire, Luciana Lopes; Arezes, Pedro Miguel; Campos, José Creissac

2012-01-01

The usability analysis of information systems has been the target of several research studies over the past thirty years. These studies have highlighted a great diversity of points of view, including researchers from different scientific areas such as Ergonomics, Computer Science, Design and Education. Within the domain of information ergonomics, the study of tools and methods used for usability evaluation dedicated to E-learning presents evidence that there is a continuous and dynamic evolution of E-learning systems, in many different contexts -academics and corporative. These systems, also known as LMS (Learning Management Systems), can be classified according to their educational goals and their technological features. However, in these systems the usability issues are related with the relationship/interactions between user and system in the user's context. This review is a synthesis of research project about Information Ergonomics and embraces three dimensions, namely the methods, models and frameworks that have been applied to evaluate LMS. The study also includes the main usability criteria and heuristics used. The obtained results show a notorious change in the paradigms of usability, with which it will be possible to discuss about the studies carried out by different researchers that were focused on usability ergonomic principles aimed at E-learning.

Nondestructive evaluation tools and experimental studies for monitoring the health of space propulsion systems

NASA Technical Reports Server (NTRS)

Generazio, Edward R.

1991-01-01

An overview is given of background and information on space propulsion systems on both the programmatic and technical levels. Feasibility experimental studies indicate that nondestructive evaluation tools such as ultrasonic, eddy current and x-ray may be successfully used to monitor the life limiting failure mechanisms of space propulsion systems. Encouraging results were obtained for monitoring the life limiting failure mechanisms for three space propulsion systems; the degradation of tungsten arcjet and magnetoplasmadynamic electrodes; presence and thickness of spallable electrically conducting molybdenum films in ion thrusters; and the degradation of the catalyst in hydrazine thrusters.

Evaluation Of The Diagnostic Performance Of A Multimedia Medical Communications System.

NASA Astrophysics Data System (ADS)

Robertson, John G.; Coristine, Marjorie; Goldberg, Morris; Beeton, Carolyn; Belanger, Garry; Tombaugh, Jo W.; Hickey, Nancy M.; Millward, Steven F.; Davis, Michael; Whittingham, David

1989-05-01

The central concern of radiologists when evaluating Picture Archiving Communication System (PACS) is the diagnostic performance of digital images compared to the original analog versions of the same images. Considerable work has been done comparing the ROC curves of various types of digital systems to the corresponding analog systems for the detection of specific phantoms or diseases. Although the studies may notify the radiologists that for a specific lesion a digital system may perform as well as the analog system, it tells the radiologists very little about the impact on diagnostic performance of a digital system in the general practice of radiology. We describe in this paper an alternative method for evaluating the diagnostic performance of a digital system and a preliminary experiment we conducted to test the methodology.

Evaluating Recommendation Systems

NASA Astrophysics Data System (ADS)

Shani, Guy; Gunawardana, Asela

Recommender systems are now popular both commercially and in the research community, where many approaches have been suggested for providing recommendations. In many cases a system designer that wishes to employ a recommendation system must choose between a set of candidate approaches. A first step towards selecting an appropriate algorithm is to decide which properties of the application to focus upon when making this choice. Indeed, recommendation systems have a variety of properties that may affect user experience, such as accuracy, robustness, scalability, and so forth. In this paper we discuss how to compare recommenders based on a set of properties that are relevant for the application. We focus on comparative studies, where a few algorithms are compared using some evaluation metric, rather than absolute benchmarking of algorithms. We describe experimental settings appropriate for making choices between algorithms. We review three types of experiments, starting with an offline setting, where recommendation approaches are compared without user interaction, then reviewing user studies, where a small group of subjects experiment with the system and report on the experience, and finally describe large scale online experiments, where real user populations interact with the system. In each of these cases we describe types of questions that can be answered, and suggest protocols for experimentation. We also discuss how to draw trustworthy conclusions from the conducted experiments. We then review a large set of properties, and explain how to evaluate systems given relevant properties. We also survey a large set of evaluation metrics in the context of the properties that they evaluate.

Comparison of two heuristic evaluation methods for evaluating the usability of health information systems.

PubMed

Khajouei, Reza; Hajesmaeel Gohari, Sadrieh; Mirzaee, Moghaddameh

2018-04-01

In addition to following the usual Heuristic Evaluation (HE) method, the usability of health information systems can also be evaluated using a checklist. The objective of this study is to compare the performance of these two methods in identifying usability problems of health information systems. Eight evaluators independently evaluated different parts of a Medical Records Information System using two methods of HE (usual and with a checklist). The two methods were compared in terms of the number of problems identified, problem type, and the severity of identified problems. In all, 192 usability problems were identified by two methods in the Medical Records Information System. This was significantly higher than the number of usability problems identified by the checklist and usual method (148 and 92, respectively) (p < 0.0001). After removing the duplicates, the difference between the number of unique usability problems identified by the checklist method (n = 100) and usual method (n = 44) was significant (p < 0.0001). Differences between the mean severity of the real usability problems (1.83) and those identified by only one of the methods (usual = 2.05, checklist = 1.74) were significant (p = 0.001). This study revealed the potential of the two HE methods for identifying usability problems of health information systems. The results demonstrated that the checklist method had significantly better performance in terms of the number of identified usability problems; however, the performance of the usual method for identifying problems of higher severity was significantly better. Although the checklist method can be more efficient for less experienced evaluators, wherever usability is critical, the checklist should be used with caution in usability evaluations. Copyright © 2018 Elsevier Inc. All rights reserved.

Double-blind whitening Night-Guard study using ten percent carbamide peroxide.

PubMed

Ouellet, D; Los, S; Case, H; Healy, R

1992-01-01

The conservative technique of professionally dispensed and supervised, home-administered vital bleaching is now a routine treatment in the dental profession. This double-blind study evaluated the Rembrandt Lightening Gel and Whitening Toothpaste for shade change, colorimeter shade change. As well, it evaluated soft tissue health by periodontal probing, plaque index, and bleeding index. A patient questionnaire evaluated perception of whitening, perception of oral hygiene, average hours per day, and average days per week. Bleaching trays were worn over a 4-week period. The bleaching system showed definitive whitening effects as evaluated with the Vita shade guide and the colorimeter. The bleaching system had no deleterious effects on the soft tissue. The Rembrandt toothpaste alone demonstrated two-shade lightening. This vital bleaching system shows definitive whitening of the teeth in short periods of time with no adverse effects.

Satellite power system concept development and evaluation program. Volume 2: System definition

NASA Technical Reports Server (NTRS)

1981-01-01

The system level results of the system definition studies performed by NASA as a part of the Department of Energy/NASA satellite power system concept development and evaluation program are summarized. System requirements and guidelines are discussed as well as the major elements that comprise the reference system and its design options. Alternative system approaches including different system sizes, solid state amplifier (microwave) concepts, and laser power transmission system cost summaries are reviewed. An overview of the system analysis and planning efforts is included. The overall study led to the conclusion that the reference satellite power system concept is a feasible baseload source of electrical power and, within the assumed guidelines, the minimum cost per kilowatt is achieved at the maximum output of 5 gigawatts to the utility grid. Major unresolved technical issues include maximum allowable microwave power density in the ionosphere and performance/mass characteristics of laser power transmission systems.

Isotope Brayton electric power system for the 500 to 2500 watt range

NASA Technical Reports Server (NTRS)

Macosko, R. P.; Barna, G. J.; Block, H. B.; Ingle, B. D.

1972-01-01

An extensive study was conducted at the Lewis Research Center to evaluate an isotope Brayton electric power system for use in the 500 to 2500 W power range. Overall system simplicity was emphasized in order to reduce parasitic power losses and improve system reliability. Detailed parametric cycle analysis, conceptual component designs, and evaluation of system packaging were included. A single-loop system (gas) with six major components including one rotating unit was selected. Calculated net system efficiency varies from 23 to 28 percent over the power range.

Capabilities of the Environmental Effects Branch at Marshall Space Flight Cente

NASA Technical Reports Server (NTRS)

Rogers, Jan; Finckenor, Miria; Nehls, Mary

2016-01-01

The Environmental Effects Branch at the Marshall Space Flight Center supports a myriad array of programs for NASA, DoD, and commercial space including human exploration, advanced space propulsion, improving life on Earth, and the study of the Sun, the Earth, and the solar system. The branch provides testing, evaluation, and qualification of materials for use on external spacecraft surfaces and in contamination-sensitive systems. Space environment capabilities include charged particle radiation, ultraviolet radiation, atomic oxygen, impact, plasma, and thermal vacuum, anchored by flight experiments and analysis of returned space hardware. These environmental components can be combined for solar wind or planetary surface environment studies or to evaluate synergistic effects. The Impact Testing Facility allows simulation of impacts ranging from sand and rain to micrometeoroids and orbital debris in order to evaluate materials and components for flight and ground-based systems. The Contamination Control Team is involved in the evaluation of environmentally-friendly replacements for HCFC-225 for use in propulsion oxygen systems, developing cleaning methods for additively manufactured hardware, and reducing risk for the Space Launch System.

New York State technical and economic MAGLEV evaluation. Final report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

1991-06-01

The study is the preliminary evaluation of magnetically levitated ground transportation systems (MAGLEV). The evaluation focuses on using the New York State Thruway right-of-way in combination with MAGLEV systems currently in development in Germany and Japan and those proposed for development in the United States. The Energy Authority's goal in cosponsoring the study was to determine if MAGLEV offered the potential to meet future New York State transportation demands cost-effectively, and to evaluate the benefits that the State might expect from supporting MAGLEV technology development and system implementation. According to the preliminary report, substantial economic benefits could accrue to themore » State through MAGLEV-related research, development, manufacturing and construction. Implementation would have a favorable impact on issues related to transportation, the environment and energy conservation. With the exception of the German Transrapid system, developing a domestic prototype MAGLEV vehicle would take seven to nine years; no insurmountable technical barriers are apparent. EMF shielding (electromagnetic fields) is, however, a concern. It will cost an estimated $1 billion to develop a new MAGLEV system design; however, innovative designs may reduce the price.« less

Evaluation of health care system reform in Hubei Province, China.

PubMed

Sang, Shuping; Wang, Zhenkun; Yu, Chuanhua

2014-02-21

This study established a set of indicators for and evaluated the effects of health care system reform in Hubei Province (China) from 2009 to 2011 with the purpose of providing guidance to policy-makers regarding health care system reform. The resulting indicators are based on the "Result Chain" logic model and include the following four domains: Inputs and Processes, Outputs, Outcomes and Impact. Health care system reform was evaluated using the weighted TOPSIS and weighted Rank Sum Ratio methods. Ultimately, the study established a set of indicators including four grade-1 indicators, 16 grade-2 indicators and 76 grade-3 indicators. The effects of the reforms increased year by year from 2009 to 2011 in Hubei Province. The health status of urban and rural populations and the accessibility, equity and quality of health services in Hubei Province were improved after the reforms. This sub-national case can be considered an example of a useful approach to the evaluation of the effects of health care system reform, one that could potentially be applied in other provinces or nationally.

Implementation of Effective Intervention: An Empirical Study to Evaluate the Efficacy of Fountas & Pinnell's Leveled Literacy Intervention System (LLI). 2009-2010

ERIC Educational Resources Information Center

Ransford-Kaldon, Carolyn R.; Flynt, E. Sutton; Ross, Cristin L.; Franceschini, Louis; Zoblotsky, Todd; Huang, Ying; Gallagher, Brenda

2010-01-01

This report summarizes evaluation results for an efficacy study of the Leveled Literacy Intervention system (LLI) implemented in Tift County Schools (TCS) in Georgia and the Enlarged City School District of Middletown (ECSDM) in New York during the 2009-2010 school year. Developed by Fountas & Pinnell (2009) and published by Heinemann, LLI is…

A Reliability and Validity of an Instrument to Evaluate the School-Based Assessment System: A Pilot Study

ERIC Educational Resources Information Center

Ghazali, Nor Hasnida Md

2016-01-01

A valid, reliable and practical instrument is needed to evaluate the implementation of the school-based assessment (SBA) system. The aim of this study is to develop and assess the validity and reliability of an instrument to measure the perception of teachers towards the SBA implementation in schools. The instrument is developed based on a…

Case Studies of Teacher Satisfaction with Three Plans for Evaluation and Supervision

ERIC Educational Resources Information Center

Arp, Jeb-Stuart Bennett

2013-01-01

The purpose of this study was to identify which plans for evaluation and supervision are most satisfactory to teachers. The study's participants come from three school systems in northwest Georgia. Each school district uses a different plan for evaluation and supervision; each claiming that the end goal is to improve teacher performance. Prior…

PILOT-SCALE EVALUATION OF AN INCINERABILITY RANKING SYSTEM FOR HAZARDOUS ORGANIC COMPOUNDS

EPA Science Inventory

The subject study was conducted to evaluate an incinerability ranking system developed by teh University of Dayton Research Institute under contract to the EPA Risk Reduction Engineering Laboratory. Fixtures of organic compounds were prepared and combined with a clay-based sorben...

Evaluation of Video Detection Systems and Development of Application Guidelines at Signalized Intersections

DOT National Transportation Integrated Search

2010-07-01

This report documents the results of a study on evaluating three major video imaging vehicle detection systems (VIVDS) currently deployed in Nevadas urban areas. The report first provides a brief review of the features and functions of some major ...

76 FR 57722 - Notice of Proposed Information Collection Requests

Federal Register 2010, 2011, 2012, 2013, 2014

2011-09-16

... Emerging Teacher Evaluation Systems in the United States. OMB Control Number: Pending. Agency Form Number(s...: 467. Abstract: The Study of Emerging Teacher Evaluation Systems in the United States will contribute... DEPARTMENT OF EDUCATION Notice of Proposed Information Collection Requests AGENCY: Department of...

Building-integrated photovoltaics: A case study

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kiss, G.; Kinkead, J.; Raman, M.

1995-03-01

In 1992, Kiss Cathcart Anders Architects performed a study for NREL on Building-Integrated Photovoltaics (BIPV) issues as seen from the perspective of the building community. In general, the purpose of the study was to list major issues and potential applications; by it`s nature it asked more questions than it answered. This second phase study was to produce quantitative data on the performance of specific BIPV systems. Only roof systems are evaluated. The energy performance, construction cost and simple payback for five different BIPV roof options are evaluated in six different locations: Oakland, New York, Miami, Phoenix, Chicago, and Cincinnati. Themore » roof options evaluated include the following: single-glazed PV roof using glass-substrate PVs; double-glazed PV roof with insulating PV modules; ballasted roof-mounted system; sawtooth light monitor roof with indirect north daylighting; sawtooth roof with north light and active heat recovery.« less

The development of an evaluation framework for injury surveillance systems

PubMed Central

Mitchell, Rebecca J; Williamson, Ann M; O'Connor, Rod

2009-01-01

Background Access to good quality information from injury surveillance is essential to develop and monitor injury prevention activities. To determine if information obtained from surveillance is of high quality, the limitations and strengths of a surveillance system are often examined. Guidelines have been developed to assist in evaluating certain types of surveillance systems. However, to date, no standard guidelines have been developed to specifically evaluate an injury surveillance system. The aim of this research is to develop a framework to guide the evaluation of injury surveillance systems. Methods The development of an Evaluation Framework for Injury Surveillance Systems (EFISS) involved a four stage process. First, a literature review was conducted to identify an initial set of characteristics that were recognised as important and/or had been recommended to be assessed in an evaluation of a surveillance system. Second, this set of characteristics was assessed using SMART criteria. Third, those surviving were presented to an expert panel using a two round modified-Delphi study to gain an alternative perspective on characteristic definitions, practicality of assessment, and characteristic importance. Finally, a rating system was created for the EFISS characteristics. Results The resulting EFISS consisted of 18 characteristics that assess three areas of an injury surveillance system – five characteristics assess data quality, nine characteristics assess the system's operation, and four characteristics assess the practical capability of an injury surveillance system. A rating system assesses the performance of each characteristic. Conclusion The development of the EFISS builds upon existing evaluation guidelines for surveillance systems and provides a framework tailored to evaluate an injury surveillance system. Ultimately, information obtained through an evaluation of an injury data collection using the EFISS would be useful for agencies to recommend how a collection could be improved to increase its usefulness for injury surveillance and in the long-term injury prevention. PMID:19627617

Participatory ergonomics simulation of hospital work systems: The influence of simulation media on simulation outcome.

PubMed

Andersen, Simone Nyholm; Broberg, Ole

2015-11-01

Current application of work system simulation in participatory ergonomics (PE) design includes a variety of different simulation media. However, the actual influence of the media attributes on the simulation outcome has received less attention. This study investigates two simulation media: full-scale mock-ups and table-top models. The aim is to compare, how the media attributes of fidelity and affordance influence the ergonomics identification and evaluation in PE design of hospital work systems. The results illustrate, how the full-scale mock-ups' high fidelity of room layout and affordance of tool operation support ergonomics identification and evaluation related to the work system entities space and technologies & tools. The table-top models' high fidelity of function relations and affordance of a helicopter view support ergonomics identification and evaluation related to the entity organization. Furthermore, the study addresses the form of the identified and evaluated conditions, being either identified challenges or tangible design criteria. Copyright © 2015 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Suitability of virtual prototypes to support human factors/ergonomics evaluation during the design.

PubMed

Aromaa, Susanna; Väänänen, Kaisa

2016-09-01

In recent years, the use of virtual prototyping has increased in product development processes, especially in the assessment of complex systems targeted at end-users. The purpose of this study was to evaluate the suitability of virtual prototyping to support human factors/ergonomics evaluation (HFE) during the design phase. Two different virtual prototypes were used: augmented reality (AR) and virtual environment (VE) prototypes of a maintenance platform of a rock crushing machine. Nineteen designers and other stakeholders were asked to assess the suitability of the prototype for HFE evaluation. Results indicate that the system model characteristics and user interface affect the experienced suitability. The VE system was valued as being more suitable to support the assessment of visibility, reach, and the use of tools than the AR system. The findings of this study can be used as a guidance for the implementing virtual prototypes in the product development process. Copyright © 2016 Elsevier Ltd. All rights reserved.

Experimental evaluation of ontology-based HIV/AIDS frequently asked question retrieval system.

PubMed

Ayalew, Yirsaw; Moeng, Barbara; Mosweunyane, Gontlafetse

2018-05-01

This study presents the results of experimental evaluations of an ontology-based frequently asked question retrieval system in the domain of HIV and AIDS. The main purpose of the system is to provide answers to questions on HIV/AIDS using ontology. To evaluate the effectiveness of the frequently asked question retrieval system, we conducted two experiments. The first experiment focused on the evaluation of the quality of the ontology we developed using the OQuaRE evaluation framework which is based on software quality metrics and metrics designed for ontology quality evaluation. The second experiment focused on evaluating the effectiveness of the ontology in retrieving relevant answers. For this we used an open-source information retrieval platform, Terrier, with retrieval models BM25 and PL2. For the measurement of performance, we used the measures mean average precision, mean reciprocal rank, and precision at 5. The results suggest that frequently asked question retrieval with ontology is more effective than frequently asked question retrieval without ontology in the domain of HIV/AIDS.

A Modified User-Oriented Heuristic Evaluation of a Mobile Health System for Diabetes Self-management Support

PubMed Central

Georgsson, Mattias; Staggers, Nancy; Weir, Charlene

2016-01-01

Mobile health platforms offer significant opportunities for improving diabetic self-care, but only if adequate usability exists. Expert evaluations such as heuristic evaluation can provide distinct usability information about systems. The purpose of this study was to complete a usability evaluation of a mobile health system for diabetes patients using a modified heuristic evaluation technique of (1) dual-domain experts (healthcare professionals, usability experts), (2) validated scenarios and user tasks related to patients’ self-care, and (3) in-depth severity factor ratings. Experts identified 129 usability problems with 274 heuristic violations for the system. The categories Consistency and Standards dominated at 24.1% (n = 66), followed by Match Between System and Real World at 22.3% (n = 61). Average severity ratings across system views were 2.8 (of 4), with 9.3% (n = 12) rated as catastrophic and 53.5% (n = 69) as major. The large volume of violations with severe ratings indicated clear priorities for redesign. The modified heuristic approach allowed evaluators to identify unique and important issues, including ones related to self-management and patient safety. This article provides a template for one type of expert evaluation adding to the informaticists’ toolbox when needing to conduct a fast, resource-efficient and user-oriented heuristic evaluation. PMID:26657618

A Modified User-Oriented Heuristic Evaluation of a Mobile Health System for Diabetes Self-management Support.

PubMed

Georgsson, Mattias; Staggers, Nancy; Weir, Charlene

2016-02-01

Mobile health platforms offer significant opportunities for improving diabetic self-care, but only if adequate usability exists. Expert evaluations such as heuristic evaluation can provide distinct usability information about systems. The purpose of this study was to complete a usability evaluation of a mobile health system for diabetes patients using a modified heuristic evaluation technique of (1) dual-domain experts (healthcare professionals, usability experts), (2) validated scenarios and user tasks related to patients' self-care, and (3) in-depth severity factor ratings. Experts identified 129 usability problems with 274 heuristic violations for the system. The categories Consistency and Standards dominated at 24.1% (n = 66), followed by Match Between System and Real World at 22.3% (n = 61). Average severity ratings across system views were 2.8 (of 4), with 9.3% (n = 12) rated as catastrophic and 53.5% (n = 69) as major. The large volume of violations with severe ratings indicated clear priorities for redesign. The modified heuristic approach allowed evaluators to identify unique and important issues, including ones related to self-management and patient safety. This article provides a template for one type of expert evaluation adding to the informaticists' toolbox when needing to conduct a fast, resource-efficient and user-oriented heuristic evaluation.

Advanced propulsion system for hybrid vehicles

NASA Technical Reports Server (NTRS)

Norrup, L. V.; Lintz, A. T.

1980-01-01

A number of hybrid propulsion systems were evaluated for application in several different vehicle sizes. A conceptual design was prepared for the most promising configuration. Various system configurations were parametrically evaluated and compared, design tradeoffs performed, and a conceptual design produced. Fifteen vehicle/propulsion systems concepts were parametrically evaluated to select two systems and one vehicle for detailed design tradeoff studies. A single hybrid propulsion system concept and vehicle (five passenger family sedan)were selected for optimization based on the results of the tradeoff studies. The final propulsion system consists of a 65 kW spark-ignition heat engine, a mechanical continuously variable traction transmission, a 20 kW permanent magnet axial-gap traction motor, a variable frequency inverter, a 386 kg lead-acid improved state-of-the-art battery, and a transaxle. The system was configured with a parallel power path between the heat engine and battery. It has two automatic operational modes: electric mode and heat engine mode. Power is always shared between the heat engine and battery during acceleration periods. In both modes, regenerative braking energy is absorbed by the battery.

Hermetic and Web Plagiarism Detection Systems for Student Essays--An Evaluation of the State-of-the-Art

ERIC Educational Resources Information Center

Kakkonen, Tuomo; Mozgovoy, Maxim

2010-01-01

Plagiarism has become a serious problem in education, and several plagiarism detection systems have been developed for dealing with this problem. This study provides an empirical evaluation of eight plagiarism detection systems for student essays. We present a categorical hierarchy of the most common types of plagiarism that are encountered in…

Evaluation of absorption cycle for space station environmental control system application

NASA Technical Reports Server (NTRS)

Sims, W. H.; Oneill, M. J.; Reid, H. C.; Bisenius, P. M.

1972-01-01

The study to evaluate an absorption cycle refrigeration system to provide environmental control for the space stations is reported. A zero-gravity liquid/vapor separator was designed and tested. The results were used to design a light-weight, efficient generator for the absorption refrigeration system. It is concluded that absorption cycle refrigeration is feasible for providing space station environmental control.

Design evaluation: S-band exciters

NASA Technical Reports Server (NTRS)

1974-01-01

A design evaluation study was conducted to produce S-band exciter (SBE) system to provide a highly stable phase or modulated carrier for transmission to spacecraft. The exciter is part of an S-band receiver/exciter/ranging system at Spaceflight Tracking and Data Network (STDN) ground stations. The major features of the system are defined. Circuit diagrams of the electronic components are provided.

Evaluation of a multifunctional technology system in a memory care unit: Opportunities for innovation in dementia care.

PubMed

Lazar, Amanda; Demiris, George; Thompson, Hilaire J

2016-12-01

Stimulating recreational and leisure activities (RLAs) are essential to physical and mental well-being; however, people living in memory care units (MCUs) may lack access to them. Technology has the potential to facilitate and enrich activity engagement in this context. In this 6-month study, we evaluated a commercially available system designed to encourage the engagement of people with dementia in activities and social interactions, using a mixed-methods approach in a MCU. Quantitative measures included those to evaluate cognition, depression, quality of life, and resource utilization. We qualitatively evaluated the system using semi-structured interviews with family members and staff. Five residents with dementia, four family members, and seven staff were included in the 6-month study. Staff and family members reported benefits for residents such as enjoyment, interactions and connections with others, and mental stimulation. Findings also highlight challenges such as technical and ethical concerns. Factors that influence system use and integration are also discussed. It was feasible to introduce a system designed for recreation and engagement in a MCU, and staff, family members, and residents experienced benefits. However, barriers existed in the introduction and use of the system.

Evaluation of a multifunctional technology system in a memory care unit: Opportunities for innovation in dementia care

PubMed Central

Lazar, Amanda; Demiris, George; Thompson, Hilaire J.

2016-01-01

Introduction Stimulating recreational and leisure activities (RLAs) are essential to physical and mental well-being; however, people living in memory care units (MCUs) may lack access to them. Technology has the potential to facilitate and enrich activity engagement in this context. Objectives In this 6-month study, we evaluated a commercially available system designed to encourage the engagement of people with dementia in activities and social interactions, using a mixed-methods approach in a MCU. Methods Quantitative measures included those to evaluate cognition, depression, quality of life, and resource utilization. We qualitatively evaluated the system using semi-structured interviews with family members and staff. Five residents with dementia, four family members, and seven staff were included in the 6-month study. Results Staff and family members reported benefits for residents such as enjoyment, interactions and connections with others, and mental stimulation. Findings also highlight challenges such as technical and ethical concerns. Factors that influence system use and integration are also discussed. Conclusion It was feasible to introduce a system designed for recreation and engagement in a MCU, and staff, family members, and residents experienced benefits. However, barriers existed in the introduction and use of the system. PMID:26819070

Usability evaluation of Laboratory and Radiology Information Systems integrated into a hospital information system.

PubMed

Nabovati, Ehsan; Vakili-Arki, Hasan; Eslami, Saeid; Khajouei, Reza

2014-04-01

This study was conducted to evaluate the usability of widely used laboratory and radiology information systems. Three usability experts independently evaluated the user interfaces of Laboratory and Radiology Information Systems using heuristic evaluation method. They applied Nielsen's heuristics to identify and classify usability problems and Nielsen's severity rating to judge their severity. Overall, 116 unique heuristic violations were identified as usability problems. In terms of severity, 67 % of problems were rated as major and catastrophic. Among 10 heuristics, "consistency and standards" was violated most frequently. Moreover, mean severity of problems concerning "error prevention" and "help and documentation" heuristics was higher than of the others. Despite widespread use of specific healthcare information systems, they suffer from usability problems. Improving the usability of systems by following existing design standards and principles from the early phased of system development life cycle is recommended. Especially, it is recommended that the designers design systems that inhibit the initiation of erroneous actions and provide sufficient guidance to users.

Quantitative method of medication system interface evaluation.

PubMed

Pingenot, Alleene Anne; Shanteau, James; Pingenot, James D F

2007-01-01

The objective of this study was to develop a quantitative method of evaluating the user interface for medication system software. A detailed task analysis provided a description of user goals and essential activity. A structural fault analysis was used to develop a detailed description of the system interface. Nurses experienced with use of the system under evaluation provided estimates of failure rates for each point in this simplified fault tree. Means of estimated failure rates provided quantitative data for fault analysis. Authors note that, although failures of steps in the program were frequent, participants reported numerous methods of working around these failures so that overall system failure was rare. However, frequent process failure can affect the time required for processing medications, making a system inefficient. This method of interface analysis, called Software Efficiency Evaluation and Fault Identification Method, provides quantitative information with which prototypes can be compared and problems within an interface identified.

[Development and clinical evaluation of an anesthesia information management system].

PubMed

Feng, Jing-yi; Chen, Hua; Zhu, Sheng-mei

2010-09-21

To study the design, implementation and clinical evaluation of an anesthesia information management system. To record, process and store peri-operative patient data automatically, all kinds of bedside monitoring equipments are connected into the system based on information integrating technology; after a statistical analysis of those patient data by data mining technology, patient status can be evaluated automatically based on risk prediction standard and decision support system, and then anesthetist could perform reasonable and safe clinical processes; with clinical processes electronically recorded, standard record tables could be generated, and clinical workflow is optimized, as well. With the system, kinds of patient data could be collected, stored, analyzed and archived, kinds of anesthesia documents could be generated, and patient status could be evaluated to support clinic decision. The anesthesia information management system is useful for improving anesthesia quality, decreasing risk of patient and clinician, and aiding to provide clinical proof.

Computer Science and Technology: Modeling and Measurement Techniques for Evaluation of Design Alternatives in the Implementation of Database Management Software. Final Report.

ERIC Educational Resources Information Center

Deutsch, Donald R.

This report describes a research effort that was carried out over a period of several years to develop and demonstrate a methodology for evaluating proposed Database Management System designs. The major proposition addressed by this study is embodied in the thesis statement: Proposed database management system designs can be evaluated best through…

VERSATILE AEROSOL CONCENTRATION ENRICHMENT SYSTEM (VACES) FOR SIMULTANEOUS IN-VIVO AND IN-VITRO EVALUATION OF TOXIC EFFECTS OF ULTRAFINE, FINE, AND COARSE AMBIENT PARTICLES. PART II. FIELD EVALUATION. (R826232)

EPA Science Inventory

Abstract

This study presents results from a field evaluation of a mobile versatile aerosol concentration enrichment system (VACES), designed to enhance the ambient concentrations of ultrafine (less than 0.18 VERSATILE AEROSOL CONCENTRATION ENRICHMENT SYSTEM (VACES) FOR SIMULTANEOUS IN VIVO AND IN VITRO EVALUATION OF TOXIC EFFECTS OF ULTRAFINE, FINE AND COARSE AMBIENT PARTICLES. PART II: FIELD EVALUATION. (R827352C001)

EPA Science Inventory

This study presents results from a field evaluation of a mobile versatile aerosol concentration enrichment system (VACES), designed to enhance the ambient concentrations of ultrafine (less than 0.18 Self-Evaluation of PANDA-FBG Based Sensing System for Dynamic Distributed Strain and Temperature Measurement.

PubMed

Zhu, Mengshi; Murayama, Hideaki; Wada, Daichi

2017-10-12

A novel method is introduced in this work for effectively evaluating the performance of the PANDA type polarization-maintaining fiber Bragg grating (PANDA-FBG) distributed dynamic strain and temperature sensing system. Conventionally, the errors during the measurement are unknown or evaluated by using other sensors such as strain gauge and thermocouples. This will make the sensing system complicated and decrease the efficiency since more than one kind of sensor is applied for the same measurand. In this study, we used the approximately constant ratio of primary errors in strain and temperature measurement and realized the self-evaluation of the sensing system, which can significantly enhance the applicability, as well as the reliability in strategy making.

Reference standards, judges, and comparison subjects: roles for experts in evaluating system performance.

PubMed

Hripcsak, George; Wilcox, Adam

2002-01-01

Medical informatics systems are often designed to perform at the level of human experts. Evaluation of the performance of these systems is often constrained by lack of reference standards, either because the appropriate response is not known or because no simple appropriate response exists. Even when performance can be assessed, it is not always clear whether the performance is sufficient or reasonable. These challenges can be addressed if an evaluator enlists the help of clinical domain experts. 1) The experts can carry out the same tasks as the system, and then their responses can be combined to generate a reference standard. 2)The experts can judge the appropriateness of system output directly. 3) The experts can serve as comparison subjects with which the system can be compared. These are separate roles that have different implications for study design, metrics, and issues of reliability and validity. Diagrams help delineate the roles of experts in complex study designs.

Performance Evaluation of Wearable Sensor Systems: A Case Study in Moderate-Scale Deployment in Hospital Environment.

PubMed

Sun, Wen; Ge, Yu; Zhang, Zhiqiang; Wong, Wai-Choong

2015-09-25

A wearable sensor system enables continuous and remote health monitoring and is widely considered as the next generation of healthcare technology. The performance, the packet error rate (PER) in particular, of a wearable sensor system may deteriorate due to a number of factors, particularly the interference from the other wearable sensor systems in the vicinity. We systematically evaluate the performance of the wearable sensor system in terms of PER in the presence of such interference in this paper. The factors that affect the performance of the wearable sensor system, such as density, traffic load, and transmission power in a realistic moderate-scale deployment case in hospital are all considered. Simulation results show that with 20% duty cycle, only 68.5% of data transmission can achieve the targeted reliability requirement (PER is less than 0.05) even in the off-peak period in hospital. We then suggest some interference mitigation schemes based on the performance evaluation results in the case study.

Teacher Evaluation in Colorado: How Policy Frustrates Practice

ERIC Educational Resources Information Center

Ramirez, Al; Clouse, Wendi; Davis, Kristyn White

2014-01-01

This article is a report of a study that used data from multiple sources to explore the hypothesis that systemic barriers inherent in Colorado's teacher evaluation policies often contribute to ineffective teacher evaluations across the state. Data were collected from extant studies, focus groups, and surveys of teachers, site administrators/head…

Linking Job-Embedded Professional Development and Mandated Teacher Evaluation: Teacher as Learner

ERIC Educational Resources Information Center

Derrington, Mary Lynne; Kirk, Julia

2017-01-01

This study explores the link between individualized, job-embedded professional development and teacher evaluation. Moreover, the study explores and describes job-embedded strategies that principals used to facilitate teacher development while working within a state-mandated evaluation system. The theoretical frame utilized four elements of…

A Statistical Evaluation of the Diagnostic Performance of MEDAS-The Medical Emergency Decision Assistance System

PubMed Central

Georgakis, D. Christine; Trace, David A.; Naeymi-Rad, Frank; Evens, Martha

1990-01-01

Medical expert systems require comprehensive evaluation of their diagnostic accuracy. The usefulness of these systems is limited without established evaluation methods. We propose a new methodology for evaluating the diagnostic accuracy and the predictive capacity of a medical expert system. We have adapted to the medical domain measures that have been used in the social sciences to examine the performance of human experts in the decision making process. Thus, in addition to the standard summary measures, we use measures of agreement and disagreement, and Goodman and Kruskal's λ and τ measures of predictive association. This methodology is illustrated by a detailed retrospective evaluation of the diagnostic accuracy of the MEDAS system. In a study using 270 patients admitted to the North Chicago Veterans Administration Hospital, diagnoses produced by MEDAS are compared with the discharge diagnoses of the attending physicians. The results of the analysis confirm the high diagnostic accuracy and predictive capacity of the MEDAS system. Overall, the agreement of the MEDAS system with the “gold standard” diagnosis of the attending physician has reached a 90% level.

Oral Exam System at Teacher Appointments in Turkey

ERIC Educational Resources Information Center

Colak, Ismail; Demir, Selcuk Besir

2017-01-01

Many systems have been developed on teacher selection and appointments procedures throughout history in Turkey. Latest teacher appointments and selection systems in Turkey is Oral Exam Evaluation. This new system is discussed in detail in this study. Basically, the study is to analysis what the positive and negative reflections of the system might…

Skin collagen can be accurately quantified through noninvasive optical method: Validation on a swine study.

PubMed

Tzeng, S-Y; Kuo, T-Y; Hu, S-B; Chen, Y-W; Lin, Y-L; Chu, K-Y; Tseng, S-H

2018-02-01

Diffuse reflectance spectroscopy (DRS) is a noninvasive optical technology characterized by relatively low system cost and high efficiency. In our previous study, we quantified the relative concentration of collagen for the individual keloid patient. However, no actual value of collagen concentration can prove the reliability of collagen detection by our DRS system. Skin-mimicking phantoms were prepared using different collagen and coffee concentrations, and their chromophore concentrations were quantified using the DRS system to analyze the influence of collagen and other chromophores. Moreover, we used the animal study to compare the DRS system with the collagen evaluation of biopsy section by second-harmonic generation (SHG) microscopy at four different skin parts. In the phantom study, the result showed that coffee chromophore did not severely interfere with collagen concentration recovery. In the animal study, a positive correlation (r=.902) between the DRS system and collagen evaluation with SHG microscopy was found. We have demonstrated that the DRS system can quantify the actual values of collagen concentration and excluded the interference of other chromophores in skin-mimicking phantoms. Furthermore, a high positive correlation was found in the animal study with SHG microscopy. We consider that the DRS is a potential technique and can evaluate skin condition objectively. © 2017 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Assessment of three risk evaluation systems for patients aged ≥70 in East China: performance of SinoSCORE, EuroSCORE II and the STS risk evaluation system.

PubMed

Shan, Lingtong; Ge, Wen; Pu, Yiwei; Cheng, Hong; Cang, Zhengqiang; Zhang, Xing; Li, Qifan; Xu, Anyang; Wang, Qi; Gu, Chang; Zhang, Yangyang

2018-01-01

To assess and compare the predictive ability of three risk evaluation systems (SinoSCORE, EuroSCORE II and the STS risk evaluation system) in patients aged ≥70, and who underwent coronary artery bypass grafting (CABG) in East China. Three risk evaluation systems were applied to 1,946 consecutive patients who underwent isolated CABG from January 2004 to September 2016 in two hospitals. Patients were divided into two subsets according to their age: elderly group (age ≥70) with a younger group (age <70) used for comparison. The outcome of interest in this study was in-hospital mortality. The entire cohort and subsets of patients were analyzed. The calibration and discrimination in total and in subsets were assessed by the Hosmer-Lemeshow and the C statistics respectively. Institutional overall mortality was 2.52%. The expected mortality rates of SinoSCORE, EuroSCORE II and the STS risk evaluation system were 0.78(0.64)%, 1.43(1.14)% and 0.78(0.77)%, respectively. SinoSCORE achieved the best discrimination (the area under the receiver operating characteristic curve (AUC) = 0.829), followed by the STS risk evaluation system (AUC = 0.790) and EuroSCORE II (AUC = 0.769) in the entire cohort. In the elderly group, the observed mortality rate was 4.82% while it was 1.38% in the younger group. SinoSCORE (AUC = .829) also achieved the best discrimination in the elderly group, followed by the STS risk evaluation system (AUC = .730) and EuroSCORE II (AUC = 0.640) while all three risk evaluation systems all had good performances in the younger group. SinoSCORE, EuroSCORE II and the STS risk evaluation system all achieved positive calibrations in the entire cohort and subsets. The performance of the three risk evaluation systems was not ideal in the entire cohort. In the elderly group, SinoSCORE appeared to achieve better predictive efficiency than EuroSCORE II and the STS risk evaluation system.

Evaluation of the Effect of Silicone Contamination on Various Bond Systems and the Feasibility of Removing the Contamination

NASA Technical Reports Server (NTRS)

Stanley, Stephanie D.

2008-01-01

Silicone is a contaminant that can cause catastrophic failure of a bond system depending on the materials and processes used to fabricate the bond system. Unfortunately, more and more materials are fabricated using silicone. The purpose of this testing was to evaluate which bond systems are sensitive to silicone contamination and whether or not a cleaning process could be utilized to remove the silicone to bring the bond system performance back to baseline. Due to the extensive nature of the testing, attempts will be made to generalize the understanding within classes of substrates, bond systems, and surface preparation and cleaning methods. This study was done by contaminating various metal (steel, Inconel, and aluminum), phenolic (carbon-cloth phenolic [CCP] and glass-cloth phenolic [GCP]), and rubber (natural rubber, asbestos-silicone dioxide filled natural butyldiene rubber [ASNBR]; silica-filled ethylene propylenediene monomer [SFEPDM], and carbon-filled ethylene propylenediene monomer [CFEPDM]) substrates which were then bonded using various adhesives and coatings (epoxy-based adhesives, paints, ablative compounds, and Chemlok adhesives) to determine the effect silicone contamination has on a given bond system's performance. The test configurations depended on the bond system being evaluated. The study also evaluated the feasibility of removing the silicone contamination by cleaning the contaminated substrate prior to bonding. The cleaning processes also varied depending on bond system.

Development of high temperature silicone adhesive formulations for thermal protection system applications

NASA Technical Reports Server (NTRS)

Hockridge, R. R.

1973-01-01

Trade-off studies and screening evaluations were made of commercial polymers and silicone foam sheet stock. A low modulus, low density 0.26 gm/cc modification was developed of the GE-RESD PD-200 system based upon GE RTV-560 silicone polymer. The bond system modification was initially characterized for mechanical and thermal properties, evaluated for application methods, and its capability demonstrated as a strain arrestor bond system.

A system for evaluating the impact of noise pollution on the population's health.

PubMed

Bressane, Adriano; Mochizuki, Patricia Satie; Caram, Rosana Maria; Roveda, José Arnaldo Frutuoso

2016-05-01

The aim of this study was to develop a support system for the evaluation of noise pollution, applied to the central urban area of Rio Claro, São Paulo State, Brazil. Data were obtained from noise measurements and interviews with the population, generating the following indicators: equivalent sound level (Leq ), traffic noise index (LTNI ), and a participatory diagnosis (Dp ), integrated through a fuzzy inference system (FIS). The proposed system allowed classifying the measurement points according to the degree of impact of noise pollution on the population's health (IPS ) in the study area. Impact was considered significant in 31.4% of the measurement points and very significant in 62.9%. The FIS can be adjusted to local conditions, allowing generalization and thus also supporting noise pollution evaluation and respective environmental noise management in other geographic areas.

Primary reaction control system/remote manipulator system interaction with loaded arm. Space shuttle engineering and operations support

NASA Technical Reports Server (NTRS)

Taylor, E. C.; Davis, J. D.

1978-01-01

A study of the interaction between the orbiter primary reaction control system (PRCS) and the remote manipulator system (RMS) with a loaded arm is documented. This analysis was performed with the Payload Deployment and Retrieval Systems Simulation (PDRSS) program with the passive arm bending option. The passive-arm model simulates the arm as massless elastic links with locked joints. The study was divided into two parts. The first part was the evaluation of the response of the arm to step inputs (i.e. constant jet torques) about each of the orbiter body axes. The second part of the study was the evaluation of the response of the arm to minimum impulse primary RCS jet firings with both single pulse and pulse train inputs.

Evaluation of effective dose with chest digital tomosynthesis system using Monte Carlo simulation

NASA Astrophysics Data System (ADS)

Kim, Dohyeon; Jo, Byungdu; Lee, Youngjin; Park, Su-Jin; Lee, Dong-Hoon; Kim, Hee-Joung

2015-03-01

Chest digital tomosynthesis (CDT) system has recently been introduced and studied. This system offers the potential to be a substantial improvement over conventional chest radiography for the lung nodule detection and reduces the radiation dose with limited angles. PC-based Monte Carlo program (PCXMC) simulation toolkit (STUK, Helsinki, Finland) is widely used to evaluate radiation dose in CDT system. However, this toolkit has two significant limits. Although PCXMC is not possible to describe a model for every individual patient and does not describe the accurate X-ray beam spectrum, Geant4 Application for Tomographic Emission (GATE) simulation describes the various size of phantom for individual patient and proper X-ray spectrum. However, few studies have been conducted to evaluate effective dose in CDT system with the Monte Carlo simulation toolkit using GATE. The purpose of this study was to evaluate effective dose in virtual infant chest phantom of posterior-anterior (PA) view in CDT system using GATE simulation. We obtained the effective dose at different tube angles by applying dose actor function in GATE simulation which was commonly used to obtain the medical radiation dosimetry. The results indicated that GATE simulation was useful to estimate distribution of absorbed dose. Consequently, we obtained the acceptable distribution of effective dose at each projection. These results indicated that GATE simulation can be alternative method of calculating effective dose in CDT applications.

Economic evaluations of eHealth technologies: A systematic review.

PubMed

Sanyal, Chiranjeev; Stolee, Paul; Juzwishin, Don; Husereau, Don

2018-01-01

Innovations in eHealth technologies have the potential to help older adults live independently, maintain their quality of life, and to reduce their health system dependency and health care expenditure. The objective of this study was to systematically review and appraise the quality of cost-effectiveness or utility studies assessing eHealth technologies in study populations involving older adults. We systematically searched multiple databases (MEDLINE, EMBASE, CINAHL, NHS EED, and PsycINFO) for peer-reviewed studies published in English from 2000 to 2016 that examined cost-effectiveness (or utility) of eHealth technologies. The reporting quality of included studies was appraised using the Consolidated Health Economic Evaluation Reporting Standards statement. Eleven full text articles met the inclusion criteria representing public and private health care systems. eHealth technologies evaluated by these studies includes computerized decision support system, a web-based physical activity intervention, internet-delivered cognitive behavioral therapy, telecare, and telehealth. Overall, the reporting quality of the studies included in the review was varied. Most studies demonstrated efficacy and cost-effectiveness of an intervention using a randomized control trial and statistical modeling, respectively. This review found limited information on the feasibility of adopting these technologies based on economic and organizational factors. This review identified few economic evaluations of eHealth technologies that included older adults. The quality of the current evidence is limited and further research is warranted to clearly demonstrate the long-term cost-effectiveness of eHealth technologies from the health care system and societal perspectives.

Unique Systems Analysis Task 7, Advanced Subsonic Technologies Evaluation Analysis

NASA Technical Reports Server (NTRS)

Eisenberg, Joseph D. (Technical Monitor); Bettner, J. L.; Stratton, S.

2004-01-01

To retain a preeminent U.S. position in the aircraft industry, aircraft passenger mile costs must be reduced while at the same time, meeting anticipated more stringent environmental regulations. A significant portion of these improvements will come from the propulsion system. A technology evaluation and system analysis was accomplished under this task, including areas such as aerodynamics and materials and improved methods for obtaining low noise and emissions. Previous subsonic evaluation analyses have identified key technologies in selected components for propulsion systems for year 2015 and beyond. Based on the current economic and competitive environment, it is clear that studies with nearer turn focus that have a direct impact on the propulsion industry s next generation product are required. This study will emphasize the year 2005 entry into service time period. The objective of this study was to determine which technologies and materials offer the greatest opportunities for improving propulsion systems. The goals are twofold. The first goal is to determine an acceptable compromise between the thermodynamic operating conditions for A) best performance, and B) acceptable noise and chemical emissions. The second goal is the evaluation of performance, weight and cost of advanced materials and concepts on the direct operating cost of an advanced regional transport of comparable technology level.

Thermal power systems small power systems applications project. Volume 2: Detailed report

NASA Technical Reports Server (NTRS)

Marriott, A. T.

1979-01-01

Small power system technology as applied to power plants up to 10 MW in size was considered. Markets for small power systems were characterized and cost goals were established for the project. Candidate power plant system design concepts were selected for evaluation and preliminary performance and cost assessments were made. Breakeven capital costs were determined for leading contenders among the candidate systems. The potential use of small power systems in providing part of the demand for pumping power by the extensive aqueduct system of California, was studied. Criteria and methodologies were developed for the ranking of candidate power plant system design concepts. Experimental power plant concepts of 1 MW rating were studied to define a power plant configuration for subsequent detail design construction, testing and evaluation. Site selection criteria and ground rules were developed.

Evaluation of propfan propulsion applied to general aviation

NASA Technical Reports Server (NTRS)

Awker, R. W.

1986-01-01

Propfan propulsion on business aircraft was evaluated. Comparisons, in terms of cost and performance, were made between propfan propulsion systems and conventional turbofan propulsion systems on a typical business aircraft. In addition, configuration and cost sensitivity studies were conducted to further assess the potential of propfan propulsion.

Human factors evaluation of an in-vehicle active traffic and demand management (ATDM) system : final report.

DOT National Transportation Integrated Search

2016-02-15

This research study focused on the development and subsequent evaluation of an in-vehicle Active Traffic and Demand Management (ATDM) system deployed on Interstate 66 in Northern Virginia. The ATDM elements inside the vehicle allowed drivers to remai...

Evaluation of the SafeLane overlay system for crash reduction on bridge deck surfaces.

DOT National Transportation Integrated Search

2010-03-01

The winter performance of the SafeLane commercial overlay system has been evaluated at four installations on : bridge decks in the state of Minnesota. The study was conducted over a period of a total of three years. Analyses : included mechanical ...

Peanut canopy temperature and NDVI response to varying irrigation rates

USDA-ARS?s Scientific Manuscript database

Variable rate irrigation (VRI) systems have the potential to conserve water by spatially allocating limited water resources. In this study, peanut was grown under a VRI system to evaluate the impact of differential irrigation rates on peanut yield. Additionally, we evaluated the impact of differenti...

Pilot-scale cooling tower to evaluate corrosion, scaling, and biofouling control strategies for cooling system makeup water.

PubMed

Chien, S H; Hsieh, M K; Li, H; Monnell, J; Dzombak, D; Vidic, R

2012-02-01

Pilot-scale cooling towers can be used to evaluate corrosion, scaling, and biofouling control strategies when using particular cooling system makeup water and particular operating conditions. To study the potential for using a number of different impaired waters as makeup water, a pilot-scale system capable of generating 27,000 kJ∕h heat load and maintaining recirculating water flow with a Reynolds number of 1.92 × 10(4) was designed to study these critical processes under conditions that are similar to full-scale systems. The pilot-scale cooling tower was equipped with an automatic makeup water control system, automatic blowdown control system, semi-automatic biocide feeding system, and corrosion, scaling, and biofouling monitoring systems. Observed operational data revealed that the major operating parameters, including temperature change (6.6 °C), cycles of concentration (N = 4.6), water flow velocity (0.66 m∕s), and air mass velocity (3660 kg∕h m(2)), were controlled quite well for an extended period of time (up to 2 months). Overall, the performance of the pilot-scale cooling towers using treated municipal wastewater was shown to be suitable to study critical processes (corrosion, scaling, biofouling) and evaluate cooling water management strategies for makeup waters of complex quality.

Problems in the Context Evaluation of Individualized Courses

ERIC Educational Resources Information Center

Plomp, Tjeerd; Van der Meer, Adri

1977-01-01

The development of the Individualized Study System (ISS) in The Netherlands from 1970 to 1975 is reviewed and a case study for first-year engineering is described. A classification of ISS courses illustrates the complexity of the system, with advice offered on the management of individualized study systems. (Author/LBH)

A study on eco-environmental vulnerability of mining cities: a case study of Panzhihua city of Sichuan province in China

NASA Astrophysics Data System (ADS)

Shao, Huaiyong; Xian, Wei; Yang, Wunian

2009-07-01

The large-scale and super-strength development of mineral resources in mining cities in long term has made great contributions to China's economic construction and development, but it has caused serious damage to the ecological environment even ecological imbalance at the same time because the neglect of the environmental impact even to the expense of the environment to some extent. In this study, according to the characteristics of mining cities, the scientific and practical eco-environmental vulnerability evaluation index system of mining cities had been established. Taking Panzhihua city of Sichuan province as an example, using remote sensing and GIS technology, applying various types of remote sensing image (TM, SPOT5, IKONOS) and Statistical data, the ecological environment evaluation data of mining cities was extracted effectively. For the non-linear relationship between the evaluation indexes and the degree of eco-environmental vulnerability in mining cities, this study innovative took the evaluation of eco-environmental vulnerability of the study area by using artificial neural network whose training used SCE-UA algorithm that well overcome the slow learning and difficult convergence of traditional neural network algorithm. The results of ecoenvironmental vulnerability evaluation of the study area were objective, reasonable and the credibility was high. The results showed that the area distribution of five eco-environmental vulnerability grade types was basically normal, and the overall ecological environment situation of Panzhihua city was in the middle level, the degree of eco-environmental vulnerability in the south was higher than the north, and mining activities were dominant factors to cause ecoenvironmental damage and eco-environmental Vulnerability. In this study, a comprehensive theory and technology system of regional eco-environmental vulnerability evaluation which included the establishment of eco-environmental vulnerability evaluation index system, processing of evaluation data and establishing of evaluation model. New ideas and methods had provided for eco-environmental vulnerability of mining cities.

Management Information Systems for Higher Education. Studies in Institutional Management in Higher Education.

ERIC Educational Resources Information Center

Hussain, K. M., Ed.

Contents include an introduction to information systems (basic concepts and life-cycle); development of an information system (design, implementation, testing, and conversion); operation (evaluation and maintenance, quality control, and economics); and case studies of such systems at the New University of Lisbon, Bath University, Laval University…

Organs-on-a-chip: Current applications and consideration points for in vitro ADME-Tox studies.

PubMed

Ishida, Seiichi

2018-02-01

Assay systems using in vitro cultured cells are increasingly applied for evaluation of the efficacy, safety, and toxicity of drug candidates. In vitro cell-based assays have two main applications in the drug discovery process: searching for a compound that is effective against the target disease (seed investigation) and confirmation of safety during use of the identified compounds (safety assessment). Currently available in vitro cell-based assays have been designed to evaluate the efficacy and toxicity in single organs, but the in vivo pharmacokinetics and pharmacodynamics of the administered drug candidates have not been considered. Thus, an evaluation system that interconnects cell culture units, one of which has appropriate drug metabolism activities and the other assesses the efficacy and toxicity of compounds, is needed. Accordingly, the in vitro ADME-Tox culture system known as organs-on-a-chip has been proposed. In this review, after introducing the organs-on-a-chip system, the evaluation of enterohepatic circulation and the gut-liver axis relationship will be presented as an example of the application of the organs-on-a-chip system for ADME studies based on inter-organ network. Additionally, the functions required for the organs-on-a-chip system and the necessity of standardization of cells mounted on the chip system will be discussed. Copyright © 2018 The Japanese Society for the Study of Xenobiotics. Published by Elsevier Ltd. All rights reserved.

A case study of the Maintenance Decision Support System (MDSS) in Maine.

DOT National Transportation Integrated Search

2007-09-10

This report presents the results of a case study evaluation of a Maintenance Decision Support System (MDSS) project under a program funded by the U.S. Department of Transportations (USDOT) Intelligent Transportation Systems (ITS) Joint Program Off...

Performance evaluations of continuous glucose monitoring systems: precision absolute relative deviation is part of the assessment.

PubMed

Obermaier, Karin; Schmelzeisen-Redeker, Günther; Schoemaker, Michael; Klötzer, Hans-Martin; Kirchsteiger, Harald; Eikmeier, Heino; del Re, Luigi

2013-07-01

Even though a Clinical and Laboratory Standards Institute proposal exists on the design of studies and performance criteria for continuous glucose monitoring (CGM) systems, it has not yet led to a consistent evaluation of different systems, as no consensus has been reached on the reference method to evaluate them or on acceptance levels. As a consequence, performance assessment of CGM systems tends to be inconclusive, and a comparison of the outcome of different studies is difficult. Published information and available data (as presented in this issue of Journal of Diabetes Science and Technology by Freckmann and coauthors) are used to assess the suitability of several frequently used methods [International Organization for Standardization, continuous glucose error grid analysis, mean absolute relative deviation (MARD), precision absolute relative deviation (PARD)] when assessing performance of CGM systems in terms of accuracy and precision. The combined use of MARD and PARD seems to allow for better characterization of sensor performance. The use of different quantities for calibration and evaluation, e.g., capillary blood using a blood glucose (BG) meter versus venous blood using a laboratory measurement, introduces an additional error source. Using BG values measured in more or less large intervals as the only reference leads to a significant loss of information in comparison with the continuous sensor signal and possibly to an erroneous estimation of sensor performance during swings. Both can be improved using data from two identical CGM sensors worn by the same patient in parallel. Evaluation of CGM performance studies should follow an identical study design, including sufficient swings in glycemia. At least a part of the study participants should wear two identical CGM sensors in parallel. All data available should be used for evaluation, both by MARD and PARD, a good PARD value being a precondition to trust a good MARD value. Results should be analyzed and presented separately for clinically different categories, e.g., hypoglycemia, exercise, or night and day. © 2013 Diabetes Technology Society.

Analysis of a document/reporting system

NASA Technical Reports Server (NTRS)

Narrow, B.

1971-01-01

An in-depth analysis of the information system within the Data Processing Branch is presented. Quantitative measures are used to evaluate the efficiency and effectiveness of the information system. It is believed that this is the first documented study which utilizes quantitative measures for full scale system analysis. The quantitative measures and techniques for collecting and qualifying the basic data, as described, are applicable to any information system. Therefore this report is considered to be of interest to any persons concerned with the management design, analysis or evaluation of information systems.

Evaluation of Knowledge Development in a Healthcare Setting

NASA Astrophysics Data System (ADS)

Schaffer, Scott P.

Healthcare organizations worldwide have recently increased efforts to improve performance, quality, and knowledge transfer using information and communication technologies. Evaluation of the effectiveness and quality of such efforts is challenging. A macro and micro-level system evaluation conducted with a 14000 member US hospital administrative services organization examined the appropriateness of a blended face-to-face and technology-enabled performance improvement and knowledge development system. Furthermore, a successful team or microsystem in a high performing hospital was studied in-depth. Several types of data methods including interview, observation, and questionnaire were used to address evaluation questions within a knowledge development framework created for the study. Results of this preliminary study focus on how this organization attempted to organize clinical improvement efforts around quality and performance improvement processes supported by networked technologies.

Evaluation of the Emergency Response Dose Assessment System(ERDAS)

NASA Technical Reports Server (NTRS)

Evans, Randolph J.; Lambert, Winifred C.; Manobianco, John T.; Taylor, Gregory E.; Wheeler, Mark M.; Yersavich, Ann M.

1996-01-01

The emergency response dose assessment system (ERDAS) is a protype software and hardware system configured to produce routine mesoscale meteorological forecasts and enhanced dispersion estimates on an operational basis for the Kennedy Space Center (KSC)/Cape Canaveral Air Station (CCAS) region. ERDAS provides emergency response guidance to operations at KSC/CCAS in the case of an accidental hazardous material release or an aborted vehicle launch. This report describes the evaluation of ERDAS including: evaluation of sea breeze predictions, comparison of launch plume location and concentration predictions, case study of a toxic release, evaluation of model sensitivity to varying input parameters, evaluation of the user interface, assessment of ERDA's operational capabilities, and a comparison of ERDAS models to the ocean breeze dry gultch diffusion model.

Twelve-hour shift on ITU: a nursing evaluation.

PubMed

Richardson, Annette; Dabner, Nichola; Curtis, Sarah

2003-01-01

This paper describes the introduction and subsequent evaluation of a 12-h shift system in a large ITU in the northeast of UK. To date, only a small number of studies has evaluated nurses working the 12-h shifts in critical care areas. To evaluate the level of staff satisfaction, data were collected by means of a questionnaire involving 41 nurses, at 3 months following the introduction of the 12-h shifts. The responses from the evaluation advocated the continuation of 12-h shifts with alternative shift patterns for nurses who felt dissatisfied with the current system. Twelve-hour shifts can be seen as a flexible system for nurses working in intensive care and may assist with staff satisfaction and improving nurse recruitment and retention.

Evaluating investment in quality improvement capacity building: a systematic review

PubMed Central

Mery, Gustavo; Dobrow, Mark J; Baker, G Ross; Im, Jennifer; Brown, Adalsteinn

2017-01-01

Purpose Leading health systems have invested in substantial quality improvement (QI) capacity building, but little is known about the aggregate effect of these investments at the health system level. We conducted a systematic review to identify key steps and elements that should be considered for system-level evaluations of investment in QI capacity building. Methods We searched for evaluations of QI capacity building and evaluations of QI training programmes. We included the most relevant indexed databases in the field and a strategic search of the grey literature. The latter included direct electronic scanning of 85 relevant government and institutional websites internationally. Data were extracted regarding evaluation design and common assessment themes and components. Results 48 articles met the inclusion criteria. 46 articles described initiative-level non-economic evaluations of QI capacity building/training, while 2 studies included economic evaluations of QI capacity building/training, also at the initiative level. No system-level QI capacity building/training evaluations were found. We identified 17 evaluation components that fit within 5 overarching dimensions (characteristics of QI training; characteristics of QI activity; individual capacity; organisational capacity and impact) that should be considered in evaluations of QI capacity building. 8 key steps in return-on-investment (ROI) assessments in QI capacity building were identified: (1) planning—stakeholder perspective; (2) planning—temporal perspective; (3) identifying costs; (4) identifying benefits; (5) identifying intangible benefits that will not be included in the ROI estimation; (6) discerning attribution; (7) ROI calculations; (8) sensitivity analysis. Conclusions The literature on QI capacity building evaluation is limited in the number and scope of studies. Our findings, summarised in a Framework to Guide Evaluations of QI Capacity Building, can be used to start closing this knowledge gap. PMID:28219957

A Strategic Study about Quality Characteristics in e-Health Systems Based on a Systematic Literature Review.

PubMed

Domínguez-Mayo, F J; Escalona, M J; Mejías, M; Aragón, G; García-García, J A; Torres, J; Enríquez, J G

2015-01-01

e-Health Systems quality management is an expensive and hard process that entails performing several tasks such as analysis, evaluation, and quality control. Furthermore, the development of an e-Health System involves great responsibility since people's health and quality of life depend on the system and services offered. The focus of the following study is to identify the gap in Quality Characteristics for e-Health Systems, by detecting not only which are the most studied, but also which are the most used Quality Characteristics these Systems include. A strategic study is driven in this paper by a Systematic Literature Review so as to identify Quality Characteristics in e-Health. Such study makes information and communication technology organizations reflect and act strategically to manage quality in e-Health Systems efficiently and effectively. As a result, this paper proposes the bases of a Quality Model and focuses on a set of Quality Characteristics to enable e-Health Systems quality management. Thus, we can conclude that this paper contributes to implementing knowledge with regard to the mission and view of e-Health (Systems) quality management and helps understand how current researches evaluate quality in e-Health Systems.

A Strategic Study about Quality Characteristics in e-Health Systems Based on a Systematic Literature Review

PubMed Central

Escalona, M. J.; Mejías, M.; Aragón, G.; García-García, J. A.; Torres, J.; Enríquez, J. G.

2015-01-01

e-Health Systems quality management is an expensive and hard process that entails performing several tasks such as analysis, evaluation, and quality control. Furthermore, the development of an e-Health System involves great responsibility since people's health and quality of life depend on the system and services offered. The focus of the following study is to identify the gap in Quality Characteristics for e-Health Systems, by detecting not only which are the most studied, but also which are the most used Quality Characteristics these Systems include. A strategic study is driven in this paper by a Systematic Literature Review so as to identify Quality Characteristics in e-Health. Such study makes information and communication technology organizations reflect and act strategically to manage quality in e-Health Systems efficiently and effectively. As a result, this paper proposes the bases of a Quality Model and focuses on a set of Quality Characteristics to enable e-Health Systems quality management. Thus, we can conclude that this paper contributes to implementing knowledge with regard to the mission and view of e-Health (Systems) quality management and helps understand how current researches evaluate quality in e-Health Systems. PMID:26146656

A SWOT analysis of the organization and financing of the Danish health care system.

PubMed

Christiansen, Terkel

2002-02-01

The organization and financing of the Danish health care system was evaluated within a framework of a SWOT analysis (analysis of Strengths, Weaknesses, Opportunities and Threats) by a panel of five members with a background in health economics. The present paper describes the methods and materials used for the evaluation: selection of panel members, structure of the evaluation task according to the health care triangle model, selection of background material consisting of documents and literature on the Danish health care system, and a 1-week study visit.

A study of an orbital radar mapping mission to Venus. Volume 2: Configuration comparisons and systems evaluation

NASA Technical Reports Server (NTRS)

1973-01-01

Configuration comparisons and systems evaluation for the orbital radar mapping mission of the planet Venus are discussed. Designs are recommended which best satisfy the science objectives of the Venus radar mapping concept. Attention is given to the interaction and integration of those specific mission-systems recommendations with one another, and the final proposed designs are presented. The feasibility, cost, and scheduling of these configurations are evaluated against assumptions of reasonable state-of-the-art growth and space funding expectations.

Analysis and design of a capsule landing system and surface vehicle control system for Mars exporation

NASA Technical Reports Server (NTRS)

Frederick, D. K.; Lashmet, P. K.; Sandor, G. N.; Shen, C. N.; Smith, E. J.; Yerazunis, S. W.

1972-01-01

The problems related to the design and control of a mobile planetary vehicle to implement a systematic plan for the exploration of Mars were investigated. Problem areas receiving attention include: vehicle configuration, control, dynamics, systems and propulsion; systems analysis; navigation, terrain modeling and path selection; and chemical analysis of specimens. The following specific tasks were studied: vehicle model design, mathematical modeling of dynamic vehicle, experimental vehicle dynamics, obstacle negotiation, electromechanical controls, collapsibility and deployment, construction of a wheel tester, wheel analysis, payload design, system design optimization, effect of design assumptions, accessory optimal design, on-board computer subsystem, laser range measurement, discrete obstacle detection, obstacle detection systems, terrain modeling, path selection system simulation and evaluation, gas chromatograph/mass spectrometer system concepts, chromatograph model evaluation and improvement and transport parameter evaluation.

End-user satisfaction analysis on library management system unnes using technology acceptance model towards national standard of integrated library

NASA Astrophysics Data System (ADS)

Hardyanto, W.; Purwinarko, A.; Adhi, M. A.

2018-03-01

The library which is the gate of the University should be supported by the existence of an adequate information system, to provide excellent service and optimal to every user. Library management system that has been in existence since 2009 needs to be re-evaluated so that the system can meet the needs of both operator and Unnes user in particular, and users from outside Unnes in general. This study aims to evaluate and improve the existing library management system to produce a system that is accountable and able to meet the needs of end users, as well as produce a library management system that is integrated Unnes. Research is directed to produce evaluation report with Technology Acceptance Model (TAM) approach and library management system integrated with the national standard.

Beginning Teacher Evaluation Study: Phase II, 1973-74, Final Report: Volume III.2. Reading and Mathematics Observation System: Description and Analysis of Time Expenditures.

ERIC Educational Resources Information Center

Calfee, Robert; Calfee, Kathryn Hoover

The Beginning Teacher Evaluation Study (BTES), Phase II, was a research project on effective teaching behavior--what teachers do that significantly affects what and how pupils learn. The purposes of Phase II were to (1) develop an assessment system for measuring teacher and pupil behaviors and other factors which could influence each of them and…

Manned remote work station development article. Volume 1, book 2, appendix B: Trade and design definition studies

NASA Technical Reports Server (NTRS)

1979-01-01

System trades, evaluations, and selection were organized under the appropriate manned remote work station roles and subsystems. Those trades/evaluations that have an impact on simulator fidelity were given emphasis in terms of identifying alternate concepts, making a selection, and defining the system approach. Those trades that do not impact simulator fidelity have the issues delineated and future study requirements identified.

Innovative neuro-fuzzy system of smart transport infrastructure for road traffic safety

NASA Astrophysics Data System (ADS)

Beinarovica, Anna; Gorobetz, Mikhail; Levchenkov, Anatoly

2017-09-01

The proposed study describes applying of neural network and fuzzy logic in transport control for safety improvement by evaluation of accidents’ risk by intelligent infrastructure devices. Risk evaluation is made by following multiple-criteria: danger, changeability and influence of changes for risk increasing. Neuro-fuzzy algorithms are described and proposed for task solution. The novelty of the proposed system is proved by deep analysis of known studies in the field. The structure of neuro-fuzzy system for risk evaluation and mathematical model is described in the paper. The simulation model of the intelligent devices for transport infrastructure is proposed to simulate different situations, assess the risks and propose the possible actions for infrastructure or vehicles to minimize the risk of possible accidents.

An improved filter elution and cell culture assay procedure for evaluating public groundwater systems for culturable enteroviruses.

PubMed

Dahling, Daniel R

2002-01-01

Large-scale virus studies of groundwater systems require practical and sensitive procedures for both sample processing and viral assay. Filter adsorption-elution procedures have traditionally been used to process large-volume water samples for viruses. In this study, five filter elution procedures using cartridge filters were evaluated for their effectiveness in processing samples. Of the five procedures tested, the third method, which incorporated two separate beef extract elutions (one being an overnight filter immersion in beef extract), recovered 95% of seeded poliovirus compared with recoveries of 36 to 70% for the other methods. For viral enumeration, an expanded roller bottle quantal assay was evaluated using seeded poliovirus. This cytopathic-based method was considerably more sensitive than the standard plaque assay method. The roller bottle system was more economical than the plaque assay for the evaluation of comparable samples. Using roller bottles required less time and manipulation than the plaque procedure and greatly facilitated the examination of large numbers of samples. The combination of the improved filter elution procedure and the roller bottle assay for viral analysis makes large-scale virus studies of groundwater systems practical. This procedure was subsequently field tested during a groundwater study in which large-volume samples (exceeding 800 L) were processed through the filters.

Safety and efficacy of the predictive low glucose management system in the prevention of hypoglycaemia: protocol for randomised controlled home trial to evaluate the Suspend before low function.

PubMed

Abraham, M B; Nicholas, J A; Ly, T T; Roby, H C; Paramalingam, N; Fairchild, J; King, B R; Ambler, G R; Cameron, F; Davis, E A; Jones, T W

2016-04-15

Innovations with sensor-augmented pump therapy (SAPT) to reduce hypoglycaemia in patients with type 1 diabetes are an ongoing area of research. The predictive low glucose management (PLGM) system incorporates continuous glucose sensor data into an algorithm and suspends basal insulin before the occurrence of hypoglycaemia. The system was evaluated in in-clinic studies, and has informed the parameters of a larger home trial to study its efficacy and safety in real life. The aim of this report is to describe the study design and outcome measures for the trial. This is a 6-month, multicentre, randomised controlled home trial to test the PLGM system in children and adolescents with type 1 diabetes. The system is available in the Medtronic MiniMed 640G pump as the 'Suspend before low' feature. Following a run-in period, participants are randomised to either the control arm with SAPT alone or the intervention arm with SAPT and Suspend before low. The primary aim of this study is to evaluate the time spent hypoglycaemic (sensor glucose <3.5 mmol/L) with and without the system. The secondary aims are to determine the number of hypoglycaemic events, the time spent hyperglycaemic, and to evaluate safety with ketosis and changes in glycated haemoglobin. The study also aims to assess the changes in counter-regulatory hormone responses to hypoglycaemia evaluated by a hyperinsulinaemic hypoglycaemic clamp in a subgroup of patients with impaired awareness. Validated questionnaires are used to measure the fear of hypoglycaemia and the impact on the quality of life to assess burden of the disease. Ethics committee permissions were gained from respective Institutional Review boards. The findings of the study will provide high quality evidence of the ability of the system in the prevention of hypoglycaemia in real life. ACTRN12614000510640, Pre-results. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Optimizing the physical ergonomics indices for the use of partial pressure suits.

PubMed

Ding, Li; Li, Xianxue; Hedge, Alan; Hu, Huimin; Feathers, David; Qin, Zhifeng; Xiao, Huajun; Xue, Lihao; Zhou, Qianxiang

2015-03-01

This study developed an ergonomic evaluation system for the design of high-altitude partial pressure suits (PPSs). A total of twenty-one Chinese males participated in the experiment which tested three types of ergonomics indices (manipulative mission, operational reach and operational strength) were studied using a three-dimensional video-based motion capture system, a target-pointing board, a hand dynamometer, and a step-tread apparatus. In total, 36 ergonomics indices were evaluated and optimized using regression and fitting analysis. Some indices that were found to be linearly related and redundant were removed from the study. An optimal ergonomics index system was established that can be used to conveniently and quickly evaluate the performance of different pressurized/non-pressurized suit designs. The resulting ergonomics index system will provide a theoretical basis and practical guidance for mission planners, suit designers and engineers to design equipment for human use, and to aid in assessing partial pressure suits. Copyright © 2014 Elsevier Ltd and The Ergonomics Society. All rights reserved.

System Life Cycle Evaluation(SM) (SLiCE): harmonizing water treatment systems with implementers' needs.

PubMed

Goodman, Joseph; Caravati, Kevin; Foote, Andrew; Nelson, Molly; Woods, Emily

2013-06-01

One of the methods proposed to improve access to clean drinking water is the mobile packaged water treatment system (MPWTS). The lack of published system performance comparisons combined with the diversity of technology available and intended operating conditions make it difficult for stakeholders to choose the system best suited for their application. MPWTS are often deployed in emergency situations, making selection of the appropriate system crucial to avoiding wasted resources and loss of life. Measurable critical-to-quality characteristics (CTQs) and a system selection tool for MPWTS were developed by utilizing relevant literature, including field studies, and implementing and comparing seven different MPWTS. The proposed System Life Cycle Evaluation (SLiCE) method uses these CTQs to evaluate the diversity in system performance and harmonize relevant performance with stakeholder preference via a selection tool. Agencies and field workers can use SLiCE results to inform and drive decision-making. The evaluation and selection tool also serves as a catalyst for communicating system performance, common design flaws, and stakeholder needs to system manufacturers. The SLiCE framework can be adopted into other emerging system technologies to communicate system performance over the life cycle of use.

Empirical evaluation of decision support systems: Needs, definitions, potential methods, and an example pertaining to waterfowl management

USGS Publications Warehouse

Sojda, R.S.

2007-01-01

Decision support systems are often not empirically evaluated, especially the underlying modelling components. This can be attributed to such systems necessarily being designed to handle complex and poorly structured problems and decision making. Nonetheless, evaluation is critical and should be focused on empirical testing whenever possible. Verification and validation, in combination, comprise such evaluation. Verification is ensuring that the system is internally complete, coherent, and logical from a modelling and programming perspective. Validation is examining whether the system is realistic and useful to the user or decision maker, and should answer the question: “Was the system successful at addressing its intended purpose?” A rich literature exists on verification and validation of expert systems and other artificial intelligence methods; however, no single evaluation methodology has emerged as preeminent. At least five approaches to validation are feasible. First, under some conditions, decision support system performance can be tested against a preselected gold standard. Second, real-time and historic data sets can be used for comparison with simulated output. Third, panels of experts can be judiciously used, but often are not an option in some ecological domains. Fourth, sensitivity analysis of system outputs in relation to inputs can be informative. Fifth, when validation of a complete system is impossible, examining major components can be substituted, recognizing the potential pitfalls. I provide an example of evaluation of a decision support system for trumpeter swan (Cygnus buccinator) management that I developed using interacting intelligent agents, expert systems, and a queuing system. Predicted swan distributions over a 13-year period were assessed against observed numbers. Population survey numbers and banding (ringing) studies may provide long term data useful in empirical evaluation of decision support.

A Study on the Application of Normalized Point Source Sensitivity in Wide Field Optical Spectrometer of the Thirty Meter Telescope

NASA Astrophysics Data System (ADS)

Chen, Li-si; Hu, Zhong-wen

2017-10-01

The image evaluation of an optical system is the core of optical design. Based on the analysis and comparison of the PSSN (Normalized Point Source Sensitivity) proposed in the image evaluation of the TMT (Thirty Meter Telescope) and the common image evaluation methods, the application of PSSN in the TMT WFOS (Wide Field Optical Spectrometer) is studied. It includes an approximate simulation of the atmospheric seeing, the effect of the displacement of M3 in the TMT on the PSSN of the system, the effect of the displacement of collimating mirror in the WFOS on the PSSN of the system, the relations between the PSSN and the zenith angle under different conditions of atmospheric turbulence, and the relation between the PSSN and the wavefront aberration. The results show that the PSSN is effective for the image evaluation of the TMT under a limited atmospheric seeing.

To twist, roll, stroke or poke? A study of input devices for menu navigation in the cockpit.

PubMed

Stanton, Neville A; Harvey, Catherine; Plant, Katherine L; Bolton, Luke

2013-01-01

Modern interfaces within the aircraft cockpit integrate many flight management system (FMS) functions into a single system. The success of a user's interaction with an interface depends upon the optimisation between the input device, tasks and environment within which the system is used. In this study, four input devices were evaluated using a range of Human Factors methods, in order to assess aspects of usability including task interaction times, error rates, workload, subjective usability and physical discomfort. The performance of the four input devices was compared using a holistic approach and the findings showed that no single input device produced consistently high performance scores across all of the variables evaluated. The touch screen produced the highest number of 'best' scores; however, discomfort ratings for this device were high, suggesting that it is not an ideal solution as both physical and cognitive aspects of performance must be accounted for in design. This study evaluated four input devices for control of a screen-based flight management system. A holistic approach was used to evaluate both cognitive and physical performance. Performance varied across the dependent variables and between the devices; however, the touch screen produced the largest number of 'best' scores.

Generating One Biometric Feature from Another: Faces from Fingerprints

PubMed Central

Ozkaya, Necla; Sagiroglu, Seref

2010-01-01

This study presents a new approach based on artificial neural networks for generating one biometric feature (faces) from another (only fingerprints). An automatic and intelligent system was designed and developed to analyze the relationships among fingerprints and faces and also to model and to improve the existence of the relationships. The new proposed system is the first study that generates all parts of the face including eyebrows, eyes, nose, mouth, ears and face border from only fingerprints. It is also unique and different from similar studies recently presented in the literature with some superior features. The parameter settings of the system were achieved with the help of Taguchi experimental design technique. The performance and accuracy of the system have been evaluated with 10-fold cross validation technique using qualitative evaluation metrics in addition to the expanded quantitative evaluation metrics. Consequently, the results were presented on the basis of the combination of these objective and subjective metrics for illustrating the qualitative properties of the proposed methods as well as a quantitative evaluation of their performances. Experimental results have shown that one biometric feature can be determined from another. These results have once more indicated that there is a strong relationship between fingerprints and faces. PMID:22399877

An analytical Study on Dynamics of Public Procurement System and Bidding-Strategy in Local Contractor's Management

NASA Astrophysics Data System (ADS)

Ninomiya, Hitoshi; Nanerikawa, Susumu

Public procurement system such as Overall-Evaluation dynamically has been changed on local public works in Japan. However some characteristics of Bidding-Strategy and procurement system have not enough clarified. This paper attempt to analysis for a syatem dynamics and mechanisum of Overall-Evaluation by developing new simulation model focused on Bidding-Strategy, to propose some improvement scenario.

How Can We Assess and Evaluate the Competitive Advantage of a Country's Human Resource Development System?

ERIC Educational Resources Information Center

Oh, Hunseok; Ryu, Hyue-Hyun; Choi, Myungweon

2013-01-01

The purpose of this study was to develop an index to assess and evaluate the competitive advantage of a country's human resource development system. Based on an extensive literature review, a theoretical model of a human resource development system at the national level (named National Human Resource Development: NHRD) was constructed. The…

Success Factors for e-Learning in a Developing Country: A Case Study of Serbia

ERIC Educational Resources Information Center

Raspopovic, Miroslava; Jankulovic, Aleksandar; Runic, Jovana; Lucic, Vanja

2014-01-01

In this paper, DeLone and McLean's updated information system model was used to evaluate the success of an e-Learning system and its courses in a transitional country like Serbia. In order to adapt this model to an e-Learning system, suitable success metrics were chosen for each of the evaluation stages. Furthermore, the success metrics for…

Technology Enhanced Teacher Evaluation

ERIC Educational Resources Information Center

Teter, Richard B.

2010-01-01

The purpose of this research and development study was to design and develop an affordable, computer-based, pre-service teacher assessment and reporting system to allow teacher education institutions and supervising teachers to efficiently enter evaluation criteria, record pre-service teacher evaluations, and generate evaluation reports. The…

Management systems research study

NASA Technical Reports Server (NTRS)

Bruno, A. V.

1975-01-01

The development of a Monte Carlo simulation of procurement activities at the NASA Ames Research Center is described. Data cover: simulation of the procurement cycle, construction of a performance evaluation model, examination of employee development, procedures and review of evaluation criteria for divisional and individual performance evaluation. Determination of the influences and apparent impact of contract type and structure and development of a management control system for planning and controlling manpower requirements.

Combat Identification Systems COMO Integrated Air Defense Model Evaluation (CISE) Study

DTIC Science & Technology

1989-02-01

use K or IR , whichever one applies) E-6 CAA-SR-89- 3 Subroutine PDECLR 1/21/88 Before label 1000 Insert: IF (IR.GT.10) IR a 10 These changes were made...Internal Distribution: Unclassified Library 2 F-2 CAA-SR-89- 3 GLOSSARY 1. ABBREVIATIONS, ACRONYMS, AND SHORT TERMS ADM2 Air Defense Models Modification...STUDY REPORT ’ , CAA-Sn-89- 3 i , .- CD o COMBAT IDENTIFICATION SYSTEMS N COMO INTEGRATED AIR DEFENSE MODEL EVALUATION (CISE) STUDY FEBRUARY 1989

[The study of establishment of the " Chinese provincial Blindness prevention technical guidance group performance evaluation system"].

PubMed

Lu, L N; He, X G; Zhu, J F; Xu, X; Zhang, R; Hu, X; Zou, H D

2016-11-11

Objective: To establish an assessment system, including indexes and scoring methods, that can be used for performance evaluation of the provincial blindness prevention technical guidance group properly and effectively . Methods: The indexes and scoring methods were set based on the core content of The " National Plan of Prevention and Treatment of Blindness (2012-2015)" , the specific requirement and target of the World Health Organization (WHO) "For the General Eye Health: Global plan of Action (2014-2019)" , and the current situation of the China's provinces and autonomous regions. These indexes should be of effectiveness, feasibility, comparability, guidance and advancing. Formed by a literature review of candidate indicators, the framework of the system is built by qualitative assessment. With the Delphi method, the system was further revised and improved. Empirical pilot study was then used to prove the feasibility, followed by the final qualitative analysis that establish the " Chinese provincial Blindness prevention technical guidance group performance evaluation system" . Results: Through the literature review and qualitative assessment, a six dimensional system framework was built, including 6 first-level indicators, 16 second-level indicators, and 29 third-level indicators through Delphi method evaluation. With the variation coefficient method, the coeffiences of the first-level index weight were calculated as: Organization and management 0.15, Development and implementation of blindness prevention plans 0.15, Implementation of blindness prevention projects 0.14, Training 0.17, Health education 0.18, and Cooperation and exchanges 0.21. The specific scoring method for this system is confirmed as: data and files check, field interview, and record interview, sampling investigation. Empirical pilot study was conducted in the Jilin, Guizhou and Gansu provinces, and the self-assessment results from local experts were consistent with the scores from the systems. Conclusion: This system established is appropriate at current time, and it can effectively evaluate the performance of the Chinese provincial Blindness prevention technical guidance group. (Chin J Ophthalmol, 2016, 52:814-824) .

DEVELOPMENT OF A SYSTEM FOR AN EDUCATIONAL PRODUCTS INFORMATION EXCHANGE. FINAL REPORT.

ERIC Educational Resources Information Center

KOMOSKI, P. KENNETH

THIS STUDY WAS UNDERTAKEN TO DESIGN AN EASILY ACCESSIBLE NATIONWIDE SYSTEM FOR EXCHANGING DESCRIPTIVE, EVALUATIVE PRODUCT INFORMATION AMONG ALL SECTORS OF THE EDUCATIONAL COMMUNITY ON A COOPERATIVE COST-SHARING BASIS. THE FEASIBILITY OF SUCH A COLLECTION AND EXCHANGE OF DESCRIPTIVE AND EVALUATIVE INFORMATION ABOUT INSTRUCTIONAL MATERIALS SYSTEMS…

An evaluation of likely environmental benefits of a time-dependent green routing system in the greater Buffalo-Niagara Region : final report.

DOT National Transportation Integrated Search

2012-03-01

Currently, strategies are being examined with regard to their potential for mitigating the negative impacts of the surface transportation sector on the environment. The focus of this study is to evaluate an ITS (intelligent transportation systems)-ba...

Administrators' Perceptions Regarding the Effectiveness of the Teacher Observation Evaluation System

ERIC Educational Resources Information Center

Williams, Kathleen Riley

2015-01-01

This phenomenological narrative study was designed to explore public school administrators' perceptions regarding Louisiana's Compass teacher observation evaluation system as a method for assessing teacher performance. Participants were administrators with at least two years of experience as a public school administrator at the secondary level,…

Educational Needs of Finnish Polytechnic Librarians.

ERIC Educational Resources Information Center

Viiri, Marjariitta

The polytechnics are the newest part of the Finnish system of higher education. The whole polytechnic system is being developed on the basis of systematic monitoring and evaluation of its activities. Staff development and library and information services were both targets selected for evaluation in this study carried out to identify the…

Redesigning Teacher Evaluation: Lessons from a Pilot Implementation. REL 2015-030

ERIC Educational Resources Information Center

Riordan, Julie; Lacireno-Paquet, Natalie; Shakman, Karen; Bocala, Candice; Chang, Quincy

2015-01-01

REL Northeast and Islands, in collaboration with the Northeast Educator Effectiveness Research Alliance and the New Hampshire Department of Education, conducted a study of the implementation of new teacher evaluation systems in New Hampshire's School Improvement Grant (SIG) schools. While the basic system features are similar across district…

Parsimonious Use of Indicators for Evaluating Sustainability Systems with Multivariate Statistical Analyses

EPA Science Inventory

Indicators are commonly used for evaluating relative sustainability for competing products and processes. When a set of indicators is chosen for a particular system of study, it is important to ensure that they are variable independently of each other. Often the number of indicat...

A Document Analysis of Teacher Evaluation Systems Specific to Physical Education

ERIC Educational Resources Information Center

Norris, Jason M.; van der Mars, Hans; Kulinna, Pamela; Kwon, Jayoun; Amrein-Beardsley, Audrey

2017-01-01

Purpose: The purpose of this document analysis study was to examine current teacher evaluation systems, understand current practices, and determine whether the instrumentation is a valid measure of teaching quality as reflected in teacher behavior and effectiveness specific to physical education (PE). Method: An interpretive document analysis…

A systematic literature review of automated clinical coding and classification systems

PubMed Central

Williams, Margaret; Fenton, Susan H; Jenders, Robert A; Hersh, William R

2010-01-01

Clinical coding and classification processes transform natural language descriptions in clinical text into data that can subsequently be used for clinical care, research, and other purposes. This systematic literature review examined studies that evaluated all types of automated coding and classification systems to determine the performance of such systems. Studies indexed in Medline or other relevant databases prior to March 2009 were considered. The 113 studies included in this review show that automated tools exist for a variety of coding and classification purposes, focus on various healthcare specialties, and handle a wide variety of clinical document types. Automated coding and classification systems themselves are not generalizable, nor are the results of the studies evaluating them. Published research shows these systems hold promise, but these data must be considered in context, with performance relative to the complexity of the task and the desired outcome. PMID:20962126

A systematic literature review of automated clinical coding and classification systems.

PubMed

Stanfill, Mary H; Williams, Margaret; Fenton, Susan H; Jenders, Robert A; Hersh, William R

2010-01-01

Clinical coding and classification processes transform natural language descriptions in clinical text into data that can subsequently be used for clinical care, research, and other purposes. This systematic literature review examined studies that evaluated all types of automated coding and classification systems to determine the performance of such systems. Studies indexed in Medline or other relevant databases prior to March 2009 were considered. The 113 studies included in this review show that automated tools exist for a variety of coding and classification purposes, focus on various healthcare specialties, and handle a wide variety of clinical document types. Automated coding and classification systems themselves are not generalizable, nor are the results of the studies evaluating them. Published research shows these systems hold promise, but these data must be considered in context, with performance relative to the complexity of the task and the desired outcome.

Collaborative mental health services in primary care systems in Latin America: contextualized evaluation needs and opportunities.

PubMed

Sapag, Jaime C; Rush, Brian; Ferris, Lorraine E

2016-02-01

This study examined Latin American evaluation needs regarding the development of a collaborative mental health care (CMHC) evaluation framework as seen by local key health-care leaders and professionals. Potential implementation challenges and opportunities were also identified. This multisite research study used an embedded mixed methods approach in three public health networks in Mexico, Nicaragua and Chile. Local stakeholders participated: decision-makers in key informant interviews, front-line clinicians in focus groups and other stakeholders through a survey. The analysis was conducted within site and then across sites. A total of 22 semi-structured interviews, three focus groups and 27 questionnaires (52% response rate) were conducted. Participants recognized a strong need to evaluate different areas of CMHC in Latin America, including access, types and quality of services, human resources and outcomes related to mental disorders, including addiction. A priority was to evaluate collaboration within the health system, including the referral system. Issues of feasibility, including the weaknesses of information systems, were also identified. Local stakeholders strongly supported the development of a comprehensive evaluation framework for CMHC in Latin America and cited several dimensions and contextual factors critical for inclusion. Implementation must allow flexibility and adaptation to the local context. © 2015 John Wiley & Sons Ltd.

A new amoxicillin/clavulanate therapeutic system: preparation, in vitro and pharmacokinetic evaluation.

PubMed

Kerc, Janez; Opara, Jerneja

2007-04-20

A new peroral amoxicillin/clavulanate therapeutic system composed of immediate release tablet and controlled release floating capsule was developed and evaluated by in vivo bioavailability study. Pharmacokinetic (PK) parameters for amoxicillin and clavulanic acid of the new therapeutic systems: AUCt, AUCi, (AUCt/AUCi), Cmax, Tmax, kel, T(1/2) and additionally for amoxicillin T(4) and T(2) were calculated from the plasma levels. The study confirmed enhanced pharmacokinetic parameters of a newly developed therapeutic system containing 1500 mg of amoxicillin and 125 mg of clavulanic acid. Prolonged time over MIC of amoxicillin in relation to a regular immediate release amoxicillin/clavulanate formulation was confirmed.

Systems study for an Integrated Digital-Electric Aircraft (IDEA)

NASA Technical Reports Server (NTRS)

Tagge, G. E.; Irish, L. A.; Bailey, A. R.

1985-01-01

The results of the Integrated Digital/Electric Aircraft (IDEA) Study are presented. Airplanes with advanced systems were, defined and evaluated, as a means of identifying potential high payoff research tasks. A baseline airplane was defined for comparison, typical of a 1990's airplane with advanced active controls, propulsion, aerodynamics, and structures technology. Trade studies led to definition of an IDEA airplane, with extensive digital systems and electric secondary power distribution. This airplane showed an improvement of 3% in fuel use and 1.8% in DOC relative to the baseline configuration. An alternate configuration, an advanced technology turboprop, was also evaluated, with greater improvement supported by digital electric systems. Recommended research programs were defined for high risk, high payoff areas appropriate for implementation under NASA leadership.

Study of Synthetic Vision Systems (SVS) and Velocity-vector Based Command Augmentation System (V-CAS) on Pilot Performance

NASA Technical Reports Server (NTRS)

Liu, Dahai; Goodrich, Ken; Peak, Bob

2006-01-01

This study investigated the effects of synthetic vision system (SVS) concepts and advanced flight controls on single pilot performance (SPP). Specifically, we evaluated the benefits and interactions of two levels of terrain portrayal, guidance symbology, and control-system response type on SPP in the context of lower-landing minima (LLM) approaches. Performance measures consisted of flight technical error (FTE) and pilot perceived workload. In this study, pilot rating, control type, and guidance symbology were not found to significantly affect FTE or workload. It is likely that transfer from prior experience, limited scope of the evaluation task, specific implementation limitations, and limited sample size were major factors in obtaining these results.

Evaluation of a Digital Companion for Older Adults with Mild Cognitive Impairment.

PubMed

Demiris, George; Thompson, Hilaire J; Lazar, Amanda; Lin, Shih-Yin

2016-01-01

Study Objective: The purpose of this study was to examine the feasibility of a digital companion system used by older adults with mild cognitive impairment (MCI). We utilized a commercially available system that is comprehensive in its functionalities (including conversation ability, use of pictures and other media, and reminders) to explore the system's impact on older adults ' social interactions, anxiety, depressive symptoms, and acceptance of the system. Study Design: We conducted a three-month mixed methods evaluation study of the digital companion. Results: Ten female community-dwelling older adults (average age 78.3 years) participated in the study. Overall, participants utilized the tool regularly and appreciated its presence and their interactions. Participants scored higher at the end of the study in cognition and social support scales, and lower in presence of depressive symptoms. Conclusion: Findings indicate the feasibility of a digital companion for people with MCI and inform the need for additional research.

Multimodal digital color imaging system for facial skin lesion analysis

NASA Astrophysics Data System (ADS)

Bae, Youngwoo; Lee, Youn-Heum; Jung, Byungjo

2008-02-01

In dermatology, various digital imaging modalities have been used as an important tool to quantitatively evaluate the treatment effect of skin lesions. Cross-polarization color image was used to evaluate skin chromophores (melanin and hemoglobin) information and parallel-polarization image to evaluate skin texture information. In addition, UV-A induced fluorescent image has been widely used to evaluate various skin conditions such as sebum, keratosis, sun damages, and vitiligo. In order to maximize the evaluation efficacy of various skin lesions, it is necessary to integrate various imaging modalities into an imaging system. In this study, we propose a multimodal digital color imaging system, which provides four different digital color images of standard color image, parallel and cross-polarization color image, and UV-A induced fluorescent color image. Herein, we describe the imaging system and present the examples of image analysis. By analyzing the color information and morphological features of facial skin lesions, we are able to comparably and simultaneously evaluate various skin lesions. In conclusion, we are sure that the multimodal color imaging system can be utilized as an important assistant tool in dermatology.

Participatory Design, User Involvement and Health IT Evaluation.

PubMed

Kushniruk, Andre; Nøhr, Christian

2016-01-01

End user involvement and input into the design and evaluation of information systems has been recognized as being a critical success factor in the adoption of information systems. Nowhere is this need more critical than in the design of health information systems. Consistent with evidence from the general software engineering literature, the degree of user input into design of complex systems has been identified as one of the most important factors in the success or failure of complex information systems. The participatory approach goes beyond user-centered design and co-operative design approaches to include end users as more active participants in design ideas and decision making. Proponents of participatory approaches argue for greater end user participation in both design and evaluative processes. Evidence regarding the effectiveness of increased user involvement in design is explored in this contribution in the context of health IT. The contribution will discuss several approaches to including users in design and evaluation. Challenges in IT evaluation during participatory design will be described and explored along with several case studies.

Integrating service development with evaluation in telehealthcare: an ethnographic study.

PubMed

Finch, Tracy; May, Carl; Mair, Frances; Mort, Maggie; Gask, Linda

2003-11-22

To identify issues that facilitate the successful integration of evaluation and development of telehealthcare services. Ethnographic study using various qualitative research techniques to obtain data from several sources, including in-depth semistructured interviews, project steering group meetings, and public telehealthcare meetings. Seven telehealthcare evaluation projects (four randomised controlled trials and three pragmatic service evaluations) in the United Kingdom, studied over two years. Projects spanned a range of specialties-dermatology, psychiatry, respiratory medicine, cardiology, and oncology. Clinicians, managers, technical experts, and researchers involved in the projects. Key problems in successfully integrating evaluation and service development in telehealthcare are, firstly, defining existing clinical practices (and anticipating changes) in ways that permit measurement; secondly, managing additional workload and conflicting responsibilities brought about by combining clinical and research responsibilities (including managing risk); and, thirdly, understanding various perspectives on effectiveness and the limitations of evaluation results beyond the context of the research study. Combined implementation and evaluation of telehealthcare systems is complex, and is often underestimated. The distinction between quantitative outcomes and the workability of the system is important for producing evaluative knowledge that is of practical value. More pragmatic approaches to evaluation, that permit both quantitative and qualitative methods, are required to improve the quality of such research and its relevance for service provision in the NHS.

Multiple animal studies for medical chemical defense program in soldier/patient decontamination and drug development on task order 86-25: Evaluation of the effectiveness of two ROHM and HAAS candidate decontamination systems against percutaneous application of undiluted TGD, Gd, VX HD, and L on the laboratory albino rabbit. Final report, 1 September 1986-1 February 1987

DOE Office of Scientific and Technical Information (OSTI.GOV)

Joiner, R.L.; Keys, W.B.; Harroff, H.H.

1988-02-18

A task was assigned to Battelle's Medical Research and Evaluation Facility(MREF) to evaluate the effectiveness of two candidate decontamination systems when compared to the standard dual component M258A1 decontamination system currently fielded by the U.S. Army. The chemical surety material (CSM) used in the evaluation were the organophosphates Soman (GD), polymer thickened GD (TGD), and VX, and the vesicants sulfur mustard (HD) and Lewisite (LS). The efficacies of the two candidate decontamination systems were evaluated in such a manner as to determine the LD50 and protective ratio (PR) for each decontaminant against each organophosphate CSM as compared to the standardmore » M258A1 decontamination system LD50. The PR constituted a comparison for each candidate system against the M258A1 standard. In the vesicant phase of the screen, the efficacies of the candidate systems were evaluated in a side-by-side comparison to the M258A1 decontamination system to determine whether the candidates were as good as or better than the standard dual component system.« less

[A development and evaluation of nursing KMS using QFD in outpatient departments].

PubMed

Lee, Han Na; Yun, Eun Kyoung

2014-02-01

This study was done to develop and implement the Nursing KMS (knowledge management system) in order to improve knowledge sharing and creation among clinical nurses in outpatient departments. This study was a methodological research using the 'System Development Life Cycle': consisting of planning, analyzing, design, implementation, and evaluation. Quality Function Deployment (QFD) was applied to establish nurse requirements and to identify important design requirements. Participants were 32 nurses and for evaluation data were collected pre and post intervention at K Hospital in Seoul, a tertiary hospital with over 1,000 beds. The Nursing KMS was built using a Linux-based operating system, Oracle DBMS, and Java 1.6 web programming tools. The system was implemented as a sub-system of the hospital information system. There was statistically significant differences in the sharing of knowledge but creating of knowledge was no statistically meaningful difference observed. In terms of satisfaction with the system, system efficiency ranked first followed by system convenience, information suitability and information usefulness. The results indicate that the use of Nursing KMS increases nurses' knowledge sharing and can contribute to increased quality of nursing knowledge and provide more opportunities for nurses to gain expertise from knowledge shared among nurses.

Retractions of the gingival margins evaluated by holographic methods

NASA Astrophysics Data System (ADS)

Sinescu, Cosmin; Negrutiu, Meda Lavinia; Manole, Marius; de Sabata, Aldo; Rusu, Laura-Cristina; Stratul, Stefan; Dudea, Diana; Dughir, Ciprian; Duma, Virgil-Florin

2015-05-01

The periodontal disease is one of the most common pathological states of the teeth and gums system. The issue is that its evaluation is a subjective one, i.e. it is based on the skills of the dental medical doctor. As for any clinical condition, a quantitative evaluation and monitoring in time of the retraction of the gingival margins is desired. This phenomenon was evaluated in this study with a holographic method by using a He-Ne laser with a power of 13 mW. The holographic system we have utilized - adapted for dentistry applications - is described. Several patients were considered in a comparative study of their state of health - regarding their oral cavity. The impressions of the maxillary dental arch were taken from a patient during his/her first visit and after a period of six months. The hologram of the first model was superposed on the model cast after the second visit. The retractions of the gingival margins could be thus evaluated three-dimensionally in every point of interest. An evaluation of the retraction has thus been made. Conclusions can thus be drawn for the clinical evaluation of the health of the teeth and gums system of each patient.

Runway Incursion Prevention System for General Aviation Operations

NASA Technical Reports Server (NTRS)

Jones, Denise R.; Prinzel III, Lawrence J.

2006-01-01

A Runway Incursion Prevention System (RIPS) and additional incursion detection algorithm were adapted for general aviation operations and evaluated in a simulation study at the National Aeronautics and Space Administration (NASA) Langley Research Center (LaRC) in the fall of 2005. RIPS has been designed to enhance surface situation awareness and provide cockpit alerts of potential runway conflicts in order to prevent runway incidents while also improving operational capability. The purpose of the study was to evaluate the airborne incursion detection algorithms and associated alerting and airport surface display concepts for general aviation operations. This paper gives an overview of the system, simulation study, and test results.

Evaluation through Follow-Up of Students (UGU). Project No. 2119. Current Project 1983:4.

ERIC Educational Resources Information Center

Ljung, Bengt-Olov; Emanuelsson, Ingemar

1983-01-01

This newsletter describes a research design enabling descriptive, comparative, evaluative follow-up studies of individual development in social contexts related to schooling. In addition, it describes a research project focusing mainly on evaluative studies of the ability of the educational system to confer, on different individuals in various…

Evaluating the Effectiveness of Cognitive-Behavioral Treatment of Residual Symptoms and Impairment in Schizophrenia

ERIC Educational Resources Information Center

Bradshaw, William; Roseborough, David

2004-01-01

This study evaluated the effectiveness of cognitive-behavioral interventions in the treatment of persons with schizophrenia who experienced significant residual symptoms and impaired functioning despite their adherence to medication. The study used an aggregated AB single-system research design across 22 participants to evaluate change in clinical…

Measuring benefits of protected area management: trends across realms and research gaps for freshwater systems.

PubMed

Adams, Vanessa M; Setterfield, Samantha A; Douglas, Michael M; Kennard, Mark J; Ferdinands, Keith

2015-11-05

Protected areas remain a cornerstone for global conservation. However, their effectiveness at halting biodiversity decline is not fully understood. Studies of protected area benefits have largely focused on measuring their impact on halting deforestation and have neglected to measure the impacts of protected areas on other threats. Evaluations that measure the impact of protected area management require more complex evaluation designs and datasets. This is the case across realms (terrestrial, freshwater, marine), but measuring the impact of protected area management in freshwater systems may be even more difficult owing to the high level of connectivity and potential for threat propagation within systems (e.g. downstream flow of pollution). We review the potential barriers to conducting impact evaluation for protected area management in freshwater systems. We contrast the barriers identified for freshwater systems to terrestrial systems and discuss potential measurable outcomes and confounders associated with protected area management across the two realms. We identify key research gaps in conducting impact evaluation in freshwater systems that relate to three of their major characteristics: variability, connectivity and time lags in outcomes. Lastly, we use Kakadu National Park world heritage area, the largest national park in Australia, as a case study to illustrate the challenges of measuring impacts of protected area management programmes for environmental outcomes in freshwater systems. © 2015 The Author(s).

Measuring benefits of protected area management: trends across realms and research gaps for freshwater systems

PubMed Central

Adams, Vanessa M.; Setterfield, Samantha A.; Douglas, Michael M.; Kennard, Mark J.; Ferdinands, Keith

2015-01-01

Protected areas remain a cornerstone for global conservation. However, their effectiveness at halting biodiversity decline is not fully understood. Studies of protected area benefits have largely focused on measuring their impact on halting deforestation and have neglected to measure the impacts of protected areas on other threats. Evaluations that measure the impact of protected area management require more complex evaluation designs and datasets. This is the case across realms (terrestrial, freshwater, marine), but measuring the impact of protected area management in freshwater systems may be even more difficult owing to the high level of connectivity and potential for threat propagation within systems (e.g. downstream flow of pollution). We review the potential barriers to conducting impact evaluation for protected area management in freshwater systems. We contrast the barriers identified for freshwater systems to terrestrial systems and discuss potential measurable outcomes and confounders associated with protected area management across the two realms. We identify key research gaps in conducting impact evaluation in freshwater systems that relate to three of their major characteristics: variability, connectivity and time lags in outcomes. Lastly, we use Kakadu National Park world heritage area, the largest national park in Australia, as a case study to illustrate the challenges of measuring impacts of protected area management programmes for environmental outcomes in freshwater systems. PMID:26460127

Image-Based Medical Expert Teleconsultation in Acute Care of Injuries. A Systematic Review of Effects on Information Accuracy, Diagnostic Validity, Clinical Outcome, and User Satisfaction

PubMed Central

Hasselberg, Marie; Beer, Netta; Blom, Lisa; Wallis, Lee A.; Laflamme, Lucie

2014-01-01

Objective To systematically review the literature on image-based telemedicine for medical expert consultation in acute care of injuries, considering system, user, and clinical aspects. Design Systematic review of peer-reviewed journal articles. Data sources Searches of five databases and in eligible articles, relevant reviews, and specialized peer-reviewed journals. Eligibility criteria Studies were included that covered teleconsultation systems based on image capture and transfer with the objective of seeking medical expertise for the diagnostic and treatment of acute injury care and that presented the evaluation of one or several aspects of the system based on empirical data. Studies of systems not under routine practice or including real-time interactive video conferencing were excluded. Method The procedures used in this review followed the PRISMA Statement. Predefined criteria were used for the assessment of the risk of bias. The DeLone and McLean Information System Success Model was used as a framework to synthesise the results according to system quality, user satisfaction, information quality and net benefits. All data extractions were done by at least two reviewers independently. Results Out of 331 articles, 24 were found eligible. Diagnostic validity and management outcomes were often studied; fewer studies focused on system quality and user satisfaction. Most systems were evaluated at a feasibility stage or during small-scale pilot testing. Although the results of the evaluations were generally positive, biases in the methodology of evaluation were concerning selection, performance and exclusion. Gold standards and statistical tests were not always used when assessing diagnostic validity and patient management. Conclusions Image-based telemedicine systems for injury emergency care tend to support valid diagnosis and influence patient management. The evidence relates to a few clinical fields, and has substantial methodological shortcomings. As in the case of telemedicine in general, user and system quality aspects are poorly documented, both of which affect scale up of such programs. PMID:24887257

New York State technical economic MAGLEV evaluation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

1991-06-01

The Energy Authority, the New York State Departments of Transportation, Economic Development, Environmental Conservation and the New York State Thruway Authority sponsored an evaluation of high-speed surface transit options for New York State. This study is the preliminary evaluation of magnetically levitated ground transportation systems (MAGLEV). The evaluation focuses on using the New York State Thruway right-of-way in combination with MAGLEV systems currently in development in Germany and Japan and those proposed for development in the United States. The Energy Authority's goal in cosponsoring this study was to determine if MAGLEV offered the potential to meet future New York Statemore » transportation demands cost-effectively, and to evaluate the benefits that the State might expect from supporting MAGLEV technology development and system implementation. According to the preliminary report, substantial economic benefits could accrue to the State through MAGLEV-related research, development, manufacturing and construction. Implementation would have a favorable impact on issues related to transportation, the environment and energy conservation. With the exception of the German Transrapid system, developing a domestic prototype MAGLEV vehicle would take seven to nine years; no insurmountable technical barriers are apparent. EMF shielding (electromagnetic fields) is, however a concern. 39 refs., 71 figs., 26 tabs.« less

The Decision Making Trial and Evaluation Laboratory (Dematel) and Analytic Network Process (ANP) for Safety Management System Evaluation Performance

NASA Astrophysics Data System (ADS)

Rolita, Lisa; Surarso, Bayu; Gernowo, Rahmat

2018-02-01

In order to improve airport safety management system (SMS) performance, an evaluation system is required to improve on current shortcomings and maximize safety. This study suggests the integration of the DEMATEL and ANP methods in decision making processes by analyzing causal relations between the relevant criteria and taking effective analysis-based decision. The DEMATEL method builds on the ANP method in identifying the interdependencies between criteria. The input data consists of questionnaire data obtained online and then stored in an online database. Furthermore, the questionnaire data is processed using DEMATEL and ANP methods to obtain the results of determining the relationship between criteria and criteria that need to be evaluated. The study cases on this evaluation system were Adi Sutjipto International Airport, Yogyakarta (JOG); Ahmad Yani International Airport, Semarang (SRG); and Adi Sumarmo International Airport, Surakarta (SOC). The integration grades SMS performance criterion weights in a descending order as follow: safety and destination policy, safety risk management, healthcare, and safety awareness. Sturges' formula classified the results into nine grades. JOG and SMG airports were in grade 8, while SOG airport was in grade 7.

Examining the influence of family physician supply on district health system performance in South Africa: An ecological analysis of key health indicators.

PubMed

Von Pressentin, Klaus B; Mash, Bob J; Esterhuizen, Tonya M

2017-04-28

The supply of appropriate health workers is a key building block in the World Health Organization's model of effective health systems. Primary care teams are stronger if they contain doctors with postgraduate training in family medicine. The contribution of such family physicians to the performance of primary care systems has not been evaluated in the African context. Family physicians with postgraduate training entered the South African district health system (DHS) from 2011. This study aimed to evaluate the impact of family physicians within the DHS of South Africa. The objectives were to evaluate the impact of an increase in family physician supply in each district (number per 10 000 population) on key health indicators. All 52 South African health districts were included as units of analysis. An ecological study evaluated the correlations between the supply of family physicians and routinely collected data on district performance for two time periods: 2010/2011 and 2014/2015. Five years after the introduction of the new generation of family physicians, this study showed no demonstrable correlation between family physician supply and improved health indicators from the macro-perspective of the district. The lack of a measurable impact at the level of the district is most likely because of the very low supply of family physicians in the public sector. Studies which evaluate impact closer to the family physician's circle of control may be better positioned to demonstrate a measurable impact in the short term.

Configuration evaluation and criteria plan. Volume 1: System trades study and design methodology plan (preliminary). Space Transportation Main Engine (STME) configuration study

NASA Technical Reports Server (NTRS)

Bair, E. K.

1986-01-01

The System Trades Study and Design Methodology Plan is used to conduct trade studies to define the combination of Space Shuttle Main Engine features that will optimize candidate engine configurations. This is accomplished by using vehicle sensitivities and engine parametric data to establish engine chamber pressure and area ratio design points for candidate engine configurations. Engineering analyses are to be conducted to refine and optimize the candidate configurations at their design points. The optimized engine data and characteristics are then evaluated and compared against other candidates being considered. The Evaluation Criteria Plan is then used to compare and rank the optimized engine configurations on the basis of cost.

Study on evaluation of construction reliability for engineering project based on fuzzy language operator

NASA Astrophysics Data System (ADS)

Shi, Yu-Fang; Ma, Yi-Yi; Song, Ping-Ping

2018-03-01

System Reliability Theory is a research hotspot of management science and system engineering in recent years, and construction reliability is useful for quantitative evaluation of project management level. According to reliability theory and target system of engineering project management, the defination of construction reliability appears. Based on fuzzy mathematics theory and language operator, value space of construction reliability is divided into seven fuzzy subsets and correspondingly, seven membership function and fuzzy evaluation intervals are got with the operation of language operator, which provides the basis of corresponding method and parameter for the evaluation of construction reliability. This method is proved to be scientific and reasonable for construction condition and an useful attempt for theory and method research of engineering project system reliability.

From Paper to PDA: Design and Evaluation of a Clinical Ward Instruction on a Mobile Device

NASA Astrophysics Data System (ADS)

Kanstrup, Anne Marie; Stage, Jan

Mobile devices with small screens and minimal facilities for interaction are increasingly being used in complex human activities for accessing and processing information, while the user is moving. This paper presents a case study of the design and evaluation of a mobile system, which involved transformation of complex text and tables to digital format on a PDA. The application domain was an emergency medical ward, and the user group was junior registrars. We designed a PDA-based system for accessing information, focusing on the ward instruction, implemented a prototype and evaluated it for usability and utility. The evaluation results indicate significant problems in the interaction with the system as well as the extent to which the system is useful for junior registrars in their daily work.

Evaluation of Aeroservoelastic Effects on Flutter

NASA Technical Reports Server (NTRS)

Nagaraja, K. S.; Felt, Larry R.; Kraft, Raymond

1998-01-01

This report presents work performed by The Boeing Company to satisfy the deliverable "Evaluation of aeroservoelastic Effects on Symmetric Flutter" for Subtask 7 of Reference 1. The objective of this report is to incorporate the improved methods for studying the effects of a closed-loop control system on the aeroservoelastic behavior of the airplane planned under NASA HSR technical Integration Task 20 work. Also, a preliminary evaluation of the existing pitch control laws on symmetric flutter of the TCA configuration was addressed."The goal is to develop an improved modeling methodology and perform design studies that account for the aero-structures-systems interaction effects.

Hybrid propulsion technology program: Phase 1. Volume 3: Thiokol Corporation Space Operations

NASA Technical Reports Server (NTRS)

Schuler, A. L.; Wiley, D. R.

1989-01-01

Three candidate hybrid propulsion (HP) concepts were identified, optimized, evaluated, and refined through an iterative process that continually forced improvement to the systems with respect to safety, reliability, cost, and performance criteria. A full scale booster meeting Advanced Solid Rocket Motor (ASRM) thrust-time constraints and a booster application for 1/4 ASRM thrust were evaluated. Trade studies and analyses were performed for each of the motor elements related to SRM technology. Based on trade study results, the optimum HP concept for both full and quarter sized systems was defined. The three candidate hybrid concepts evaluated are illustrated.

Implementation and evaluation of LMS mobile application: scele mobile based on user-centered design

NASA Astrophysics Data System (ADS)

Banimahendra, R. D.; Santoso, H. B.

2018-03-01

The development of mobile technology is now increasing rapidly, demanding all activities including learning should be done on mobile devices. It shows that the implementation of mobile application as a learning medium needs to be done. This study describes the process of developing and evaluating the Moodle-based mobile Learning Management System (LMS) application called Student Centered e-Learning Environment (SCeLE). This study discusses the process of defining features, implementing features into the application, and evaluating the application. We define the features using user research and literature study, then we implement the application with user-centered design basis, at the last phase we evaluated the application using usability testing and system usability score (SUS). The purpose of this study is to determine the extent to which this application can help the users doing their tasks and provide recommendation for the next research and development.

Establishment of a Quantitative Medical Technology Evaluation System and Indicators within Medical Institutions.

PubMed

Wu, Suo-Wei; Chen, Tong; Pan, Qi; Wei, Liang-Yu; Wang, Qin; Li, Chao; Song, Jing-Chen; Luo, Ji

2018-06-05

The development and application of medical technologies reflect the medical quality and clinical capacity of a hospital. It is also an effective approach in upgrading medical service and core competitiveness among medical institutions. This study aimed to build a quantitative medical technology evaluation system through questionnaire survey within medical institutions to perform an assessment to medical technologies more objectively and accurately, and promote the management of medical quality technologies and ensure the medical safety of various operations among the hospitals. A two-leveled quantitative medical technology evaluation system was built through a two-round questionnaire survey of chosen experts. The Delphi method was applied in identifying the structure of evaluation system and indicators. The judgment of the experts on the indicators was adopted in building the matrix so that the weight coefficient and maximum eigenvalue (λ max), consistency index (CI), and random consistency ratio (CR) could be obtained and collected. The results were verified through consistency tests, and the index weight coefficient of each indicator was conducted and calculated through analytical hierarchy process. Twenty-six experts of different medical fields were involved in the questionnaire survey, 25 of whom successfully responded to the two-round research. Altogether, 4 primary indicators (safety, effectiveness, innovativeness, and benefits), as well as 13 secondary indicators, were included in the evaluation system. The matrix is built to conduct the λ max, CI, and CR of each expert in the survey, and the index weight coefficients of primary indicators were 0.33, 0.28, 0.27, and 0.12, respectively, and the index weight coefficients of secondary indicators were conducted and calculated accordingly. As the two-round questionnaire survey of experts and statistical analysis were performed and credibility of the results was verified through consistency evaluation test, the study established a quantitative medical technology evaluation system model and assessment indicators within medical institutions based on the Delphi method and analytical hierarchy process. Moreover, further verifications, adjustments, and optimizations of the system and indicators will be performed in follow-up studies.

A Hybrid Evaluation System Framework (Shell & Web) with Standardized Access to Climate Model Data and Verification Tools for a Clear Climate Science Infrastructure on Big Data High Performance Computers

NASA Astrophysics Data System (ADS)

Kadow, C.; Illing, S.; Kunst, O.; Cubasch, U.

2014-12-01

The project 'Integrated Data and Evaluation System for Decadal Scale Prediction' (INTEGRATION) as part of the German decadal prediction project MiKlip develops a central evaluation system. The fully operational hybrid features a HPC shell access and an user friendly web-interface. It employs one common system with a variety of verification tools and validation data from different projects in- and outside of MiKlip. The evaluation system is located at the German Climate Computing Centre (DKRZ) and has direct access to the bulk of its ESGF node including millions of climate model data sets, e.g. from CMIP5 and CORDEX. The database is organized by the international CMOR standard using the meta information of the self-describing model, reanalysis and observational data sets. Apache Solr is used for indexing the different data projects into one common search environment. This implemented meta data system with its advanced but easy to handle search tool supports users, developers and their tools to retrieve the required information. A generic application programming interface (API) allows scientific developers to connect their analysis tools with the evaluation system independently of the programming language used. Users of the evaluation techniques benefit from the common interface of the evaluation system without any need to understand the different scripting languages. Facilitating the provision and usage of tools and climate data increases automatically the number of scientists working with the data sets and identify discrepancies. Additionally, the history and configuration sub-system stores every analysis performed with the evaluation system in a MySQL database. Configurations and results of the tools can be shared among scientists via shell or web-system. Therefore, plugged-in tools gain automatically from transparency and reproducibility. Furthermore, when configurations match while starting a evaluation tool, the system suggests to use results already produced by other users-saving CPU time, I/O and disk space. This study presents the different techniques and advantages of such a hybrid evaluation system making use of a Big Data HPC in climate science. website: www-miklip.dkrz.de visitor-login: guest password: miklip

A Hybrid Evaluation System Framework (Shell & Web) with Standardized Access to Climate Model Data and Verification Tools for a Clear Climate Science Infrastructure on Big Data High Performance Computers

NASA Astrophysics Data System (ADS)

Kadow, Christopher; Illing, Sebastian; Kunst, Oliver; Ulbrich, Uwe; Cubasch, Ulrich

2015-04-01

The project 'Integrated Data and Evaluation System for Decadal Scale Prediction' (INTEGRATION) as part of the German decadal prediction project MiKlip develops a central evaluation system. The fully operational hybrid features a HPC shell access and an user friendly web-interface. It employs one common system with a variety of verification tools and validation data from different projects in- and outside of MiKlip. The evaluation system is located at the German Climate Computing Centre (DKRZ) and has direct access to the bulk of its ESGF node including millions of climate model data sets, e.g. from CMIP5 and CORDEX. The database is organized by the international CMOR standard using the meta information of the self-describing model, reanalysis and observational data sets. Apache Solr is used for indexing the different data projects into one common search environment. This implemented meta data system with its advanced but easy to handle search tool supports users, developers and their tools to retrieve the required information. A generic application programming interface (API) allows scientific developers to connect their analysis tools with the evaluation system independently of the programming language used. Users of the evaluation techniques benefit from the common interface of the evaluation system without any need to understand the different scripting languages. Facilitating the provision and usage of tools and climate data increases automatically the number of scientists working with the data sets and identify discrepancies. Additionally, the history and configuration sub-system stores every analysis performed with the evaluation system in a MySQL database. Configurations and results of the tools can be shared among scientists via shell or web-system. Therefore, plugged-in tools gain automatically from transparency and reproducibility. Furthermore, when configurations match while starting a evaluation tool, the system suggests to use results already produced by other users-saving CPU time, I/O and disk space. This study presents the different techniques and advantages of such a hybrid evaluation system making use of a Big Data HPC in climate science. website: www-miklip.dkrz.de visitor-login: click on "Guest"

Assessing the Potential Use of Eye-Tracking Triangulation for Evaluating the Usability of an Online Diabetes Exercise System.

PubMed

Schaarup, Clara; Hartvigsen, Gunnar; Larsen, Lars Bo; Tan, Zheng-Hua; Årsand, Eirik; Hejlesen, Ole Kristian

2015-01-01

The Online Diabetes Exercise System was developed to motivate people with Type 2 diabetes to do a 25 minutes low-volume high-intensity interval training program. In a previous multi-method evaluation of the system, several usability issues were identified and corrected. Despite the thorough testing, it was unclear whether all usability problems had been identified using the multi-method evaluation. Our hypothesis was that adding the eye-tracking triangulation to the multi-method evaluation would increase the accuracy and completeness when testing the usability of the system. The study design was an Eye-tracking Triangulation; conventional eye-tracking with predefined tasks followed by The Post-Experience Eye-Tracked Protocol (PEEP). Six Areas of Interests were the basis for the PEEP-session. The eye-tracking triangulation gave objective and subjective results, which are believed to be highly relevant for designing, implementing, evaluating and optimizing systems in the field of health informatics. Future work should include testing the method on a larger and more representative group of users and apply the method on different system types.

Empirically evaluating the impact of adjudicative tribunals in the health sector: context, challenges and opportunities.

PubMed

Hoffman, Steven J; Sossin, Lorne

2012-04-01

Adjudicative tribunals are an integral part of health system governance, yet their real-world impact remains largely unknown. Most assessments focus on internal accountability and use anecdotal methodologies; few, studies if any, empirically evaluate their external impact and use these data to test effectiveness, track performance, inform service improvements and ultimately strengthen health systems. Given that such assessments would yield important benefits and have been conducted successfully in similar settings (e.g. specialist courts), their absence is likely attributable to complexity in the health system, methodological difficulties and the legal environment within which tribunals operate. We suggest practical steps for potential evaluators to conduct empirical impact evaluations along with an evaluation matrix template featuring possible target outcomes and corresponding surrogate endpoints, performance indicators and empirical methodologies. Several system-level strategies for supporting such assessments have also been suggested for academics, health system institutions, health planners and research funders. Action is necessary to ensure that policymakers do not continue operating without evidence but can rather pursue data-driven strategies that are more likely to achieve their health system goals in a cost-effective way.

Accuracy Evaluation of 19 Blood Glucose Monitoring Systems Manufactured in the Asia-Pacific Region: A Multicenter Study.

PubMed

Yu-Fei, Wang; Wei-Ping, Jia; Ming-Hsun, Wu; Miao-O, Chien; Ming-Chang, Hsieh; Chi-Pin, Wang; Ming-Shih, Lee

2017-09-01

System accuracy of current blood glucose monitors (BGMs) in the market has already been evaluated extensively, yet mostly focused on European and North American manufacturers. Data on BGMs manufactured in the Asia-Pacific region remain to be established. In this study, we sought to assess the accuracy performance of 19 BGMs manufactured in the Asia-pacific region. A total of 19 BGMs were obtained from local pharmacies in China. The study was conducted at three hospitals located in the Asia-Pacific region. Measurement results of each system were compared with results of the reference instrument (YSI 2300 PLUS Glucose Analyzer), and accuracy evaluation was performed in accordance to the ISO 15197:2003 and updated 2015 guidelines. Radar plots, which is a new method, are described herein to visualize the analytical performance of the 19 BGMs evaluated. Consensus error grid is a tool for evaluating the clinical significance of the results. The 19 BGMs resulted in a satisfaction rate between 83.5% and 100.0% within ISO 15197:2003 error limits, and between 71.3% and 100.0% within EN ISO 15197:2015 (ISO 15197:2013) error limits. Of the 19 BGMs evaluated, 12 met the minimal accuracy requirement of the ISO 15197:2003 standard, whereas only 4 met the tighter EN ISO 15197:2015 (ISO 15197:2013) requirements. Accuracy evaluation of BGMs should be performed regularly to maximize patient safety.

Evaluation of several corrosion protective coating systems on aluminum

NASA Technical Reports Server (NTRS)

Higgins, R. H.

1981-01-01

A study of several protective coating systems for use on aluminum in seawater/seacoast environments was conducted to review the developments made on protective coatings since early in the Space Shuttle program and to perform comparative studies on these coatings to determine their effectiveness for providing corrosion protection during exposure to seawater/seacoast environments. Panels of 2219-T87 aluminum were coated with 21 different systems and exposed to a 5 percent salt spray for 4000 hr. Application properties, adhesion measurements, heat resistance and corrosion protection were evaluated. For comparative studies, the presently specified Bostik epoxy system used on the SRB structures was included. Results of these tests indicate four systems with outstanding performance and four additional systems with protection almost as good. These systems are based on a chromated pretreatment, a chromate epoxy primer, and a polyurethane topcoat. Consideration for one of these systems should be included for those applications where superior corrosion protection for aluminum surfaces is required.

Passive fire building protection system evaluation (case study: millennium ict centre)

NASA Astrophysics Data System (ADS)

Rahman, Vinky; Stephanie

2018-03-01

Passive fire protection system is a system that refers to the building design, both regarding of architecture and structure. This system usually consists of structural protection that protects the structure of the building and prevents the spread of fire and facilitate the evacuation process in case of fire. Millennium ICT Center is the largest electronic shopping center in Medan, Indonesia. As a public building that accommodates the crowd, this building needs a fire protection system by the standards. Therefore, the purpose of this study is to evaluate passive fire protection system of Millennium ICT Center building. The study was conducted to describe the facts of the building as well as direct observation to the research location. The collected data is then processed using the AHP (Analytical Hierarchy Process) method in its weighting process to obtain the reliability value of passive fire protection fire system. The results showed that there are some components of passive fire protection system in the building, but some are still unqualified. The first section in your paper

Systems Engineering Case Studies: Synopsis of the Learning Principles

DTIC Science & Technology

2010-05-17

Engineering Case Study HST refers to the Hubble Space Telescope Systems Engineering Case Study TBMCS refers to the Theater Battle Management Core System...going to orbit undetected in spite of substantial evidence that could have been used to prevent this occurrence. TBMCS /1 Requirements Definition...baseline was volatile up to system acceptance, which took place after TBMCS passed operational test and evaluation. TBMCS /2 System Architecture The

Study terrestrial applications of solar cell powered systems

NASA Technical Reports Server (NTRS)

Ravin, J. W.

1973-01-01

Terrestrial applications of solar cells and design systems are considered for those applications that show the most promise for becoming practical and accepted by users within the next five years. The study includes the definition, categorization, evaluation and screening of the most attractive potential terrestrial applications for solar cells. Potential markets are initially grouped and categorized in a general sense and are weighted in priority by their business volume, present and future. From a categorized list including marine, transportation, security, communication, meteorological and others, 66 potential solar cell applications have been cataloged. A methodology was formulated to include the criteria for evaluation and screening. The evaluation process covers all parts and components of the complete system required for each application and gives consideration to all factors, such as engineering, economic, production, marketing and other factors that may have an influence on the acceptance of the system.

An Evaluation of Output Quality of Machine Translation (Padideh Software vs. Google Translate)

ERIC Educational Resources Information Center

Azer, Haniyeh Sadeghi; Aghayi, Mohammad Bagher

2015-01-01

This study aims to evaluate the translation quality of two machine translation systems in translating six different text-types, from English to Persian. The evaluation was based on criteria proposed by Van Slype (1979). The proposed model for evaluation is a black-box type, comparative and adequacy-oriented evaluation. To conduct the evaluation, a…